[Flask] REST based File Sharing server Implementation in Flask

G.S.Vijay Raajaa gsvijayraajaa at gmail.com
Sun Jun 25 13:58:32 EDT 2017


This issue is that the project will be deployed on-premise with no internet
connectivity from the server. So any 3rd party cloud service is ruled out.

Regards,
Vijay Raajaa GS

On Sun, Jun 25, 2017 at 11:24 PM, Corey Boyle <coreybrett at gmail.com> wrote:

> You might also consider storing files in AWS S3 or some other object
> store. Dreamhost has a service for that as well.
>
>
> __
> Corey
>
> On Jun 25, 2017 1:47 PM, "G.S.Vijay Raajaa" <gsvijayraajaa at gmail.com>
> wrote:
>
>> The number of non-block servings will correspond to the max number of workers in that case? Hypothetically if one user uploads multiple files that keeps all the workers busy, I am blocked when rest of the users online trying to upload files. Any thoughts to delegate it asynchronously?
>>
>> Regards,
>>
>> Vijay Raajaa GS
>>
>>
>> On Sun, Jun 25, 2017 at 10:13 PM, G.S.Vijay Raajaa <
>> gsvijayraajaa at gmail.com> wrote:
>>
>>> Hi UB,
>>>
>>> Thanks for the idea. I shall probe more into the same. But I have quick
>>> clarifications, even with mongo/gridfs and having the connectionI/O
>>> delegated to the database driver makes the transaction blocking? Kindly
>>> correct me if I am wrong. Is there a async way of handling the upload to
>>> mongo and keep flask serve other incoming request?
>>>
>>> On the same note, w.r.t mongodb-gridFS, how do you think the write
>>> performance is when compared to storing them directly on the filesystem,
>>> same w.r.t to read for serving?
>>>
>>> I like to idea of scalability when you have file store within DB.
>>>
>>> Regards,
>>> Vijay Raajaa GS
>>>
>>> On Sun, Jun 25, 2017 at 8:08 PM, G.S.Vijay Raajaa <
>>> gsvijayraajaa at gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I am trying to build a REST based file sharing server on top of flask.
>>>> I am looking for a scalable stack.
>>>>
>>>> The requirement goes as follows;
>>>>
>>>> 1) Cater multiple file uploads.
>>>> 2) Files can be of the order of 30-100GB. The server hosting the python
>>>> webserver should not read the file to memory and spill to disk.
>>>> 3) Non blocking - when user uploads multiple files.
>>>> 4) Non blocking - when multiple user try to upload files.
>>>>
>>>> Pointers to any existing open source project is also much appreciated.
>>>>
>>>> Idea inspired from https://filebin.net/
>>>>
>>>> Seeing if celery + Flask can come handy. Kindly suggest the WSGI to use
>>>> it for production too.
>>>>
>>>> Looking forward to your valuable suggestions.
>>>>
>>>> Regards,
>>>> Vijay Raajaa GS
>>>>
>>>
>>>
>>
>> _______________________________________________
>> Flask mailing list
>> Flask at python.org
>> https://mail.python.org/mailman/listinfo/flask
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/flask/attachments/20170625/24533192/attachment.html>


More information about the Flask mailing list