[Flask] Flask Digest, Vol 24, Issue 8

[G.S.Vijay Raajaa]

Hi UB,

Thanks for the idea. I shall probe more into the same. But I have quick
clarifications, even with mongo/gridfs and having the connectionI/O
delegated to the database driver makes the transaction blocking? Kindly
correct me if I am wrong. Is there a async way of handling the upload to
mongo and keep flask serve other incoming request?

On the same note, w.r.t mongodb-gridFS, how do you think the write
performance is when compared to storing them directly on the filesystem,
same w.r.t to read for serving?

I like to idea of scalability when you have file store within DB.

Regards,
Vijay Raajaa GS

On Sun, Jun 25, 2017 at 9:30 PM, <flask-request at python.org> wrote:

> Send Flask mailing list submissions to
>         flask at python.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://mail.python.org/mailman/listinfo/flask
> or, via email, send a message with subject or body 'help' to
>         flask-request at python.org
>
> You can reach the person managing the list at
>         flask-owner at python.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Flask digest..."
>
>
> Today's Topics:
>
>    1. REST based File Sharing server Implementation in Flask
>       (G.S.Vijay Raajaa)
>    2. Re: REST based File Sharing server Implementation in Flask
>       (ub at artfacts.net)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Sun, 25 Jun 2017 20:08:34 +0530
> From: "G.S.Vijay Raajaa" <gsvijayraajaa at gmail.com>
> To: flask at python.org
> Subject: [Flask] REST based File Sharing server Implementation in
>         Flask
> Message-ID:
>         <CAB9NB9aNRbZTdLNMWO3k=gDxGW-E0gcHZF0d4X=_b41CPTSFAA at mail.
> gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hi,
>
> I am trying to build a REST based file sharing server on top of flask. I am
> looking for a scalable stack.
>
> The requirement goes as follows;
>
> 1) Cater multiple file uploads.
> 2) Files can be of the order of 30-100GB. The server hosting the python
> webserver should not read the file to memory and spill to disk.
> 3) Non blocking - when user uploads multiple files.
> 4) Non blocking - when multiple user try to upload files.
>
> Pointers to any existing open source project is also much appreciated.
>
> Idea inspired from https://filebin.net/
>
> Seeing if celery + Flask can come handy. Kindly suggest the WSGI to use it
> for production too.
>
> Looking forward to your valuable suggestions.
>
> Regards,
> Vijay Raajaa GS
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://mail.python.org/pipermail/flask/attachments/
> 20170625/b824c18b/attachment-0001.html>
>
> ------------------------------
>
> Message: 2
> Date: Sun, 25 Jun 2017 17:47:07 +0200
> From: "ub at artfacts.net" <ub at artfacts.net>
> To: flask at python.org
> Subject: Re: [Flask] REST based File Sharing server Implementation in
>         Flask
> Message-ID: <d0a2d934-452f-5471-fd0f-422918cc4c71 at artfacts.net>
> Content-Type: text/plain; charset=utf-8
>
> hey vijay,
>
> you could use mongodb's gridfs. that way you hand over connection/IO
> control to the database driver and scaling would be determined by
> mongodb's scaling potential.
>
> there's multiple exmaples online:
> https://gist.github.com/artisonian/492713
> https://stackoverflow.com/questions/32492501/list-and-
> serve-files-from-gridfs-with-flask
> https://github.com/RedBeard0531/python-gridfs-server/blob/master/gridfs_
> server.py
> ...
>
> i personally haven't used mongodb for quite some time, so this is just
> an idea.
>
> cheers,
> ub
>
>
> On 25.06.2017 16:38, G.S.Vijay Raajaa wrote:
> > Hi,
> >
> > I am trying to build a REST based file sharing server on top of flask. I
> > am looking for a scalable stack.
> >
> > The requirement goes as follows;
> >
> > 1) Cater multiple file uploads.
> > 2) Files can be of the order of 30-100GB. The server hosting the python
> > webserver should not read the file to memory and spill to disk.
> > 3) Non blocking - when user uploads multiple files.
> > 4) Non blocking - when multiple user try to upload files.
> >
> > Pointers to any existing open source project is also much appreciated.
> >
> > Idea inspired from https://filebin.net/
> >
> > Seeing if celery + Flask can come handy. Kindly suggest the WSGI to use
> > it for production too.
> >
> > Looking forward to your valuable suggestions.
> >
> > Regards,
> > Vijay Raajaa GS
> >
> >
> > _______________________________________________
> > Flask mailing list
> > Flask at python.org
> > https://mail.python.org/mailman/listinfo/flask
> >
>
>
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> Flask mailing list
> Flask at python.org
> https://mail.python.org/mailman/listinfo/flask
>
>
> ------------------------------
>
> End of Flask Digest, Vol 24, Issue 8
> ************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/flask/attachments/20170625/96d02a3b/attachment.html>