High Performance solutions are needed to do things like urlretrieve

MRAB python at mrabarnett.plus.com
Wed Jul 14 14:10:04 EDT 2010


David wrote:
> urlretrieve works fine.  However, when file size get very large.  It
> goes on forever, and even fails.
> 
> For instance, one of download .zip file is of 363,096KB.
> 
> Particularly, when trying to get, with urlretrieve, a zipped folder of
> a very large size, it could take up to 20 to 30 minutes.  Often it
> fails, never any problem with smaller folders.  Any solution for this?
> 
Do you have any control over the other end? If yes, then you could try
transferring it in multiple chunks.



More information about the Python-list mailing list