High Performance solutions are needed to do things like urlretrieve
MRAB
python at mrabarnett.plus.com
Wed Jul 14 14:10:04 EDT 2010
David wrote:
> urlretrieve works fine. However, when file size get very large. It
> goes on forever, and even fails.
>
> For instance, one of download .zip file is of 363,096KB.
>
> Particularly, when trying to get, with urlretrieve, a zipped folder of
> a very large size, it could take up to 20 to 30 minutes. Often it
> fails, never any problem with smaller folders. Any solution for this?
>
Do you have any control over the other end? If yes, then you could try
transferring it in multiple chunks.
More information about the Python-list
mailing list