Réf. : Re: limitation in urllib.urlretrieve(url, fn) ??

Patrick.Bussi at space.alcatel.fr Patrick.Bussi at space.alcatel.fr
Thu Apr 10 06:44:53 EDT 2003




---------------------- Envoyé par Patrick Bussi/ALCATEL-SPACE le 10/04/2003
12:44 ---------------------------
(Embedded image moved to file: pic03042.pcx)
Patrick Bussi
(Embedded image moved to file: pic16905.pcx)
10/04/2003 12:44
(Embedded image moved to file: pic11087.pcx)

Pour :    VanL <vlindberg at verio.net>
cc :
Objet :   Réf. : Re: limitation in urllib.urlretrieve(url, fn) ??

I have had similar hang up in a slightly different case using

f=urllib2.urlopen(url).read()

The read() was stuck because the server did not accept to answer to a client
which had not cookie support. I don't know if it could explain the case with
urlretrieve().

I suggest you see if urllib2 + ClientCookie modules can cover your needs (
http://wwwsearch.sourceforge.net/ClientCookie/)

Hope this helps.
Patrick
---
Patrick Bussi

Any opinions expressed are my own and not necessarily those of my Company.




VanL <vlindberg at verio.net> on 10/04/2003 01:26:17

Pour :    python-list at python.org
cc :   (ccc : Patrick Bussi/ALCATEL-SPACE)
Objet :   Re: limitation  in urllib.urlretrieve(url, fn) ??


-------------- next part --------------

There isn't a general python limitation;  I have used urllib.urlretrieve
to automate the downloading of files as large as 50 MB with
python2.2.2/freebsd 4.3.  Can't comment about Solaris, tho.

VanL

HP wrote:
> For example,
> url = 'http://www.londonstockexchange.com/techlib/word/ser/Live8102.doc';
> fn  = '/local/disk/file_name';
>
> urllib:urlretrieve(url, fn) hangs in the air !!
>
> This happens for many of the files in the above
> web site.  Those files have one thing in common:
> their file size is larger than 200K.
>
> Is there a limit on the file size in the function:
> urllib:urlretrieve(url, fn) ??
>
> (I am running python.2.2.2 on Sun Solaris 5.8).
>
> HP

--
http://mail.python.org/mailman/listinfo/python-list





-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic03042.pcx
Type: application/octet-stream
Size: 1275 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/python-list/attachments/20030410/d4d9d4dc/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic16905.pcx
Type: application/octet-stream
Size: 1275 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/python-list/attachments/20030410/d4d9d4dc/attachment-0001.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pic11087.pcx
Type: application/octet-stream
Size: 1275 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/python-list/attachments/20030410/d4d9d4dc/attachment-0002.obj>


More information about the Python-list mailing list