Python urllib.urlretrieve vs. Perl getstore

holger krekel pyth at devel.trillke.net
Fri Nov 15 09:29:47 EST 2002


Adam S wrote:
> 
> I have a Perl and a Python version of a program designed to fetch
> large files (40MB) from a remote HTTP server.
> 
> Initial tests indicate that the Perl version, using getstore()
> is 3-4 times faster than the Python version. Is there a reason
> for this and is there another Python library HTTP file fetch
> function I can use? I don't want to use FTP as there
> is no anonymous logon for this server.

Please be more specific and post relevant code-snippets and
which python-library you use. 

IMO perl's as well as python's retrieving functions should be 
99% IO-bound meaning that there shouldn't be a speed
difference unless you are having a Gigabit-Internet-Connection :-)

regards,

    holger




More information about the Python-list mailing list