httplib incredibly slow :-(

[David Robinow]

On Thu, Aug 13, 2009 at 3:20 AM, Chris Withers<chris at simplistix.co.uk> wrote:
> David Robinow wrote:
>>
>> On Wed, Aug 12, 2009 at 12:37 PM, Chris Withers<chris at simplistix.co.uk>
>> wrote:
>>>
>>> David Stanek wrote:
>>>>
>>>> Also on the same box where you run this script
>>>> can you test with curl or wget?
>>>
>>> It's a Windows box, so no :-(
>>
>> Why not?
>>
>> http://users.ugent.be/~bpuype/wget/
>> http://curl.haxx.se/download.html
>
> Fair point, but I don't see what this will achieve...
>
> I've already established that the file downloads in seconds with [something
> else], so I'd like to understand why python isn't doing the same and fix the
> problem...
 My post was simply to correct the implication that curl and wget can
not be used on Windows. It's up to you whether you want to use one or
the other.
 I'm not the OP, and this is not my area of expertise, but ...
  You've got two data points. You've jumped to the conclusion that
there's something wrong with Python or your code. You're probably
right. However, if you try wget, for example, and it's as slow as your
code, you cqn look elsewhere.  If, on the other hand, wget is as fast
as IE, you'll have more proof that your code is the problem.
 Then, since wget is open source you can look at the source code and
see what wget is doing right that you (or httplib) is doing wrong.