[Python-Dev] how to debug httplib slowness

[Antoine Pitrou]

Guido van Rossum <guido <at> python.org> writes:
> 
> +1 on trying this. Constructing a 116MB string by concatenating 1KB
> buffers surely must take forever. (116MB divided by 85125 recv() calls
> give 1365 byte per chunk, which is awful.)

It certainly is quite small but perhaps the server tries to stay below the
detected MTU?
(not that there is necessarily any point in doing so for most HTTP content,
IMO... except perhaps when the client does some progressive decoding)