[issue6838] httplib's _read_chunked extremely slow for lots of chunks

[Chris Withers]

New submission from Chris Withers <chris at simplistix.co.uk>:

As the comment in this method suggests, accumulating the value by repeated string concatenation is slow. Appending to a list speeds this 
up dramatically.

To quantify this, downloading a 110Mb file from Apache take:

~3s using Internet Explorer
2.2s using wget
30mins using the script in http://mail.python.org/pipermail/python-
dev/2009-September/091581.html

With the attached patch applied, this time drops to 2.3s.

----------
assignee: cjw296
files: httplib.patch.txt
keywords: easy
messages: 92257
nosy: cjw296
priority: high
severity: normal
status: open
title: httplib's _read_chunked extremely slow for lots of chunks
versions: Python 2.6, Python 2.7, Python 3.1, Python 3.2
Added file: http://bugs.python.org/file14830/httplib.patch.txt

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue6838>
_______________________________________