[Newbie] Is there any method to urlretrieve to a file the html source from a url with "Transfer-encoding": chunked

Thinker thinker at branda.to
Mon Feb 25 13:50:17 CET 2008

Aldo Ceccarelli wrote:
> Hello All,
> I apologize for posting a question on this but I could not find a
> complete answer after reading and searching so far:-)
> My problem is that I'd like to store the html source of a certain web
> url but when I try via urllib / urllib2 reads or urlretrieve I get
> only a part of the contents (ist type is text/html).
> Metainformation associated with the url show that it has a:
> Transfer-Encoding: chunked
> and this seems the reason why I can get only a part of it.
Please show your code, here.  urllib doesn't always return full content
in one time.  I guess it is the problem.

More information about the Python-list mailing list