how to get 20000 html pages content quickly from one server?
zbir at urbanape.com
Wed Mar 15 17:34:26 CET 2006
On Mar 15, 2006, at 11:22 AM, JuHui wrote:
> I want to get 200000 html pages content from one server, you know
> urllib.urlopen need construct network connection, it will be very
> slowly, how to speed up this function?
> I try to using multi-thread, it speed up, but I want to quickly more,
> any idea about it?
Physically remove the harddrive and reinstall it locally?
Happy to help.
More information about the Python-list