Spidering Hacks for Python, not Perl
Duncan Booth
duncan.booth at invalid.invalid
Tue Mar 21 04:40:39 EST 2006
Enigma Curry wrote:
> I've been looking for similar stuff recently. I haven't found much, but
> this is the list of links I've come across so far:
>
> Harvest Man - http://harvestman.freezope.org/
> Mechanize - http://wwwsearch.sourceforge.net/mechanize/
> Beautiful Soup - http://www.crummy.com/software/BeautifulSoup/
> (Neither Beautiful Soup, nor Mechanize are complete crawlers but
> probably have a lot of the nuts and bolts)
>
> If anyone is aware of a book or other documentation like the OP would
> like, I would be pleased to see it as well.
>
Don't forget webchecker and websucker in the Python distribution Tools
folder.
More information about the Python-list
mailing list