web crawler help?
Erik Price
erikprice at mac.com
Tue Sep 10 10:10:02 EDT 2002
On Thursday, September 5, 2002, at 07:15 PM, koko wrote:
> is there any sample for basic web crawler, that ask for a starting url
> and
> log the url and extract the hyperlinks?
> thx
If you just want to learn the basics of making a web crawler, there is
a great tutorial on page 187 of "Python Web Programming" by Steve
Holden. There are more fully-featured spiders available in Python, but
this one presents the core principles nicely.
Erik
--
Erik Price (zombies
roam)
email: erikprice at mac.com
jabber: erikprice at jabber.org
More information about the Python-list
mailing list