web crawler help?

Erik Price erikprice at mac.com
Tue Sep 10 10:10:02 EDT 2002

On Thursday, September 5, 2002, at 07:15  PM, koko wrote:

> is there any sample for basic web crawler, that ask for a starting url 
> and
> log the url and extract the hyperlinks?
> thx

If you just want to learn the basics of making a web crawler, there is 
a great tutorial on page 187 of "Python Web Programming" by Steve 
Holden.  There are more fully-featured spiders available in Python, but 
this one presents the core principles nicely.


Erik Price                                                  (zombies 

email: erikprice at mac.com
jabber: erikprice at jabber.org

More information about the Python-list mailing list