web crawler help?

Steve Holden sholden at holdenweb.com
Sat Sep 7 23:28:54 CEST 2002


"koko" <kokohh at hotmail.com> wrote in message
news:JARd9.6927$yt3.3340577 at newssrv26.news.prodigy.com...
> is there any sample for basic web crawler, that ask for a starting url and
> log the url and extract the hyperlinks?
> thx


Take a look at tools/websucker in your Python distribution (you might need
to download it if you have used a limited binary installer).

regards
-----------------------------------------------------------------------
Steve Holden                                  http://www.holdenweb.com/
Python Web Programming                        pydish.holdenweb.com/pwp/
Previous .sig file retired to                    www.homeforoldsigs.com
-----------------------------------------------------------------------






More information about the Python-list mailing list