spidering script

David Waizer dwaizer at noreply.com
Thu Jan 18 18:57:56 CET 2007


I'm  looking for a script (perl, python, sh...)or program (such as wget) 
that will help me get a list of ALL the links on a website.

For example ./magicscript.pl www.yahoo.com and outputs it to a file, it 
would be kind of like a spidering software..

Any suggestions would be appreciated.


More information about the Python-list mailing list