Python implementation for a web spider \ site mirroring

Haran Shivanan hs2l2ATyahoodotcom at yahoo.com
Wed Apr 23 09:22:47 EDT 2003


module "A.M. Kuchling" core dumped with the following output:
> On 22 Apr 2003 02:14:34 -0700, 
> 	Tzahi <tzahij at hotmail.com> wrote:
>> I need to copy complete web sites form the web.
> 
> Try GNU wget (http://www.gnu.org/software/wget/wget.html); not written in
> Python, but quite featureful.
> 
> --amk

wget -k -r http://base-site-to-crawl will do the trick.
-- 
Freedom is a state of mind




More information about the Python-list mailing list