[Tutor] Website Retrieval Program

Kent Johnson kent37 at tds.net
Wed Aug 24 20:37:44 CEST 2005

Daniel Watkins wrote:
> I'm currently trying to write a script that will get all the files
> necessary for a webpage to display correctly, followed by all the
> intra-site pages and such forth, in order to try and retrieve one of the
> many sites I have got jumbled up on my webspace. After starting the
> writing, someone introduced me to wget, but I'm continuing this because
> it seems like fun (and that statement is the first step on a slippery
> slope :P).

If you are not set on writing this yourself, you might be interested in Naja and HarvestMan, both of which seem intended for this purpose.


More information about the Tutor mailing list