HarvestMan version 1.0

Anand Pillai pythonguy@Hotpop.com
10 Jun 2003 10:07:58 -0700


HarvestMan is an world wide web crawler(robot) program written in
python
using urllib2, httplib, and HTMLParser. It is a re-write of the
earlier 'PIDER'(Program for Internet Data Extraction and Retrieval)
program.

This release 1.0 features the following.

1. A much-improved 'fast-mode' for download using multiple threads.
2. Many options in the config file for tweaking download.
3. Control by Depth-of-url checking.
4. A brower page for browsing finished projects.
5. A default configuration suitable to download online manuals/
   tutorials/books/html presentations.
6. Many bug fixes.

The project page is situated at
http://members.lycos.co.uk/anandpillai.

Thanks for your kind support and attention.

Regards,

Anand Pillai