Simulating a Web Browser in Python

[David Fisher]

----- Original Message -----
From: "Brian Fritz" <brianfr at grace.speakeasy.org>
Newsgroups: comp.lang.python
To: <python-list at python.org>
Sent: Tuesday, March 21, 2000 1:37 PM
Subject: Re: Simulating a Web Browser in Python

>
> Well to make my intent a bit more clear... What I'm writing is going to
> be a Web Robot.
>
> However, I'd heard of grail and it may be a good source of example and
> howto code.
>

Well then, in the Tools directory of the Python source is webchecker.  It
will traverse a web tree looking for bad links.  In the same directory is
websucker, which will mirror a remote web site locally when pointed at the
root url.  I use it all the time when I want to pull content from the web
and maintain it's structure.

dnf