[Tutor] Writing a web bot.
Sat, 8 Jul 2000 02:37:13 -0700 (PDT)
On Fri, 7 Jul 2000, Furmanek, Greg wrote:
> The task I am trying to perform is write an
> internet bot. I was going to use urllib for
> this project however one of the requirements
> is for the connection to be continuous during
> the session.
Since HTTP is inherently stateless, there's no real continuity between
requests. Perl's webbots, for example, simulate it by keeping track of
where they are. I couldn't find an exact equivalent to LWP::UserAgent in
the core library. But then, I'm completely unfamiliar with this, so
perhaps others can give better advice. However, I did find something that
might be useful:
It contains source to an implementation of a python webbot. With luck,
you should be able to adjust it to suit your needs. I found it using the
Vaults of Parnassus:
Sorry I couldn't give a more definite answer on this.