crawlers in python with graphing?

bryan rasmussen rasmussen.bryan at
Tue Jun 20 10:07:40 CEST 2006


Sorry, was imprecise, I meant not save the downloaded page locally.
There probably isn't one though, so I should build one myself.
Probably just need a good crawler that can be set to dump all links
into dataset that I can analyse with R.

Bryan Rasmussen

On 6/19/06, Marc 'BlackJack' Rintsch <bj_666 at> wrote:
> In <mailman.7200.1150722071.27775.python-list at>, bryan rasmussen
> wrote:
> > It should hopefully be as high level as Wget, not download the pages
> > but just follow the links, and output graphs.
> How do you get at the links without downloading the page!?
> Ciao,
>        Marc 'BlackJack' Rintsch
> --

More information about the Python-list mailing list