Library for crawling forums

Thomas Wittek mail at
Thu Oct 11 23:22:37 CEST 2007

> I'm trying to write a utility to crawl forums and strip posts to be
> gone through offline. Just the content, I don't need to get who posted
> or sigs or any identifying info.
> Can anyone suggest a library that is already geared toward this?

Maybe a combination of mechanize [1] and BeautifulSoup [2]?

Thomas Wittek
Jabber: streawkceur at
GPG: 0xF534E231

More information about the Python-list mailing list