John J. Lee
jjl at pobox.com
Thu Aug 9 23:41:32 CEST 2007
Dan Stromberg - Datallegro <dstromberg at datallegro.com> writes:
> Is there a method, with python, of screenscraping a web page, if that web
Not pure CPython, no.
> I know about BeautifulSoup, but AFAIK at this time, BeautifulSoup is for
It's not that BeautifulSoup is unhappy with JS, it's just that there's
no support for executing the JS.
There are some Java libraries that know how to execute JS embedded in
web pages, which could be used from Jython:
You can also automate a browser, but that still seems to be painful in
one way or another.
More information about the Python-list