liburl cant load webpage with Javascript

[Lorenzo Gatti]

Uwe Mayer <merkosh at hadiko.de> wrote in message news:<c80oqk$t7$1 at news2.rz.uni-karlsruhe.de>...
> Hi,
> 
> I want do use liburl to scan a webpage which is only accessible from within
> my LAN environment. While mozilla manages to load the target URL properly
> neither wget, nor liburl or liburl2 does.
> I had a closer look at the html source and discovered a lot of Javascript,
> including Cookies.
> 
> My suspicion is that the Javascript code needs to be executed for the page
> to work properly. Also I don't know how liburl deals with Cookies, but
> since they are handled by the Javascript in the source code they are
> probably not considered at all.
> 
> In any case I get an IOError: connection refused, Error Code 111.
> 
> Does anyone know a way out of this?
> 
> Thanks for any hints,
> Ciao
> Uwe

Mozilla is a web browser, and it implements cookies, DOM for HTML
pages, and a Javascript interpreter with objects representing browser
automation.
It's unlikely and inappropriate for low level HTTP implementations
like wget and liburl to have that kind of support for advanced web
features; maybe you can support cookies and Javascript in your
application.

In the specific case of "IOError: connection refused, Error Code 111",
however, the failure seems to happen at a lower protocol level: wrong
host names or port numbers, unavailable servers and maybe proxy
authentication requirements are the usual causes of refused
connections.

Lorenzo Gatti