Can Beautiful Soup execute scripts? I was trying to scrape using
urllib2, and the Javascripts messed my navigation up something chronic.<br>
<br><br><div><span class="gmail_quote">On 6/13/05, <b class="gmail_sendername">Liam Clarke</b> <<a href="mailto:cyresse@gmail.com">cyresse@gmail.com</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
For what Ismael wants, you'd need to use PyXPCOM.<br>
<br>
IMAO, on a Win32 box, if you're not browsing dubious sites, it's
not really worth the effort of trying to grasp XPCOM, when ActiveX/COM
& IE are sitting there ready to use with a simpler interface.<br>
<br>
My $0.02.<div><span class="e" id="q_104741b6f47cb9a9_1"><br>
<br>
<br><div><span class="gmail_quote">On 6/12/05, <b class="gmail_sendername">Terry Carroll</b> <<a href="mailto:carroll@tjc.com" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">carroll@tjc.com</a>
> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
On Sat, 11 Jun 2005, Ismael Garrido wrote:<br><br>> I've been looking around for a web browser either written in python, or<br>> with python bindings.<br><br>MozPython? <a href="http://www.thomas-schilz.de/MozPython/README.html" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
http://www.thomas-schilz.de/MozPython/README.html</a><br><br>> What I need to do is load a web-page, enter a password-protected site<br>> and follow certain links, it needs to have frames and follow the refresh<br>
> meta. I'm running winxp, python
2.4<br><br>Why not write a scraper, using something like Beautiful Soup?<br><br><br>_______________________________________________<br>Tutor maillist - <a href="mailto:Tutor@python.org" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
Tutor@python.org</a><br><a href="http://mail.python.org/mailman/listinfo/tutor" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
http://mail.python.org/mailman/listinfo/tutor</a><br></blockquote></div><br><br><br></span></div><div><span class="e" id="q_104741b6f47cb9a9_2">-- <br>'There is only one basic human right, and that is to do as you damn well please.
<br>And with it comes the only basic human duty, to take the consequences.'
</span></div></blockquote></div><br><br><br>-- <br>'There is only one basic human right, and that is to do as you damn well please.<br>And with it comes the only basic human duty, to take the consequences.'