[Tutor] Interfacing to the web

andy surany mongo57a@comcast.net
Wed Oct 23 12:04:02 2002


This is a multi-part message in MIME format.

--Boundary_(ID_vM3DNYHmNYAPsMoh0/dmFg)
Content-type: text/plain; charset=iso-8859-1
Content-transfer-encoding: 7BIT

Hi All!

Here is what I need to accomplish:

    From a python program, I need to launch a browser. The user then uses the browser to interact with the web site. However, the python program must continually monitor the data from the web site to capture specific data elements.

    Unfortunately, I can't point the program to the specific URL as there is a significant and secure (cookies, etc.) exchange that must occur in order to reach the page.

    In the archives, I found a section on parsing HTML which I think would be very helpful. However, I am unsure how to a) launch the browser from the program, and b) how to passively (important point...) interact with the return data stream (i.e. how to apply html parsing in this case).

Anybody have advice?

TIA
-Andy

--Boundary_(ID_vM3DNYHmNYAPsMoh0/dmFg)
Content-type: text/html; charset=iso-8859-1
Content-transfer-encoding: 7BIT

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=windows-1252">
<META content="MSHTML 5.50.4522.1800" name=GENERATOR></HEAD>
<BODY bgColor=#ffffff>
<DIV><FONT size=2>Hi All!</FONT></DIV>
<DIV><FONT size=2></FONT>&nbsp;</DIV>
<DIV><FONT size=2>Here is what I need to accomplish:</FONT></DIV>
<DIV><FONT size=2></FONT>&nbsp;</DIV>
<DIV><FONT size=2>&nbsp;&nbsp;&nbsp; From a python program, I need to launch a 
browser. The user then uses the browser to interact with the web site. However, 
the python program must continually monitor the data from the web site to 
capture specific data elements.</FONT></DIV>
<DIV><FONT size=2></FONT>&nbsp;</DIV>
<DIV><FONT size=2>&nbsp;&nbsp;&nbsp; Unfortunately, I can't point the program 
to&nbsp;the specific URL as there is a significant and secure (cookies, etc.) 
exchange that must occur in order to reach the page.</FONT></DIV>
<DIV><FONT size=2></FONT>&nbsp;</DIV>
<DIV><FONT size=2>&nbsp;&nbsp;&nbsp; In the archives, I found a section on 
parsing HTML which I think would be very helpful. However, I am unsure how to a) 
launch the browser from the program, and b) how to passively (important 
point...) interact with the return data stream (i.e. how to apply html parsing 
in this case).</FONT></DIV>
<DIV><FONT size=2></FONT>&nbsp;</DIV>
<DIV><FONT size=2>Anybody have advice?</FONT></DIV>
<DIV><FONT size=2></FONT>&nbsp;</DIV>
<DIV><FONT size=2>TIA</FONT></DIV>
<DIV><FONT size=2>-Andy</FONT></DIV></BODY></HTML>

--Boundary_(ID_vM3DNYHmNYAPsMoh0/dmFg)--