Example Script to parse web page links and extract data?

livin livin at
Thu Sep 15 00:29:21 CEST 2005

I'm hoping someone knows of an example script I can see to help me build 

I'm looking for an easy way to automate the below web site browsing and pull 
the data I'm searching for.
Here's steps it needs to accomplish...

1) login to the site (windows dialog when hitting web page)  *optional*

2) Choose menu link from ASP page (script shows/hides menu items depending 
on mouseover) *optional*

3) Basic Search Form and enter zip code or city to pull all the data.

4) After search, table shows many links (hundreds sometimes) to the actual 
data I need.
    Links are this format... <a href="javascript:GetAgent('AA059')">

5) Each link opens new window with table providing required data.
    The URLs that each href opens is this... 
http://armls.marketlinx.com/Roster/Scripts/Member.asp?PubID=AA059 where the 
PubID is record I need.

Table format looks like this:


<td bgcolor="#C0C0C0" align="center">

<a href="javascript:GetAgent('MA142')">

<font face="Arial" size="2">6</font></a></td>

<td><font face="Arial" size="2">

<a href="javascript:GetAgent('MA142')">Alaze</a><br></font></td>

<td><font face="Arial" size="2">Mark <br></font></td>

<td><font face="Arial" size="2">MA142</font><br>


<td><font face="Arial" size="2">

<a href="javascript:GetBroker('COLD56')">Banker Success 


<td><font face="Arial" size="2"><script LANGUAGE="javascript">





More information about the Python-list mailing list