[Chicago] Metra Rail schedule -> sql db
Bob Hays
purplehayz at earthlink.net
Fri Nov 7 16:16:55 CET 2008
Is that web app on the http://www.alephnaught.com/ domain? If so, drop me a
reply - I have some (notably ugly) Java code that scrapes the site and
creates XML files as a result - it would be a slam dunk to load those XML
into a DB IMHO.
The XML files are also up on my web site in case you want to take a look at
the format.
(Probably should have done this in Python in hindsight, but that's 20-20)
It would take some effort to create a minimal jar file of source + binaries,
but I could do it if someone really wanted it.
I'm no longer in the Chicagoland area, so I'm not keeping it up to date
(except by request, and I have had two since I moved to SoCal in March [its
going to be 86F and bright sunshine today]).
Good luck! - Bob
On Thu, 11/6/08 8:22 PM, "Tom Printy" <tprinty at mail.edisonave.net> wrote:
> Hi Alan,
>
> I am, hoping to put the data into a sqllite db then use it to build an
> app based on it.
>
> Thanks
> -Tom
>
> Allan Spale wrote:
>> Hi Tom,
>>
>> I have done quite a bit of screen scraping lately and have some code
>> that does a sort of decent job with urls and XPath (when you use it
>> with Firefox plugins Firebug and XPather). It was very tough to find
>> the modules that worked best, but it worked out ok for a handful of
>> websites. So, do you want to just extract all of the schedules and
>> then serve it up differently?
>>
>>
>> Allan
>>
>> On Thu, Nov 6, 2008 at 6:06 PM, Tom Printy <tprinty at mail.edisonave.net
>> <mailto:tprinty at mail.edisonave.net>> wrote:
>>
>> A while a go somebody wrote a web app the was a nicer interface to
>> the Metra schedule. I am interested in the code to scrape the
>> site. I would like to put the data in a sql lite database. Can
>> anyone help here?
>>
>> Thanks
>> -Tom Printy
>> _______________________________________________
>> Chicago mailing list
>> Chicago at python.org <mailto:Chicago at python.org>
>> http://mail.python.org/mailman/listinfo/chicago
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Chicago mailing list
>> Chicago at python.org
>> http://mail.python.org/mailman/listinfo/chicago
>>
>
> _______________________________________________
> Chicago mailing list
> Chicago at python.org
> http://mail.python.org/mailman/listinfo/chicago
--
Bob Hays
(818) 836-0509 (C)
purplehayz at earthlink.net
http://www.alephnaught.com
"People will work for money, but they'll give a piece of their lives for
meaning."
-- Schwab's Dawn Lapore
More information about the Chicago
mailing list