Is that web app on the http://www.alephnaught.com/ domain? If so, drop me a
reply - I have some (notably ugly) Java code that scrapes the site and
creates XML files as a result - it would be a slam dunk to load those XML
into a DB IMHO.
The XML files are also up on my web site in case you want to take a look at
the format.
(Probably should have done this in Python in hindsight, but that's 20-20)
It would take some effort to create a minimal jar file of source + binaries,
but I could do it if someone really wanted it.
I'm no longer in the Chicagoland area, so I'm not keeping it up to date
(except by request, and I have had two since I moved to SoCal in March [its
going to be 86F and bright sunshine today]).
Good luck! - Bob
On Thu, 11/6/08 8:22 PM, "Tom Printy" <tprinty at mail.edisonave.net> wrote:
> Hi Alan,
>> I am, hoping to put the data into a sqllite db then use it to build an
> app based on it.
>> Thanks
> -Tom
>> Allan Spale wrote:
>> Hi Tom,
>>>> I have done quite a bit of screen scraping lately and have some code
>> that does a sort of decent job with urls and XPath (when you use it
>> with Firefox plugins Firebug and XPather). It was very tough to find
>> the modules that worked best, but it worked out ok for a handful of
>> websites. So, do you want to just extract all of the schedules and
>> then serve it up differently?
>>>>>> Allan
>>>> On Thu, Nov 6, 2008 at 6:06 PM, Tom Printy <tprinty at mail.edisonave.net>> <mailto:tprinty at mail.edisonave.net>> wrote:
>>>> A while a go somebody wrote a web app the was a nicer interface to
>> the Metra schedule. I am interested in the code to scrape the
>> site. I would like to put the data in a sql lite database. Can
>> anyone help here?
>>>> Thanks
>> -Tom Printy
>> _______________________________________________
>> Chicago mailing list
>>Chicago at python.org <mailto:Chicago at python.org>
>>http://mail.python.org/mailman/listinfo/chicago>>>>>> ------------------------------------------------------------------------
>>>> _______________________________________________
>> Chicago mailing list
>>Chicago at python.org>>http://mail.python.org/mailman/listinfo/chicago>>>> _______________________________________________
> Chicago mailing list
>Chicago at python.org>http://mail.python.org/mailman/listinfo/chicago
--
Bob Hays
(818) 836-0509 (C)
purplehayz at earthlink.nethttp://www.alephnaught.com
"People will work for money, but they'll give a piece of their lives for
meaning."
-- Schwab's Dawn Lapore