website data extract

Galib · 12-17-2010, 10:51 PM

What would be the best way to extract data by sending queries to a website?

The data comes in table format.

devnull10 · 12-18-2010, 02:35 AM

How do you want to extract it, and what do you want to do with it?

j-ray · 12-18-2010, 04:55 AM

My personal's favourite (assumed you want to analyze a specific table somewhere on the web)
1. write a perl script
2. use LWP, create a UserAgent, fetch the result
3. extract table content from the result with regular expressions
4. split content into an array of rows with regular expressions
5. split the elements of the table rows with regular expressions