Folks,
As a youth sports coach and referee, I have dozens of web sites I visit
to gather game schedule, practice schedule, contact information and similar details. Does anyone know of programmer or end-user software that will help me automate the process?
- read a list of pages to visit
- login for each page
- scrape 'doormat' or 'home page' for announcement content
- send email about announcements
- navigate to desired content following login
- scrape the desired content and store it somehow for local processing
- repeat for every page on the list
- send email to notify that work is done (or other details)
This sounds like the job for a perl or python application run under
anacron control. I hope there are web page scraping libraries and frameworks that folks are willing to recommend.
Thanks in advance,
~~~ 0;-/ Dan
