Using Wget to check updated product pages

ewingtux · 12-03-2008, 03:41 PM

Hi,

I have a huge catalog of php pages and i need to check for any price chnages that have been done. Can I download each page and setup a cron tab to check the page and compare to the one we have?

I feel Wget could possibly do this but hear cURL is also useful for this too.

Any help on how i can check for any updates on PHP or HTML files would be much appreciated.

Thanks

burschik · 12-04-2008, 03:21 AM

Quote:

Originally Posted by ewingtux

I have a huge catalog of php pages and i need to check for any price chnages that have been done. Can I download each page and setup a cron tab to check the page and compare to the one we have?

Of course you can.

Quote:

I feel Wget could possibly do this but hear cURL is also useful for this too.

Either will do.

Quote:

Any help on how i can check for any updates on PHP or HTML files would be much appreciated.

It all depends on what exactly you want to check. If you are interested only in whether the page has changed at all, you can simply compare md5 checksums or something similar.

ewingtux · 12-04-2008, 08:35 AM

For example, if i wanted to be notified that this product had gone up to £62. How would I go about doing this

In an ideal world I would like to emailed a list of anything that has changed very 6 hours or so. Any help much appreciated.

http://www.amazon.co.uk/Philips-Cool...APRD2QBX6ZPEXC

Thanks