I'll try to be brief
I manage a system that collects weather data and it uses wget to capture data from various pages the National Weather Service. They are changing the links for the data and I'm under a deadline to get it pointing to the new links before the scripts break.
This is a link to the information that I need WGET to dump to a file(wget -O filename.txt etc...)
http://forecast.weather.gov/product....F&issuedby=MLB
It works fine from a browser - Please see for yourself - but WGET gets a 404 error ultimately...the actual output is below.
I think it has something to do w/the 302 Redirect but have yet to find a way around it. I tried various options including sending a browsers user agent string but everything ends in a 404.
I'd owe whoever knows what is going on and how to fix it a beer.
_____________________________________________________
This command
wget
http://forecast.weather.gov/product....F&issuedby=MLB
Give the following output:
[2] 25677
[3] 25678
--2014-03-07 15:40:48--
http://forecast.weather.gov/product.php?site=NWS
Resolving forecast.weather.gov... [3]- Done product=FWF
nondem@nondem:~/clscraper/temp$ 69.22.154.11, 69.22.154.35
Connecting to forecast.weather.gov|69.22.154.11|:80... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: / [following]
--2014-03-07 15:40:48--
http://forecast.weather.gov/
Reusing existing connection to forecast.weather.gov:80.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: weather.gov [following]
--2014-03-07 15:40:48--
http://forecast.weather.gov/weather.gov
Reusing existing connection to forecast.weather.gov:80.
HTTP request sent, awaiting response... 404 Not Found
2014-03-07 15:40:48 ERROR 404: Not Found.