it downloads in firefox, not in wget

moob8 · 02-06-2007, 07:13 PM

There are some sites I go to where I can click on a file to download in firefox and it will begin to download. The firefox download tends to poop out about 200K or so in so I use wget to get anything more than 200k or so. Recently I have begun to see files that will start to download in firefox, but the same URL, when passed to wgetc, fails to download.

As a specific example, from the page http://princess.elricm.net/PSModsList.htm If I click the link for http://downloads.elricm.net/hosted/p...asAtLokken.zip
in firefix I'll get the start of a download. This demonstrates that the link is valid. If I try it with wget I get this:

Code:

--20:00:10--  http://downloads.elricm.net/hosted/princess/ChristmasAtLokken.zip
           => `ChristmasAtLokken.zip'
Resolving downloads.elricm.net... 64.72.118.223
Connecting to downloads.elricm.net|64.72.118.223|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://www.elricm.com/nuke/html/404forbidden.php [following]
--20:00:11--  http://www.elricm.com/nuke/html/404forbidden.php
           => `404forbidden.php'
Resolving www.elricm.com... 64.72.118.140
Connecting to www.elricm.com|64.72.118.140|:80... connected.
HTTP request sent, awaiting response... 500 Internal Server Error
20:00:12 ERROR 500: Internal Server Error.

Errr, ooookayyyy.

Now what? Any ideas? Thanks in advance.

edit: the intent here is to find a way to get wget to download such files.

osor · 02-06-2007, 08:01 PM

They are trying to protect against direct links by using some sort of rudimentary tracking/authentication (to see this, try to clear your browser cache/cookies/whatever else and then click the link you posted).

moob8 · 02-10-2007, 09:10 AM

Quote:

Originally Posted by osor

They are trying to protect against direct links by using some sort of rudimentary tracking/authentication (to see this, try to clear your browser cache/cookies/whatever else and then click the link you posted).

So are you saying that I would clear the firefox cookies in order to get wget to download successfully?

yodermk · 02-10-2007, 09:40 AM

No, Firefox would then refuse to download it!

If that is correct, what's happening is the server is checking the "Referrer:" header to make sure you were already browsing their page when you started the download. This prevents other sites from leeching their bandwidth by linking directly to the file.

You may be able to download it with wget by adding:

--referer=http://whatever

to the command line, where "whatever" is the page you were browsing when you clicked the download link.