Wget usage

The_Nerd · 01-26-2008, 10:01 PM

Hello! I am trying to use wget in conjunction google images to download wallpapers. I am having a problem however because wget wants to recurse all over the place... So, can anyone tell me how to tell wget to only recurse into certain links? For example: I want to download all images on national geographic: This link:

http://images.google.com/images?hl=e...h+Images&gbv=2

Can I tell wget to recurse like crazy, but only DOWNLOAD things from "animals.nationalgeographic.com"???

jantman · 01-27-2008, 02:21 AM

That's a job for a quick little script in whatever language you prefer - Perl, Python, or if you're hardcore, shell/grep/awk/whatever else.

cyent · 01-27-2008, 02:58 AM

Try this page in the manual...

http://www.informatik.uni-hamburg.de...et/wget_4.html

Else try batchdownload addon for firefox.

https://addons.mozilla.org/en-US/firefox/addon/3104

archtoad6 · 01-29-2008, 07:18 AM

All 10,700 of them? -- From your link:
"Images Results 1 - 20 of about 10,700 for site:animals.nationalgeographic.com"

jantman · 01-29-2008, 10:57 AM

I did something like this ta few years ago to mine images off of a site (for personal use only). I'd say that Python is the way to go, but I guess it's a personal thing. PM me if you want the script.

archtoad6 · 01-29-2008, 12:27 PM

Me, I use wget, often in a loop, to d/l; lynx -dump & curl to find structure.

OP, what are you trying to do?