LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Software (https://www.linuxquestions.org/questions/linux-software-2/)
-   -   Wget usage (https://www.linuxquestions.org/questions/linux-software-2/wget-usage-616540/)

The_Nerd 01-26-2008 10:01 PM

Wget usage
 
Hello! I am trying to use wget in conjunction google images to download wallpapers. I am having a problem however because wget wants to recurse all over the place... So, can anyone tell me how to tell wget to only recurse into certain links? For example: I want to download all images on national geographic: This link:

http://images.google.com/images?hl=e...h+Images&gbv=2

Can I tell wget to recurse like crazy, but only DOWNLOAD things from "animals.nationalgeographic.com"???

jantman 01-27-2008 02:21 AM

That's a job for a quick little script in whatever language you prefer - Perl, Python, or if you're hardcore, shell/grep/awk/whatever else.

cyent 01-27-2008 02:58 AM

Wget selection...
 
Try this page in the manual...

http://www.informatik.uni-hamburg.de...et/wget_4.html

Else try batchdownload addon for firefox.

https://addons.mozilla.org/en-US/firefox/addon/3104

archtoad6 01-29-2008 07:18 AM

All 10,700 of them? -- From your link:
"Images Results 1 - 20 of about 10,700 for site:animals.nationalgeographic.com"

jantman 01-29-2008 10:57 AM

I did something like this ta few years ago to mine images off of a site (for personal use only). I'd say that Python is the way to go, but I guess it's a personal thing. PM me if you want the script.

archtoad6 01-29-2008 12:27 PM

Me, I use wget, often in a loop, to d/l; lynx -dump & curl to find structure.

OP, what are you trying to do?


All times are GMT -5. The time now is 03:52 AM.