trying to automate wget commands

Spawn10 · 09-16-2010, 02:49 PM

I a complete newbie trying to use wget on a windows environment. Anyway, i was wondering if there was a way that I could automate the wget processes by calling it from another application. Is this possible, and has anyone has luck doing this before? Any ideas are welcomed...but please be patient and explain it to me like a 5 year old. I thought maybe a batch file might work, but don't know how to get that done either. Also, if there are any sample code that I can look at, that will also be tremendously helpful.

Thanks

suprstar · 09-16-2010, 02:55 PM

What do you need to know? Run:

wget http://some.webserver.com/whatever/somefile.mp3

and it downloads it to your local pc. There's really nothing else to say, it's prety simple! Put it in a batch file, add it to the scheduler, whatever. It's no different than automating any other process.

Spawn10 · 09-20-2010, 06:56 PM

Well am trying to figure out a way with which i could specify the url and other wget options outside code. i.e, avoiding hard-coding...so for example, if i want to mirror a site, i want to be able to specify the wget options at the run time for my program.
Is there a way to get this done? or has this been done before?

As an example I might want to specify "-k" in one mirror and not the next, but i want to enter those parameters at run time...any ideas? Thanks

suprstar · 09-21-2010, 08:54 AM

Try a:

wget --help

You'll see that you can use:

wget -r http://whatever.com

to download basically every html, image, css, etc. it can see from the server. Obviously for any .php and etc., you will see the processed output, not the source.. You'll see a zillion other options that may be of use as well.

Tinkster · 09-21-2010, 06:38 PM

Moved: This thread is more suitable in <GENERAL> and has been moved accordingly to help your thread/question get the exposure it deserves.

Sitemapper · 09-22-2010, 09:49 PM

If you are interested in downloading/mirroring websites and using Windows you could either try httrack or A1 Website Download. The first is free/opensource I think and the other shareware (i.e. free to try)