LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Slackware (https://www.linuxquestions.org/questions/slackware-14/)
-   -   wget know how (https://www.linuxquestions.org/questions/slackware-14/wget-know-how-105105/)

ksd 10-17-2003 08:32 AM

wget know how
 
hey..i just downloaded wget1.8. it s installed alright.but i am not getting the logic in downloading files wit h its help.i mean..do i have to use it through the console itself?when i did the wget --help..its asking for the url to type beside wget..how do i do it?does it not have any gui?is it not visible on the desktop or on the so that i can simply right click on the download link (just as i used do with download manager when windows was on my system)..has any one got any idea?

jkobrien 10-17-2003 08:42 AM

No, wget doesn't have a gui (that I know of), it's used more for non-interactive downloads. So if you wanted to send a batch of queries to some online web-site and download the results, you would write a script that prepared your queries, sent them to the web page with wget and saved the results somewhere. All this without you having to be there, or even logged on.

There's tons more information under "man wget" and "locate wget | grep README".

gftp is a good package for more straightforward file retrieval.

john

ksd 10-17-2003 09:13 AM

hey jkobrien..thanx for that info..i'd better refer man wget..i'll also try gftp..ok..

JollyRogers 10-17-2003 12:50 PM

I like wget. It is only usable from the commandline, however, I have seen ncurser programs that utilize wget to grab files etc....

an example of how to use it..

$wget http://www.ultrasoul.com/~jollyrogers/fireballmail2.mp3

arunshivanandan 10-17-2003 01:03 PM

wget is superb.you can even add all the urls of the files to be downloaded to a file say temp and just give 'wget -i temp' and it will download everything.it is extremely usefull if you are in a lan since it will continue downloading in the background even after you have logged out.(therefore it is in noway comparable to gftp).if you are not working in a lan,then download accelerators like prozilla or prozGUI will be more usefull.(see my sig).I dont know of any application that combines these two.(Why are they not coupling it??)
--arun

arunshivanandan 10-17-2003 01:18 PM

also use -b option with wget to run it in background,-c to continue a partially downloaded file, --proxy=on/off to set proxy, ' --directory-prefix=<DIR_NAME> to specify the destination directory, --http-user=USE_NAME ,--http-passwd=password to specify the user name and password to which one should logon.for more refer man page.

gwp 10-17-2003 01:45 PM

Try this

If your access is via a proxy:

export http_proxy=<proxyip or dns name>

Then

wget --convert-links --proxy-user=youruser --proxy-passwd=yourpwd -r http://yoururl

Hope that helps...

fye 10-17-2003 03:52 PM

Quote:

Originally posted by arunshivanandan
--http-user=USE_NAME ,--http-passwd=password
wget is great and I use it quite often, but I'd still prefer it to ask me the password if I just entered the username. This way I wouldn't have to put my passwd to the commandline, which is not very secure, imo. Interesting, I looked at the man page, but there was no mention of such a usage. Maybe I missed something, because it is insane to make passing the password as the argument the only way to send a passwd.

ksd 10-17-2003 10:58 PM

hey arun shivanandan..thanx for that info ..i would refer the manpage of wget..

arunshivanandan 10-18-2003 01:48 AM

Quote:

Originally posted by fye
, I looked at the man page, but there was no mention of such a usage. Maybe I missed something, because it is insane to make passing the password as the argument the only way to send a passwd.
Quoting from wget manual page,
Quote:

--http-user=user --http-passwd=password Specify the username user and password password on an HTTP server. According to the type of the challenge, Wget will encode them using either the `basic' (inse_ cure) or the `digest' authentication scheme. Another way to specify username and password is in the URL itself.
Is your manpage different from mine??(mine is wget 1.7)

gwp 10-18-2003 04:01 AM

According my man page (version 1.8.2)

Quote:

--proxy-user=user
--proxy-passwd=password
Specify the username user and password password for authentication
on a proxy server. Wget will encode them using the "basic" authen-
tication scheme.

Security considerations similar to those with --http-passwd pertain
here as well.
Although I do concur that passwords on the command line are a big no no

Just though I'd help get him/her started

Don't use it much, but has been useful when I often refer to something on a site.

What I'll often do is use --no-parent when I don't want to ascend and get a bunch
of stuff I don't need

I'm no master with wget, but its a cool util

BR,

G

senthilkumaran 10-18-2003 07:13 AM

hi
wget is an exceptional command line tool mainly for ftp doing downloads. you can even write scripts using wget and add in crond for automatic downloads. It has the capability to resume the connection if it get disconnects.

hope this example will give an idea to use wget.

wget -c -nH -P /home/anyfolder -a /logs/LOG_FILE_NAME.log ftp://username:password@sitename/FLDR_NAME/*.[t,d][x,o][t,c] && echo "FLDR_NAME Sucessfully Downloaded"

-c will resume the connection (The ftp server should have the resume connection option enabled)
-nH will cut the remote parent directory and takes the rest.
for ex if you try downloading files form ftp://ftp.sitename/download the directory structure will be created on hte local machine also. -nH will not create the folder name "ftp.sitename" instead it uses the -P option which tells the prefix to be used.

-a will write the file transfer details in the given logfile.

*.[t,d][x,o][t,c] will download only 'txt' and 'doc' file if any.

if you are using the proxy server
add the proxy details of http_proxy and ftp_proxy in the 'wgetrc' file before you use the command.

Also refer the man page for more options.
regards,

andrewlkho 10-18-2003 01:14 PM

Hey..that's a good idea actually [sorry, this is completely random] - anyone fancy writing a gui for wget [mainly for batch downloads for script newbies]?

arunshivanandan 10-18-2003 01:43 PM

if someone is going to work on wget,try applying the concept of download accelarator to wget.(like prozilla).that is the look should be something like that og gftp,it should have all the properties of present wget(like continue downloading even when the user has logged out) and that of download accelarator.How nice will be that??

LinFreak! 10-18-2003 06:34 PM

Great idea, if only I learned to script.....


All times are GMT -5. The time now is 06:12 PM.