LinuxQuestions.org
LinuxAnswers - the LQ Linux tutorial section.
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > General
User Name
Password
General This forum is for non-technical general discussion which can include both Linux and non-Linux topics. Have fun!

Notices

Reply
 
LinkBack Search this Thread
Old 05-20-2003, 05:04 PM   #1
TruckStuff
Member
 
Registered: Apr 2002
Posts: 498

Rep: Reputation: 30
Why can't I use wget?


For the life of me, I can't get wget to work on my system. I am trying to run a mirror of an existing project hosted on another domain. I would love to be able to simply download all the files in a given folder. Here is an example of what I see:

Quote:
[root@localhost php]# wget http://www.mydomain.com/php/
--17:04:55-- http://www.mydomain.com/php/
=> `index.html'
Resolving www.mydomain.com... done.
Connecting to www.mydomain.com[x.x.x.x]:80... connected.
HTTP request sent, awaiting response... 403 Access Forbidden
17:04:55 ERROR 403: Access Forbidden.
OK, so I use my uname and passwd:
Quote:
[root@localhost php]# wget --http-user=me --http-passwd=pass http://www.mydomain.com/php/
--17:07:03-- http://www.mydomain.com/php/
=> `index.html.2'
Resolving www.mydomain.com... done.
Connecting to www.mydomain.com[x.x.x.x]:80... connected.
HTTP request sent, awaiting response... 403 Access Forbidden
17:07:03 ERROR 403: Access Forbidden.
I can succesfully login using this user name and password any other time. I feel like a complete bonehead here... everything I read says "use wget, its easy", but it seems useless to me. I'm sure I'm just misusing it. Tips are appreicated.
 
Old 05-20-2003, 09:17 PM   #2
serz
Member
 
Registered: Apr 2003
Location: Buenos Aires, Argentina
Distribution: Slackware, Gentoo
Posts: 397

Rep: Reputation: 30
You're trying to download the content of a directory? Cause with a normal file that should ahve worked.

I think you have to use the -r option, it's recursively.

Hope that helps.
 
Old 05-21-2003, 08:57 AM   #3
TruckStuff
Member
 
Registered: Apr 2002
Posts: 498

Original Poster
Rep: Reputation: 30
I tried adding the -r extension and get the same error about access being forbidden. If I specify a page, e.g. www.mydomain.com/php/index.php, I get 4 files downloaded, all of which are linked to from my index.php. I have also tried several different options with recurssion level, getting page requisites, etc. and the max number of files it has ever downloaded is 5. Surely there is some way to mirror a web site!
 
Old 05-21-2003, 10:45 AM   #4
trickykid
Guru
 
Registered: Jan 2001
Posts: 24,133

Rep: Reputation: 194Reputation: 194
Its right in front of you in the man pages... or type wget --help for more options..

wget -m www.mydomain.com

-m = mirror

It will get all the files and directories though from the whole domain from my understanding though. Check the man pages for more details, its pretty straight forward.
 
Old 05-21-2003, 03:04 PM   #5
TruckStuff
Member
 
Registered: Apr 2002
Posts: 498

Original Poster
Rep: Reputation: 30
Sorry, I forgot to list the -m option before as having tried that. Still get the same error. I did read the man pages.
 
Old 05-21-2003, 03:13 PM   #6
fancypiper
Guru
 
Registered: Feb 2003
Location: Sparta, NC USA
Distribution: Ubuntu 10.04
Posts: 5,141

Rep: Reputation: 57
Can the site you are trying to mirror give you permission for the directories that they have restricted?
 
Old 01-26-2007, 09:47 PM   #7
caffiendo
LQ Newbie
 
Registered: Jan 2007
Posts: 1

Rep: Reputation: 0
I am having the same issue with a site I use. The site is a wholesale company that I use and I have full log-in access with a Username and Password. Is there a way to use WGET in conjunction with a password?
 
Old 02-24-2009, 01:39 PM   #8
mikluha
LQ Newbie
 
Registered: Feb 2009
Posts: 0

Rep: Reputation: 0
the same issue

hi guys. I have the same issue.

If i try download something as root using wget, wget gets stuck and then timeouts...
But if i try to download using wget as ordinary user then all
just OK!

TruckStuff: maybe you try download site as ordinary user, and then
copy to whatever you want?
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
can't wget!! aru_04 Linux - General 5 08-13-2005 05:07 AM
wget noir911 Linux - Newbie 8 07-30-2005 08:57 AM
wget Harp00 Linux - Newbie 4 11-15-2004 07:27 PM
wget toastermaker Linux - Software 4 11-13-2004 10:59 AM
wget filex Linux - Security 4 09-08-2004 08:02 PM


All times are GMT -5. The time now is 07:30 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration