Share your knowledge at the LQ Wiki.
Go Back > Forums > Linux Forums > Linux - Newbie
User Name
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!


  Search this Thread
Old 09-13-2006, 08:32 AM   #1
Registered: May 2006
Posts: 55

Rep: Reputation: 15
Unhappy wget command access forbidden problem pls help


The site is
when I tried to wget it, I got the following error message,

[root@localhost b]# wget -t1 -r -np --level=1
=> `'
Resolving done.
Connecting to[]:80... connected.
HTTP request sent, awaiting response... 403 Access Forbidden
18:10:54 ERROR 403: Access Forbidden.

FINISHED --18:10:54--
Downloaded: 0 bytes in 0 files
[root@localhost b]#

There are lot of exe files under (Eg.

I can download the above i_bpk_lite.exe file using wget At this time I can download the file.

But there are a number of exe files on the above site. I want to download all of them using single wget command.

I tried :

root@localhost b]# wget -t1 -r -np --level=1[*]*
Warning: wildcards not supported in HTTP.
=> `[*]*'
Resolving done.
Connecting to[]:80... connected.
HTTP request sent, awaiting response... 404 Object Not Found
18:19:29 ERROR 404: Object Not Found.

FINISHED --18:19:29--
Downloaded: 0 bytes in 0 files
[root@localhost b]#

But it is not working. I tried to use wild-characters to download all files on the site.

How can I do this??? please help.
Thanks in Advance.
Old 09-13-2006, 08:48 AM   #2
LQ Veteran
Registered: Feb 2003
Location: Maryland
Distribution: Slackware
Posts: 7,803
Blog Entries: 1

Rep: Reputation: 420Reputation: 420Reputation: 420Reputation: 420Reputation: 420
This is a completely wild guess, but I'm going to bet that the site is using Apache with mod_security and there are rules in mod_security that prevent the use of tools like wget and curl. Unless you have administrator privileges to that site, you probably can't use wget to get everything.
Old 01-26-2007, 10:41 PM   #3
LQ Newbie
Registered: Jan 2007
Posts: 1

Rep: Reputation: 0
Is there anyway around this is? I am looking at the same problem on a different site. The site is a company that I do business with and I have an account that allows me access to the entire site. Is there a way to use WGET and a username and password?
Old 01-27-2007, 01:02 AM   #4
Senior Member
Registered: May 2004
Location: In the DC 'burbs
Distribution: Arch, Scientific Linux, Debian, Ubuntu
Posts: 4,289

Rep: Reputation: 378Reputation: 378Reputation: 378Reputation: 378
You can use the --user and --password option to wget. Note, however, that this only works if the site is using "vanilla" http encryption (and not some added on system like a CMS to control access). In that case you might have to script wget to use the session key returned by the site to download files.

As always, be sure that downloading with a tool like wget is allowed in the site's TOS before proceeding. Some webmasters don't like it for various reasons.


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
problem doing software updates using yum command, pls help ravifrequent Fedora 3 09-01-2006 04:59 AM
problem with wget COMMAND Fond_of_Opensource Linux - Newbie 2 06-30-2006 04:44 AM
Access forbidden to directory mirat46 Linux - Newbie 1 02-07-2006 02:09 PM
Forbidden Access Problems. ivanagrozny SUSE / openSUSE 3 02-06-2006 06:55 PM
wget/curl problems PLS HELP tommmmmm Linux - Software 0 08-19-2005 04:58 AM > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 03:36 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration