Can't replicate the site using wget

ravi.xolve · 01-19-2010, 06:58 AM

I want to replicate this small howto (http://legos.sourceforge.net/HOWTO) using wget.

I use the following command:

Code:

wget --recursive --tries=100 --timeout=60s --spider --verbose --convert-links --html-extension --page-requisites --user-agent="Mozilla/5.0 (X11; U; Linux i686; en-GB; rv:1.9.2b5) Gecko/20091204 Firefox/3.6b5" -e robots=off http://legos.sourceforge.net/HOWTO

However I just get a single file and not the other pages and that file too is not html.

Dave_Devnull · 01-19-2010, 07:11 AM

I've run your command and I get a full directory:

legos.sourceforge.net/
total 20K
drwxr-xr-x 5 root root 4.0K 2010-01-19 13:09 .
drwxr-xr-x 11 root root 4.0K 2010-01-19 13:09 ..
drwxr-xr-x 2 root root 4.0K 2010-01-19 13:09 API
drwxr-xr-x 5 root root 4.0K 2010-01-19 13:09 files
drwxr-xr-x 2 root root 4.0K 2010-01-19 13:09 HOWTO
...

jschiwal · 01-19-2010, 07:20 AM

Moved: This thread is more suitable in Linux Software and has been moved accordingly to help your thread/question get the exposure it deserves.

craigevil · 01-19-2010, 07:36 AM

wget --random-wait -r -p -e robots=off -U mozilla http://www.example.com

http://www.unixmen.com/linux-tutoria...ine-cheatsheet

ravi.xolve · 01-19-2010, 11:42 PM

I already know how to use wget.

The question I want to ask I just want to replicate the HOWTO directory and I am not getting what is expected and I can't find the reason for it.

Quote:

Originally Posted by Dave_Devnull

I've run your command and I get a full directory:

legos.sourceforge.net/
total 20K
drwxr-xr-x 5 root root 4.0K 2010-01-19 13:09 .
drwxr-xr-x 11 root root 4.0K 2010-01-19 13:09 ..
drwxr-xr-x 2 root root 4.0K 2010-01-19 13:09 API
drwxr-xr-x 5 root root 4.0K 2010-01-19 13:09 files
drwxr-xr-x 2 root root 4.0K 2010-01-19 13:09 HOWTO
...