LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Newbie (https://www.linuxquestions.org/questions/linux-newbie-8/)
-   -   wget --mirror https (https://www.linuxquestions.org/questions/linux-newbie-8/wget-mirror-https-898760/)

Jorris 08-22-2011 08:43 AM

wget --mirror https
 
I am trying to mirror a secured website like this:

Code:

wget -m https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC
But this command only downloads an index.html file:
Code:

--2011-08-22 15:45:06--  https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC
Resolving proxy.intra.rma.ac.be... 10.67.1.93, 10.67.1.62, 10.67.1.94, ...
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 301 Moved Permanently
Location: https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC/ [following]
--2011-08-22 15:45:07--  https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC/
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Server file no newer than local file `openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC' -- not retrieving.

Loading robots.txt; please ignore errors.
--2011-08-22 15:45:08--  https://openfoam-extend.svn.sourceforge.net/robots.txt
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 302 Found
Location: http://openfoam-extend.svn.sourceforge.net/robots.txt [following]
--2011-08-22 15:45:08--  http://openfoam-extend.svn.sourceforge.net/robots.txt
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 200 OK
Length: 150 [text/plain]
Saving to: `openfoam-extend.svn.sourceforge.net/robots.txt'

100%[==========================================================================================>] 150        --.-K/s  in 0s     

2011-08-22 15:45:08 (22.5 MB/s) - `openfoam-extend.svn.sourceforge.net/robots.txt' saved [150/150]

FINISHED --2011-08-22 15:45:08--
Downloaded: 1 files, 150 in 0s (22.5 MB/s)

However, I need all of the files in this folder and the ones below it. It is possible to download file by file with wget, but this will take too much time.

How do I mirror everything, keeping the directory structure?

SharpyWarpy 08-23-2011 01:01 AM

From the manual pages of the wget command. Try this:
wget -E -H -k -K -p https://<site>/<document>
The wget manual is good reading. Enjoy:
man wget


All times are GMT -5. The time now is 06:58 PM.