LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 08-22-2011, 09:43 AM   #1
Jorris
LQ Newbie
 
Registered: Aug 2011
Posts: 1

Rep: Reputation: Disabled
wget --mirror https


I am trying to mirror a secured website like this:

Code:
wget -m https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC
But this command only downloads an index.html file:
Code:
--2011-08-22 15:45:06--  https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC
Resolving proxy.intra.rma.ac.be... 10.67.1.93, 10.67.1.62, 10.67.1.94, ...
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 301 Moved Permanently
Location: https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC/ [following]
--2011-08-22 15:45:07--  https://openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC/
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Server file no newer than local file `openfoam-extend.svn.sourceforge.net/svnroot/openfoam-extend/trunk/Breeder_1.6/libraries/groovyBC' -- not retrieving.

Loading robots.txt; please ignore errors.
--2011-08-22 15:45:08--  https://openfoam-extend.svn.sourceforge.net/robots.txt
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 302 Found
Location: http://openfoam-extend.svn.sourceforge.net/robots.txt [following]
--2011-08-22 15:45:08--  http://openfoam-extend.svn.sourceforge.net/robots.txt
Connecting to proxy.intra.rma.ac.be|10.67.1.93|:3128... connected.
Proxy request sent, awaiting response... 200 OK
Length: 150 [text/plain]
Saving to: `openfoam-extend.svn.sourceforge.net/robots.txt'

100%[==========================================================================================>] 150         --.-K/s   in 0s      

2011-08-22 15:45:08 (22.5 MB/s) - `openfoam-extend.svn.sourceforge.net/robots.txt' saved [150/150]

FINISHED --2011-08-22 15:45:08--
Downloaded: 1 files, 150 in 0s (22.5 MB/s)
However, I need all of the files in this folder and the ones below it. It is possible to download file by file with wget, but this will take too much time.

How do I mirror everything, keeping the directory structure?
 
Old 08-23-2011, 02:01 AM   #2
SharpyWarpy
Member
 
Registered: Feb 2003
Location: Florida
Distribution: Fedora 18
Posts: 862

Rep: Reputation: 90
From the manual pages of the wget command. Try this:
wget -E -H -k -K -p https://<site>/<document>
The wget manual is good reading. Enjoy:
man wget
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How do i get wget to mirror images referenced in CSS files Spawn10 General 2 10-19-2010 01:58 PM
wget (or other util): how do I mirror parts of this site? exscape Linux - Software 2 08-04-2010 01:03 PM
What's So Reliable About the wget Mirror Command vs Downloading Other Ways? des_a Linux - Software 0 03-12-2008 12:53 PM
wget with https and proxy in redhat sudevank Linux - Software 3 03-29-2007 02:36 AM
wget and mirror scottrell Linux - General 1 05-30-2003 05:54 AM


All times are GMT -5. The time now is 04:56 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration