LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 04-08-2010, 11:37 AM   #1
redir
Member
 
Registered: May 2004
Location: Virginia USA
Distribution: Debian_Ubuntu_FreeBSD
Posts: 110

Rep: Reputation: 15
Help downloading files recursively from an http site


I feel like an idiot here because I cannot manage to do this and I should know better. Anyway how do I download all the files form here: http://openmetaverse.org/viewvc/inde...anches/stable/

I am on freeBSD 7.0 and I tried wget with the -r switch and it gives me URL's only. Maybe this is simply not an ftp site I don't know.

Any suggestions on how I can download all those files with the same directory structure would be appreciated. Thanks.
 
Old 04-08-2010, 11:52 AM   #2
roreilly
Member
 
Registered: Aug 2006
Location: Canada
Distribution: Debian, Slackware
Posts: 106

Rep: Reputation: 28
Try this:

wget -r -l5 -H -t1 -nd -N -np -A.jpg,.gif -erobots=off <url_here>
 
Old 04-08-2010, 12:21 PM   #3
cardy
Member
 
Registered: Jan 2005
Location: Shropshire, England, UK
Distribution: RedHat, Fedora, CentOS..........
Posts: 121

Rep: Reputation: 19
Looking at that link you seem to be after the latest stable code. If this is indeed the case then the simplest way is to get it using subversion.

Details for the URLs are on the download page.

http://openmv.org/projects/libopenmetaverse/download

The commands below will either check-out or export 0.7.0 of the stable branch, there is a link for the development branch too if you need that its on the downloads page above.

Lee
 
Old 04-08-2010, 02:37 PM   #4
redir
Member
 
Registered: May 2004
Location: Virginia USA
Distribution: Debian_Ubuntu_FreeBSD
Posts: 110

Original Poster
Rep: Reputation: 15
Hey Cardy, I think I would have to install svn since it's not how freeBSD does things. I know I can install svn on freeBSD but I am not sure I want to at this point. Maybe I will have to I don't know?

roreilly I don't want to download the actual web files but the source code files that are in that repository. That wget command will have me downloading jpegs and gif's won't it?
 
Old 04-08-2010, 04:45 PM   #5
cardy
Member
 
Registered: Jan 2005
Location: Shropshire, England, UK
Distribution: RedHat, Fedora, CentOS..........
Posts: 121

Rep: Reputation: 19
Mmmmmm I can see what you mean however as all the files are being viewed though some form of web based viewer there is a chance of the files being modified in some way by that viewer. svn would at least give you a clean code set to work with. I believe you can always un-install svn packages afterwards if you are only likely to run the command once.
 
Old 04-08-2010, 04:52 PM   #6
redir
Member
 
Registered: May 2004
Location: Virginia USA
Distribution: Debian_Ubuntu_FreeBSD
Posts: 110

Original Poster
Rep: Reputation: 15
Yeah I'm thinking I might do that now that package is not in the ports collection anyway and if I ever do get this running on this box I'll let it sit in this state forever.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How can I download a bunch of files from an http site? abefroman Linux - Desktop 4 12-16-2009 10:00 PM
Downloading distros from the LQ site? Lola Kews Linux - Software 3 05-08-2009 08:27 AM
how are files downloaded from an http://x.x.x.x site dsids Linux - General 3 11-19-2006 10:52 AM
Downloading all the .zips on this site Baix Programming 6 02-22-2005 03:34 AM
ripping all links of a site recursively rsingh Linux - Newbie 1 10-29-2003 03:03 PM


All times are GMT -5. The time now is 10:23 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration