LinuxQuestions.org
Latest LQ Deal: Latest LQ Deals
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 12-15-2013, 12:28 PM   #1
dazdaz
Member
 
Registered: Aug 2003
Location: Europe
Distribution: RHEL, CentOS, Ubuntu
Posts: 333

Rep: Reputation: 17
Downloading a folder over http


What is the best/latest/most recommended tool to download a directory over http ? rsync does'nt support HTTP. The tool has to read the index.html file.

There is zsync, although this is'nt working for me. Any recommendations ?

An example would be that I would want to download all of the RPM files within here [without using yum] but I don't want to specify each individual filename, to a local folder.

http://yum.mariadb.org/5.5.34/centos6-amd64/rpms/

Because I hate wget, is there any other recommended tool for HTTP mirroring ?

I do know that this works, but there must be an easier tool to use.
wget -A.rpm -l0 -r --no-parent http://yum.mariadb.org/5.5.34/centos6-amd64/rpms

Last edited by dazdaz; 12-15-2013 at 12:45 PM.
 
Old 12-15-2013, 12:45 PM   #2
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600
Quote:
Originally Posted by dazdaz View Post
What is the best/latest/most recommended tool to download a directory over http ?
Why would you want to use something like HTTrack when you can haz wget?..
 
1 members found this post helpful.
Old 12-15-2013, 12:47 PM   #3
dazdaz
Member
 
Registered: Aug 2003
Location: Europe
Distribution: RHEL, CentOS, Ubuntu
Posts: 333

Original Poster
Rep: Reputation: 17
I was just curious to learn of any new tool that may perform the same task, but is a little easier to use.

I did'nt know that HTTrack existed under Linux, that is very handy, thank you !
 
Old 12-15-2013, 01:02 PM   #4
unSpawn
Moderator
 
Registered: May 2001
Posts: 29,415
Blog Entries: 55

Rep: Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600Reputation: 3600
Maybe start by telling us what's hard about wget? I mean it comes with a manual, its fast and it doesn't need all the QT, wxWidgets and other libraries a GUI app needs...
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Need help with downloading from http site (Robby's packages) with file globbing damgar Slackware 7 09-15-2010 03:27 PM
Help downloading files recursively from an http site redir Linux - Newbie 5 04-08-2010 03:52 PM
phpMyAdmin can't get it to my http folder shorto Linux - Newbie 3 07-06-2007 09:47 PM
Incremental Downloading: wget http://www.mysite.org/pic[001-125].jpg fc6_user Programming 5 04-04-2007 10:25 AM
How does file downloading happen in HTTP and FTP seidren General 4 11-09-2003 08:59 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 01:53 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration