LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 06-26-2014, 05:54 AM   #1
Siliskor
LQ Newbie
 
Registered: May 2014
Posts: 11

Rep: Reputation: Disabled
How to download multiple files


Hey all,

I feel this is a really silly question but is there a way to download a directory from these type of sites?

http://www.slackware.com/~alien/slackbuilds/

For example, I want to download the Wine folder but when I click on it, it goes into another directory, which leads into another directory, which then I must download each file individually and notepad files seem to require me to create a new text file, copy and paste the code and save them.

Is it possible to download the entire directory? I feel like I am doing something wrong.

Thanks.
 
Old 06-26-2014, 06:30 AM   #2
TenTenths
Senior Member
 
Registered: Aug 2011
Location: Dublin
Distribution: Centos 5 / 6 / 7
Posts: 2,166

Rep: Reputation: 751Reputation: 751Reputation: 751Reputation: 751Reputation: 751Reputation: 751Reputation: 751
Use:
Code:
wget
Do a google search for wget -r and you'll find plenty of examples.
 
Old 06-26-2014, 06:33 AM   #3
eklavya
Member
 
Registered: Mar 2013
Posts: 619

Rep: Reputation: 136Reputation: 136
Install httrack and run the command
Code:
httrack "http://http://www.slackware.com/~alien/slackbuilds/" -O "/tmp/mysite" "+*.slackware.com/*" -v
It will download all available packages in /tmp as a directory mysite.
 
Old 06-26-2014, 06:33 AM   #4
Siliskor
LQ Newbie
 
Registered: May 2014
Posts: 11

Original Poster
Rep: Reputation: Disabled
Thanks a lot TenTenths and eklavya. I really appreciate the help.
 
Old 06-26-2014, 06:36 AM   #5
ricemark20
Member
 
Registered: Aug 2003
Location: Wauconda, Illinois, USA
Distribution: Arch Linux
Posts: 78

Rep: Reputation: 16
There are 2 tools I know of, wget and curl.

http://linux.about.com/od/commands/l/blcmdl1_wget.htm

http://linux.about.com/od/commands/l/blcmdl1_curl.htm

This is from the man pages, and I think it is what you need.

Code:
Recursive Retrieval Options

-r
--recursive
    Turn on recursive retrieving. 
-l depth
--level=depth
    Specify recursion maximum depth level depth. The default maximum depth is 5. 
--delete-after
    This option tells Wget to delete every single file it downloads, after having done so. It is useful for pre-fetching popular pages through a proxy, e.g.:

            wget -r -nd --delete-after http://whatever.com/~popular/page/

    The -r option is to retrieve recursively, and -nd to not create directories.

    Note that --delete-after deletes files on the local machine. It does not issue the DELE command to remote FTP sites, for instance. Also note that when --delete-after is specified, --convert-links is ignored, so .orig files are simply not created in the first place.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] How to chmod multiple files based on multiple --reference files ? bot.anist Linux - Newbie 10 06-13-2014 03:54 AM
Use wget to download multiple files with wildcards Anant Khaitan Linux - Networking 8 08-23-2013 10:45 PM
[SOLVED] Jigdo download of DVD-7 ALWAYS fails with just 5 files left to download IslandWolf Debian 3 03-12-2011 04:24 AM
Downloader Manager to download multiple files at once dsjellesma Linux - Newbie 1 06-21-2009 06:14 PM
[SOLVED] wget: download multiple files Steve W Linux - Software 6 05-25-2009 12:29 PM


All times are GMT -5. The time now is 12:51 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration