Download your favorite Linux distribution at LQ ISO.
Go Back > Forums > Linux Forums > Linux - Newbie
User Name
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!


  Search this Thread
Old 02-17-2011, 12:49 AM   #1
LQ Newbie
Registered: Sep 2008
Posts: 3

Rep: Reputation: 0
wget copy web directory


I know there are posts on copying entire websites with Wget (Linux), but how do I copy a particular directory only. For example, if I'm at a website that offers free eBooks and the url looked like this: (I made this url up)

How can I tell Wget to:
1) Copy only what is in the directory 'romance'
2) Copy the HTML files first
3) specify which filetypes to include in the download.

I have a few other questions:
1) Is it possible to increase the timeout?
2) Is it possible to set an option for resume?

Thanks, and sorry if this is a repeat. If it is, perhaps you could point to the url covering the topic. I did a search in the newbie section before posting this.

Please don't suggest Webhttrack...thanks.
Old 02-17-2011, 01:07 AM   #2
LQ Guru
Registered: Apr 2005
Posts: 5,818

Rep: Reputation: 1004Reputation: 1004Reputation: 1004Reputation: 1004Reputation: 1004Reputation: 1004Reputation: 1004Reputation: 1004
As far as downloading a specific directory, I thought about the same thing a while ago but never really tried it out.

Found this link, and it works pretty well. You just need to edit the command arguments to fit your needs. As far as the filetypes are concerned, it pretty much explains how to do it.


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
How to Copy files from local directory to a particular directory using alias dynamics Linux - Newbie 7 09-11-2009 05:19 PM
wget, web crawler, web spider and web archiving beckettisdogg Linux - Newbie 1 08-16-2009 08:27 AM
How to copy files after search in array from this directory to another directory! phanvinhgiap Programming 4 01-04-2009 07:48 PM
Using wget to copy large amounts of data via ftp. AndrewCAtWayofthebit Linux - General 1 05-11-2006 12:55 PM
Using wget to copy entire ftp directory stuartmunro Linux - Newbie 7 06-17-2005 08:06 PM > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 02:13 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration