LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 02-17-2011, 12:49 AM   #1
peragrate
LQ Newbie
 
Registered: Sep 2008
Posts: 3

Rep: Reputation: 0
wget copy web directory


Hi,

I know there are posts on copying entire websites with Wget (Linux), but how do I copy a particular directory only. For example, if I'm at a website that offers free eBooks and the url looked like this:

www.ebooks.com/romance (I made this url up)

How can I tell Wget to:
1) Copy only what is in the directory 'romance'
2) Copy the HTML files first
3) specify which filetypes to include in the download.

I have a few other questions:
1) Is it possible to increase the timeout?
2) Is it possible to set an option for resume?

Thanks, and sorry if this is a repeat. If it is, perhaps you could point to the url covering the topic. I did a search in the newbie section before posting this.

Please don't suggest Webhttrack...thanks.
 
Old 02-17-2011, 01:07 AM   #2
corp769
LQ Guru
 
Registered: Apr 2005
Posts: 5,817

Rep: Reputation: 1002Reputation: 1002Reputation: 1002Reputation: 1002Reputation: 1002Reputation: 1002Reputation: 1002Reputation: 1002
As far as downloading a specific directory, I thought about the same thing a while ago but never really tried it out.

http://www.linux.com/community/blogs...directory.html

Found this link, and it works pretty well. You just need to edit the command arguments to fit your needs. As far as the filetypes are concerned, it pretty much explains how to do it.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How to Copy files from local directory to a particular directory using alias dynamics Linux - Newbie 7 09-11-2009 05:19 PM
wget, web crawler, web spider and web archiving beckettisdogg Linux - Newbie 1 08-16-2009 08:27 AM
How to copy files after search in array from this directory to another directory! phanvinhgiap Programming 4 01-04-2009 07:48 PM
Using wget to copy large amounts of data via ftp. AndrewCAtWayofthebit Linux - General 1 05-11-2006 12:55 PM
Using wget to copy entire ftp directory stuartmunro Linux - Newbie 7 06-17-2005 08:06 PM


All times are GMT -5. The time now is 06:26 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration