LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices

Reply
 
LinkBack Search this Thread
Old 03-08-2005, 04:58 PM   #1
ngan_yine
Member
 
Registered: Aug 2003
Distribution: Slackware 10.1
Posts: 113

Rep: Reputation: 15
how to copy entire website using linux


Hi
I am going back to my country where internet access is moniter closely and I don't think they would allow linux web site(probably anti-linux goverment);People say that in order to view a site you have to ask permission from offical and then they 'll allow to view it and open the firewall just to view that site to your home only(weird ,I know).And I was thinking about copying some site which I might find useful and I wanted to known which software and how do I copy entire web site for offline broswing.Doing save as whole pages take a lot of times.
Any tool that would allow to copy it in a click or any tool in kde or gnome that alreay is but I still haven't know about it?
 
Old 03-08-2005, 05:11 PM   #2
kevinatkins
Member
 
Registered: Jan 2004
Location: cheshire, uk
Distribution: Ubuntu Hoary
Posts: 605

Rep: Reputation: 31
hi,

the easiest way i have found is to open a console and use the 'wget' command. In the most basic case, you'd want to create a directory in which you want to download the site's files, go into that directory, then issue -

Code:
wget -r http://www.sitename...
this will recursively traverse the entire site and download its content. i'd advise you to look at the wget manual page and adjust any options to suit the particular site you wish to grab (recursion depth in particular might need to be adjusted - it defaults to 5)

hope this helps.
 
Old 03-08-2005, 05:15 PM   #3
Bruce Hill
HCL Maintainer
 
Registered: Jun 2003
Location: Tupelo, MS
Distribution: Gentoo
Posts: 6,926

Rep: Reputation: 124Reputation: 124
Re: how to copy entire website using linux

Quote:
Originally posted by ngan_yine
I am going back to my country where internet access is moniter closely
I don't know which country this is, but can only
guess from your name. There is a government
firewall in the country where I live, and we use
proxy servers to bypass this firewall to view
websites.
 
Old 03-09-2005, 04:04 PM   #4
ngan_yine
Member
 
Registered: Aug 2003
Distribution: Slackware 10.1
Posts: 113

Original Poster
Rep: Reputation: 15
Thanks for the replies guys,I never knew we could download websites with wgets;I'd been downloading ebooks and some linux How-To from web-sites and wget -rnp command is the best;I don't even have to download entire websites.That is really cool ,thanks for the tips;By the way chinaman,I wouldn't bypass govement firewall even it if I can because if they found out they could put me in prison for 15 years or more.If you own an illegal fax machine you could do same amout of times.I am from the country that is near your ID (chaninman),There is more chance of getting away with murder and rape than reading foribidden substances in my country.Anyway thanks for the tip ,I have been downloading most all the ebooks from
http://freebooks.by.ru/ computer and other subjects books are hard to get by in my country;
Thanks you all
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
How to copy an entire directory structure except certain files? thanhvn Programming 9 01-27-2012 11:41 AM
Copy an entire install to second harddisk seriesx4 Linux - General 7 10-13-2005 11:44 AM
Using wget to copy entire ftp directory stuartmunro Linux - Newbie 7 06-17-2005 07:06 PM
is there a linux program that downloads an entire website? lemuel Linux - Software 10 01-06-2005 02:10 AM
is it possible to copy an entire fc2 system to another disk? parv Fedora 8 09-20-2004 06:04 PM


All times are GMT -5. The time now is 03:33 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration