Share your knowledge at the LQ Wiki.
Go Back > Forums > Linux Forums > Linux - Newbie
User Name
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!


  Search this Thread
Old 03-08-2005, 05:58 PM   #1
Registered: Aug 2003
Distribution: Slackware 10.1
Posts: 113

Rep: Reputation: 15
how to copy entire website using linux

I am going back to my country where internet access is moniter closely and I don't think they would allow linux web site(probably anti-linux goverment);People say that in order to view a site you have to ask permission from offical and then they 'll allow to view it and open the firewall just to view that site to your home only(weird ,I know).And I was thinking about copying some site which I might find useful and I wanted to known which software and how do I copy entire web site for offline broswing.Doing save as whole pages take a lot of times.
Any tool that would allow to copy it in a click or any tool in kde or gnome that alreay is but I still haven't know about it?
Old 03-08-2005, 06:11 PM   #2
Registered: Jan 2004
Location: cheshire, uk
Distribution: Ubuntu Hoary
Posts: 605

Rep: Reputation: 33

the easiest way i have found is to open a console and use the 'wget' command. In the most basic case, you'd want to create a directory in which you want to download the site's files, go into that directory, then issue -

wget -r http://www.sitename...
this will recursively traverse the entire site and download its content. i'd advise you to look at the wget manual page and adjust any options to suit the particular site you wish to grab (recursion depth in particular might need to be adjusted - it defaults to 5)

hope this helps.
Old 03-08-2005, 06:15 PM   #3
Bruce Hill
HCL Maintainer
Registered: Jun 2003
Location: McCalla, AL, USA
Distribution: Arch, Gentoo
Posts: 6,939

Rep: Reputation: 129Reputation: 129
Re: how to copy entire website using linux

Originally posted by ngan_yine
I am going back to my country where internet access is moniter closely
I don't know which country this is, but can only
guess from your name. There is a government
firewall in the country where I live, and we use
proxy servers to bypass this firewall to view
Old 03-09-2005, 05:04 PM   #4
Registered: Aug 2003
Distribution: Slackware 10.1
Posts: 113

Original Poster
Rep: Reputation: 15
Thanks for the replies guys,I never knew we could download websites with wgets;I'd been downloading ebooks and some linux How-To from web-sites and wget -rnp command is the best;I don't even have to download entire websites.That is really cool ,thanks for the tips;By the way chinaman,I wouldn't bypass govement firewall even it if I can because if they found out they could put me in prison for 15 years or more.If you own an illegal fax machine you could do same amout of times.I am from the country that is near your ID (chaninman),There is more chance of getting away with murder and rape than reading foribidden substances in my country.Anyway thanks for the tip ,I have been downloading most all the ebooks from computer and other subjects books are hard to get by in my country;
Thanks you all


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
How to copy an entire directory structure except certain files? thanhvn Programming 9 01-27-2012 12:41 PM
Copy an entire install to second harddisk seriesx4 Linux - General 7 10-13-2005 12:44 PM
Using wget to copy entire ftp directory stuartmunro Linux - Newbie 7 06-17-2005 08:06 PM
is there a linux program that downloads an entire website? lemuel Linux - Software 10 01-06-2005 03:10 AM
is it possible to copy an entire fc2 system to another disk? parv Fedora 8 09-20-2004 07:04 PM > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 12:35 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration