LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 03-25-2013, 08:12 PM   #1
tuananh87vn
LQ Newbie
 
Registered: Mar 2009
Posts: 19

Rep: Reputation: 0
Automatic Incremental backup solution on Linux


Hi all,

I've started exploring and administrating a Linux (CentOS) server. So far I have been doing backup for server only by compressing files and directories and download them to local disks, on a daily routine.

That's manual, and it sucks because it eats a lot of disk space. Data is growing bigger and i'm not rich enough to raise it this way.

Now i'm looking for a solution that can perform backup incrementally, which means only changes will be backed up. But we can choose to return any point in the past (like Windows's restore point and MAC's time machine).

The two main things to do put in the backup file are the system configurations (users, networks, ..) and/or all or specific directories and files (/var, /home, ...)

As i googled, i found something about RSYNC, but am not sure if it can do as I expect.

If anybody here has experience with this, please let me know

Thanx a lot!
 
Old 03-25-2013, 08:31 PM   #2
273
LQ Addict
 
Registered: Dec 2011
Location: UK
Distribution: Debian Sid AMD64, Raspbian Wheezy, various VMs
Posts: 6,734

Rep: Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918Reputation: 1918
This is just my opinion but anything which is not a complete bit-for-bit backup is not a backup. There are lots of clever things out there but if the data isn't there it's not there.
A proper backup is off site.
How much is the data worth? If the building burns down is the business dead already?
 
Old 03-25-2013, 09:21 PM   #3
tuananh87vn
LQ Newbie
 
Registered: Mar 2009
Posts: 19

Original Poster
Rep: Reputation: 0
Quote:
Originally Posted by 273 View Post
This is just my opinion but anything which is not a complete bit-for-bit backup is not a backup. There are lots of clever things out there but if the data isn't there it's not there.
A proper backup is off site.
How much is the data worth? If the building burns down is the business dead already?
Thanks,

You're right. But while our business is in small size, I'm thinking about a backup strategy like doing a full backup per week or fortnight, and do it everyday on an incremental basis.

Btw, we're running Kloxo, any application specific backup method for it?
 
Old 03-25-2013, 11:21 PM   #4
nagabhushan
LQ Newbie
 
Registered: Mar 2012
Posts: 16

Rep: Reputation: 0
I suggest Bacula or Amanda. Go through the links below -
http://www.amanda.org/
http://www.bacula.org/en/
 
Old 03-26-2013, 03:23 AM   #5
mddnix
Member
 
Registered: Mar 2013
Distribution: Redhat, Ubuntu
Posts: 525

Rep: Reputation: 141Reputation: 141
You can take incremental backup from 'tar' too, and its also very efficient. All you have to do is take a full backup first and incremental backups later whenever you want. The incremented backup contains only the files that have been changed since full backup. You can also automate it by using cron.
  1. Take full backup with snapshot file.
    • # tar -czvg /backup/snapshot-file -f /backup/full-backup.tar.gz /home /var

  2. And then take incremental backup whenever you want.
    • # tar -czvg /backup/snapshot-file -f /backup/monday-backup.tar.gz /home /var

  3. To restore backup, untar from first file
    • # tar -xzvf /backup/full-backup.tar.gz
    • # tar -xzvf /backup/monday-backup.tar.gz

Last edited by mddnix; 03-26-2013 at 05:54 AM.
 
Old 03-26-2013, 10:31 AM   #6
lleb
Senior Member
 
Registered: Dec 2005
Location: Florida
Distribution: CentOS/Fedora
Posts: 2,630

Rep: Reputation: 495Reputation: 495Reputation: 495Reputation: 495Reputation: 495
Quote:
Originally Posted by nagabhushan View Post
I suggest Bacula or Amanda. Go through the links below -
http://www.amanda.org/
http://www.bacula.org/en/
these are great options as is rsync. I personally prefer rsync as that is exactly what it was created for. use the tool that does the job right.

Amanda and Bacula both use rsync IIRC for their backups as well as the option for compression.

If you are backing up the data INTO the server that is not a backup as if you lose the HDDs or any other part of the server you are done for. Invest in a NAS worst case senario and backup the data to the NAS.

Typically when I backup via rsync ill create day of the week folder names and perform full backups into the appropriate DOW folder. the beauty of rsync is that it will perform the full update the first time, then incremental after that into those days keeping seven days worth of data. If you need longer, say 30 days worth, then you might want to go with date vs DOW for folder names and what not. either way you can have complete control over the amount of data you store.
 
Old 03-26-2013, 10:46 AM   #7
TenTenths
Senior Member
 
Registered: Aug 2011
Location: Dublin
Distribution: Centos 5 / 6 / 7
Posts: 2,401

Rep: Reputation: 860Reputation: 860Reputation: 860Reputation: 860Reputation: 860Reputation: 860Reputation: 860
We use dirvish to take nightly backups of servers on to a single server and from there on to tape.

Dirvish is nice as it makes use of rsync and also gives us a (very!) basic versioning system to allow us to recover previous versions when the finance department mangle their spreadsheets.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
incremental backup in linux dinakumar12 Linux - Server 22 10-13-2010 01:13 AM
Incremental backup Ammad Linux - Software 2 02-22-2008 03:41 PM
incremental/differencial backup solution... IcoNyx Linux - Server 6 08-22-2007 08:12 AM
Looking for incremental backup solution. wbuik Linux - Server 5 09-19-2006 04:56 PM
incremental backup .... redrobin77 Linux - Software 1 01-31-2006 05:29 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 06:50 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration