LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 01-17-2007, 12:38 PM   #1
jimmyjiang
Member
 
Registered: Jun 2006
Posts: 132

Rep: Reputation: 15
need advise for new backup software


I need to find some backup software to save some of data offsite. We have a new server with a lot of space set up in a new data center and we need to find some software that will let us save some data to it remotely. Here are the requirements for the software.
-scp from linux
-scp from windows
-email notifications
-scheduling
-compress before sending

if anyone know some good backup software ,please let me know.
thanks!
 
Old 01-17-2007, 01:12 PM   #2
ramram29
Member
 
Registered: Jul 2003
Location: Miami, Florida, USA
Distribution: Debian
Posts: 848
Blog Entries: 1

Rep: Reputation: 47
Most admins I know simply write their own scripts to do this. Linux Backup Software is kind of an oximoron; unless you are backing up Windows' registry and locked files, then you'll need special software for that.
 
Old 01-17-2007, 02:36 PM   #3
jimmyjiang
Member
 
Registered: Jun 2006
Posts: 132

Original Poster
Rep: Reputation: 15
do you have such kind scripts I can reference?
 
Old 01-17-2007, 03:36 PM   #4
trickykid
LQ Guru
 
Registered: Jan 2001
Posts: 24,149

Rep: Reputation: 269Reputation: 269Reputation: 269
If you want to write your own scripts, use rsync.

If you need some prebuilt application to handle scheduling, notifications and such, might want to check out bacula and or amanda.
 
Old 01-17-2007, 10:44 PM   #5
TongueTied
Member
 
Registered: Aug 2003
Distribution: SuSE 8.1 pro
Posts: 94

Rep: Reputation: 15
rsync is probably best particularly if you are doing offsite incremental backup.
 
Old 01-17-2007, 10:57 PM   #6
ramram29
Member
 
Registered: Jul 2003
Location: Miami, Florida, USA
Distribution: Debian
Posts: 848
Blog Entries: 1

Rep: Reputation: 47
Quote:
Originally Posted by jimmyjiang
do you have such kind scripts I can reference?
Basically you can create tarballs and copy it over to a remote computer or external USB drive. Unlike Windows, tar copies most files even if they are locked. google 'Linux backup scripts'. You may want to get yourself familiar with writing bash scripts.
 
Old 01-17-2007, 11:11 PM   #7
TongueTied
Member
 
Registered: Aug 2003
Distribution: SuSE 8.1 pro
Posts: 94

Rep: Reputation: 15
Why would you use tarballs? Wouldn't running rsync be enough? I admit that I am not doing offsite with rsync right now but I run rsync in a script to back everything up daily to a removable harddrive. The first time it took hours to back up the server this way (about 70gb worth) but the daily routine takes only 5 minutes now. If tarballs were used, I would think the total process time would increase (ie first make the tarballs, then rsync to external site or drive and since the tarball changed, the whole thing would need to be transfered). Would that be correct?
 
Old 01-17-2007, 11:25 PM   #8
ramram29
Member
 
Registered: Jul 2003
Location: Miami, Florida, USA
Distribution: Debian
Posts: 848
Blog Entries: 1

Rep: Reputation: 47
Quote:
Originally Posted by jimmyjiang
do you have such kind scripts I can reference?
Basically you need to put into a script what you would type in the command line in order to backup your data. Google 'Linux backup scripts'
 
Old 01-18-2007, 01:45 AM   #9
TongueTied
Member
 
Registered: Aug 2003
Distribution: SuSE 8.1 pro
Posts: 94

Rep: Reputation: 15
For an rsync script, here is what I use. Now, this is for backup to a removable harddrive, not a external site. If you search on the internet or check out http://samba.anu.edu.au/rsync/ you can figure out how to make this an off site backup.

Code:
#Backup-Script-0.1.sh
#First mount the drive to the /backup folder
mount /dev/sda2 /backup/

#Now the actual rsync call

sudo rsync -av --exclude-from=/path-to-where-my-script-lives/Backup-exclude --delete // /backup/

# Unmount the external drive
umount /dev/sda2
The exclude section ensures that some files aren't backedup. Note, the directory "/backup/" is in the excludes because that is where I mount the external harddrive during the backup.

Code:
### Backup-exclude
### transient directories - contents
### tmp ###
+ tmp/
- **/tmp/**
### transient ###
+ /proc/
- /proc/**
+ /mnt/
- /mnt/**
+ /dev/
- /dev/**
+ /media/
- /media/**
+ /backup/
- /backup/**
+ /sys/
- /sys/**
### obj ###
# kernel build
- usr/src/**.o
# special library .o (may be RH specific?)
+ usr/*/lib/**.o
+ usr/lib/**.o
# all others
- *.o
### backup ###
- *~
This isn't by any means perfect but it has worked quite well so far. Much of this I got from this site. I can't find the thread where it was but it is here somewhere.
 
Old 01-18-2007, 05:42 AM   #10
trickykid
LQ Guru
 
Registered: Jan 2001
Posts: 24,149

Rep: Reputation: 269Reputation: 269Reputation: 269
Quote:
Originally Posted by TongueTied
Why would you use tarballs? Wouldn't running rsync be enough? I admit that I am not doing offsite with rsync right now but I run rsync in a script to back everything up daily to a removable harddrive. The first time it took hours to back up the server this way (about 70gb worth) but the daily routine takes only 5 minutes now. If tarballs were used, I would think the total process time would increase (ie first make the tarballs, then rsync to external site or drive and since the tarball changed, the whole thing would need to be transfered). Would that be correct?
I'd agree not using tarballs every single day. That's just making daily full backups which takes up space.

In my own setup for my personal servers, I have a full weekly script that creates larger tarballs and all other days I have an rsync script that makes the incremental changes.
 
Old 01-18-2007, 11:17 AM   #11
ramram29
Member
 
Registered: Jul 2003
Location: Miami, Florida, USA
Distribution: Debian
Posts: 848
Blog Entries: 1

Rep: Reputation: 47
Quote:
Originally Posted by TongueTied
Why would you use tarballs? Wouldn't running rsync be enough?
rsync stands for remote sync and it does not compress. rsync is better for small non-compressed backups of a few megabytes, but it is not good by itself for full backups of 70GB; then you'll need to compress. rsync is designed to syncronize files in separate systems. Hence the 'sync' in the name. tar stands for Tape Archiver. It was created decades ago exclusively for backing up to tape on Unix systems.

For daily differential or incremental backups use 'find' and 'tar'.
With find you can discover all the files that are less than one day old or less than a week old then you pipe it onto tar to compress and store the tarball onto a remote drive or tape. That's the way most guru's do it.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Linux backup software and drive mirroring software csross Linux - Software 1 12-26-2007 06:59 PM
Advise for storage control software mijohnst Linux - Hardware 2 11-30-2005 10:34 AM
backup software klintonray Linux - Software 3 04-11-2003 04:27 PM
Backup Software. Which way do I go? BigP Linux - Software 10 03-13-2003 02:39 PM
Backup software limested Linux - Software 3 01-08-2003 03:04 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 04:22 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration