Backup Script from Multiple Drives to one Big Drive

robinhood1995 · 03-26-2005, 04:08 AM

Hi All,

I didn't know if this would be usful to anyone but I made a script to backup three drive onto one 200gig drive.

Code:

#!/bin/bash
###############################################################################
#
# Weekly Backup Script for Liunx box
# This will copy all files to another drive
#
###############################################################################
#
#Set the Date for the file
DATE=`date +%F_%H%M%S`
INSTALL_DIR=/u2/back
LOGS=/u2/back
LOGNAME=Weekly_backup_$DATE.log
EXCLUDES=backup_exclude
STORAGE=/u3/osbkup
#
# This cd to the root folder
cd /
# This mounts the drive
mount /dev/hdb1 /u3
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" > $LOGS/$LOGNAME
echo -e "Started the Daily backup `date`" >> $LOGS/$LOGNAME
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
echo -e " "
#
###############################################################################
#
# This will make copy on the drive
#
# This is the root section "The -vaux commant is to stay in one file system 
# and only update the file that are newer
cp -vaux /bin /boot /etc /ftp /home /initrd /KIWI /lib /misc /mnt /opt /root /sbin /tftpboot /tmp /usr /var /u3/osbkup/ >> $LOGS/$LOGNAME
cd /u
cp -vaux /u/* /u3/osbkup/u/ >> $LOGS/$LOGNAME
cd /u2
cp -vaux /u2/* /u3/osbkup/u2/ >> $LOGS/$LOGNAME
#
echo -e " "
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
echo -e "Ended the Daily backup `date`" >> $LOGS/$LOGNAME
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
echo -e " "
#
###############################################################################
#
#This will list out the files to a log file.
#
echo -e "Creating the Daily backup file list `date`" >> $LOGS/$LOGNAME
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
echo -e " "
ls -l $STORAGE/* >> $LOGS/$LOGNAME.txt
echo -e " "
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
echo -e "Ended the Daily backup file list `date`" >> $LOGS/$LOGNAME
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
echo -e "Stopped the Daily backup `date`" >> $LOGS/$LOGNAME
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
chmod 666 $LOGS/$LOGNAME
#
echo -e "Emailed the Daily backup results `date`" >> $LOGS/$LOGNAME
echo -e "+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++" >> $LOGS/$LOGNAME
#
# This emails that user
/usr/bin/mutt "" -a $LOGS/$LOGNAME.txt -a $LOGS/$LOGNAME -s "Daily Backup Log" johndoe@whereever.com < /dev/null
#
# This unmounts the drive
umount /u3
#
##############################################################################

macemoneta · 03-26-2005, 05:58 AM

Consider using rsync instead of 'cp'. Since most of the content that you are copying will not change between backups, rsync will be much faster (it only copies changes). You also have additional controls, allowing remote copy via ssh, and bandwidth limiting, for example. Rsync isn't just for remote use.

For example, instead of:

cp -vaux /bin /boot /etc /ftp /home /initrd /KIWI /lib /misc /mnt /opt /root /sbin /tftpboot /tmp /usr /var /u3/osbkup/ >> $LOGS/$LOGNAME

Use:

/usr/bin/rsync -av --delete /bin /boot /etc /ftp /home /initrd /KIWI /lib /misc /mnt /opt /root /sbin /tftpboot /tmp /usr /var /u3/osbkup/ >> $LOGS/$LOGNAME

robinhood1995 · 03-26-2005, 09:31 AM

Quote:

Originally posted by macemoneta
/usr/bin/rsync -av --delete /bin /boot /etc /ftp /home /initrd /KIWI /lib /misc /mnt /opt /root /sbin /tftpboot /tmp /usr /var /u3/osbkup/ >> $LOGS/$LOGNAME

Hi macemoneta,

My drives are local so not really any bandwithd required. But I thought that "rsync" was only used for remote or samba connections is this correct?

Thanks

trickykid · 03-26-2005, 09:47 AM

Moved: More suitable in our Success Stories forum.

macemoneta · 03-26-2005, 10:33 AM

Quote:

Originally posted by robinhood1995
Hi macemoneta,

My drives are local so not really any bandwithd required. But I thought that "rsync" was only used for remote or samba connections is this correct?

Thanks

No, rsync can copy files locally as well. I use it almost exclusively for moving large media files, with the "--progress" option to see estimated time to completion, and '--partial', so that I can interrupt the operation and complete it later if needed (picking up where it left off). It's also comforting to know that the source and destination are verified the same. The extra speed (when updating) doesn't hurt either.

I have an alias defined for interactive use:

alias rsync='/usr/bin/rsync -av --progress --partial'

You certainly don't need to use a bandwidth limit when copying to an external drive, however, if that drives is also used for other concurrent purposes, limiting bandwidth can be beneficial. For example, if the drive is used to store and playback music/movies, monopolizing the bandwidth can cause "stuttering" playback. You could then use the bandwidth limit to leave adequate bandwidth for media streaming. For example:

/usr/bin/rsync -av --delete --bwlimit=5000 ... ...

This will keep rsync to about 5MB/sec.

robinhood1995 · 03-26-2005, 06:17 PM

Quote:

Originally posted by macemoneta
This will keep rsync to about 5MB/sec.

Thanks,

Will try it out...