shell scripting - help needed

jonhewer · 08-23-2005, 10:03 AM

ok thanks

tomj88 · 08-23-2005, 10:12 AM

Ok setting up a cron task for it... if I wanted it to run a 21:00 everyday, would it be:
00 21 * * * root /root/mysqlbackup.sh
I can't remember whether the clock is in 24 hour format...

tomj88 · 08-23-2005, 10:20 AM

I modified the code slightly so it doesn't use ftp (because I don't have a ftp server to dump the data to), and added variables that are slightly easier to change, except it is now asking me everytime for a password even though I have added a variable for password. See if you can figure it out (I'm sure it's a noobish error). Here you go anyway:

Code:

#!/bin/sh

#backup directory
cd /var/backup

#date in format yyyy-mm-dd
date=`date -I`


mysqluname="your user"
mysqlpass="your pass"
mysqldb="your database"


echo "Backup: $date" >> backuplog

echo "Dumping MySQL data..." >> backuplog

#dumps database table structures and data into file backup-yyyy-mm-dd.sql
mysqldump -u $mysqluname -p $mysqlpass $mysqldb > backup-$date.sql 2>>backuplog

#check if this file exists and is not empty, as an with mysqldump in the command above
# will result in creating an empty file
if [ -s backup-$date.sql ]
then
	echo "MySQL dump successful." >> backuplog
	#remove files beginning with backup- which are older than 7 days
	find /var/backup -name "backup-*" -mtime +7 -exec rm -v '{}' \;
else
	echo "MySQL dump failed." >> backuplog
	echo "MySQL dump failed."
fi

echo "" >> backuplog

exit 0

jonhewer · 08-23-2005, 10:20 AM

thanks, i'll test that out 2moro

now to modify my code to make it email the backup status to someone.....

jonhewer · 08-23-2005, 10:28 AM

how would i use a variable to build up the log message, appending data at different points? i can't think how to do this..

then i can write the variable contents to the log file in one go, and also email it to someone

thanks

tomj88 · 08-23-2005, 10:28 AM

I haven't got a clue (new to shell scripting).

For the email I suppose you could just use sendmail, but I don't really know how to use this

I will have a quick look, but I'm guessing all that needs to be done is a simple message (backuplog?) and an attachment (the .sql file). Maybe try compressing the sql file? Would be useful on large databases...

jonhewer · 08-23-2005, 10:31 AM

ok no worries, i'll google it

thanks for the suggestions.

tomj88 · 08-23-2005, 10:33 AM

sendmail your@email.com < /var/backup/backup-$date.sql

Will that do for the emailing the backup to someone?

jonhewer · 08-23-2005, 10:35 AM

i'll try that out later (i'm off home now) thanks again for your help - i'll get back to you with any further improvements i make

jonhewer · 08-24-2005, 04:50 AM

i decided to use mail instead of sendmail because you can specify the email subject using -s flag, with sendmail u'd need to actually include teh necessary headers in the email

i now have two log files, one is the entire log, and the other is the most recent log entry - this file is appended to the entire log and emailed as the message body. while having a second log like this is a little messy, its the only way i can think of doing this

fotoguy · 08-24-2005, 06:31 AM

I too have something similar and need some help with. I making a small script for backing up to a directory and burning to a cdrom and I'd like it to keep the backups around for seven days before deleting, who would i use in my script:

find /var/backup -name "backup-*" -mtime +7 -exec rm -v '{}' \;

I'm a noob when it comes to programming here's my script if someone can help

#!/bin/bash
#
Backup_Dirs="/tempinst" # eg. /etc /usr/local /opt /var /root /boot
Backup_Dest_Dir=/tmp/backup
Backup_Date=`date +%b%d%Y`
Speed=8 # Use best speed for CD-R/RW disks on YOUR system

# Check to see of backup directory exists, if not then create it

if [ ! -d $Backup_Dest_Dir ]; then
{
mkdir $Backup_Dest_Dir;
}
else
{
echo "Backup Directory already exists";
}
fi

# Create tar file with todays Month Day Year prepended for easy identification

tar -cvzf $Backup_Dest_Dir/$Backup_Date.tar.gz $Backup_Dirs > $Backup_Dest_Dir/backup_$Backup_Date.log
echo "Create $Backup_Date.img including log file"

# Create a image that can be written to writeable media

mkisofs -r -o $Backup_Dest_Dir/$Backup_Date.img $Backup_Dest_Dir/$Backup_Date.tar.gz $Backup_Dest_Dir/backup_$Backup_Date.log

# Check size of directory to burn in MB

Size=`du -m $Backup_Dest_Dir/$Backup_Date.img | cut -c 1-3`
if [ $Size -lt 680 ];then
{
echo "Size of $Backup_Date.img is $Size MB, OK to Burn";
}
else
{
echo "Size of $Backup_Date.img too Large to burn too CD-R....Maybe time for DvD Burner";
exit1
}
fi

# Burn the CD-RW

echo "Burning back-up to disc."
cdrecord dev=ATAPI:0,1,0 -v -eject fs=64M driveropts=burnproof speed=$Speed -tao $Backup_Dest_Dir/$Backup_Date.img
echo "Successfully backed-up $Backup_Date.img to cd-r/rw"

exit 0

jonhewer · 08-24-2005, 07:13 AM

Code:

find /var/backup -name "backup-*" -mtime +7 -exec rm -v '{}' \;

find is a tool used to search for files - i will explain what the above command does:

/var/backup is the base directory to search in

-name "backup-*" means i want all files beginning with backup-

-mtime +7 matches files last modified more than 7 days ago

-exec rm-v '{}' \; deletes the files, -v for verbose

this is all explained in the manual

HTH

tomj88 · 08-24-2005, 09:32 AM

Would you be interested in writing something similar to this in python? I have never wrote anything in it before and would like to learn, so it seems like a nice project to start on. How good are you at writing in python Jon? And thanks for the tip about using mail! Just changed the sendmail line to mail -s "mysql backup" tom@tomj.sytes.net < /var/backup/backup-$date.sql and it works perfectly!

jonhewer · 08-24-2005, 09:43 AM

i've only recently started learning python - i started writing a very basic rss reader which grabs the rss file, downloads it, parses it and outputs some of the data, but i've got a bit bored of that now

i may well write a similar script in python, depends really if i am set any more work for my last week at my internship i'm currently doing (and for which i am writing this script to backup the database backend of my project), or if i have some free time.

i have a python network programming book at home which covers ftp, and i have some knowledge already of reading and writing to files.

tomj88 · 08-24-2005, 09:53 AM

I've still got 3 weeks left before I go back to school hehe... starting my computing course in 6th form then, and the school has just purchased visual basic .net

.... but I believe we can use c, c++ and other languages, let's hope that I can use something other than vb.net haha