shell script help

cojo · 08-22-2007, 04:21 PM

I wrote this script to automate a daily FTP download with cron job. The script work when I run it manually. But, it won't execute anything from gpg portion of the script when it's run by cron job. Any suggestions?

Here is my sript:

#!/bin/bash
cd /var/tmp/BOA_Downloads
HOST="ftp4.bankofamerica.com"
USER="FTP_Username"
PASSWD="FTP_Password"
FILE="BISTATE"
DATE=`date +%m%d%y`
ftp -n -v $HOST << EOT
binary
user $USER $PASSWD
prompt
mget $FILE
bye
bye
EOT
mv $FILE $FILE$DATE
echo m3tr0b0@ | gpg --passphrase m3tr0b0@ --output /var/tmp/BOA_Decrypt/$FILE$DATE --decrypt $FILE$DATE
cp /var/tmp/BOA_Decrypt/$FILE$DATE /var/tmp/$FILE$DATE.dat
scp /var/tmp/BOA_Decrypt/$FILE$DATE root@bsdacore10:/var/tmp/BOA_Decrypt/

Please help.....John

cgjones · 08-22-2007, 04:58 PM

Are you using the system crontab, or the crontab of a specific user?

cojo · 08-22-2007, 05:00 PM

crontab under root

cgjones · 08-22-2007, 05:14 PM

I assume that when you run the script manually, you run it as your normal user?

unSpawn · 08-22-2007, 06:03 PM

How about splitting up stuff? I mean the grabbing and distributing stuff can be run unattended from a cronjob. Then you can do the decrypting when you're at the console. Putting the PGP passphrase in a script is a hazard itself and defeats any encryption purposes (IMNSHO).

cojo · 08-23-2007, 11:44 PM

cgjones,

I'm actually running this script as root.

unSpawn,

unfortunately, this is a daily job and our business unit want this run automatically. I know run gpg passphrase in a script is not a great idea. But, this server is sitting inside 2 layers of Cisco firewall and I have iptables running on it.

colucix · 08-24-2007, 03:41 AM

Probably from crontab, it can't find the PATH to gpg command, since by default the crontab environment has a very limited PATH. You can check this by simply executing (from crontab) a

Code:

echo $PATH > somefile

Also you can check with the mail command, if you have received some error message from the crontab job. All this stuff on linux can be set in the crontab file. See

Code:

man 5 crontab

for details (look for setting MAILTO and PATH variables).

cojo · 08-29-2007, 09:54 PM

colucix,

I put in the whole path and still no luck with the job. I'm not getting any error log either.

colucix · 08-30-2007, 08:06 AM

What exactly does not work? Can't you find any of the created/copied/s-copied files? As a further debug option you can add -x to the first line

Code:

#!/bin/bash -x

This will give the execution trace. Then redirect standard error and standard output to a file directly in the crontab job, e.g

Code:

05 15 * * * $HOME/theScript.sh > $HOME/logfile 2>&1

You can post the output here, if you don't mind. Cheers!

nan0meter · 08-30-2007, 08:37 AM

Code:

#!/bin/bash
HOST="ftp4.bankofamerica.com"
USER="FTP_Username"
PASSWD="FTP_Password"
FILE="BISTATE"
DATE=`date +%m%d%y`
LOG="/var/log/boa_cron.log"

echo "[$DATE] Moving to directory: /var/tmp/BOA_Downloads" > $LOG

cd /var/tmp/BOA_Downloads

echo "[$DATE] Moving to directory /var/tmp/BOA_Downloads: done" > $LOG
echo "[$DATE] Downloading files from $HOST" > $LOG

ftp -n -v $HOST << EOT
binary
user $USER $PASSWD
prompt
mget $FILE
bye
bye
EOT

echo "[$DATE] Downloading file from $HOST: done" > $LOG
echo "[$DATE] Moving file..." > $LOG

mv $FILE $FILE$DATE

echo "[$DATE] Moving file: done" > $LOG

echo "[$DATE] Decrypting..." > $LOG
echo m3tr0b0@ | gpg --passphrase m3tr0b0@ --output /var/tmp/BOA_Decrypt/$FILE$DATE --decrypt $FILE$DATE

echo "[$DATE] Decrypting: done" > $LOG
echo "[$DATE] Copying decrypted file..." > $LOG

cp /var/tmp/BOA_Decrypt/$FILE$DATE /var/tmp/$FILE$DATE.dat

echo "[$DATE] Copying decrypted file: done" > $LOG
echo "[$DATE] Copying decrypted file to root@bsdacore10" > $LOG

scp /var/tmp/BOA_Decrypt/$FILE$DATE root@bsdacore10:/var/tmp/BOA_Decrypt/

echo "[$DATE] Copying decrypted file: done" > $LOG
echo " --- " > $LOG

As you can see i modified the code with debug messages that he logs in $LOG (/var/log/boa_cron.log). Be sure to run this as root else you might not create the log files.

Now try to execute it in cron and see if it puts any output in /var/log/boa_cron.log. If it doesn't then it doesn't execute the script (properly).

As posted above, you can also try to run this script with bash -x but i didn't include it in this one.

cojo · 09-06-2007, 04:58 PM

thanks nan0meter. I will modified my script and see what the log have to said tomorrow.