[SOLVED] schedule a bash script to move recent/latest dump files from server(rhel 5.7) system to another system(rhel 7.5)

edpksrtc · 02-19-2020, 05:27 AM

hello all,

i am a newbie in Linux OS , hence need help in below problem.

i have below bash script where i have been taking whole sys user oracle backup and storing it in server itself.

ie,

#!/bin/bash
# file : /home/oracle/app/expbkp_TESTONE.sh
# description : run export backup to localdisk
##########################
##### Variables #######
##########################
RUNTIME=`date '+%H%M_%d%m%Y'`
RUNDATE=`date '+%d%m%Y'`
export LD_LIBRARY_PATH=/home/oracle/app/oracle/product/11.2.0/dbhome_1/lib
export ORACLE_SID=oracle
export ORACLE_HOME=/home/oracle/app/oracle/product/11.2.0/dbhome_1
export PATH=$PATH:${ORACLE_HOME}/bin
# start the Export backup
expdp "/ as sysdba" directory=EXP_IMP_DIR dumpfile=${ORACLE_SID}_tmk_${RUNTIME}.dmp logfile=${ORACLE_SID}_tmk_${RUNTIME}.log full=y
#########################################################################
#Removing 3 days old dump files
find /home/oracle/expdp_impdp_oracle -mtime +2 -exec rm {} \;

As of date, i have been using scp to manually copy/move recent/latest dump files from host server(rhel 5.7) to backup system (rhel 7.5).

i need help in writing bash script to automate the copying/moving of recent/latest dump files from host server (rhel 5.7) to another system (rhel 7.5).

thanks in advance!!!

pan64 · 02-19-2020, 02:19 PM

probably you can add that scp command at the end of this script.

berndbausch · 02-20-2020, 01:08 AM

As pan64 suggests, you could modify your script (modifications in blue):

Code:

#!/bin/bash
# file : /home/oracle/app/expbkp_TESTONE.sh
# description : run export  backup to localdisk
##########################
##### Variables #######
##########################
RUNTIME=`date '+%H%M_%d%m%Y'`
RUNDATE=`date '+%d%m%Y'`
export LD_LIBRARY_PATH=/home/oracle/app/oracle/product/11.2.0/dbhome_1/lib
export ORACLE_SID=oracle
export ORACLE_HOME=/home/oracle/app/oracle/product/11.2.0/dbhome_1
export PATH=$PATH:${ORACLE_HOME}/bin
DUMPFILE={ORACLE_SID}_tmk_${RUNTIME}.dmp
# start the  Export backup
expdp "/ as sysdba"  directory=EXP_IMP_DIR dumpfile=$DUMPFILE  logfile=${ORACLE_SID}_tmk_${RUNTIME}.log  full=y
#########################################################################
#Removing 3  days old dump files
find /home/oracle/expdp_impdp_oracle  -mtime +2 -exec rm {} \;

scp $DUMPFILE rhel7-5-server:/whereeverthedumpsgo

Alternatively, after running the original script, use rsync to copy dump files to the RHEL7.5 server. rsync is great at only copying what is not on the destination already. I would need a few additional minutes to dig out the required command line options.

Alternatively, explore whether the expdp program support remote destinations.

It does worry me a little that your script is named TESTONE...

edpksrtc · 02-20-2020, 02:31 AM

sir,
i have been using this below scp command

scp oracle_tmk_2200_19022020.dmp oracle_tmk_2200_19022020.log root@10.0.1.145:/home/ksrtc/bkp

but by using this command i need to specify which file i am transferring to the other system, i need script which takes latest (dump and log) files to be copied/moved from rhel 5.7 server system to rhel 7.5 backup system.

thanks

pan64 · 02-20-2020, 02:40 AM

yes, that was described in post #3

Code:

DUMPFILE={ORACLE_SID}_tmk_${RUNTIME}.dmp
LOGFILE=${ORACLE_SID}_tmk_${RUNTIME}.log
# start the  Export backup
expdp "/ as sysdba"  directory=EXP_IMP_DIR dumpfile=$DUMPFILE  logfile=$LOGFILE  full=y
#########################################################################
#Removing 3  days old dump files
find /home/oracle/expdp_impdp_oracle  -mtime +2 -exec rm {} \;

scp $DUMPFILE $LOGFILE root@10.0.1.145:/home/ksrtc/bkp

edpksrtc · 02-20-2020, 03:14 AM

okay sir,,

will try that and will let you all know,,, thanks a lot !

edpksrtc · 02-20-2020, 03:43 AM

Master table "SYS"."SYS_EXPORT_FULL_01" successfully loaded/unloaded
******************************************************************************
Dump file set for SYS.SYS_EXPORT_FULL_01 is:
/home/oracle/expdp_impdp_oracle/oracle_tmk_1453_20022020.dmp
Job "SYS"."SYS_EXPORT_FULL_01" successfully completed at 14:55:46

oracle_tmk_1453_20022020.dmp: No such file or directory
oracle_tmk_1453_20022020.log: No such file or directory

sir ,

after running the bash script backup file is saving in the given directory, but for scp command that directory is not getting looked up!

berndbausch · 02-20-2020, 06:29 AM

Quote:

Originally Posted by edpksrtc

for scp command that directory is not getting looked up!

You need to specify the full pathname to the dump file.

Can you share the current script? Use code tags for better readability.

edpksrtc · 02-28-2020, 05:56 AM

Quote:

Originally Posted by berndbausch

You need to specify the full pathname to the dump file.

Can you share the current script? Use code tags for better readability.

#!/bin/bash
# file : /home/oracle/app/expbkp_TESTONE.sh
# description : run export backup to localdisk
##########################
##### Variables #######
##########################
RUNTIME=`date '+%H%M_%d%m%Y'`
RUNDATE=`date '+%d%m%Y'`
export LD_LIBRARY_PATH=/home/oracle/app/oracle/product/11.2.0/dbhome_1/lib
export ORACLE_SID=oracle
export ORACLE_HOME=/home/oracle/app/oracle/product/11.2.0/dbhome_1
export PATH=$PATH:${ORACLE_HOME}/bin
DUMPFILE=${ORACLE_SID}_tmk_${RUNTIME}.dmp
LOGFILE=${ORACLE_SID}_tmk_${RUNTIME}.log
# start the Export backup
expdp "/ as sysdba" directory=EXP_IMP_DIR dumpfile=$DUMPFILE logfile=$LOGFILE full=y
#########################################################################
#Removing 3 days old dump files
find /home/oracle/expdp_impdp_oracle -mtime +2 -exec rm {} \;

scp $DUMPFILE $LOGFILE root@10.0.1.145:/home/ksrtc/bkp

after running above scripts , i am getting the error as below while sending the latest file to another system through scp

Dump file set for SYS.SYS_EXPORT_FULL_01 is:
/home/oracle/expdp_impdp_oracle/oracle_tmk_1453_20022020.dmp
Job "SYS"."SYS_EXPORT_FULL_01" successfully completed at 14:55:46

oracle_tmk_1453_20022020.dmp: No such file or directory
oracle_tmk_1453_20022020.log: No such file or directory

the underlined command's are giving the issue while transferring the file to another system

TenTenths · 02-28-2020, 06:27 AM

Try the change in blue:

Code:

#!/bin/bash
# file : /home/oracle/app/expbkp_TESTONE.sh
# description : run export  backup to localdisk
##########################
##### Variables #######
##########################
RUNTIME=`date '+%H%M_%d%m%Y'`
RUNDATE=`date '+%d%m%Y'`
export LD_LIBRARY_PATH=/home/oracle/app/oracle/product/11.2.0/dbhome_1/lib
export ORACLE_SID=oracle
export ORACLE_HOME=/home/oracle/app/oracle/product/11.2.0/dbhome_1
export PATH=$PATH:${ORACLE_HOME}/bin
DUMPFILE=${ORACLE_SID}_tmk_${RUNTIME}.dmp
LOGFILE=${ORACLE_SID}_tmk_${RUNTIME}.log
# start the  Export backup
expdp "/ as sysdba"  directory=EXP_IMP_DIR dumpfile=$DUMPFILE  logfile=$LOGFILE  full=y
#########################################################################
#Removing 3  days old dump files
find /home/oracle/expdp_impdp_oracle  -mtime +2 -exec rm {} \;

cd /home/oracle/expdp_impdp_oracle

scp $DUMPFILE $LOGFILE root@10.0.1.145:/home/ksrtc/bkp

edpksrtc · 02-28-2020, 06:44 AM

Quote:

Originally Posted by TenTenths

Try the change in blue:

Code:

#!/bin/bash
# file : /home/oracle/app/expbkp_TESTONE.sh
# description : run export  backup to localdisk
##########################
##### Variables #######
##########################
RUNTIME=`date '+%H%M_%d%m%Y'`
RUNDATE=`date '+%d%m%Y'`
export LD_LIBRARY_PATH=/home/oracle/app/oracle/product/11.2.0/dbhome_1/lib
export ORACLE_SID=oracle
export ORACLE_HOME=/home/oracle/app/oracle/product/11.2.0/dbhome_1
export PATH=$PATH:${ORACLE_HOME}/bin
DUMPFILE=${ORACLE_SID}_tmk_${RUNTIME}.dmp
LOGFILE=${ORACLE_SID}_tmk_${RUNTIME}.log
# start the  Export backup
expdp "/ as sysdba"  directory=EXP_IMP_DIR dumpfile=$DUMPFILE  logfile=$LOGFILE  full=y
#########################################################################
#Removing 3  days old dump files
find /home/oracle/expdp_impdp_oracle  -mtime +2 -exec rm {} \;

cd /home/oracle/expdp_impdp_oracle

scp $DUMPFILE $LOGFILE root@10.0.1.145:/home/ksrtc/bkp

sir i changed this code scp $DUMPFILE $LOGFILE root@10.0.1.145:/home/ksrtc/bkp to scp /home/oracle/expdp_impdp_oracle/$DUMPFILE /home/oracle/expdp_impdp_oracle/$LOGFILE root@10.0.1.145:/home/ksrtc/bkp

but here the password for the destination machine is been asked , how to automate and the ssh password , which will take the password automatically and tranfer the dump file to destination system

TenTenths · 02-28-2020, 06:47 AM

Use SSH key pairs for authentication not passwords. There's plenty of resources on how to do this, there's even one in my sig.

edpksrtc · 02-28-2020, 06:50 AM

Quote:

Originally Posted by TenTenths

Use SSH key pairs for authentication not passwords. There's plenty of resources on how to do this, there's even one in my sig.

okay sir, thanks for your valuable help! helped me a lot!

pan64 · 02-28-2020, 06:58 AM

see post #8

Code:

#!/bin/bash
EXP_IMP_DIR=/home/oracle/expdp_impdp_oracle
# file : /home/oracle/app/expbkp_TESTONE.sh
.....

DUMPFILE=${ORACLE_SID}_tmk_${RUNTIME}.dmp
LOGFILE=${ORACLE_SID}_tmk_${RUNTIME}.log
# start the Export backup
expdp "/ as sysdba" directory=$EXP_IMP_DIR dumpfile=$DUMPFILE logfile=$LOGFILE full=y

scp $EXP_IMP_DIR/$DUMPFILE $EXP_IMP_DIR/$LOGFILE root@10.0.1.145:/home/ksrtc/bkp

probably works better

edpksrtc · 02-28-2020, 07:48 AM

Quote:

Originally Posted by pan64

see post #8

Code:

#!/bin/bash
EXP_IMP_DIR=/home/oracle/expdp_impdp_oracle
# file : /home/oracle/app/expbkp_TESTONE.sh
.....

DUMPFILE=${ORACLE_SID}_tmk_${RUNTIME}.dmp
LOGFILE=${ORACLE_SID}_tmk_${RUNTIME}.log
# start the Export backup
expdp "/ as sysdba" directory=$EXP_IMP_DIR dumpfile=$DUMPFILE logfile=$LOGFILE full=y

scp $EXP_IMP_DIR/$DUMPFILE $EXP_IMP_DIR/$LOGFILE root@10.0.1.145:/home/ksrtc/bkp

probably works better

sir, everything is working fine except for password! after all the exporting , the scp command is asking for password to transfer the file. though the ssh keys have been created . while manually using scp command in terminal, the password is not been asked ,, but the scp command at last of the bash script, the password is been asked, here how to automate, so that the password in not asked for the below scp command

scp /home/oracle/expdp_impdp_oracle/$DUMPFILE /home/oracle/expdp_impdp_oracle/$LOGFILE root@10.0.1.145:/home/ksrtc/bkp