Linux script to check the informatica log

Maya_Pillai · 08-04-2010, 10:41 PM

Hi,

We are loading 100 + oracle tables using informatica. At the end of the run, we need to verify the informatica log to confirm the rows are loaded properly to target tables.

There are so many detials included in the etllog. But,the part of the informatica log, linux script needs to look into look like as below -(vary for different table names. here, CMN_1740 is the table name.)

MAPPING> TM_6252 Source Load Summary.
MAPPING> CMN_1740 Table: [SQ_W_CASE_FS] (Instance Name: [SQ_W_CASE_FS])
Output Rows [1], Affected Rows [1], Applied Rows [1], Rejected Rows [0]
MAPPING> TM_6253 Target Load Summary.
MAPPING> CMN_1740 Table: [W_CASE_F] (Instance Name: [W_CASE_F])
Output Rows [1], Affected Rows [1], Applied Rows [1], Rejected Rows [0]

--------------------

1. The details of source load summary (source table name and the details -Output Rows [1], Affected Rows [1], Applied Rows [1], Rejected Rows [0]) should be written to a log
3. We need to check whether the affected rows is 0 or rejected rows > 0 for source load summary. In that case , script should write that to a log and exit

2. The details of target load summary (target table name and the details -Output Rows [1], Affected Rows [1], Applied Rows [1], Rejected Rows [0]) should be written to a log

3. We need to check whether the affected rows is 0 or rejected rows > 0
for target load summary. In that case, script should write that to a log and exit.

4.The above steps should be repeated for all set of tables mentioned in the etllog.

Can somebody please help?
Thanks
Maya

catkin · 08-05-2010, 06:57 AM

LQ helps people when the get stuck or are in doubt, it does not provide custom programming to order.

If you show what you have tried so far, what it does and how it does not meet your requirements then people will help you move forward.

Maya_Pillai · 08-05-2010, 10:53 PM

Here is my script. Can somebody suggest how can I fine tune the below script?

Code:

logfile=${ETLLOG}/etllogs.log
 	found=0
        echo >${POS_LOG}/dw_postodw_rowcount.log
        while read line
        do
                
                if [ found -eq 0 ]; then
                {
                        
                        checkline=`echo $line |grep "Source Load Summary" `
                        if [ $? = 0 ]; then
                        echo " Found source load summary .. Found is setting to 1\n"
                                found=1
                        fi
                }
                elif [ found -eq 1 ]
                then
                 {
			sourcetable=`echo $line | cut -f2 -d" " `
                        echo " Source Table: $sourcetable" >> ${POS_LOG}/dw_postodw_rowcount.log
                        found=2

                }
                elif [ found -eq 2 ]
                then
                {
                        echo " The source load summary $line " >>${POS_LOG}/dw_postodw_rowcount.log

                        affected=`echo ${line} |cut -f6 -d" " `

                        affectedcount=`echo ${affected} | grep 0 `

                        if [ $? = 0 ]
                        then
                                echo "Source load affected rows = 0 .. Issue found\n">>${POS_LOG}/dw_postodw_rowcount.log
                                exit 1
                        fi
                        
			rejected=`echo ${line} | cut -f12 -d" " `
                        rejectedcount=`echo ${rejected} | grep [1-9] `
                      	if [ $? = 0 ]
                        then
                                echo "Source load rejected rows >0 .. Issue foun\n">>${POS_LOG}/dw_postodw_rowcount.log
                                exit 1
                        fi

                        found=3

                }
                elif [ found -eq 3 ]
                then
                {
                        echo " Target Table: " >> ${POS_LOG}/dw_postodw_rowcount.log
                        found=4
                }
                elif [ found -eq 4 ]
                then
                {

			targettable=`echo ${line} | cut -f2 -d" " `
                        echo "$targettable \n " >> ${POS_LOG}/dw_postodw_rowcount.log
                        found=5
                }
                elif [ found -eq 5 ]
                then
                {
                        echo " The Target load summary $line " >>${POS_LOG}/dw_postodw_rowcount.log

                        affected=`echo ${line} |cut -f6 d" "`

                        affectedcount=` echo ${affected} | grep 0 `

                        if [ $? = 0 ]; then
                                echo "Target load affected rows =0 .. Issue found\n">>${POS_LOG}/dw_postodw_rowcount.log
                                exit 1
                        fi
                        rejected=` echo ${line} |cut -f12 -d" " `

                        rejectedcount=`echo ${rejected} | grep [1-9] `

                        if [ $? = 0 ]; then
                        echo "Target load rejected rows >0 .. Issue found \n">>${POS_LOG}/dw_postodw_rowcount.log
                                exit 1
                        fi
                        found=0
                }
                fi

        done<$logfile

I need to get an exact match for 0 .

Code:

affectedcount=`echo ${affected} | grep 0 `

This fetches all 10,20.. etc.

Thanks
Maya