delete old logs

tjay1983 · 11-11-2010, 08:31 PM

Hi

Hpunix.
I have logfiles in /archive_store directory which are deleted by below script once the directory is 90 percent full.
What I want to do is, before deleting each logfile, I want to make sure they are at least 1 day older than current time.
If they are not, the script should terminate.
Time of the each log can be seen before ".Z" prefix.
I have to pickup that time and compare it with current time.

I aprreciate any help.

----------------------------------------------------
ls /archive_store

akprd_uwprod_0000015702_1_201011121305.Z
akprd_srprod_0000099047_1_201011121305.Z
...
...
...

----------------------------------------------------
The script is:

#!/bin/sh

LOGDIR=/usr/logs/
LOG=trim_archive_store.log
DIR=/archive_store
threshold=${1:-90}

cd ${DIR}

count=$(ls | grep -c '^ak')
if [ $count -eq 0 ]; then
exit
fi
percent=$(df -k ${DIR} | awk '/allocation used/ {print $1;}')
while [ ${percent} -ge $threshold ]; do
files=$(ls -1t ${DIR}/ak* | tail -3)
DTIME=$(date +%Y/%m/%d_%X)
for file in $files; do
echo "$DTIME - Deleting File $file" >> $LOGDIR/$LOG
echo "Deleting file $file"
rm ${file}
done
percent=$(df -k ${DIR} | awk '/allocation used/ {print $1;}')
done

hda7 · 11-12-2010, 08:52 AM

You could try:

Code:

TODAY=`date '+%Y%m%d'`
LOGDAY=`echo "$file" | perl -ne 's/.*_(\d{8})[^_]*\.Z$/\1/; print;'`
if [[ `expr $TODAY - $LOGDAY` -lt 1 ]]; then
  exit
fi

Note: I did not compare times, just dates.

tjay1983 · 11-14-2010, 09:13 PM

Hi hda7,

Thanks for your help.
By using your code, I have written below code, which suits my needs.

What I want to ask is, this code will not be accurate in below scnerio:

LOGDAY=20101129
TODAY= 20101201

Difference is 72, which is not correct, since these are dates.

How can I fix this?

#!/bin/sh

DIR=/archive_store
TODAY=`date '+%Y%m%d'`

cd ${DIR}

file=$(ls -1t ${DIR}/ak* | tail -1)
LOGDAY=`echo "$file" | perl -ne 's/.*_(\d{8})[^_]*\.Z$/\1/; print;'`

if [[ `expr $TODAY - $LOGDAY` -lt 4 ]]; then
echo "Please check logs..."
fi

stress_junkie · 11-14-2010, 09:25 PM

If all of the files in that directory are subject to deletion then this would work.

Code:

find /archive_store -type f -atime +1 -exec rm {} \;

If all of the files to be deleted have names that end in Z and if there are other files that you need to keep that have names that do NOT end in Z then this would work.

Code:

find /archive_store -type f -atime +1 -name *Z -exec rm {} \;

It's a little simpler than your script.

Note that the find utility will follow all of the subdirectories unless you tell it not do do that using -maxdepth 1.

Code:

find /archive_store -maxdepth 1 -type f -atime +1 -name *Z -exec rm {} \;

tjay1983 · 11-14-2010, 10:43 PM

Hi

Thanks for your suggestion but I dont want to delete.
The following script suits my needs, however as I mentioned above it doesnt work in below scnerio:

LOGDAY=20101129
TODAY= 20101201

Difference is 72, which is not correct, since these are dates.

#!/bin/sh

DIR=/archive_store
TODAY=`date '+%Y%m%d'`

cd ${DIR}

file=$(ls -1t ${DIR}/ak* | tail -1)
LOGDAY=`echo "$file" | perl -ne 's/.*_(\d{8})[^_]*\.Z$/\1/; print;'`

if [[ `expr $TODAY - $LOGDAY` -lt 4 ]]; then
echo "Please check logs..."
fi

stress_junkie · 11-14-2010, 10:51 PM

Quote:

Originally Posted by tjay1983

Hi
Thanks for your suggestion but I dont want to delete.

The title of your thread is "delete old logs".

tjay1983 · 11-14-2010, 10:57 PM

Ohh, my mistake.
I should have found a better title.
thanks for your help

hda7 · 11-16-2010, 03:14 PM

To make a proper comparison, you could get both dates into perl and use a perl script to calculate the date and time difference (perl would be better suited to that than bash).

By the way, if you find a post helpful, click the scales icon to the left of the post.