[SOLVED] Bash Scripting -- Find big files and gzip it

Toushi · 07-30-2012, 11:59 PM

Hello All ,

I am newbie in bash scripting I stuck in one script. My script purpose is to find out the big files from current path 'pwd' and move the big file after gzip to particular destination.

My script is working if one file is exist in that path but if there are more than 2 files then script not execute as expected.

Could you please someone help me to solve this issue.

#!/bin/bash

ARCHIVENR=`date +%Y%m%d`
DESTDIR="$PWD/archive-$ARCHIVENR"
mkdir "$DESTDIR"

BIGFILE=`find "$PWD" -xdev -type f -a -size +10000 -exec ls -lrt {} \; |awk '{ print $9 }'`

for i in $BIGFILE

#while [ -f "$BIGFILE" ]

do
gzip "$BIGFILE"; mv "$BIGFILE".gz "$DESTDIR"
echo "$BIGFILE archived"
done

Regards,
Toushi

evo2 · 07-31-2012, 12:04 AM

Hi,

you need to use $i inside the loop, not $BIGFILE. Eg

Code:

for i in $BIGFILE
do
  gzip "$i"
  mv "${i}.gz" $DESTDIR
done

HTH,

Evo2.

anomie · 07-31-2012, 12:43 AM

Also, some changes for you to consider (to avoid performing unnecessary / redundant tasks):

Code:

#!/bin/bash

PATH=/bin:/usr/bin

_archive="archive-$(date +%Y%m%d)"

[ -e "${_archive}" ] || mkdir "${_archive}"

find . -xdev -maxdepth 1 -type f -size +10000 \
	-exec gzip {} \; \
	-exec mv {}.gz ${_archive} \;

exit 0

NB the -maxdepth option I added to find(1). That will prevent find(1) from descending into your archive directory and trying to gzip an already gzip'd file that still matches the size criteria.

Toushi · 08-01-2012, 02:44 AM

Hello Evo2 anomie,

Thank you very much for replying on my post. I tried both suggestion and it worked for me.

Regards,
Toushi