Exclude files in gzip command

rohit_shinez · 05-01-2014, 09:32 AM

hi,

I would like to exlcude certain files which starts with AUS from a directory while gzip the files but i need it in gzip command only

cd direct
AUS1.txt
AUS2.txt
NZ1.txt
AUS1.csv
AUS2.csv
USA.tx

i need to exclude file starting with AUS and ends with either .csv or .txt

output:

NZ1.gz
USA.gz

grail · 05-01-2014, 09:47 AM

So what have you tried and where are you stuck?

Have you at least read the man page and perhaps tried a google search?

rohit_shinez · 05-01-2014, 09:58 AM

i have tried something like this

Code:

gzip !(AUS*)

mina86 · 05-01-2014, 10:01 AM

Rather than trying to come up with an extended glob, you can also just loop over the files and filter them with an if statement.

rohit_shinez · 05-01-2014, 10:04 AM

i don't wanted to loop becoz of performance problem becoz there are huge number of files with huge sizes

NevemTeve · 05-01-2014, 10:06 AM

U shuold ues find(1) uiltiy. And xargs(1) uttiliy.

grail · 05-01-2014, 10:56 AM

Quote:

i don't wanted to loop becoz of performance problem becoz there are huge number of files with huge sizes

So apart from not being able to spell 'because', I am not sure I understand the relevance of this statement?

You wish to zip each file that does not match a specific pattern. How will looping through all those that do not meet the pattern be any slower than your other methods?
Also, the size of the file will only affect how quickly gzip can compress it, it will in now way affect the speed of a loop to recall its name to be included as a file that needs to be processed

rohit_shinez · 05-01-2014, 10:59 AM

Grail

i needed the solution rather than to use in loop i know loop will work but i don't wanted to use it rather to use in gzip command something like this

Code:

gzip `ls | egrep -v "AUS.*csv|AUS.*txt"`

grail · 05-01-2014, 12:21 PM

In that case you will need to follow NevemTeve's advice

rohit_shinez · 05-01-2014, 12:32 PM

Grail

can you help on the above code with invoking directly from directory rather than giving cd $directory

szboardstretcher · 05-01-2014, 12:56 PM

What command do you have so far? Where is it broken? Post your command, and your question.

mina86 · 05-01-2014, 02:41 PM

Quote:

Originally Posted by rohit_shinez

Code:

gzip `ls | egrep -v "AUS.*csv|AUS.*txt"`

Don't do that. It does not handle white space in file names correctly.

Like it has been mentioned, if you don't want to loop, the easiest option is find. And you don't even need xargs, you can do “find … -exec gzip {} +”.

Or even “find … -exec parallel gzip ::: {} +”.

rohit_shinez · 05-01-2014, 11:59 PM

hi achived with below one but i want to ignore any subdirectory but grep -v "^d"` is not ignoring the directory

Code:

gzip `ls | egrep -v ''AUS*[.](csv|txt)$'|grep -v "^d"`

grail · 05-02-2014, 02:09 AM

Why would there be a 'd' at the start of the line? Or are you just skipping those directories starting with a 'd'?

NevemTeve · 05-02-2014, 08:05 AM

Mentioned "find" earlier, so please try to use it, or at least read its manual, including option "-maxdepth"