Delete rows accoring to pattern in a file.

Siggloo · 04-22-2015, 10:02 AM

Hi

I have to create a document containing all permissons on a fileserver and then clean it from all inharited permissions and so on.

I have created the file with sudo ls -Rlae > FILE (file created about 800MB, almost 800 000 lines)

The pattern we want to search for is on five lines:

0: user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
1: group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
2: user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
3: group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
4: user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity

We want those five lines and the line before to be deleted.

So is there possible to make a awk-script to do this?
Or is it a better way to list permissions and create the file?

Regards

sudowtf · 04-23-2015, 08:22 AM

So is the keyword "inherited" the unique factor? If so how about

Code:

grep -v -B 1 "inherited" input.txt > output.txt

where -v is inverse, and -B 1 is include 1 line before

my system does not allow the -e parameter on ls for me to analyze.

danielbmartin · 04-23-2015, 09:22 AM

Quote:

Originally Posted by sudowtf

... how about

Code:

grep -v -B 1 "inherited" input.txt > output.txt

where -v is inverse, and -B 1 is include 1 line before ...

This might not work. See my recently thread at http://www.linuxquestions.org/questi...xt-4175540507/

Daniel B. Martin

danielbmartin · 04-24-2015, 09:09 AM

Quote:

Originally Posted by Siggloo

The pattern we want to search for is on five lines:

0: user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
1: group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
2: user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
3: group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
4: user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity

We want those five lines and the line before to be deleted.

Take those five lines and put them in a file called PatFile ...

Code:

user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity

I constructed a test InFile by making five copies of the pattern, planting a few "filler" lines between each, and then "munging" three of the five with 9's so that only two perfect matches remain.
InFile ...

Code:

Apple pie
Cherry cobbler
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:999999999 inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
Vanilla ice cream
Chocolate ice cream
Strawberry ice cream
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
Potatos
Broccoli
Asparagus
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,999999999999
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
Ford
Honda
Toyota
Nissan
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
Bicycle
Skateboard
Scooter
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_999999999 inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity

The desired transformation is to "blow away" the two perfect matches, along with the filler line which immediately precedes them: strawberry ice cream, and Nissan.

This code ...

Code:

Pat="~"$(paste -sd"~" $PatFile)
 paste -sd"~" $InFile  \
|sed "s/$Pat/QQQ/g"    \
|tr "~" "\n"           \
|grep -v "QQQ"         \
>$OutFile

... produced this OutFile ...

Code:

Apple pie
Cherry cobbler
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:999999999 inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
Vanilla ice cream
Chocolate ice cream
Potatos
Broccoli
Asparagus
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,999999999999
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
Ford
Honda
Toyota
Bicycle
Skateboard
Scooter
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_spotlight inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
group:konceptit inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity
user:_999999999 inherited allow read,write,execute,append,readattr,writeattr,readextattr,writeextattr,readsecurity

Daniel B. Martin