[SOLVED] recursive search for pattern and print out all text next to it

pedropt · 01-15-2022, 04:21 AM

Hello everyone , i am trying to get a text after specific pattern using awk , however awk only gets the first match on each line and i want to do it recursively .

On this text

Quote:

The following signatures couldn't be verified because the public key is not available: NO_PUBKEY ED444FF07D8D0BF6
Reading package lists...
W: GPG error: http://ftp.de.debian.org/debian stretch Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 04EE7237B7D453EC NO_PUBKEY 648ACFD622F3D138 NO_PUBKEY 0E98404D386FA1D9 NO_PUBKEY EF0F382A1A7B6500
E: The repository 'http://ftp.de.debian.org/debian stretch Release' is not signed.
W: GPG error: http://kali.download/kali kali-rolling InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY ED444FF07D8D0BF6
E: The repository 'http://http.kali.org/kali kali-rolling InRelease' is not signed.

I want to get the expired pubkeys only , but using this code :

Code:

grep "NO_PUBKEY" myfile.log | awk -F'NO_PUBKEY' '{print $2}'

I am unable to get all the codes , only 3 because awk only search the first match on a line instead recursively .

Probably there is a more easy way to do this but i can not remember at this moment .

Any idea ?

Turbocapitalist · 01-15-2022, 04:34 AM

The -F addresses the Field Separator variable (FS), you may want to use the Record Separator (RS) variable instead:

Code:

awk '{print $1}' RS='NO_PUBKEY' myfile.log

That will print the fingerprints from the log file.

syg00 · 01-15-2022, 04:42 AM

Don't you just hate it when the computer does what you tell it, instead of what you want it to do ?.

pedropt · 01-15-2022, 04:43 AM

Thank you for the tip , works perfectly .

grail · 01-15-2022, 07:02 AM

Quote:

Originally Posted by pedropt

works perfectly

Really??

Code:

awk '{print $1}' RS='NO_PUBKEY' myfile.log
The
ED444FF07D8D0BF6
04EE7237B7D453EC
648ACFD622F3D138
0E98404D386FA1D9
EF0F382A1A7B6500
ED444FF07D8D0BF6

Turbocapitalist · 01-15-2022, 07:40 AM

Quote:

Originally Posted by pedropt

Thank you for the tip , works perfectly .

Well about 86% or so, not quite perfectly.

shruggy · 01-15-2022, 07:53 AM

I guess this would do better

Code:

grep -Po 'NO_PUBKEY \K\w+' myfile.log

mjolnir · 01-15-2022, 11:23 AM

Quote:

Originally Posted by shruggy

I guess this would do better

Code:

grep -Po 'NO_PUBKEY \K\w+' myfile.log

Works 'perfectly'

in my experiment but I wonder why the output is colored red in my terminal?

pan64 · 01-15-2022, 12:08 PM

Quote:

Originally Posted by mjolnir

Works 'perfectly'

in my experiment but I wonder why the output is colored red in my terminal?

because grep --color is on

Code:

awk 'BEGIN {RS="(NO_PUBKEY|\n)"}  NF==1 { print $1 }'

shruggy · 01-15-2022, 01:00 PM

Put spaces around NO_PUBKEY in RE to trim them from the output

Code:

awk NF==1 RS=' NO_PUBKEY |\n'

mjolnir · 01-15-2022, 02:36 PM

Quote:

Originally Posted by pan64

because grep --color is on

Code:

awk 'BEGIN {RS="(NO_PUBKEY|\n)"}  NF==1 { print $1 }'

Yep, forgot about that - thanks.

shruggy · 01-15-2022, 03:03 PM

The color settings affect only output to terminal, redirecting or piping the output of grep is safe regardless of the value of --color. This is also true for most (all?) GNU tools that understand --color

Code:

grep -Po 'NO_PUBKEY \K\w+' myfile.log|cat

syg00 · 01-15-2022, 03:32 PM

Or simply escape the command "\grep ..."

Xeratul · 01-15-2022, 06:34 PM

The most simple method:

Quote:

void listdir(const char *name, int indent)
{
DIR *dir;
struct dirent *entry;

if (!(dir = opendir(name)))
return;

while ((entry = readdir(dir)) != NULL) {
if (entry->d_type == DT_DIR) {
char path[1024];
if (strcmp(entry->d_name, ".") == 0 || strcmp(entry->d_name, "..") == 0)
continue;
snprintf(path, sizeof(path), "%s/%s", name, entry->d_name);
printf("%*s[%s]\n", indent, "", entry->d_name);
listdir(path, indent + 2);
} else {
printf("%*s- %s\n", indent, "", entry->d_name);
}
}
closedir(dir);
}

int main(void) {
listdir(".", 0);
return 0;
}

astrogeek · 01-15-2022, 10:17 PM

Quote:

Originally Posted by Xeratul

The most simple method:

I think that perhaps you posted to the wrong thread? Your reply has no bearing on the question being asked as far as I can tell.