grep -v issue

lleemon · 06-14-2003, 07:37 AM

I am writting a script to display only certain log files but I can't get the following to work:

PHP Code:



 
#IPs  are made up 
vgrepstr="grep -v 11.11.11.11 | grep -v 11.11.11.12 | grep -v 1.1.1.1" 
 
filelist="access_log.4 access_log.3 access_log.2 access_log.1 access_log" 
 
  #for each access_log file look for site given and pull IP's out 
  for curfile in $filelist 
  do 
      cat $curfile | grep $v_site |  $vgrepstr | awk -F" " '{print $1}' 
  done

My issue is the $vgrepstr. For some reason the pipe (|) isn't recognized. Any way I can get it to read as a pipe?

Thanks in advance

Azmeen · 06-14-2003, 09:41 AM

Try escaping it with a backslash... eg.:

Code:

vgrepstr="grep -v 11.11.11.11 \| grep -v 11.11.11.12 \| grep -v 1.1.1.1"

acid_kewpie · 06-14-2003, 10:15 AM

i'd recommend a better use of grep, e.g using regexes rather than three seperate processes:

grep -v 11.11.11.1[12] $curfile

i'd assume that those ip's your using are ficticious though...

lleemon · 06-14-2003, 10:41 AM

Neither of these work for me.

when I do a bash -x scriptname.sh
it gets to the grep and what is displayed is:

+ cat /home/virtual.....
+ grep http://www.........
+ grep -v 11.11.11.11 '\|' grep -v 11.11.11.12 '\|' grep -v 1.1.1.1
grep: \|: No such file or directory
grep: grep: No such file or directory
grep: 11.11.11.12: No such file or directory
grep: \|: No such file or directory
grep: grep: No such file or directory
grep: 1.1.1.1: No such file or directory

Same response for the [12]
grep: [12]: No such file or directory
grep: grep: No such file or directory
grep: 11.11.11.12: No such file or directory
grep: [12]: No such file or directory
grep: grep: No such file or directory
grep: 1.1.1.1: No such file or directory

Looks like the first grep -v is working but all the rest are not due to the ' ' around the |, \|, and [12] that I have tried.

moses · 06-14-2003, 12:14 PM

Before I start digging into this too deeply, what, exactly are you attempting to do? What is the one field you are using awk to get?

lleemon · 06-14-2003, 01:11 PM

Good question. The reason for doing this is that I have many scripts created already that we view results (from our logs) and we don't want our IP's to show up in these results. Each of these scripts has the following in them:
IP1="ipaddresshere"
IP2="ipaddresshere"
.... plus many more ....

then I later do:
cat logfile | grep -v IP1 | grep -v IP2 | .. and all other ip's ....

Since our IP's change it gets really messy to go into each script and add the new ip to the list and the cat portion. So far I got it so I can create a text file with just the ip's and then all the scripts would read this central file and create the grep -v IP's dynamically so I never have to up date the scripts, at least for new/updated IP changes. My only issue is that in the string portion it doesn't work properly.

Hope this makes sense.

moses · 06-14-2003, 09:15 PM

So, you have a bunch of log files that report stuff with IP addresses, and you want to cull out everything that contains the IP addresses of your computers, all of which have dynamic IP addresses? I guess my understanding of what you want isn't complete, but to get what you show at the top, do the following:

Code:

vgrepstr="11.11.11.11|11.11.11.12|1.1.1.1"

for $curfile in $filelist 
do
  grep $v_site $curfile |  grep -v -E $vgrepstr
done

The -E tells grep to treat the next expression as a complex regex, and the | in the $vgrepstr can be thought of as a binary "OR".

lleemon · 06-16-2003, 03:50 PM

Yep, works perfectly!

Thanks for all the help all that posted.