Bash - Searching strings for array elements...

Phier · 05-08-2010, 11:36 AM

The new IP2 gets it's Country from the first IP2 instance that was looked up.

I'm not sure how to do it with sed 'cause sed outputs the whole file's contents each time it's called. So running sed for each newly found country outputs the file multiple times. That's why i've opted for processing each line at a time like in the above code.

grail · 05-09-2010, 12:13 AM

So i have one more question, does this script only update this file?
ie. does it do other things as well or not?

Phier · 05-09-2010, 02:19 AM

It moves and rsyncs a number of other files, but the files interaction we've been concerned with go like this:

Every 5 minutes:

Code:

rsync cvsfile,etc for stats
for each sqlfile
   sed sqlfile >> cvsfile
for each line of cvsfile
   jwhoisUpdate cvsfile > newcvsfile
mv newcvsfile cvsfile
rsync-and-remove sqlfiles

Whilst another database sql dump script periodically creates the sqlfiles with updates.

Cheers.

grail · 05-09-2010, 04:37 AM

hmm ... well looking at that it may almost pay to do your for loop actions all in awk.
What i mean is that you could have awk do the work and then call jwhois only for the lines that are necessary.

So are these line:

Quote:

2010-04-30 11:05:10,ICMP Echo Reply,Possible harmful network activity detected,3,<IP address>

Coming from the sql files?
Essentially i was thinking along the lines of:

Code:

awk -F, 'NF==5{<do jwhois>}' cvsfile >newcvsfile

This would then only perform the changes on the required lines.