Share your knowledge at the LQ Wiki.
Go Back > Forums > Non-*NIX Forums > Programming
User Name
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.


  Search this Thread
Old 03-22-2005, 08:46 AM   #1
Registered: Mar 2003
Location: Macondo
Distribution: Mandrake 9.1, 10.1, SuSE 8.1 pro, 10.1, Red Hat 8.0/9.0
Posts: 380

Rep: Reputation: 30
I need to pick out the first, last and how many from a file...?!!?

Hello All,

I am having a h3ll of a time redoing my log analysis scripts in bash....please help me :-(....

OK this is what I need to do...

I get a file copied to a directory every day with this content:

<<<<<<<<<<<<START of FILE>>>>>>>>>>>>>>>>>


<<<<<<<<<<<<END of FILE>>>>>>>>>>>>>>>>>>>

From this file I have to write a script that does the following things AND they have to be done from a script written for the bash shell:

1) Based on the last 2 arguments "JOE,0015557" figure out how many times it comes up in the file.

2) From the ones that occur more than once, when was the first and when was the last time it occured. This you figure out based on the first field which is a timestamp.

So the file that has to come as output from the bash scipt will be something like:

JOE,0015557------3 times-----First Incidence:20050312091225-----Lastincidence:20050312091226
BOB,0016744------8 times-----First Incidence:20050100034434-----Lastincidence:20050315160004

Any thoughts on how to do this in bash shell?
Old 03-22-2005, 08:53 AM   #2
LQ Newbie
Registered: Mar 2005
Location: USA
Distribution: Mandrake
Posts: 19

Rep: Reputation: 0

try using cut and use as your delimiter the ',' asign fields 2 and 3 to a variable and loop throgh the file, if you have a counter variable whenever you find a match you increase the counter

cut --delimiter='/' --output-delimiter='/' --fields=2,3
Old 03-22-2005, 11:34 AM   #3
Registered: Jul 2004
Location: Santiago, Chile
Distribution: Ubuntu
Posts: 410

Rep: Reputation: 31
Perl is your man.


while(<STDIN>) {
  ($date,$user,$number) = split /,/;
  $key = "$user,$number";
  if ($first{$key}) {
    $first{$key} = $date if ($first{$key} ge $date);
  } else {
    $first{$key} = $date;
  if ($last{$key}) {
    $last{$key} = $date if ($last{$key} le $date);
  } else {
    $last{$key} = $date;

for $i (keys %frec) {
  if ($frec{$i}>1) {
    print "$i---$frec{$i}---First incidende:$first{$i}----Last incidende:$last{$i}\n";
If you save a file named "yourscript" with this and give it excecution permissions, you can run

cat yourfile.txt | yourscript
PS: I'm very new to perl, but from what I now of its, there is plenty of other ways to write this problem, many of them better than mine. Anyway, at least I can explain you how this solution works, so dont hesitate to ask...
Old 03-22-2005, 01:44 PM   #4
Registered: Sep 2002
Location: Tulsa, OK
Distribution: Slack, baby!
Posts: 349

Rep: Reputation: 33
Isn't this the exact same problem you asked in this thread, minus slight data modification?


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Your Presidential Pick??? eskiled General 187 11-04-2004 01:24 AM
Help me pick a distro??? snjbrian Linux - Distributions 30 10-21-2004 01:58 PM
How to pick a string from a text file? sdandeker Linux - General 1 02-12-2004 04:17 AM
I Need a Pick-Me-Up Slack_Master General 8 02-14-2003 12:46 AM
Help Me Pick A NIC... morozov50 Linux - Networking 4 04-17-2001 08:48 PM > Forums > Non-*NIX Forums > Programming

All times are GMT -5. The time now is 07:56 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration