Problem with shell script

Dcrusoe · 05-15-2009, 11:46 AM

Hello all,

Long time lurker and learner, first time poster. I'm having a problem figuring out how to pull two fields from a file. Normally this is simple I know but in this case the fields are disparate such that I am not having any luck figuring this out. in the example below I need the numbers in the second field and then the last number in the line with the work HIDDEN. I need them in that order. File also has headers in it which I can by pass but am unable to get the data out in the correct order. Any ideas would be greatly appreciated with much gratitude!

3 23601 0.00
0.00 98 A04-2 0.0100000 9999999999.00 27952.55
HIDDEN 0.0000000 25000.00 25000.00 25000.00

4 15636 0.00
0.00 98 A04-3 0.0100000 9999999999.00 5149.90
HIDDEN 0.0000000 5000.00 5000.00 5000.00

5 23616 0.00
0.00 98 A04-4 0.0100000 9999999999.00 5243.40
HIDDEN 0.0000000 5000.00 5000.00 5000.00

6 16138 0.00
16140 0.00
16141 0.00
16142 0.00
16145 0.00
16134 0.00
16135 0.00
16136 0.00
16143 0.00
0.00 98 A05 0.0100000 9999999999.00 20919.60
HIDDEN 0.0000000 20000.00 20000.00 20000.00

7 12802 0.00
12803 0.00
12804 0.00
12805 0.00
12806 0.00
12807 0.00
12808 0.00
0.00 98 B02 0.0050000 9999999999.00 4428.05
HIDDEN 0.0000000 4000.00 4000.00 4000.00

schneidz · 05-15-2009, 12:16 PM

can you please post an example of the output you want. i cant figure it out by your description.

seems like a job for awk grep cut...

Dcrusoe · 05-15-2009, 01:35 PM

Example below

<==============Before===================

5 23616 0.00
0.00 98 A04-4 0.0100000 9999999999.00 5243.40
HIDDEN 0.0000000 5000.00 5000.00 5000.00

6 16138 0.00
16140 0.00
16141 0.00
16142 0.00
16145 0.00
16134 0.00
16135 0.00
16136 0.00
16143 0.00
0.00 98 A05 0.0100000 9999999999.00 20919.60
HIDDEN 0.0000000 20000.00 20000.00 20000.00

7 12802 0.00
12803 0.00
12804 0.00
12805 0.00
12806 0.00
12807 0.00
12808 0.00
0.00 98 B02 0.0050000 9999999999.00 4428.05
HIDDEN 0.0000000 4000.00 4000.00 4000.00

<====================After==============================>

23616

5000.00

16138
16140
16141
16142
16145
16134
16135
16136
16143

20000.00

12802
12803
12804
12805
12806
12807
12808

4000.00

forrestt · 05-15-2009, 01:41 PM

So,

records are broken up by blank lines
The second field in the first line is needed
Then each of the first fields in the next multiple lines
You don't want anything from the line before the one starting with "HIDDEN"
You then want the last field in the line starting with "HIDDEN"

Is this correct?

Forrest

Dcrusoe · 05-15-2009, 01:56 PM

Yes sir that be correct.
I was trying to use awk to pull the hidden value but I don't seem to be using it correctly at all. the field I want actually starts in the 82nd position in the file so I was trying to do something like:
but it isn't working and I then mess up my other grep for the other sets of numbers, and then I get lost....

forrestt · 05-15-2009, 02:34 PM

This does it for that particular data stream. Don't know if it will work with all of your data though.

Code:

awk '{ if ($1 == "HIDDEN") { print $NF } else { if ( NF == 3 ) { print $2 } else { if ( $1 == "0.00" ) { print "" } else {print $1 } } } }' inputfile.txt

HTH

Forrest

Dcrusoe · 05-15-2009, 02:58 PM

That does it! Thank you very much, I can pull the other field and strip the headers (27 pages)but I couldn't grab the one field, I'll go back and look closely at what you wrote and try to use the example to pull the other field as well just to see if I understand it. Thank you again!