How to get the result in such log format using linux tools (awk,sed..) ?
 

hi guys,

I have a log file which has such format:

If I need to get all the 'Aborted_clients' value, I can simply do a grep. But, how do I associate each 'Aborted_clients' value with the 'date' information on top of each paragraph ? I wish to have something like this:

In fact this logfile is generated by me every minute using a very simple syntax :
If I need to change the way I log the result to make the log become easier to be retrieved the information, you are welcome to advise me as well.

Thanks a million for any assist and advice given :)

Is this ok for you?






_________________________________
Happy with solution ... mark as SOLVED
If someone helps you, or you approve of what's posted, click the "Add to Reputation" button, on the left of the post.

Hi,

If you are only interested in the date/time and Aborted_clients parts:

hi,

Thanks for both of your feedback, it's a nice one!

I have taken 'druuna' solution, it fits with my need exactly :)

From another similar log, but this time I would like to calculate the appearance of certain lines, for example:

And the output I would need this time is:
Is that doable ? I tried to manipulate from the solution given previously, but just not able to make it work :( I tried googling, but can't find in awk docs on how to do this. Is this called multi pattern matching ?

Assuming the log file in question looks like the one in post #1: Here's an example of the output using the log from post #1:

hi druuna,

Apology that I didn't make the question clearer. Your solution is in fact not what I want this time. What I need is something a bit different with another format of log like this:

So I need to calculate the appearance of each state at each time. The end result will need to be like this:

Rather than just using stuff people provide, you should try and understand it. There's a tutorial for AWK here that will help with that.

Two possible issues with the above code:
1 - If a state isn't encountered, nothing instead of 0 will be printed.
2 - the sort part will only work if entries are all from the same day and month (date in examples aren't sane, sorting those will be hard. sorting the arrays from within gawk without losing indices might be possible).

Example output: Maybe someone comes up with a cleaner solution.

PS: I just tried pan64's solution and it seems the sleep/locked states aren't counted correctly.

You are right, a delete arr is missing:

this is somewhat of a hack but mite help[untested]:edit: this should work with the original log method[untested];

pan64,

I don't quite understand the part where you do , what does that mean ?

My problem in making awk to read a block of text are:

i) I don't know how to make it print the result after every end of the block, as I understand awk is a stream processor, how do we make it aware to only print result at the end of each block? Like for instance,
ii) how does awk know WHEN to reset the counter back to zero and counting again when it finds another 'MYT' ?

druuna's way is using a RS to do that, but I don't quite understand how's pan64 way can make awk aware about the above (i) and (ii). pan64, mind to elaborate more ?

Nylex,

Thanks for your advice, I do know taking blindly other people stuff is not a good habit, and if you have notice my question in LQ so far, I am not fall into those category. I will try understanding and discuss with the feedback and try to give my own finding. I'm slow in understanding awk even though I did go through many tutorials, hope you guys bear with my weakness in this part.

heres mine [untested]:

just to see post #9, you should try and understand.
. means any char, so /.../ means 3 chars, with other words it is a line containing at least 3 chars.
Otherwise my awk works exactly as you described:
first look for MYT to start counting
next look for non-empty lines and sum up what found in it
last on empty lines print result, reset counter and start over