[SOLVED] grep text from a line in between "start" and "end" word

deepakdeore2004 · 08-07-2013, 08:04 AM

I want to grep the text which is shown in RED below. How can I do that?

0.0.0.0 - - [02/Aug/2013:12:03:12 +0000] "POST /some/url/some_file.shtml?THEME=one&STYLE=two&LANGUAGE=fr HTTP/1.1" 200 717 "http://some.url.com/some/url/public/some_other_file.shtml?some_tool_name=ToolName&tool_abc=fr-abc-def-ghi_40&tool_def=abc-ab_12345" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:22.0) Gecko/20100101 Firefox/22.0" 0

danielbmartin · 08-07-2013, 08:14 AM

Quote:

Originally Posted by deepakdeore2004

I want to grep the text which is shown in RED below. How can I do that?

0.0.0.0 - - [02/Aug/2013:12:03:12 +0000] "POST /some/url/some_file.shtml?THEME=one&STYLE=two&LANGUAGE=fr HTTP/1.1" 200 717 "http://some.url.com/some/url/public/some_other_file.shtml?some_tool_name=ToolName&tool_abc=fr-abc-def-ghi_40&tool_def=abc-ab_12345" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:22.0) Gecko/20100101 Firefox/22.0" 0

More information, please. What is your Start and End text? Are those keywords known to be unique within each line? If there are multiple Start/End pairs in any line, do you want all the intervening characters or only the first occurrence?

Daniel B. Martin

konsolebox · 08-07-2013, 08:18 AM

You need to use grep twice:

Code:

grep -o 'tool_abc=[^&" ]*' input | grep -o '[^=]\+$'

Or add cut

Code:

grep -o 'tool_abc=[^&" ]*' input | cut -f 2 -d =

Or simply just use sed:

Code:

sed -n '/tool_abc=/{ s@.*tool_abc=@@; s@[&" ].*$@@; p; }' input

schneidz · 08-07-2013, 08:23 AM

^ konsolebox has a good presumption... the obvious solution for me (with very little information) would be to hard code it like so:

Code:

grep -o fr-abc-def-ghi_40 deepakdeore2004.txt

deepakdeore2004 · 08-07-2013, 08:44 AM

The highlighted word may change. I want the word which will be in between "&tool_abc=" and "&tool_def", this start and end will be unique.

konsolebox · 08-07-2013, 08:54 AM

So with the commands I provided you could get tool_abc, and using the same methods you could also get tool_def. The questions is how do you want them as an output? An example of what you exactly intend to have would be really helpful.

deepakdeore2004 · 08-07-2013, 09:34 AM

konsolebox · 08-07-2013, 09:45 AM

You don't need the extra grep:

Code:

grep -o 'tool_abc=[^&" ]*' log_file | cut -f 2 -d = | sort | uniq -c | sort -nr | head