LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Forums > Non-*NIX Forums > Programming
User Name
Password
Programming This forum is for all programming questions.
The question does not have to be directly related to Linux and any language is fair game.

Notices

Reply
 
Search this Thread
Old 04-19-2011, 08:42 PM   #1
ted_chou12
Member
 
Registered: Aug 2010
Location: Zhongli, Taoyuan
Distribution: slackware, windows, debian (armv4l GNU/Linux)
Posts: 421
Blog Entries: 28

Rep: Reputation: 2
sed match


Hi, I have a new problem with sed matching:
Code:
 sed -n '/Content-Disposition/{ /".*"/!N}
			/Content-Disposition/{ /".*"/!N}
			/Content-Disposition/{ /".*"/s/\n//g;s/.*"\(.*\)"/\1/p}'
matches my string perfectly like:
Code:
...
Content-Disposition: attachment;
	filename="[isoHunt] fc19192d7eb0f52392ddf96ce10b694eabee63c4.torrent"
But can't seem to match this:
Code:
Content-Disposition: attachment; filename=
	"=?gb2312?B?ob6ukNPy19bEu71Nob+h7yU1QrrDz+u45tRWxOMrtdq2/ry+JTVEJTVCS2lt?=
 =?gb2312?B?aStuaStUb2Rva2UrMm5kK1NlYXNvbiU1RCU1Qs3qveG6z7yvJTVEJTVCODQ4?=
 =?gb2312?B?eDQ4MCU1RCU1Qrex83clNUQudG9ycmVudA==?="
Thanks,
Ted
 
Old 04-19-2011, 09:28 PM   #2
grail
Guru
 
Registered: Sep 2009
Location: Perth
Distribution: Manjaro
Posts: 7,648

Rep: Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961
Well not having great sed juju, I would guess at the issue being you have not setup looping to cover more than 2 lines.

I would look at this and implement it to replace the first 2 lines of your script with one that loops until it finds what you need.

Let me know if you get stuck?
 
Old 04-20-2011, 02:48 AM   #3
crts
Senior Member
 
Registered: Jan 2010
Posts: 1,604

Rep: Reputation: 446Reputation: 446Reputation: 446Reputation: 446Reputation: 446
Hi,

grail is right. Your sed is not able to match over multiple lines. In addition, You will get some whitespace issues in the filename when you simply erase the '\n'. You will also have to erase the trailing blanks in the lines. This worked with your sample data:
Code:
sed -rn '/Content-Disposition/ {:a /filename=".*"/! {N;s/\n[[:blank:]]*//g;ba};s/.*"(.*)"/\1/;p}' file
Notice the -n -r switch. It enables extended RegEx so that you do not have to escape the '()' brackets.

Last edited by crts; 04-20-2011 at 03:41 AM. Reason: fixed typo
 
Old 04-20-2011, 03:04 AM   #4
grail
Guru
 
Registered: Sep 2009
Location: Perth
Distribution: Manjaro
Posts: 7,648

Rep: Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961
Slight correction for crts' typo, the -r switch is the one to notice

I do have a slight OT question for crts though - are you able to explain the difference between using ba as opposed to ta?
They both seem to branch but when do you use which?
 
Old 04-20-2011, 03:40 AM   #5
crts
Senior Member
 
Registered: Jan 2010
Posts: 1,604

Rep: Reputation: 446Reputation: 446Reputation: 446Reputation: 446Reputation: 446
Quote:
Originally Posted by grail View Post
Slight correction for crts' typo, the -r switch is the one to notice
Right
Quote:
I do have a slight OT question for crts though - are you able to explain the difference between using ba as opposed to ta?
They both seem to branch but when do you use which?
The difference is that 'b' is an unconditional branch. The 't' command, however, jumps only if a substitution was made before. So it only makes sense to use 't' if you used the 's///' command before.
The 'T' command works similiar but it branches only when no substitutions were made by a preceding 's///'.

This sed works similiar:
Code:
sed -rn '/Content-Disposition/ {:a /filename=".*"/! N;s/\n[[:blank:]]*//g;ta;s/.*"(.*)"/\1/;p}' file
Notice, that if the condition '/filename=".*"/!' is matched now only the next line will be read. The 's///' command will execute in any case. If it replaces a '\n' then the 't' command will branch to label ':a'. A replacement can only happen if '/filename=".*"/!' is true and a new line is read in consequence.

One more thing to know, is that the condition 's/// has made a substitution' is being reset when a 't' command jumps.
 
Old 04-20-2011, 04:36 AM   #6
4dirk1
LQ Newbie
 
Registered: Apr 2011
Posts: 3

Rep: Reputation: 0
Hi Sirs,

I have a similar issue, instead of replace the string with multiple lines, I need to replace a keyword in an xml file with the contents of a txt file containing multiple lines. the xml file has a keyowrd 'kw01', and i want to replace this string with the contents of a file named fatal_alerts.txt. is this possible via sed? i badly need this. TIA!

keyword to be replaced:
kw01

fatal_alerts.txt contents:
RAISEDATTIME
--------------------
DESCRIPTION
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
18-APR-2011 06:20:32
Fatal error in Application GATE:
<Error code: 68
Caught by: CTCS_BatchSchedulerBO.HandleException
Raise by: CTCS_FTOServerBTM.ValidateMessageCount()
Message: For Interface: FTO:1315001 in File : 190107079531.txt
File Message Count Mismatch. File reported count: 447 actual message count 797.>
 
Old 04-20-2011, 04:49 AM   #7
crts
Senior Member
 
Registered: Jan 2010
Posts: 1,604

Rep: Reputation: 446Reputation: 446Reputation: 446Reputation: 446Reputation: 446
Quote:
Originally Posted by 4dirk1 View Post
Hi Sirs,

I have a similar issue, instead of replace the string with multiple lines, I need to replace a keyword in an xml file with the contents of a txt file containing multiple lines. the xml file has a keyowrd 'kw01', and i want to replace this string with the contents of a file named fatal_alerts.txt. is this possible via sed? i badly need this. TIA!

keyword to be replaced:
kw01

fatal_alerts.txt contents:
RAISEDATTIME
--------------------
DESCRIPTION
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
18-APR-2011 06:20:32
Fatal error in Application GATE:
<Error code: 68
Caught by: CTCS_BatchSchedulerBO.HandleException
Raise by: CTCS_FTOServerBTM.ValidateMessageCount()
Message: For Interface: FTO:1315001 in File : 190107079531.txt
File Message Count Mismatch. File reported count: 447 actual message count 797.>
Do not crosspost! it is against LQ rules. I already answered you in this thread.
 
Old 04-20-2011, 04:49 AM   #8
grail
Guru
 
Registered: Sep 2009
Location: Perth
Distribution: Manjaro
Posts: 7,648

Rep: Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961Reputation: 1961
thanks crts ... complete answer as always
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] How would I use awk or sed to match this? ted_chou12 Programming 7 04-08-2011 05:27 AM
[SOLVED] Sed, how do I match even characters only? trist007 Linux - Newbie 3 09-03-2010 08:11 PM
sed match last x lines of a file bradvan Programming 12 03-20-2009 12:18 AM
sed - last occurence of a match mr_scary Linux - Desktop 7 02-13-2009 01:44 PM
grep/sed/awk - find match, then match on next line gctaylor1 Programming 3 07-11-2007 09:55 AM


All times are GMT -5. The time now is 11:31 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration