sed multi-line search/replace woes

djmm · 03-13-2009, 09:14 PM

Any idea why this isn't inserting </UL>'s across the whole file?
What'd I miss?

Code:

# foobar3 is what you see below minus the </UL> (all spaces no tabs)
$ sed -e 'N;s,\(^    \* .*\n\) \*,\1</UL>\n *,g'  foobar3

 * heading 1
    * subheading 1
    * subheading 2
 * heading 2
 * heading 3
    * subheading 1
    * subheading 2
    * subheading 3
</UL>
 * heading 4
 * heading 5
 * heading 6
 * heading 7
    * subheading 1
    * subheading 2
    * subheading 3
* heading 8

syg00 · 03-13-2009, 09:21 PM

ignore me - irrelevant post.

djmm · 03-13-2009, 09:30 PM

Quote:

Originally Posted by syg00

sed doesn't pass the newlines - you get to see the "stripped" (chomp'd in perl parlance) line.
awk or perl might be a better bet.

Sorry, I'm not following. N pulls in the next line, so the buffer always has 2 lines it in with the \n in it. Many references talk about using this method to read in 2 lines with the \n embeded (not stripped).

My question is, why is this working for ONE of the conditions met in the file and not the others. The middle one even, not even the first or last. Very strange.

syg00 · 03-13-2009, 10:21 PM

Yeah I had deleted that, but you'd already started replying apparently ... sorry.

Thinking about it some more, I think you're failing because you appear to be expecting each buffer will have every line followed by the next. What you actually get is every second line plus the next.
i.e. first data you get to work on is "line1\nline2", then you get "line3\nline4" ... (note you don't get "line2\nline3")

Add some dummy lines to your input, and you'll see what I mean - even using addressing won't get around this. Seems my suggestion of awk or perl still stands - but for a (hopefully) valid reason this time.

ghostdog74 · 03-13-2009, 10:22 PM

show in more details how your input file looks like, how you want your final output to be like. you do not need complex regular expressions to do what you want.

djmm · 03-16-2009, 05:25 PM

Quote:

Originally Posted by ghostdog74

show in more details how your input file looks like, how you want your final output to be like. you do not need complex regular expressions to do what you want.

OK, here's the starting text:

Code:

 * heading 1
    * subheading 1
    * subheading 2
 * heading 2
 * heading 3
    * subheading 1
    * subheading 2
    * subheading 3
 * heading 4
 * heading 5
 * heading 6
 * heading 7
    * subheading 1
    * subheading 2
    * subheading 3
* heading 8
    * subheading 1

Here's how I want it to look:

Code:

 * heading 1
    * subheading 1
    * subheading 2
</UL>
 * heading 2
 * heading 3
    * subheading 1
    * subheading 2
    * subheading 3
</UL>
 * heading 4
 * heading 5
 * heading 6
 * heading 7
    * subheading 1
    * subheading 2
    * subheading 3
</UL>
* heading 8
    * subheading 1
</UL>

I'm actually wrapping all the subheading blocks in <UL> and </UL>, but I already have the <UL> part working and trying to use the most simple example here, but will mention that here for the sake of context of this exercise.

Thanks for you help!

djmm · 03-16-2009, 06:23 PM

I got this working with awk, though I'd be curious to know if there's a way to do it with sed. syg00 pointed to the problem with the "N;" solution.

Code:

awk 'BEGIN {mark=0}
     /^    \*/ {mark=1}
     /^ \*/ {if (mark) print "</UL>";mark=0}
     {print}'

Kenhelm · 03-17-2009, 06:10 AM

This uses GNU sed to insert both tags; remove 'i\
<UL>' if you want to leave out the <UL> tags.

Code:

sed '/^    \*/{i\
<UL>
:a
$! {n;/^    \*/ba;i\
</UL>
}
$ {/^    \*/a\
</UL>
};}'

 * heading 1
<UL>
    * subheading 1
    * subheading 2
</UL>
 * heading 2
 * heading 3
<UL>
    * subheading 1
    * subheading 2
    * subheading 3
</UL>
 * heading 4
 * heading 5
 * heading 6
 * heading 7
<UL>
    * subheading 1
    * subheading 2
    * subheading 3
</UL>
* heading 8
<UL>
    * subheading 1
</UL>

syg00 · 03-17-2009, 06:25 AM

I am constantly amazed at what people can make sed do.

(same comment applies to awk, and perl ...)