LinuxQuestions.org
Latest LQ Deal: Linux Power User Bundle
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 06-26-2013, 03:26 PM   #1
VenkatKonda
LQ Newbie
 
Registered: Jun 2013
Posts: 1

Rep: Reputation: Disabled
Why sed is unable to remove/replace new line/'\n'


Hi there,
I am unable to replace or remove \n or new line in my source files. I will be getting 2000 files daily and I need to remove new lines from that files instantly.
Kindly suggest me workaround..

Thanks in Advance.

Venkat.
 
Old 06-26-2013, 04:47 PM   #2
kabamaru
Member
 
Registered: Dec 2011
Location: Greece
Distribution: Slackware
Posts: 276

Rep: Reputation: 133Reputation: 133
Although it is possible to do that with sed, you're better of with tr for the job:

Code:
tr -d '\n' < myfile > myfile.new
this will delete newlines from myfile and save the output to myfile.new.
 
Old 06-26-2013, 05:20 PM   #3
Firerat
Senior Member
 
Registered: Oct 2008
Distribution: Debian Jessie / sid
Posts: 1,471

Rep: Reputation: 444Reputation: 444Reputation: 444Reputation: 444Reputation: 444
input
Code:
this is a line with a new line
this is a line that I would like to join
with the next line
sed
Code:
sed ':a;/would like to join$/{N;s/\n/ /;ba}' input
I cheated
http://stackoverflow.com/questions/7...lines-together
from
https://startpage.com/do/search?q=se...+match+pattern


the detail is probably in here
http://www.gnu.org/software/sed/manual/sed.html

somewhere ..
 
Old 06-26-2013, 06:01 PM   #4
sycamorex
LQ Veteran
 
Registered: Nov 2005
Location: London
Distribution: Slackware64-current
Posts: 5,811
Blog Entries: 1

Rep: Reputation: 1191Reputation: 1191Reputation: 1191Reputation: 1191Reputation: 1191Reputation: 1191Reputation: 1191Reputation: 1191Reputation: 1191
As much as I like all things sed, as kubamaru suggests, tr is a better tool in this situation.
 
Old 06-26-2013, 06:19 PM   #5
Firerat
Senior Member
 
Registered: Oct 2008
Distribution: Debian Jessie / sid
Posts: 1,471

Rep: Reputation: 444Reputation: 444Reputation: 444Reputation: 444Reputation: 444
true,

but I hate googling, finding a thread that looks like what I need and is marked solved only to find the solution doesn’t quite fit what I needed.

Just trying to fix the net
 
Old 06-26-2013, 07:39 PM   #6
Diantre
Member
 
Registered: Jun 2011
Distribution: Slackware
Posts: 495

Rep: Reputation: 212Reputation: 212Reputation: 212
This page might be useful. Plenty of examples on how to remove newlines with several tools.
 
1 members found this post helpful.
Old 06-27-2013, 01:38 AM   #7
eklavya
Member
 
Registered: Mar 2013
Posts: 619

Rep: Reputation: 136Reputation: 136
It looks like that it should be easy with sed because we have used substitute and the replacing character so it should be
sed 's/\n/\t/g' filename or sed 's/\n/ /g' filename or sed 's/\n//g' filename
but when you will try these solutions, none of these will work because to change line you have to define all these
Code:
    :a create a label 'a'
    N append the next line to the pattern space
    $! if not the last line, ba branch (go to) label 'a'
    s substitute, /\n/ regex for new line, / / by a space, /g global match (as many times as it can)
But it does not like that if it is not done in sed, it can't be done. There are other several and much easy ways.
You have to replace new line with another character, in these examples I am replacing it with space.
If you do this using perl in a way like sed,
Code:
perl -p -e 's/\n/ /' filename.txt
with tr
Code:
tr '\n' ' ' < filename.txt
Another way with paste,
but here is some limitation, if you replace new line with one or two character(like space or tab), it is easy to use, if there are multiple charcters there can be some problem.
Code:
paste -s -d ' ' filename.txt
 
Old 06-27-2013, 04:31 AM   #8
mddnix
Member
 
Registered: Mar 2013
Location: Bangalore, India
Distribution: Redhat, Arch, Ubuntu
Posts: 505

Rep: Reputation: 137Reputation: 137
sed variant:
Code:
sed -i.bak ':begin;$!N;s/\n//;tbegin' file
sed -i.bak '{:q;N;s/\n//g;t q}' file
But as everybody have already mentioned, tr is easy
Code:
tr -d '\n' < file > newfile
 
Old 06-28-2013, 08:56 AM   #9
David the H.
Bash Guru
 
Registered: Jun 2004
Location: Osaka, Japan
Distribution: Debian sid + kde 3.5 & 4.4
Posts: 6,823

Rep: Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957Reputation: 1957
sed can't do this by default because of the way it processes lines. The process goes like this:

1) The first line of input is taken into the pattern buffer, with the trailing newline removed from it.

2) All command expressions are applied to the contents of the buffer, in order.

3) The modified string is printed to stdout (unless -n is used), with a new newline re-appended to it.

4) It goes on to the next line and processes that.

Since there's never a newline in the pattern buffer, there's no way to act on it.

Now, as shown above, it can be done with some of the more advanced multi-line commands. These work by appending extra lines (either the next one in the input, or the contents of the hold buffer) to the contents of the pattern buffer, with newline characters between them. Then once there are newlines in the buffer, you can operate on them as you expect.

But the code flow of sed when doing this kind of thing can be a real headache. Usually it's much easier to just use a different tool entirely.

Here are a few useful sed references:
http://www.grymoire.com/Unix/Sed.html
http://sed.sourceforge.net/grabbag/
http://sed.sourceforge.net/sedfaq.html
http://sed.sourceforge.net/sed1line.txt
http://www.catonmat.net/series/sed-one-liners-explained
 
1 members found this post helpful.
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Replace a line in file used sed command vin_2 Programming 1 10-17-2012 03:04 AM
[SOLVED] SED replace line after match r00t Linux - Newbie 12 05-31-2012 08:17 AM
[SOLVED] sed help - replace line feed with different character bradvan Programming 7 04-23-2012 12:31 AM
[SOLVED] Replace a line using sed finekevin Linux - Newbie 6 02-23-2012 02:14 PM
SED - replace line after substing rany Linux - Newbie 2 07-02-2009 02:13 AM


All times are GMT -5. The time now is 09:04 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration