LinuxQuestions.org
Register a domain and help support LQ
Go Back   LinuxQuestions.org > Blogs > JimRobinson
User Name
Password

Notices

Rate this Entry

Joining records using sed or awk

Posted 07-01-2009 at 07:34 AM by JimRobinson
Tags awk, line join, sed

I have a very large file, 9 million records, and there are sections in the file where I need to join records. How can I get for example line number 100,000 and join to it lines 100,001-100,050 using sed or awk? The joins need to happen multiple times throughout the file. I can get the line number for the first and last line I need in my join but am having difficulty figuring out how to reformat the file with the lines joined and the file saved with the one end-resulting line.

Any suggestions? Thanks!!
Posted in Uncategorized
Views 1845 Comments 2
« Prev     Main     Next »
Total Comments 2

Comments

  1. Old Comment
    Any suggestions would be greatly appreciated. We are archiving MQ messages and the messages recieved in XML format are causing the multiple records. To properly grep the file for researching, I need to have those records joined into one record. Thanks for any suggestions on this.

    for instance...
    1> <aaaaa>aabbccdd</aaaaa>
    2> <bbbbb>aabbccdd
    3> eeffgghhii
    4> jjkkllmm</bbbbb>

    I would want to join line 3 and 4 with 2 giving...
    1> <aaaaa>aaaaabbbbbbcccccdddd</aaaaa>
    2> <bbbbb>aabbccddeeffgghhiijjkkllmm</bbbbb>
    Posted 07-01-2009 at 08:48 AM by JimRobinson JimRobinson is offline
  2. Old Comment
    Posted 07-03-2009 at 07:34 AM by gabim gabim is offline
 

  



All times are GMT -5. The time now is 09:23 AM.

Main Menu
Advertisement

My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration