sort 2 columns

DoME69 · 07-10-2018, 03:10 AM

Hi,

I have the following print I get from SGE

Code:

35057546   16.0   13.0    r       10/07   06:52   be_main.q   cooper444   1       proj-unit1-dc-gen_rep         unit1_rtl_28_05_18_FP1_pins_oreder_fix_w_sss
35062872   6.0    NA      hqw     10/07   10:14   NA          NA          8       proj-unit1-cf        		unit1_rtl_28_05_18_FP1_pins_oreder_fix
35062828   8.0    NA      hqw     10/07   10:12   NA          NA          8       proj-unit1-coc      		unit1_rtl_28_05_18_FP1_pins_oreder_fix
35062840   9.0    NA      hqw     10/07   10:12   NA          NA          8       proj-unit1-coo     		unit1_rtl_28_05_18_FP1_pins_oreder_fix
35012037   14.0   8.3     r       09/07   15:40   be_main.q   cooper321   1       proj-unit1--INTERACTIVE       unit1_rtl_28_05_18_FP1_pins_oreder_fix_w_sss
35062810   6.0    12.5    r       10/07   10:34   be_main.q   cooper311   8       proj-unit1-po          	unit1_rtl_28_05_18_FP1_pins_oreder_fix
35062853   5.0    NA      hqw     10/07   10:13   NA          NA          8       proj-unit1-ra         	unit1_rtl_28_05_18_FP1_pins_oreder_fix
34949335   4.0    44.7    r       09/07   20:34   be_main.q   cooper343   8       proj-unit3-ra        		unit3_rtl_06_06_18_FP2
34949379   4.0    41.8    r       10/07   00:41   be_main.q   cooper358   8       proj-unit3-ra        		unit3_rtl_06_06_18_FP1
34949920   4.0    46.2    r       09/07   17:38   be_main.q   cooper341   8       proj-unit3-ra         	unit3_rtl_06_06_18_FP3
34949378   4.0    NA      hqw     08/07   11:09   NA          NA          8       proj-unit3-ro          	unit3_rtl_06_06_18_FP2
34949384   4.0    NA      hqw     08/07   11:10   NA          NA          8       proj-unit3-ro          	unit3_rtl_06_06_18_FP1
34949933   4.0    NA      hqw     08/07   11:23   NA          NA          8       proj-unit3-ro          	unit3_rtl_06_06_18_FP3
35009686   22.0   36.1    r       09/07   14:45   be_main.q   cooper440   8       proj-unit2-dc                 unit2_rtl_18_05_18r1_FP2_w_sss
35062135   35.0   16.4    r       10/07   09:39   be_main.q   cooper423   1       proj-unit2-dcrep              unit2_rtl_18_05_18r1_FP2
34951419   4.0    NA      hqw     08/07   12:01   NA          NA          8       proj-unit2-cf        		unit2_rtl_18_05_18r1_FP1_scripts_change
35063469   4.0    NA      hqw     10/07   10:26   NA          NA          8       proj-unit2-cf        		unit2_rtl_18_05_18r1_FP2
35063190   16.0   10.3    r       10/07   10:26   be_main.q   cooper307   8       proj-unit2-Id        		unit2_rtl_18_05_18r1_FP2
35003338   14.0   20.4    r       09/07   11:26   be_main.q   cooper348   1       proj-unit2--INTERACTIVE	unit2_rtl_18_05_18r1_FP1_scripts_change
34951371   4.0    60.9    r       09/07   18:57   be_main.q   cooper348   8       proj-unit2-ro          	unit2_rtl_18_05_18r1_FP1_scripts_change
35063418   4.0    NA      hqw     10/07   10:25   NA          NA          8       proj-unit2-ro          	unit2_rtl_18_05_18r1_FP2

I want to ask how can I sort twice in same command line in tcsh.
First I want to sort by name in column 10 and then by column 7 but keeping column 10 sorted.
I tried to use below command but without success

Code:

awk 'NR == 0 ; NR > 1 {print $0 | "sort -k11,11 -k7,7" }'

This should be look like below example:

Code:

35057546   16.0   13.0    r       10/07   06:52   be_main.q   cooper444   1       proj-unit1-dc-gen_rep         unit1_rtl_28_05_18_FP1_pins_oreder_fix_w_sss
35012037   14.0   8.3     r       09/07   15:40   be_main.q   cooper321   1       proj-unit1--INTERACTIVE       unit1_rtl_28_05_18_FP1_pins_oreder_fix_w_sss
35062810   6.0    12.5    r       10/07   10:34   be_main.q   cooper311   8       proj-unit1-po          	unit1_rtl_28_05_18_FP1_pins_oreder_fix
35062872   6.0    NA      hqw     10/07   10:14   NA          NA          8       proj-unit1-cf        		unit1_rtl_28_05_18_FP1_pins_oreder_fix
35062828   8.0    NA      hqw     10/07   10:12   NA          NA          8       proj-unit1-coc      		unit1_rtl_28_05_18_FP1_pins_oreder_fix
35062840   9.0    NA      hqw     10/07   10:12   NA          NA          8       proj-unit1-coo     		unit1_rtl_28_05_18_FP1_pins_oreder_fix
35062853   5.0    NA      hqw     10/07   10:13   NA          NA          8       proj-unit1-ra         	unit1_rtl_28_05_18_FP1_pins_oreder_fix
35009686   22.0   36.1    r       09/07   14:45   be_main.q   cooper440   8       proj-unit2-dc                 unit2_rtl_18_05_18r1_FP2_w_sss
35062135   35.0   16.4    r       10/07   09:39   be_main.q   cooper423   1       proj-unit2-dcrep              unit2_rtl_18_05_18r1_FP2
35063190   16.0   10.3    r       10/07   10:26   be_main.q   cooper307   8       proj-unit2-Id        		unit2_rtl_18_05_18r1_FP2
35003338   14.0   20.4    r       09/07   11:26   be_main.q   cooper348   1       proj-unit2--INTERACTIVE	unit2_rtl_18_05_18r1_FP1_scripts_change
34951371   4.0    60.9    r       09/07   18:57   be_main.q   cooper348   8       proj-unit2-ro          	unit2_rtl_18_05_18r1_FP1_scripts_change
34951419   4.0    NA      hqw     08/07   12:01   NA          NA          8       proj-unit2-cf        		unit2_rtl_18_05_18r1_FP1_scripts_change
35063469   4.0    NA      hqw     10/07   10:26   NA          NA          8       proj-unit2-cf        		unit2_rtl_18_05_18r1_FP2
35063418   4.0    NA      hqw     10/07   10:25   NA          NA          8       proj-unit2-ro          	unit2_rtl_18_05_18r1_FP2
34949335   4.0    44.7    r       09/07   20:34   be_main.q   cooper343   8       proj-unit3-ra        		unit3_rtl_06_06_18_FP2
34949379   4.0    41.8    r       10/07   00:41   be_main.q   cooper358   8       proj-unit3-ra        		unit3_rtl_06_06_18_FP1
34949920   4.0    46.2    r       09/07   17:38   be_main.q   cooper341   8       proj-unit3-ra         	unit3_rtl_06_06_18_FP3
34949378   4.0    NA      hqw     08/07   11:09   NA          NA          8       proj-unit3-ro          	unit3_rtl_06_06_18_FP2
34949384   4.0    NA      hqw     08/07   11:10   NA          NA          8       proj-unit3-ro          	unit3_rtl_06_06_18_FP1
34949933   4.0    NA      hqw     08/07   11:23   NA          NA          8       proj-unit3-ro          	unit3_rtl_06_06_18_FP3

NevemTeve · 07-10-2018, 03:24 AM

Please use "code" tags, not "quote" tags. Also please reduce the sample-lists, we do understand the concept of sorting, even without a dozen of lines.

DoME69 · 07-10-2018, 03:30 AM

Quote:

Originally Posted by NevemTeve

Please use "code" tags, not "quote" tags. Also please reduce the sample-lists, we do understand the concept of sorting, even without a dozen of lines.

Sorry,

Done.

NevemTeve · 07-10-2018, 03:44 AM

Thank you. I think it would be simply:

Code:

LC_ALL=C sort -k10 -k7 inputfile >outputfile

syg00 · 07-10-2018, 04:24 AM

sort defaults to end-of-record if no termination field is included, so the OP has the right idea, but why -k11 ?.
I know nothing of tcsh, but I also don't understand the need for awk.

DoME69 · 07-10-2018, 04:56 AM

Quote:

Originally Posted by syg00

sort defaults to end-of-record if no termination field is included, so the OP has the right idea, but why -k11 ?.
I know nothing of tcsh, but I also don't understand the need for awk.

I had to remove 2 rows from top this is why I use awk and then sort.

DoME69 · 07-10-2018, 04:58 AM

Quote:

Originally Posted by NevemTeve

Thank you. I think it would be simply:

Code:

LC_ALL=C sort -k10 -k7 inputfile >outputfile

This is not work for me.
I use the command line to sort jobs from SGE, below is the full command.

Code:

set LC_ALL="C"
qstat -showdir| egrep -v "idle.q|xmsg[00000-99999]|\-\-\-\-\-\-\-\-\-\-" | sort -k10 -k7

scasey · 07-10-2018, 05:01 AM

Quote:

Originally Posted by DoME69

I want to ask how can I sort twice in same command line in tcsh.
First I want to sort by name in column 10 and then by column 7 but keeping column 10 sorted.

That seems a contradictory specification...if you want both col 7 and col 10 sorted, but with col 10 as the high order, don't you need to sort by 7 first, then 10?

I'd have to play with it some, but it's past midnight. I'll check back in the morning.

I'd use sort, not awk.

I'm not sure which shell is being used is a factor, either.

NevemTeve · 07-10-2018, 05:07 AM

> This is not work for me.

Please explain this in more details. You may even create examples, eg:

Code:

#!/bin/sh

export LC_ALL=C

sort -k10 -k7 <<EOF
C1 C2 C3 C4 C5 C6 71 C8 C9 100
B1 B2 B3 B4 B5 B6 72 B8 B9 101
A1 A2 A3 A4 A5 A6 73 A8 A9 100
EOF

the result:

Code:

C1 C2 C3 C4 C5 C6 71 C8 C9 100
A1 A2 A3 A4 A5 A6 73 A8 A9 100
B1 B2 B3 B4 B5 B6 72 B8 B9 101

DoME69 · 07-10-2018, 05:23 AM

Quote:

Originally Posted by NevemTeve

> This is not work for me.

Please explain this in more details. You may even create examples, eg:

Code:

#!/bin/sh

export LC_ALL=C

sort -k10 -k7 <<EOF
C1 C2 C3 C4 C5 C6 71 C8 C9 100
B1 B2 B3 B4 B5 B6 72 B8 B9 101
A1 A2 A3 A4 A5 A6 73 A8 A9 100
EOF

the result:

Code:

C1 C2 C3 C4 C5 C6 71 C8 C9 100
A1 A2 A3 A4 A5 A6 73 A8 A9 100
B1 B2 B3 B4 B5 B6 72 B8 B9 101

As you can see in my open thread,
All name with the word unit* (column 10) sorted without effect in column 7 (name: be_main.q)
both columns keep sorted.

NevemTeve · 07-10-2018, 05:35 AM

> All name with the word unit* (column 10)
Isn't that column 11 ?

DoME69 · 07-10-2018, 05:50 AM

Quote:

Originally Posted by NevemTeve

> All name with the word unit* (column 10)
Isn't that column 11 ?

yes.

NevemTeve · 07-10-2018, 06:08 AM

Then try both 'sort -k11 -k7' and 'sort -k7 -k11', if neither helps then you should explain your problem more clearly.

bigearsbilly · 07-12-2018, 10:15 AM

I think your example is wrong, or impossible.