Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question?
If it is not in the man pages or the how-to's this is the place! |
Notices |
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
Are you new to LinuxQuestions.org? Visit the following links:
Site Howto |
Site FAQ |
Sitemap |
Register Now
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
|
 |
08-23-2012, 01:34 PM
|
#1
|
LQ Newbie
Registered: Jul 2012
Posts: 3
Rep: 
|
Arrange output by frequency of occurrence
Hello,
I have a file with entries like:
A
A
B
C
A
B
B
A
...
I want the output to look something like: (arrange by how many times a particular entry occurs and write down how many times it occurs)
A 4
B 3
C 1
What code should I use? My file is very large and have tens of thousands of different entries, so it's not practical for me to define individually what A, B, C...are.
Thank you =)
|
|
|
08-23-2012, 01:52 PM
|
#2
|
Member
Registered: Aug 2012
Location: /home/byannoni
Distribution: Arch
Posts: 128
Rep:
|
Code:
uniq -c file | sort -nr
|
|
|
08-23-2012, 03:27 PM
|
#3
|
LQ Guru
Registered: May 2005
Location: boston, usa
Distribution: fedora-35
Posts: 5,326
|
you would need to sort before you uniq
Code:
sort olivia.txt | uniq -c | sort -n -r # | awk '{print $2 " " $1}'
|
|
|
08-23-2012, 04:33 PM
|
#4
|
Member
Registered: Aug 2012
Location: /home/byannoni
Distribution: Arch
Posts: 128
Rep:
|
Quote:
Originally Posted by schneidz
you would need to sort before you uniq
Code:
sort olivia.txt | uniq -c | sort -n -r # | awk '{print $2 " " $1}'
|
Did you try mine before saying what it needs? It works fine and the output is the same as yours.
|
|
|
08-23-2012, 04:38 PM
|
#5
|
LQ Guru
Registered: May 2005
Location: boston, usa
Distribution: fedora-35
Posts: 5,326
|
no i didnt, i'll try it now... i always learned that a sort was necessary before a uniq since uniq counts consecutive rows.
edit:
i think i'm rite:
Code:
[schneidz@hyper abg]$ uniq -c olivia.txt | sort -nr
2 B
2 A
1 C
1 B
1 A
1 A
[schneidz@hyper abg]$ sort olivia.txt | uniq -c | sort -n -r | awk '{print $2 " " $1}'
A 4
B 3
C 1
[schneidz@hyper abg]$ uniq --version
uniq (GNU coreutils) 8.10
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Written by Richard M. Stallman and David MacKenzie.
[schneidz@hyper abg]$ sort --version
sort (GNU coreutils) 8.10
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Written by Mike Haertel and Paul Eggert.
Last edited by schneidz; 08-23-2012 at 04:42 PM.
|
|
|
08-23-2012, 05:09 PM
|
#6
|
Bash Guru
Registered: Jun 2004
Location: Osaka, Japan
Distribution: Arch + Xfce
Posts: 6,852
|
Here's a slightly more advanced gawk solution.
Code:
gawk 'BEGIN{ PROCINFO["sorted_in"]="@val_num_desc" } { a[$1]+=1 } END{ for ( i in a ) { print i,a[i] } }' infile.txt
It counts the number of each entry using an array, and prints the results out at the end.
Sorting is handled by a PROCINFO setting, which is why it requires a recent version.
For older versions of gawk or other awks, remove the BEGIN section and just pipe the output through " sort -rn -k2".
Last edited by David the H.; 08-23-2012 at 05:10 PM.
|
|
|
08-23-2012, 05:09 PM
|
#7
|
Member
Registered: Aug 2012
Location: /home/byannoni
Distribution: Arch
Posts: 128
Rep:
|
Quote:
Originally Posted by schneidz
no i didnt, i'll try it now... i always learned that a sort was necessary before a uniq since uniq counts consecutive rows.
edit:
i think i'm rite:
Code:
[schneidz@hyper abg]$ uniq -c olivia.txt | sort -nr
2 B
2 A
1 C
1 B
1 A
1 A
[schneidz@hyper abg]$ sort olivia.txt | uniq -c | sort -n -r | awk '{print $2 " " $1}'
A 4
B 3
C 1
[schneidz@hyper abg]$ uniq --version
uniq (GNU coreutils) 8.10
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Written by Richard M. Stallman and David MacKenzie.
[schneidz@hyper abg]$ sort --version
sort (GNU coreutils) 8.10
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Written by Mike Haertel and Paul Eggert.
|
I stand corrected. Sorry about that, I should have tested with values that weren't already in order.
|
|
|
All times are GMT -5. The time now is 06:43 AM.
|
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
|
Latest Threads
LQ News
|
|