Hi,

Am trying to remove the duplicate records based on field wise.
But uniq command work only when fields are delimited by space ' '.
How to work on uniq command, when fields are delimited by comma , or another separators ?

Tom,Westley,Essex
Tom,Westley,Essex
Ravi,Bopara,Essex
Marcus,Trescothick,Somerset
Joe,Root,Yorkshire
Jonny,Bairstow,Yorkshire

Change the delimiters in the input file to space before passing to uniq.
You didn't share what you were using the delimiter for, so I can't guess at which option(s) you need.

Also see sort -u in

You can probably do it all in sort. Pay attention to the -t, -k, and -u options. See "man sort"

Also, please say more about what you are trying to do. Show an example of what you want the results to look like from the input you have provided above.

1 members found this post helpful.

Sounds familiar...much in line with other *VERY* similar questions in the past, which show no effort on your part, many of which even involve how to sort and use uniq
https://www.linuxquestions.org/quest...rt-4175596519/
https://www.linuxquestions.org/quest...pt-4175597362/
https://www.linuxquestions.org/quest...ze-4175598565/
https://www.linuxquestions.org/quest...te-4175594480/
https://www.linuxquestions.org/quest...es-4175588761/

Is there some point where you're going to read the "Question Guidelines", and show your own efforts??? You've been here some time now....

hi tbone,

i hope this question is unique when compared to others and here am trying the options only in "uniq" command and not in any other commands, to understand how "uniq" is effective when compared to others.

Properly designed utilities work together. uniq needs sorted data and sort has quite a few supplemental capabilities and the two utilities compliment each other.

Show some examples of what you have been trying and explain more specifically what results you want, including examples.

No, it is not; it is use of the same tool in a slightly different manner. And again, you have shown no efforts of your own. You have done very similar things in the past, and have also asked for handouts in those threads as well.

We are happy to HELP you, but asking us to write your scripts is another thing. Also, you need to start thinking about and APPLYING what you are told, so you can learn how to accomplish these things. You have all the answers and information you need, based on your other threads. It is now up to YOU to do the work.

Ok got it, thanks

Great...but you've stated such things in the past as well. So can you now show us your own efforts, so we can try to help you??? Reference any of the other threads where you ask about uniq and other commands in scripts if you need help.