Share your knowledge at the LQ Wiki.
Go Back > Forums > Linux Forums > Linux - Newbie
User Name
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!


  Search this Thread
Old 10-13-2007, 11:16 AM   #1
Registered: Dec 2006
Posts: 36

Rep: Reputation: 17
How to AUTO remove duplicate files

Hi, I wish to remove duplicate files from my midi collection.
I started with fdupes which lets me choose which of the dupes I wish
to keep (Usually 1).

Then I realised I would have to decide over 12,000 times. Not practical!
I would be happy just to keep the first copy, then delete the rest.

Is there an app that might do this for me, or would I have to pass
the option from fdupes to some sort of bash script thingy?

I realise it's not a good idea to let the system loose like this, but
the doesn't seem to be an alternative.

If it requires a bash script, some/any advice would be greatly
appreciated, as I don't have any idea where to start.

Click here to see the post LQ members have rated as the most helpful post in this thread.
Old 10-13-2007, 11:42 AM   #2
Registered: Dec 2006
Posts: 36

Original Poster
Rep: Reputation: 17
Sorry about this, but I think I've sorted it.

I found a reference to a command called 'yes' which seems to pass
a string.

yes 1 | fdupes -rd /mnt/hda5/midi_files

Just in case anyones interested.
2 members found this post helpful.
Old 10-13-2007, 12:22 PM   #3
Senior Member
Registered: Oct 2003
Location: UK
Distribution: Kubuntu 12.10 (using awesome wm though)
Posts: 3,530

Rep: Reputation: 63
Thanks for posting the solution you found - it's good for with other people with a similar need are directed to the thread by search engines.
Old 10-13-2007, 12:25 PM   #4
Junior Hacker
Senior Member
Registered: Jan 2005
Location: North America
Distribution: Debian testing Mandriva Ubuntu
Posts: 2,687

Rep: Reputation: 61
There are a couple examples in this thread.
Old 10-13-2007, 12:57 PM   #5
Registered: Dec 2006
Posts: 36

Original Poster
Rep: Reputation: 17
Originally Posted by Junior Hacker View Post
There are a couple examples in this thread.
Thanks for that, duplicate photos were going to be next.
I did wonder about the accuracy of fdupes, I didn't realise there are
apps specializing in finding dupe images.

Very handy!
Old 03-31-2008, 11:07 PM   #6
LQ Newbie
Registered: Jan 2004
Location: Hereford, UK
Distribution: Kubuntu 7.10
Posts: 13

Rep: Reputation: 0
Bonzer! That script was exactly what I've been looking for. It's so good on the trial folders I set up, that when I let it loose on /dev/hda, it instantly recognised that I had two operating systems, deleted the one (marked "Windoof Genuine Advantage"), and kept the better version (marked "linux")! Only joking about the last bit, I cleared that crap off my hard drive five years ago, but sincerely, well discovered!
Old 04-22-2008, 07:29 PM   #7
Registered: Dec 2005
Distribution: debian
Posts: 160

Rep: Reputation: 30
a customizable alternative

if you're interested in a solution where you can rank directories
for priority of beeing deleted if duplicates found in them.
also providing a configuration file with regexes for selection
of files.
you can find a full list of features here.
the program is here
also there is a readme file here that describes the program in detail.
Old 12-11-2012, 01:54 AM   #8
LQ Newbie
Registered: Dec 2012
Posts: 1

Rep: Reputation: Disabled
Duplicate Files Deleter

I read your post. We all need to delate Duplicate Files Deleter softwere for delete Duplicate files form our PC. So I have a softwere for this work. I sheared with you my softwere so there is the link to go my site Just go there and download the free version of this softwere. If you like that then buy If not you don't want to buy it.
Old 12-11-2012, 02:03 AM   #9
Senior Member
Registered: Mar 2012
Posts: 1,606

Rep: Reputation: 422Reputation: 422Reputation: 422Reputation: 422Reputation: 422
from man fdupes:
-N --noprompt
       when used together with --delete, preserve  the  first  file  in
       each  set  of duplicates and delete the others without prompting
       the user
No script required
Old 03-13-2013, 02:19 PM   #10
LQ Newbie
Registered: Mar 2013
Posts: 2

Rep: Reputation: Disabled
I've recently found a software "Duplicate Files Deleter", and it can help you with this. Check . There is a video to explain the process. Pretty nice solution to delete duplicates safely.


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Finding duplicate files SlowCoder Linux - General 6 10-12-2007 08:25 AM
deleting duplicate files cs-cam Linux - General 3 11-14-2006 11:27 PM
editors and duplicate files printf Linux - Newbie 7 11-22-2005 03:54 AM
need app to remove duplicate files from the filesystem Ynot Irucrem Linux - Software 2 05-19-2005 12:35 PM
duplicate files in one folder! hornung Linux - Enterprise 1 01-13-2005 03:35 PM > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 08:01 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration