Find duplicate files by name

xzased · 07-24-2010, 12:14 AM

Hi, we have a huge amount of duplicate files in a folder and I would like some pointers on to writing a bash script to create a list of the duplicate files. I've seen examples that check for the md5 sum of files... but I dont need that, the file name is enough. Can someone please help me?

Telengard · 07-24-2010, 12:29 AM

Quote:

Originally Posted by xzased

Hi, we have a huge amount of duplicate files in a folder and I would like some pointers on to writing a bash script to create a list of the duplicate files ... the file name is enough.

Umm, it should not be possible to have two files with the same name in the same folder.

xzased · 07-24-2010, 12:59 AM

LOL! True Mr. Telengard. I meant in subfolders. So I have the directory /storage which holds about 10 subfolders which hold around 3 more subfolders each with around 300 + files in. Messy, I know. So the duplicates are between subfolders.

Telengard · 07-24-2010, 01:06 AM

Okay, this has had only very minimal testing so use at your own discretion. As always, it is your responsibility to evaluate this code's suitability for your purposes.

Code:

#!/bin/bash

find -type f > names.lst

while read name
do
    bn="$( basename "$name" )"
    name2="$( grep "$bn" names.lst | grep -v "$name" )"
    if [ "$name2" != "" ]
    then
	echo "$name"
	echo "$name2"
    fi
done < names.lst

I bet 3 Internets that someone else will have a much more elegant solution for you by tomorrow.

xzased · 07-24-2010, 01:35 AM

Wow, thanks sir. Your help is appreciated.