[SOLVED] BASH Script batch delete dup file in same dir

BW-userx · 06-01-2017, 06:55 AM

Quote:

Originally Posted by Guttorm

I tried it on the list in the first post. It looks like it overgenerates duplicates because of the Xtc prefix.

So then i cut of the "Xtc-" prefix, and it works well:

and @syg00
yeah - just the names I am going to worry about.
almost got it. I just got to slap it in a script and fiddle with it - that should get me where I want to be. got a figure out how to chop off the Xtc- then work with in in a script, because CLI isn't getting me anywhere.

It might just be the way it outputs and not looks at it, I do not know. I am trying to chop off the Xtc- within the $(bash fuzzy.sh "${name#*-}" ; echo "${name#*-}" ) part as my putting it before that wasn't getting me anywhere either.

Code:

userx%slackwhere ⚡ Xtc Live ⚡> while read name ; do echo   $(bash /home/userx/scripts/production/fuzzy.sh "${name#*-}" ; echo "${name#*-}") ; done< <(find "/run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live" -name "*.mp3")  | sort | uniq -d -w 4 -D                             
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Are You Receiving Me?.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-AreYouReceivingMe?.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Battery Brides.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Burning With Optimism's Flame.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Generals And Majors.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Life Begins At The Hop.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-LifeBeginsAtTheHop.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Living Through Another Cuba.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Love At First Sight.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Making Plans For Nigel.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-No Language In Our Lungs.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Respectable Street.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-RespectableStreet.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Scissor Man.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-This Is Pop?.mp3
E236 External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Towers Of London.mp3

MOD:
ok I go one thing figured out so far - I had to go long ${name##*-} on just the one being passed to fuzzy.sh

this is better

Code:

userx%slackwhere ⚡ Xtc Live ⚡> while read name ; do echo   $(bash /home/userx/scripts/production/fuzzy.sh "${name##*-}" ; echo "${name}") ; done< <(find "/run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live" -name "*.mp3")  | sort | uniq -d -w 4 -D                               
A662 /run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Are You Receiving Me?.mp3
A662 /run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-AreYouReceivingMe?.mp3
L112 /run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Life Begins At The Hop.mp3
L112 /run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-LifeBeginsAtTheHop.mp3
R212 /run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-Respectable Street.mp3
R212 /run/media/userx/3TB-External/Test-Duplecates-files/Xtc/Xtc Live/Xtc-RespectableStreet.mp3

BW-userx · 06-02-2017, 08:58 AM

The script that works (sofar)

Searches for liked named files then removes one keeps the other.

Code:

#!/bin/bash

working_dir=/run/media/userx/3TB-External/Test-Duplecates-files

move_to=/run/media/userx/3TB-External/Hold-Test-Files

#set -x
while read FILENAME
do
{
f=$FILENAME
path=${f%/*} 
xfile=${f##*/}
title=${xfile%.*}
ext=${xfile##*.}
while read FILE
do
{
f=$FILE
path=${f%/*}
xfile=${f##*/}
title2=${xfile%.*}
ext=${xfile##*.}

#check for spaces in string in first loop if spaces then look for string without spaces in inner loop
#              Has Spaces in string                         Has NO spaces in string
if [[ "$title" = "${title%[[:space:]]}" && "$title2" =  "${title2%[[:space:]]*}" ]] ; then
#remove spaces in first string to check against second string without spaces
CKtitle=${title// /}
  [[ "$CKtitle" =~ "$title2" ]] &&  (
    #if now matched remove second file without spaces
    getRidOf=${path/$working_dir/$move_to}
    mkdir -pv "$getRidOf"
    mv -v "$path/$title2.$ext" "$getRidOf"
)

fi
}
done< <(find "$path" -type f \( -name "*.mp3" -o -name "*.MP3" \))
}
done< <(find "$working_dir" -type f \( -name "*.mp3" -o -name "*.MP3" \))