[SOLVED] About 5000000 file's i need trim

Vodkaholic1983 · 02-23-2011, 11:00 AM

I need to trim(delete) the first 2,3,4,5,6 character's from a set of file's (2 from some 3 from some etc...)

I run debian is there a easy way to do this as am useless are command's and really don't want to download all them file's and use file-monkey just to reupload them.

Thank's

syg00 · 02-23-2011, 11:43 AM

I'd use sed - use "in-place" and address of one to force only the first line to be the target. Wrap it in a simple "for i in ..."

Done.

druuna · 02-23-2011, 11:49 AM

Hi,

The cut command comes to mind:
Cut first 2 chars:

Code:

cut -b 1-2 --complement infile

Cut first 6 chars:

Code:

cut -b 1-6 --complement infile

Hope this helps.

druuna · 02-23-2011, 11:55 AM

Hi,

Sed is probably easier (thanks syg00

):

Cut 2 chars:

Code:

sed -i 's/^..//' infile

Cut 6 chars:

Code:

sed -i 's/^......//' infile

Hope this helps.

syg00 · 02-23-2011, 12:00 PM

I presumed only the first line needed alteration rather than each line - the OP can clarify.

druuna · 02-23-2011, 12:06 PM

Hi,

Quote:

Originally Posted by syg00

I presumed only the first line needed alteration rather than each line - the OP can clarify.

That is indeed one way of reading it, now that I look at it more closely. OP does need to clarify, the cut command won't work if only the first line needs to be targeted. The sed command needs a small addition:

Code:

sed -i '1s/^..//' infile

That is a one (1), not an el (l).

theNbomr · 02-23-2011, 12:17 PM

Quote:

I need to trim(delete) the first 2,3,4,5,6 character's from a set of file's (2 from some 3 from some etc...)

Your request is just peculiar enough that I'm going to speculate that what you you really mean is that you want to trim the characters from the file names and not from the file contents. Can you confirm that this is correct or not. It would be a shame to see you try a script that wrecks that many files when you wanted to simply rename them.

--- rod.

H_TeXMeX_H · 02-23-2011, 12:38 PM

More details needed, provide a few examples, be clear and specific if you want us to be.

Vodkaholic1983 · 02-23-2011, 03:55 PM

Hey sorry here is a few example's

25 - bekkankou blush book bracelet cover crown dress elbow_gloves feena_fam_earthlight from_behind gloves green_eyes hat highres jewelry lavender_hair looking_back purple_hair sitting smile yoake_mae_yori_.png

804 - kanon minase_nayuki tsukimiya_ayu.png

7352 - ahoge armor chopsticks fate_stay_night rice saber solo translated yuuryuu_nagare.jpg

70002 - blue_eyes blue_hair crescent detached_sleeves hat original pointy_ears sakaki_(artist) short_hair wings.png

701358 - bad_id big_al brown_hair cosplay fingerless_gloves gloves guilty_gear headband jewelry kyuichi male necklace simple_background skull smile sol_badguy sol_badguy_(cosplay) solo vocaloid yellow_eyes.png

The part's in bold is what i want to get rid of (tho i can't bold the space's " - " everything up to the first Word basicly

Hope that clear's thing's up some thanks!

Edit = oh also file's are in folder's which say have
2 number's image's all in one folder
3 number's are in there own folder etc..

Vodkaholic1983 · 02-23-2011, 04:07 PM

Also i ran that comment in a small test folder with 2 image's in it and got this

sed -i 's/^.........//' infile

sed: can't read infile: No such file or directory

theNbomr · 02-23-2011, 04:46 PM

So, to repeat the question, are the things to be modified the file NAMEs or file CONTENT. Yup, it really matters.
--- rod.

Vodkaholic1983 · 02-24-2011, 02:23 AM

Quote:

Originally Posted by theNbomr

So, to repeat the question, are the things to be modified the file NAMEs or file CONTENT. Yup, it really matters.
--- rod.

Yes thought I just showed that above that it is the file name's
Thank's

druuna · 02-24-2011, 02:54 AM

Hi,

Quote:

Edit = oh also file's are in folder's which say have
2 number's image's all in one folder
3 number's are in there own folder etc..

Are you talking about this:

Code:

1 - some file.png
2 - other file.jpg
10 - Directory 1
     01 - file xxxxxxx.jpg
     02 - file yyyyyyy.png
     200 - Directory A
           123 - file zzzzz.jpg
           321 - file aaaaa.png

And what you want to end up with looks like this:

Code:

some file.png
other file.jpg
Directory 1
     file xxxxxxx.jpg
     file yyyyyyy.png
     Directory A
           file zzzzz.jpg
           file aaaaa.png

If not suply us with a before and after example (without the extremely long names

).

Vodkaholic1983 · 02-24-2011, 05:37 AM

Quote:

Originally Posted by druuna

Hi,

Are you talking about this:

Code:

1 - some file.png
2 - other file.jpg
10 - Directory 1
     01 - file xxxxxxx.jpg
     02 - file yyyyyyy.png
     200 - Directory A
           123 - file zzzzz.jpg
           321 - file aaaaa.png

And what you want to end up with looks like this:

Code:

some file.png
other file.jpg
Directory 1
     file xxxxxxx.jpg
     file yyyyyyy.png
     Directory A
           file zzzzz.jpg
           file aaaaa.png

If not suply us with a before and after example (without the extremely long names

).

Code:

Directory 1
     file 27 - xxxxxxx.jpg
     file 28 - yyyyyyy.png
     file 29 - yyyyyyy.png
     file 30 - xxxxxxx.jpg
     file 31 - yyyyyyy.png
     file 32 - yyyyyyy.png
Directory 2
     file 127 - xxxxxxx.jpg
     file 128 - yyyyyyy.png
     file 129 - yyyyyyy.png
     file 127 - xxxxxxx.jpg
     file 128 - yyyyyyy.png
     file 129 - yyyyyyy.png
Directory 3
     file 1127 - xxxxxxx.jpg
     file 1128 - yyyyyyy.png
     file 1129 - yyyyyyy.png
     file 1127 - xxxxxxx.jpg
     file 1128 - yyyyyyy.png
     file 1129 - yyyyyyy.png  
Directory 4
     file 11127 - xxxxxxx.jpg
     file 11128 - yyyyyyy.png
     file 11129 - yyyyyyy.png
     file 11127 - xxxxxxx.jpg
     file 11128 - yyyyyyy.png
     file 11129 - yyyyyyy.png

More like that mate

druuna · 02-24-2011, 06:07 AM

Hi again,

Code:

#!/bin/bash

find $PWD -type d | grep -v "^$PWD$" | \
while read THISDIR
do
  cd "$THISDIR"
  ls | while read FILE
  do
    mv "${FILE}" "${FILE/#[0-9]* - /}"
  done
done

Sample run:

Code:

# Before:
~/Temp $ ls -l *
-rwxr-x--- 1 druuna internet  172 Feb 24 12:56 changer.sh

Dir 1:
total 0
-rw-r----- 1 druuna internet 0 Feb 24 12:57 1 - file01.png
-rw-r----- 1 druuna internet 0 Feb 24 12:57 2 - file02.png

Dir 2:
total 0
-rw-r----- 1 druuna internet 0 Feb 24 12:57 11 - file11.png
-rw-r----- 1 druuna internet 0 Feb 24 12:57 12 - file12.png

Dir 3:
total 0
-rw-r----- 1 druuna internet 0 Feb 24 12:57 111 - file21.png
-rw-r----- 1 druuna internet 0 Feb 24 12:57 112 - file22.png

# run the script:
~/Temp $ ./changer.sh

# After:
~/Temp $ ls -l *
-rwxr-x--- 1 druuna internet  172 Feb 24 12:56 changer.sh

Dir 1:
total 0
-rw-r----- 1 druuna internet 0 Feb 24 12:57 file01.png
-rw-r----- 1 druuna internet 0 Feb 24 12:57 file02.png

Dir 2:
total 0
-rw-r----- 1 druuna internet 0 Feb 24 12:57 file11.png
-rw-r----- 1 druuna internet 0 Feb 24 12:57 file12.png

Dir 3:
total 0
-rw-r----- 1 druuna internet 0 Feb 24 12:57 file21.png
-rw-r----- 1 druuna internet 0 Feb 24 12:57 file22.png

Make sure you test this first to make sure thgis is what you actually want!

This does not check for possible duplicate files in a directory, dupes will be overwritten (ie 123 - file.abc.png and 321 - file.abc.png will be reduced to one file: file.abc.png).

Anyway, hope this helps.