I have a folder(header2018) within a pwd (/goon/gos1/header2018/) that contains hundreds of thousands of files. I have a script that moves files from header2018 into created subfolders, however I don't want the files moved into subfolders. I want them moved into folders created within the pwd. I'm thinking script could look like this.


let fileCount=3000
let dirNum=1

for f in *
do
[ -d $f ] && continue
[ $fileCount -eq 3000 ] && {
dir=$(printf "%03d" $dirNum)
mkdir $dir
let dirNum=$dirNum+1
let fileCount=0
}

mv $f $dir
mv $dir /pwd/header2018/
let fileCount=$fileCount+1
done



Please help

If I understand your intentions, you create directories whose names are numbers, and move 3000 files into each of them.

You script looks OK except this part will be executed for each file:
After the first file $f, $dir won't exist in this directory and you will get 2999 error messages.

Fix that and test it with a few thousand dummy files in a dummy directory.

Personally, I think a program is more readable when you use if instead of the && construct, but that's just a style question.

And fileCount initialization
is wrong.

Update on Question.

I found this script as the solution to my problem.

#!/bin/bash
i=0 # counter for current file
j=0 # counter for current directory
batchsize=1000 # size of each batch
find folderA -type f -print0 | while read -r -d $'\0' file
do
if (( i % batchsize == 0 ))
then
(( j++ ))
mkdir "folderA_$j"
fi
mv -- "$file" "folderA_$j"
(( i++ ))
done