Can anyone shed some light into these errors I keep getting for multiple files when I run rsync in verbose mode to a FAT32 external hard drive?

rsync: stat "/mnt/usbdrive/Batch 2/od venezuelan" failed: No such file or directory (2)
rsync: recv_generator: mkdir "/mnt/usbdrive/Batch 2/joseph gangster" failed: No space left on device (28)


I have 588GB available on my external hard drive, and i'm only trying to rsync 200GB to it, so its not out of space or anything like that.

I've tried rsync with -r -t --size-only --delete and -r -t --modify-window=1 --delete and both ways seem to give me the message.

I'm stumped!! or should i just reformat as NFTS and start over? i already had another 200GB data set copied on here, was trying to add a second. its all JPG pictures.

post the results of this (as root)
fdisk -ls

Disk /dev/sda: 1499.8 GB, 1499883110400 bytes
255 heads, 63 sectors/track, 182350 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sda1 * 1 182350 1464726343+ 83 Linux

Disk /dev/sdb: 1499.8 GB, 1499883110400 bytes
255 heads, 63 sectors/track, 182350 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sdb1 * 1 182350 1464726343+ 83 Linux

Disk /dev/sdc: 73.2 GB, 73274490880 bytes
255 heads, 63 sectors/track, 8908 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sdc1 * 1 16 128488+ 83 Linux
/dev/sdc2 17 409 3156772+ 83 Linux
/dev/sdc3 2631 8908 50428035 83 Linux
/dev/sdc4 410 2630 17840182+ 5 Extended
/dev/sdc5 410 1193 6297448+ 83 Linux
/dev/sdc6 1194 1715 4192933+ 83 Linux
/dev/sdc7 1716 2108 3156741 83 Linux
/dev/sdc8 2109 2369 2096451 82 Linux swap
/dev/sdc9 2370 2630 2096451 83 Linux

Partition table entries are not in disk order

Disk /dev/sdd: 1000.1 GB, 1000152456192 bytes
255 heads, 63 sectors/track, 121594 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sdd1 2 121594 976695772+ f W95 Ext'd (LBA)
/dev/sdd5 2 121594 976695741 b W95 FAT32

which of these is the destination folder mounted to ? sdd1? sdd5?

sdd5 I believe. when i tried to mount the other one it gave me an error.

run df -h
When I get this error usually the external drive is not mounted and I am trying to copy the files to my /mnt/sdc1 directory on my root file system.

jlinkels

Hi jlinkels. I know the df -h shows it, because that was how i saw how much free space was on it to report in my first post.

I dont know if this has any barring, but it seems like the rsync starts to work fine, but the longer it runs, the more those errors pop up, then it happens so much i cant even tell what's going on because it scrolls so fast.

I really don't understand why it would say no space where there is hundreds of GB's available, and the other message I forgot to check to see if that directory actually existed before i left today.

On /dev/sdd you have one partition which happens to be extended as well. I don't know the first partition type f W95 Ext'd (LBA). Apparently this partition holds the next extended partition.

It is obvious that /dev/sdd1 doesn't mount, it is not a real partition.

Is this normal for VFAT partitions, have you done it before? Any reason to stay on VFAT? I am not at all familiar with such a partition scheme.

I am using my external 1 TB disk with 1 primary partition formatted XFS.

jlinkels

I had it as fat32 because I need to transfer it between linux mac and pc's without having to worry about permissions. Do you think ntfs would be better to handle all those files and transfer between all those os's.

You should double-check the maximum file and partition size of FAT32. File size is 2 GB, dunno if that brings you into problems.

NTFS is certainly a better file system, but I am not 100% sure that it is compatible among all 3 OS-es.

Why did you create an extended partition on the external disk instead of one primary partition?

jlinkels

my external drive is actually two drives RAID1'd through the software utility that came with it, so that did the partitioning so its a mirrored set of 1TB drives.

most of my folder names have spaces in them too, and some are quite similar. you think that is making rsync trip up?

or perhaps its actually running out of space wherever it writes the temp files to? idk, i'm reaching here.

Could it be a "number of directory entries" issue? I notice that your failing mkdir appears to be based on a persons name. I believe max number of directory entries under fat32 is 65535, but as long-filename support can result in a single file/subdir taking up several entries, it can be much smaller than that.

If this is the case then perhaps splitting your batches further might work around this. Reports suggest anywhere in the region of 10-20K entries could be enough to trigger this issue.

it could be. i went with fat32 so i could transfer it between XP, Mac OSX, and Linux. how can i tell how many directories there currently are on the entire drive? I know some of the jpg's have long file names.