LinuxQuestions.org
Help answer threads with 0 replies.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
Search this Thread
Old 01-18-2010, 05:03 PM   #1
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Rep: Reputation: 37
Still having rsync errors to external drive


Can anyone shed some light into these errors I keep getting for multiple files when I run rsync in verbose mode to a FAT32 external hard drive?

rsync: stat "/mnt/usbdrive/Batch 2/od venezuelan" failed: No such file or directory (2)
rsync: recv_generator: mkdir "/mnt/usbdrive/Batch 2/joseph gangster" failed: No space left on device (28)


I have 588GB available on my external hard drive, and i'm only trying to rsync 200GB to it, so its not out of space or anything like that.

I've tried rsync with -r -t --size-only --delete and -r -t --modify-window=1 --delete and both ways seem to give me the message.

I'm stumped!! or should i just reformat as NFTS and start over? i already had another 200GB data set copied on here, was trying to add a second. its all JPG pictures.

Last edited by rjo98; 01-18-2010 at 05:15 PM.
 
Old 01-18-2010, 05:45 PM   #2
nephish
Member
 
Registered: Jun 2005
Distribution: arch, ubuntu
Posts: 456

Rep: Reputation: 30
post the results of this (as root)
fdisk -ls
 
Old 01-18-2010, 05:49 PM   #3
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
Disk /dev/sda: 1499.8 GB, 1499883110400 bytes
255 heads, 63 sectors/track, 182350 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sda1 * 1 182350 1464726343+ 83 Linux

Disk /dev/sdb: 1499.8 GB, 1499883110400 bytes
255 heads, 63 sectors/track, 182350 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sdb1 * 1 182350 1464726343+ 83 Linux

Disk /dev/sdc: 73.2 GB, 73274490880 bytes
255 heads, 63 sectors/track, 8908 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sdc1 * 1 16 128488+ 83 Linux
/dev/sdc2 17 409 3156772+ 83 Linux
/dev/sdc3 2631 8908 50428035 83 Linux
/dev/sdc4 410 2630 17840182+ 5 Extended
/dev/sdc5 410 1193 6297448+ 83 Linux
/dev/sdc6 1194 1715 4192933+ 83 Linux
/dev/sdc7 1716 2108 3156741 83 Linux
/dev/sdc8 2109 2369 2096451 82 Linux swap
/dev/sdc9 2370 2630 2096451 83 Linux

Partition table entries are not in disk order

Disk /dev/sdd: 1000.1 GB, 1000152456192 bytes
255 heads, 63 sectors/track, 121594 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

Device Boot Start End Blocks Id System
/dev/sdd1 2 121594 976695772+ f W95 Ext'd (LBA)
/dev/sdd5 2 121594 976695741 b W95 FAT32
 
Old 01-18-2010, 05:54 PM   #4
nephish
Member
 
Registered: Jun 2005
Distribution: arch, ubuntu
Posts: 456

Rep: Reputation: 30
which of these is the destination folder mounted to ? sdd1? sdd5?
 
Old 01-18-2010, 05:59 PM   #5
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
sdd5 I believe. when i tried to mount the other one it gave me an error.
 
Old 01-18-2010, 07:37 PM   #6
jlinkels
Senior Member
 
Registered: Oct 2003
Location: Bonaire
Distribution: Debian Wheezy/Jessie/Sid, Linux Mint DE
Posts: 4,193

Rep: Reputation: 538Reputation: 538Reputation: 538Reputation: 538Reputation: 538Reputation: 538
run df -h
When I get this error usually the external drive is not mounted and I am trying to copy the files to my /mnt/sdc1 directory on my root file system.

jlinkels
 
Old 01-18-2010, 08:44 PM   #7
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
Hi jlinkels. I know the df -h shows it, because that was how i saw how much free space was on it to report in my first post.

I dont know if this has any barring, but it seems like the rsync starts to work fine, but the longer it runs, the more those errors pop up, then it happens so much i cant even tell what's going on because it scrolls so fast.

I really don't understand why it would say no space where there is hundreds of GB's available, and the other message I forgot to check to see if that directory actually existed before i left today.
 
Old 01-18-2010, 08:55 PM   #8
jlinkels
Senior Member
 
Registered: Oct 2003
Location: Bonaire
Distribution: Debian Wheezy/Jessie/Sid, Linux Mint DE
Posts: 4,193

Rep: Reputation: 538Reputation: 538Reputation: 538Reputation: 538Reputation: 538Reputation: 538
On /dev/sdd you have one partition which happens to be extended as well. I don't know the first partition type f W95 Ext'd (LBA). Apparently this partition holds the next extended partition.

It is obvious that /dev/sdd1 doesn't mount, it is not a real partition.

Is this normal for VFAT partitions, have you done it before? Any reason to stay on VFAT? I am not at all familiar with such a partition scheme.

I am using my external 1 TB disk with 1 primary partition formatted XFS.

jlinkels
 
Old 01-18-2010, 09:15 PM   #9
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
I had it as fat32 because I need to transfer it between linux mac and pc's without having to worry about permissions. Do you think ntfs would be better to handle all those files and transfer between all those os's.
 
Old 01-19-2010, 06:57 AM   #10
jlinkels
Senior Member
 
Registered: Oct 2003
Location: Bonaire
Distribution: Debian Wheezy/Jessie/Sid, Linux Mint DE
Posts: 4,193

Rep: Reputation: 538Reputation: 538Reputation: 538Reputation: 538Reputation: 538Reputation: 538
You should double-check the maximum file and partition size of FAT32. File size is 2 GB, dunno if that brings you into problems.

NTFS is certainly a better file system, but I am not 100% sure that it is compatible among all 3 OS-es.

Why did you create an extended partition on the external disk instead of one primary partition?

jlinkels
 
Old 01-19-2010, 08:34 AM   #11
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
my external drive is actually two drives RAID1'd through the software utility that came with it, so that did the partitioning so its a mirrored set of 1TB drives.
 
Old 01-19-2010, 09:56 AM   #12
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
most of my folder names have spaces in them too, and some are quite similar. you think that is making rsync trip up?
 
Old 01-19-2010, 10:52 AM   #13
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
or perhaps its actually running out of space wherever it writes the temp files to? idk, i'm reaching here.
 
Old 01-19-2010, 11:21 AM   #14
GazL
Senior Member
 
Registered: May 2008
Posts: 3,481

Rep: Reputation: 1016Reputation: 1016Reputation: 1016Reputation: 1016Reputation: 1016Reputation: 1016Reputation: 1016Reputation: 1016
Could it be a "number of directory entries" issue? I notice that your failing mkdir appears to be based on a persons name. I believe max number of directory entries under fat32 is 65535, but as long-filename support can result in a single file/subdir taking up several entries, it can be much smaller than that.

If this is the case then perhaps splitting your batches further might work around this. Reports suggest anywhere in the region of 10-20K entries could be enough to trigger this issue.
 
Old 01-19-2010, 11:24 AM   #15
rjo98
Senior Member
 
Registered: Jun 2009
Location: US
Distribution: RHEL, CentOS
Posts: 1,559

Original Poster
Rep: Reputation: 37
it could be. i went with fat32 so i could transfer it between XP, Mac OSX, and Linux. how can i tell how many directories there currently are on the entire drive? I know some of the jpg's have long file names.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] rsync chown errors to fat32 usb drive rjo98 Linux - Newbie 12 01-28-2010 03:41 PM
[SOLVED] rsync to an external usb drive rjo98 Linux - General 8 01-28-2010 03:40 PM
[SOLVED] rsync --link-dest not creating hard links on external usb drive quasi3 Linux - General 4 08-26-2009 11:11 AM
[SOLVED] Don't rsync to disconnected external drive MurdinE Linux - General 2 08-08-2009 03:13 PM
Rsync errors to USB drive jstars Linux - Server 8 12-24-2006 12:35 AM


All times are GMT -5. The time now is 06:06 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration