LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 03-25-2006, 08:32 PM   #1
Mad Scientist
Member
 
Registered: May 2003
Posts: 167

Rep: Reputation: 30
rsync fails with USB hard drive


I am trying to use rsync to copy approximately 400GB of data from my file server to an external USB hard drive (specifically, the 500GB Seagate drive). Copying most of the data is no problem at all, but there is one huge (tar) archive file that is 203GB, and I cannot for the life of me get rsync to copy this file to my USB hard drive.

Rsync copies this file (along with the rest of the data) just fine over the network. I have copied this data between different file servers, and I have had no problem. However, as soon as I try to use rsync to copy to the USB hard drive, I get errors and the copy fails.

I am running Fedora Core 4 with the 2.6.15-1.1833_FC4 kernel. My rsync package is rsync-2.6.4-3. Specifically, with the command

Code:
rsync -rtlv --progress /path/to/huge/file /media/SEA_DISC
I see the following errors:

Code:
rsync: writefd_unbuffered failed to write 4 bytes: phase "unknown" [sender]: Broken pipe (32)
rsync: connection unexpectedly closed (35 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(420)
rsync: connection unexpectedly closed (30 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(420)
I have also tried

Code:
rsync -rtlv --bwlimit=8192 --timeout=600 --progress /path/to/huge/file /mesia/USBhd
as was described at http://www.mail-archive.com/rsync@li.../msg15618.html . But I get the same errors. What is it about using rsync via USB that is causing it to fail with this data when copying over the network works just fine?
 
Old 03-26-2006, 10:54 PM   #2
shawnbishop
Member
 
Registered: Dec 2005
Location: South Africa
Distribution: CentOS,Ubuntu,Fedora
Posts: 249

Rep: Reputation: 30
Hi

What filesystem do you have on the USB drive??,maybe format it as XFS for large files?
That might be the problem

Cheers
 
Old 03-27-2006, 11:14 AM   #3
Mad Scientist
Member
 
Registered: May 2003
Posts: 167

Original Poster
Rep: Reputation: 30
I didn't even think about that. How do I find out what filesystem is on the USB drive? I do a 'df -h', but all that tells me is that /dev/sdb1 is mounted on /media/SEA_DISC with the total, used, and available space on the device.

Would I just use 'mkfs' to format it? The filesystem on all my file servers is Reiser, and I don't remember formatting the Seagate drive. Maybe I blundered badly there.
 
Old 03-27-2006, 12:02 PM   #4
Mad Scientist
Member
 
Registered: May 2003
Posts: 167

Original Poster
Rep: Reputation: 30
Ah, I see I can use 'mount' to find the filesystem type. I formatted the USB hard drive with the Reiser filesystem, and it looks to be copying successfully. Rsync is much farther through the 203GB file than it has ever gotten previously. It looks like the filesystem issue was the problem.

Thanks for your help, shawnbishop. I really appreciate it.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Installing grub to external USB hard drive for later use as internal hard drive dhave Linux From Scratch 2 12-10-2005 08:48 AM
slackware 10.1 fails to detect ATA hard drive zodman Slackware 4 05-06-2005 05:42 AM
Grub fails to boot when not at beginning of hard drive tisource Linux - Hardware 12 01-05-2005 11:13 AM
External Hard Drive partition fails for Mandrake 10.1 installation clean_sweep Linux - Hardware 9 12-26-2004 02:02 PM
XS Drive II external USB hard drive/card reader max74 Linux - Hardware 7 10-21-2003 10:41 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 04:12 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration