LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 05-19-2009, 09:18 AM   #1
donnaaparis
LQ Newbie
 
Registered: May 2009
Location: Paris
Distribution: Ubuntu
Posts: 7

Rep: Reputation: 0
Unhappy Problem using rsync to back up large files to external harddrive


I have a 500GB Lacie Quadra 2 external hard drive which I have formatted as ext3.

I'd like to use rsync to backup up my home directory. But the command :

% > sudo rsync -av /home/donna/ /media/Desktop/backup.0/

hangs on large files. By 'large', I only mean files < 100MB. (so not so large). Killing rsync usually works, but then when I do an 'ls' on on mounted file system, even 'ls' hangs. Eventually my whole system gets stuck.

Simply copying the offending files (e.g. data000.hdf5) to the externally mounted disk works instanteonously.

I am copying to the Lacie drive over USB (via a 6 foot extension cable).

Are there any known problems with rsync that might explain this?
 
Old 05-19-2009, 10:37 AM   #2
farslayer
LQ Guru
 
Registered: Oct 2005
Location: Northeast Ohio
Distribution: linuxdebian
Posts: 7,249
Blog Entries: 5

Rep: Reputation: 191Reputation: 191
not with rsync that I am aware of. I backup files that are over 250 MB up to and including some multi GB .iso images to my External USB/Firewire drive (yes Ii alternate which connection it's using at times.) using rsync and have not had the issue you are describing.

It is by nomeans a fast process, I run it at off hours so I'm not sitting there watching it or waiting for it to finish

Last edited by farslayer; 05-19-2009 at 10:40 AM.
 
Old 05-19-2009, 01:52 PM   #3
tredegar
LQ 5k Club
 
Registered: May 2003
Location: London, UK
Distribution: Debian 11
Posts: 6,134

Rep: Reputation: 419Reputation: 419Reputation: 419Reputation: 419Reputation: 419
I have had problems with LaCie drives (their early ones, I do not have a "Quadra"): They look good, but don't always work well. (I had two - one is reliable, the other NOT - it sometimes hung, like yours does, so the enclosure, but not the disk, eventually went to the dump).

6foot for "high speed" USB may be stretching things. Have you tried using a shorter (or just a different) cable ?

Any useful errors in /var/log/messages ?

rsync has always worked perfectly for me, so I don't think the problem lies there.

Hope this helps.
 
Old 05-19-2009, 03:35 PM   #4
donnaaparis
LQ Newbie
 
Registered: May 2009
Location: Paris
Distribution: Ubuntu
Posts: 7

Original Poster
Rep: Reputation: 0
The only thing I can think of is that I am not using rsync correctly. I issued the command :

%> rsync -av /donna/home/ /media/Desktop/backup.0/

I am assuming that

(1) the directory 'backup.0' doesn't need to already exist on the mounted disk and so for first time backups, rsync is behaving
essentially like a copy command.

(2) the final backslash doesn't matter.

I am going to double check, but I am fairly sure that just doing a copy of the larger file worked perfectly. And the long cable was another concern I had, so I'll check that out too.
 
Old 05-20-2009, 07:18 AM   #5
donnaaparis
LQ Newbie
 
Registered: May 2009
Location: Paris
Distribution: Ubuntu
Posts: 7

Original Poster
Rep: Reputation: 0
Thumbs up USB cable too long!

I got rid of the USB extension cable and now everything seems to work perfectly. Disk write speeds are reasonable - about 32 mb/s on my Lacie Qaudra.

Don't know what the problem was with the extension cable, though. Was it too long (6ft)?
 
Old 05-20-2009, 08:33 AM   #6
tredegar
LQ 5k Club
 
Registered: May 2003
Location: London, UK
Distribution: Debian 11
Posts: 6,134

Rep: Reputation: 419Reputation: 419Reputation: 419Reputation: 419Reputation: 419
The USB 2.0 specification states the maximum cable length is 5m (16.4ft) but maybe you just had a bad cable, or there were timing issues with the LaCie. The only way to find out is by trying different cables and testing their performance.

Anyway, glad you got it working.
 
Old 05-20-2009, 08:55 AM   #7
farslayer
LQ Guru
 
Registered: Oct 2005
Location: Northeast Ohio
Distribution: linuxdebian
Posts: 7,249
Blog Entries: 5

Rep: Reputation: 191Reputation: 191
I just threw out a usb cable the other day because it was defective.. they do go bad on occasion, even with no visible indication of damage.

Could just be a cheap poorly made/designed cable too..
 
Old 05-20-2009, 03:05 PM   #8
donnaaparis
LQ Newbie
 
Registered: May 2009
Location: Paris
Distribution: Ubuntu
Posts: 7

Original Poster
Rep: Reputation: 0
USB cable faulty?

And I forgot to mention that I had it connected to the USB cable that came with the Lacie drive and so the two cables together were probably about 10 ft.

The extension appeared to work fine when attached to my USB key, although in that situation, I generally transfered much smaller files. But I'll be wary of using the longer cable from now on.

It's just is such a pain to crawl under the desk to plug in a USB key...

thanks again.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync can't handle large files??? deweirdt Linux - Server 19 02-28-2012 02:35 PM
Verifying Rsync Backups of Large Volumes of Files mcgirvanmedia Linux - Server 2 06-03-2008 11:30 PM
Problem copying large amount of files from IDE external case in Fedora C4 TruthSeeker Linux - Newbie 8 10-26-2005 02:04 AM
Best way to back up LARGE log files? sdebiasio Linux - Newbie 5 08-16-2004 04:54 PM
USB External Hard Disk problem with large files nick1.41 Linux - Hardware 0 05-26-2004 07:33 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 01:15 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration