LinuxQuestions.org
Go Job Hunting at the LQ Job Marketplace
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices

Reply
 
Search this Thread
Old 04-04-2009, 10:29 AM   #1
mkrems
Member
 
Registered: Jan 2008
Distribution: Ubuntu
Posts: 31

Rep: Reputation: 15
backup using rsync


Hello there,

I used a rsync in Ubuntu to backup my media and data (~60 GB) hard drive to an external hard drive. I used the following options "-avizP --delete --stats". After copying one hard drive to the other, I ran it again, and this time it should have copied exactly 0 files, correct? However, it proceeded to recopy the entire hard drive.

I have used these exact same options for simpler file systems, and it works perfectly. Can anyone offer any advice? Note that the original media and data file system was constructed in Windows, although I can't imagine this would matter as I have used a simpler Windows file system and it has worked perfectly. Does rsync just have problems with huge file systems (the one I am trying to backup is over 30000 files) rendering it totally useless for a practical backup system?!?

Thanks!

Last edited by mkrems; 04-04-2009 at 10:31 AM.
 
Old 04-04-2009, 11:52 AM   #2
amani
Senior Member
 
Registered: Jul 2006
Location: Kolkata, India
Distribution: 64-bit GNU/Linux, Kubuntu64, Fedora QA, Slackware,
Posts: 2,758

Rep: Reputation: Disabled
Maybe there are no permissions.
 
Old 04-04-2009, 12:20 PM   #3
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,598

Rep: Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516
What filesystem are the partitions? You sure it worked the first time? No, it doesn't have problems with large numbers of files.
 
Old 04-04-2009, 01:04 PM   #4
mkrems
Member
 
Registered: Jan 2008
Distribution: Ubuntu
Posts: 31

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by AlucardZero View Post
What filesystem are the partitions? You sure it worked the first time? No, it doesn't have problems with large numbers of files.
Both are FAT file systems. It seems to have problems with large nubmers of files because I can do the exact same thing with around 1000 files and it works fine. And yes, it did work the first time. It does succesfully copy the drive...it just has not idea how to update it, only how to start over again.
 
Old 04-04-2009, 01:15 PM   #5
AlucardZero
Senior Member
 
Registered: May 2006
Location: USA
Distribution: Debian
Posts: 4,598

Rep: Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516Reputation: 516
Quote:
Both are FAT
Found the problem. FAT32 is such an old and featureless filesystem, it doesn't play well with Unix files (it has no concept of permissions) or rsync. Try the following, from the man page:

Code:
       BUGS

       When transferring to FAT filesystems rsync may re-sync unmodified files.  See the comments on the --modify-window option.
Code:
       --modify-window
              When comparing two timestamps, rsync treats the timestamps as being equal  if  they differ  by  no more than the modify-window value.  This is normally 0 (for an exact match), but you may find it useful to set this to a larger  value  in  some  situations.   In  particular,  when transferring to or from an MS Windows FAT filesystem (which represents times with a 2-second resolution),  --modify-window=1  is  useful (allowing times to differ by up to 1 second).

Last edited by AlucardZero; 04-04-2009 at 01:17 PM.
 
Old 04-04-2009, 01:30 PM   #6
mkrems
Member
 
Registered: Jan 2008
Distribution: Ubuntu
Posts: 31

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by AlucardZero View Post
Found the problem. FAT32 is such an old and featureless filesystem, it doesn't play well with Unix files (it has no concept of permissions) or rsync. Try the following, from the man page:

Code:
       BUGS

       When transferring to FAT filesystems rsync may re-sync unmodified files.  See the comments on the --modify-window option.
Code:
       --modify-window
              When comparing two timestamps, rsync treats the timestamps as being equal  if  they differ  by  no more than the modify-window value.  This is normally 0 (for an exact match), but you may find it useful to set this to a larger  value  in  some  situations.   In  particular,  when transferring to or from an MS Windows FAT filesystem (which represents times with a 2-second resolution),  --modify-window=1  is  useful (allowing times to differ by up to 1 second).
Ok, actually I was copying from an NTFS system to a FAT32 but I guessing your analysis still applies. I missed that info in the man page. Thanks for your help!
 
Old 04-04-2009, 02:07 PM   #7
mkrems
Member
 
Registered: Jan 2008
Distribution: Ubuntu
Posts: 31

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by mkrems View Post
Ok, actually I was copying from an NTFS system to a FAT32 but I guessing your analysis still applies. I missed that info in the man page. Thanks for your help!
this worked like a charm. thanks again!
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync backup songeek Solaris / OpenSolaris 1 07-05-2007 07:01 AM
Using RSync to backup a secondary off-site backup server pezdspencer Linux - Software 4 06-29-2007 03:40 PM
backup with rsync muhammednavas Linux - Networking 4 12-01-2006 06:58 AM
Using rsync to backup data. Best way to backup folders? Micro420 Linux - General 2 11-23-2006 01:13 AM
rsync backup... tarballed Linux - Networking 10 06-27-2003 10:43 AM


All times are GMT -5. The time now is 06:58 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration