Share your knowledge at the LQ Wiki.
Go Back > Forums > Linux Forums > Linux - Software
User Name
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.


  Search this Thread
Old 06-05-2017, 11:04 AM   #1
Registered: Dec 2012
Posts: 52

Rep: Reputation: Disabled
Synchronizing large files with move detection

I am looking for a backup tool that synchronizes folders, such that changes to one folder are applied to the other one, and vice versa.

Let's say I have a folder containing files a and b and sync it to an USB stick. Then the USB stick also has files a and b.

If I create a file c in the original folder, and a file d on the USB stick, the tool should see the two files and copy c to the stick and d from the stick, such that there are four files in both folders.

But if I delete a file in one folder, it should delete the file in the other folder. I.e. it should not compare the two folders directly, but compare each folder to how it was before the last syncing.

If I rename the file a to x in the original and sync again, the tool would see that the file was renamed (because x has the same content/hash that a used to have), so it renames a to x on the USB stick. It should not delete a and copy the new x there, since copying takes a lot of time with large files. With directories, too. If all files are in one subdirectory and I rename it, syncing should rename the corresponding subfolder without copying everything.

It would be like git, but without storing the entire history of the file content, so that when the file is changed or deleted in all repos, the old content is gone forever.
Old 06-05-2017, 11:10 AM   #2
LQ Guru
Registered: Feb 2004
Location: SE Tennessee, USA
Distribution: Gentoo, LFS
Posts: 9,238
Blog Entries: 4

Rep: Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263Reputation: 3263
The rsync utility is pretty darned good. This technology is the basis of many venerable backup systems, including Apple's Time Machine.
Old 06-05-2017, 11:47 AM   #3
Registered: Dec 2012
Posts: 52

Original Poster
Rep: Reputation: Disabled
I do not think that detects renames. It just copies the file again

And I always get confused by the trailing slash and then I end up having every file twice.


backup, mirror, sync

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] LibreOffice slow to open moderately large to pretty large files adanedhel728 Ubuntu 17 01-16-2016 03:46 PM
[SOLVED] Duplicate picutes - move and remane large number of files smithy2010 Linux - Newbie 4 02-15-2012 01:11 PM
Synchronizing remote and local files via FTP? InExtremis Linux - Software 2 05-15-2006 08:02 AM
Synchronizing local and remote files jrdioko Linux - Software 10 11-15-2005 01:13 PM
Software for synchronizing files on web servers josephswagner Linux - Software 2 02-06-2003 12:13 AM > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 12:27 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration