LinuxQuestions.org

LinuxQuestions.org (/questions/)
-   Linux - Software (https://www.linuxquestions.org/questions/linux-software-2/)
-   -   rclone query (https://www.linuxquestions.org/questions/linux-software-2/rclone-query-4175594169/)

mr_si 11-24-2016 06:07 AM
rclone query
 
Hi All,

I have recently adopted the use of rclone on our servers to sync/backup to my company's data with their google drive.

This is working well and I've done an initial sync from the offsite backup server to the google drive (it's in a location which has a much better upload speed than the office).

I initially used the copy command but then changed to the sync command, just so that everything was in line with our existing company folder structure.

The only difference I can see in this is that a copy command doesn't delete anything from the destination if it doesn't exist on the source, whereas the sync command does (so that it's an exact replica of the source).

On running sync a second time, it runs through each folder to check its compatibility with the source and it takes ages! (our main folder is about 230 GB in size)

So, my question...

I'm wondering if any of you use rclone and if you use the copy command or the sync command? And my following question would be - what were your reasons?

Thanks,
Simon

BW-userx 11-25-2016 07:49 AM
Never used it, but...
Code:

    MD5/SHA1 hashes checked at all times for file integrity
    Timestamps preserved on files
    Partial syncs supported on a whole file basis
  Copy mode to just copy new/changed files
    Sync (one way) mode to make a directory identical
  Check mode to check for file hash equality
    Can sync to and from network, eg two different cloud accounts
    Optional encryption (Crypt)
    Optional FUSE mount (rclone mount)
Copy looks like it would just copy changed files only, therefore taking less time. Whereas, Sync maybe coping over every single file no matter what, therefore taking more time. Therefore, I think the theory would be. To Sync it on first run to get a clone of it, then use copy thereafter. and check when needed.

http://rclone.org/
this is their Forum for related questions, and updates.
https://plus.google.com/+RcloneOrg

mr_si 11-25-2016 07:55 AM
Quote:
Originally Posted by BW-userx (Post 5634400)
Never used it, but...
Code:

    MD5/SHA1 hashes checked at all times for file integrity
    Timestamps preserved on files
    Partial syncs supported on a whole file basis
  Copy mode to just copy new/changed files
    Sync (one way) mode to make a directory identical
  Check mode to check for file hash equality
    Can sync to and from network, eg two different cloud accounts
    Optional encryption (Crypt)
    Optional FUSE mount (rclone mount)
Copy looks like it would just copy changed files only, therefore taking less time. whereas, Sync maybe coping over every single file no matter what, therefore taking more time. Therefore, I think the theory would be. To Sync it on first run to get a clone of it, then use copy thereafter. and check when needed.

http://rclone.org/
Hiya,

Thanks for your reply. That exactly what I've decided to do as of last night! So it's good to get a confirmation of my thoughts.

Simon

BW-userx 11-25-2016 08:10 AM
Quote:
Originally Posted by mr_si (Post 5634402)
Hiya,

Thanks for your reply. That exactly what I've decided to do as of last night! So it's good to get a confirmation of my thoughts.

Simon
Glade to be of help, please click did this help on my post if you did, then mark solved. have a great weekend.


All times are GMT -5. The time now is 10:06 PM.