rclone query

mr_si · 11-24-2016, 06:07 AM

Hi All,

I have recently adopted the use of rclone on our servers to sync/backup to my company's data with their google drive.

This is working well and I've done an initial sync from the offsite backup server to the google drive (it's in a location which has a much better upload speed than the office).

I initially used the copy command but then changed to the sync command, just so that everything was in line with our existing company folder structure.

The only difference I can see in this is that a copy command doesn't delete anything from the destination if it doesn't exist on the source, whereas the sync command does (so that it's an exact replica of the source).

On running sync a second time, it runs through each folder to check its compatibility with the source and it takes ages! (our main folder is about 230 GB in size)

So, my question...

I'm wondering if any of you use rclone and if you use the copy command or the sync command? And my following question would be - what were your reasons?

Thanks,
Simon

BW-userx · 11-25-2016, 07:49 AM

Never used it, but...

Code:

    MD5/SHA1 hashes checked at all times for file integrity
    Timestamps preserved on files
    Partial syncs supported on a whole file basis
    Copy mode to just copy new/changed files
    Sync (one way) mode to make a directory identical
    Check mode to check for file hash equality
    Can sync to and from network, eg two different cloud accounts
    Optional encryption (Crypt)
    Optional FUSE mount (rclone mount)

Copy looks like it would just copy changed files only, therefore taking less time. Whereas, Sync maybe coping over every single file no matter what, therefore taking more time. Therefore, I think the theory would be. To Sync it on first run to get a clone of it, then use copy thereafter. and check when needed.

http://rclone.org/
this is their Forum for related questions, and updates.
https://plus.google.com/+RcloneOrg

mr_si · 11-25-2016, 07:55 AM

Quote:

Originally Posted by BW-userx

Never used it, but...

Code:

    MD5/SHA1 hashes checked at all times for file integrity
    Timestamps preserved on files
    Partial syncs supported on a whole file basis
    Copy mode to just copy new/changed files
    Sync (one way) mode to make a directory identical
    Check mode to check for file hash equality
    Can sync to and from network, eg two different cloud accounts
    Optional encryption (Crypt)
    Optional FUSE mount (rclone mount)

Copy looks like it would just copy changed files only, therefore taking less time. whereas, Sync maybe coping over every single file no matter what, therefore taking more time. Therefore, I think the theory would be. To Sync it on first run to get a clone of it, then use copy thereafter. and check when needed.

http://rclone.org/

Hiya,

Thanks for your reply. That exactly what I've decided to do as of last night! So it's good to get a confirmation of my thoughts.

Simon

BW-userx · 11-25-2016, 08:10 AM

Quote:

Originally Posted by mr_si

Hiya,

Thanks for your reply. That exactly what I've decided to do as of last night! So it's good to get a confirmation of my thoughts.

Simon

Glade to be of help, please click did this help on my post if you did, then mark solved. have a great weekend.