LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 11-24-2016, 06:07 AM   #1
mr_si
Member
 
Registered: Nov 2006
Distribution: Server: Centos 6.6, Desktop: OpenSUSE 12.3
Posts: 30

Rep: Reputation: 4
rclone query


Hi All,

I have recently adopted the use of rclone on our servers to sync/backup to my company's data with their google drive.

This is working well and I've done an initial sync from the offsite backup server to the google drive (it's in a location which has a much better upload speed than the office).

I initially used the copy command but then changed to the sync command, just so that everything was in line with our existing company folder structure.

The only difference I can see in this is that a copy command doesn't delete anything from the destination if it doesn't exist on the source, whereas the sync command does (so that it's an exact replica of the source).

On running sync a second time, it runs through each folder to check its compatibility with the source and it takes ages! (our main folder is about 230 GB in size)

So, my question...

I'm wondering if any of you use rclone and if you use the copy command or the sync command? And my following question would be - what were your reasons?

Thanks,
Simon
 
Old 11-25-2016, 07:49 AM   #2
BW-userx
LQ Guru
 
Registered: Sep 2013
Location: Somewhere in my head.
Distribution: Slackware (current), FreeBSD, Win10, It varies
Posts: 9,952

Rep: Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148
Never used it, but...
Code:
    MD5/SHA1 hashes checked at all times for file integrity
    Timestamps preserved on files
    Partial syncs supported on a whole file basis
    Copy mode to just copy new/changed files
    Sync (one way) mode to make a directory identical
    Check mode to check for file hash equality
    Can sync to and from network, eg two different cloud accounts
    Optional encryption (Crypt)
    Optional FUSE mount (rclone mount)
Copy looks like it would just copy changed files only, therefore taking less time. Whereas, Sync maybe coping over every single file no matter what, therefore taking more time. Therefore, I think the theory would be. To Sync it on first run to get a clone of it, then use copy thereafter. and check when needed.

http://rclone.org/
this is their Forum for related questions, and updates.
https://plus.google.com/+RcloneOrg

Last edited by BW-userx; 11-25-2016 at 07:56 AM.
 
Old 11-25-2016, 07:55 AM   #3
mr_si
Member
 
Registered: Nov 2006
Distribution: Server: Centos 6.6, Desktop: OpenSUSE 12.3
Posts: 30

Original Poster
Rep: Reputation: 4
Quote:
Originally Posted by BW-userx View Post
Never used it, but...
Code:
    MD5/SHA1 hashes checked at all times for file integrity
    Timestamps preserved on files
    Partial syncs supported on a whole file basis
    Copy mode to just copy new/changed files
    Sync (one way) mode to make a directory identical
    Check mode to check for file hash equality
    Can sync to and from network, eg two different cloud accounts
    Optional encryption (Crypt)
    Optional FUSE mount (rclone mount)
Copy looks like it would just copy changed files only, therefore taking less time. whereas, Sync maybe coping over every single file no matter what, therefore taking more time. Therefore, I think the theory would be. To Sync it on first run to get a clone of it, then use copy thereafter. and check when needed.

http://rclone.org/
Hiya,

Thanks for your reply. That exactly what I've decided to do as of last night! So it's good to get a confirmation of my thoughts.

Simon
 
Old 11-25-2016, 08:10 AM   #4
BW-userx
LQ Guru
 
Registered: Sep 2013
Location: Somewhere in my head.
Distribution: Slackware (current), FreeBSD, Win10, It varies
Posts: 9,952

Rep: Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148Reputation: 2148
Quote:
Originally Posted by mr_si View Post
Hiya,

Thanks for your reply. That exactly what I've decided to do as of last night! So it's good to get a confirmation of my thoughts.

Simon
Glade to be of help, please click did this help on my post if you did, then mark solved. have a great weekend.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
adaptations for rclone install on 14.2 64-bit tfrei Slackware 10 11-05-2016 10:04 PM
rclone & cloud backup under Slackware rkelsen Slackware 4 09-16-2016 12:46 PM
interesting MySQL query/view query :s mjh Programming 3 03-25-2008 07:30 AM
mysql use output of one query in another query secretlydead Programming 2 11-19-2007 01:25 AM
help with mysql query: return nth rows in query hawarden Programming 2 07-31-2006 06:36 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 08:37 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration