LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 06-15-2008, 11:07 PM   #1
jkaidor
Member
 
Registered: Jun 2008
Location: SF Peninsula
Distribution: slackware
Posts: 33

Rep: Reputation: 23
Sync-ing two filesystems


Hello,

I have two machines on which I need to sync certain
directory trees. That is, one machine is "live" and
the directory trees are being updated in the course of doing business. The other one is on "standby".

The reason for this is that I am using an old, small, slow server with an older Slackware distribution. I would like to upgrade to a bigger, newer, faster machine, and the latest distribution with 2.6 kernel.

There is a great deal of stuff to get working on the new machine, and in the meantime, the business keeps chunking along. I cannot in any manner refrain from
using the server while I get the new one up. So by the
time I get the server working, many things will have
changed, and I will have to re-transfer the business files. Yuck!

The synchronization does not have to be in real time.
It can happen in the wee hours via a chron job. There are
three directory trees involved: one is 6.5gig, another 35 gig, and the third is IIRC about 4 gig. The two machines
are connected with a gigabit ethernet.

The 35-gig tree was espcially painful to transfer, because FTP just woulnd't make it through the whole tar file. I wound up gzipping it down to 25-gig, and using
split to bust it into 25 1-gig pieces. Then ftp'ed it all and ran md5sum on all the pieces on each machine. Then compared the md5 signatures to make sure the transfers were OK, then cat'ed them all together, gunzip'ed, untar'd. I really don't want to have to do that again.

So: is there a utility that can reasonably painlessly do such synchronization? Thanks in advance,

- Jerry Kaidor
 
Old 06-15-2008, 11:10 PM   #2
billymayday
LQ Guru
 
Registered: Mar 2006
Location: Sydney, Australia
Distribution: Fedora, CentOS, OpenSuse, Slack, Gentoo, Debian, Arch, PCBSD
Posts: 6,678

Rep: Reputation: 122Reputation: 122
You should probably be using rsync for this. Have a look at the man page
 
Old 06-15-2008, 11:58 PM   #3
smus
Member
 
Registered: Nov 2005
Location: Turkey
Distribution: Suse
Posts: 104

Rep: Reputation: 16
you can use rsync as said before, additionally if its hard to do for you you can use the gui of rsync http://www.opbyte.it/grsync/

regards,
 
Old 06-16-2008, 11:51 AM   #4
jkaidor
Member
 
Registered: Jun 2008
Location: SF Peninsula
Distribution: slackware
Posts: 33

Original Poster
Rep: Reputation: 23
[QUOTE=smus;3185835]you can use rsync as said before, additionally if its hard to do for you you can use the gui of rsync

*** Thanks,

Actually, am a long time command line fan . Especially for stuff that I hope to automate.

- Jerry
 
Old 06-16-2008, 12:06 PM   #5
jkaidor
Member
 
Registered: Jun 2008
Location: SF Peninsula
Distribution: slackware
Posts: 33

Original Poster
Rep: Reputation: 23
[QUOTE=billymayday;3185802]You should probably be using rsync for this.

*** Sounds like the hot ticket. Might even wind up
using it for continuous backup after the system has
been upgraded.

- Jerry Kaidor
 
Old 06-17-2008, 09:42 AM   #6
jkaidor
Member
 
Registered: Jun 2008
Location: SF Peninsula
Distribution: slackware
Posts: 33

Original Poster
Rep: Reputation: 23
Got it up and running over ssh. Rsync is actually fairly cool, and I plan to use it more, even after the upgrade is done. Thanks!

- Jerry Kaidor
 
Old 06-17-2008, 10:54 AM   #7
IsaacKuo
Senior Member
 
Registered: Apr 2004
Location: Baton Rouge, Louisiana, USA
Distribution: Debian Stable
Posts: 2,546
Blog Entries: 8

Rep: Reputation: 465Reputation: 465Reputation: 465Reputation: 465Reputation: 465
Rsync is my savior. I was doing a major overhaul of my systems, including a revamped file/dhcp/tftp/etc server. It took me about a month, off and on, to get everything together. Using rsync, I could keep all of the backups up to date while continuing to work during the whole time. When the time came to "switch", I just ran the rsync scripts one last time and then made the switch.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
su is not su(ing) ekdya Fedora 2 09-23-2006 03:42 PM
Sync for Samsung Sync master Naphoon Linux - Hardware 1 10-16-2004 06:20 PM
windows filesystems vs. linux filesystems irfanhab General 8 05-25-2004 07:21 AM
S*[t-r]+[ing]?g gr33ndata Programming 10 03-13-2004 05:15 AM
Sync-ing Clocks across a network philfighter Linux - Networking 1 01-25-2002 03:39 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 07:33 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration