Move files from old system to new system
 

I am creating a new Virtual Linux system, or should say that it is done, but I need to move the information from the old system to the new system and I am looking for most expediant way to do this. These are both development machines that I am moving from/to. I need to be able to shut one down at the end of a days business and bring the new one up the next morning ready to go. Here are my systems.

Old system -> Physical Box RedHat Enterprise 3 (ES), /u is pointing to a separate hard device on the system which has been set up as a filesystem. I have this filesysem shared through Samba and is available to everybody.

New System -> Virtual Machine RedHat Enterprise 3 (ES), /u is pointing to a Virtual Disk on a RAID.

Options:
1. I can mount the Samba share on the new box and "cp -pr <old> <new>.

the problem with this is the mount command sets the permissions for all files/directories on the mount.

2. I can tar the files/directories on the old system. copy/ftp/whatever the file over to the new system and untar it into the new system. This would probably restore the files to their orignal owner/group and permissions. The problem with this is it is really slow. I started a tar last night at 10:00 pm and it is still running this morning.

Are there any other options that might one) be faster two) keep permissions/ownership the same?

I have STF for answers, but nothing that I have found stands out with an answer. Maybe I am asking the wrong search keywords. I have to believe that someone has run into this before.

I think rsync might do the job for you.
--- rod.

I am newbie to Linux commands.

what does rsync require for access of the remote machine.

username/password??

I tried this

rsync -avrn <computername>:/u/logs .

and got this...

<computername>: Connection refused
rsync: connection unexpectedly closed (0 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)

Check out the '-e' switch. If you are going to use this frequently, it might be convenient to set up ssh keys for passwordless ssh logins. You, as the rsync user, must have an account on the peer host, which can be accessed via ssh or rsh.

--- rod.

If you want to transfer an entire filesystem or directory of files, you could try using tar this way to transfer the files:
tar -C sourcedir/ -cf - . | ( tar -C <mounted-target-dir> -xf - )

There may be more options you need to preserve permissions, and deal with links properly. Keep in mind that the smbfs has around a 2 GB filesize limit. You might consider using NFS instead. The permissions, ownerships should transfer properly then, although, you may need to use "star" if you have to deal with ACLs and Security contexts.

thanks,

actually, while I was waiting for a response here, I read up more on --rsh and did put it in the command.

rsync -avr --rsh="ssh -l <username>" <username>@anakin:/u/send/ send

About the time you responded, I was able to get it bring files across from the remote host. However, I am still having a few problems.

I want the files to preserve the owner/group/permissions. It appears that it is doing the permissions just fine, but not the owner/group.

also, some of the files are root, so I changed the command to

rsync -avr --rsh="ssh -l <username>" root@anakin:/u/send/ send

this brought over files that the first command could not because it was denied access. But then it created the files on the new system my name and group.

so I changed it again ...

rsync -avr --rsh="ssh -l root" root@anakin:/u/send/ send

this brought the files over the same way. My login name and group. The permissions were the ok though.

I added the options ogt to the command above and got the same results.

this is getting closer, but not there yet.

I not sure how to set up the directory for nfs on the source system. You think that this will allow the transfer with owner/group and permissions?

I tried this...

mount -t nfs <host>:Programs /u3

and it came up with this.

mount: RPC: Program not registered

UPDATE: I guess I am getting better at reading forums and manuals. I have been able to create a NFS share and get it mounted on the new system.

using the command ...

cp -prv /u3/* .

... I have been able to start moving the files and they are maintain their original owner/group and permissions. And it seems rather quick!

Unless I have problems, thanks for all of the helpp

rsync may be a better choice if it also deletes files in the target that were deleted in the source. You might consider using tar with the --incremental --listed-incremental=SNAPSHOT-FILE to produce a backup of the source directory and then restore to the destination with the --listed-incremental=SNAPSHOT-FILE option. According to the info manual, this will delete files in the target that were deleted in source since the last incremental backup. This would also kill two birds with one stone. Replication and Backup. I don't know if you can use snapshot files when using tar to copy files from a source to a target machine. If you can, you could just copy updated files and delete obsolete files in the target machine.

-- update --

I touched a file and then ran the above command to transfer it over. Testing with "find /media/lbigdisk/etap -cmin -2", the file I touched did replace the copy in the destination.

However moving a file out of the source directory, and rerunning the incremental backup, the file in the destination wasn't deleted. If you were to restore from a real incremental backup, it should be.

If you use NFS, you either want to map uid and gid numbers (such as using NIS), or keep them the same across all your hosts. This could have been the problem with rsync. It is the actual number that is copied. If the same user has a different UID number, that could be the user ownership problems you were seeing. As an example, Red Hat and Mandriva start normal UIDs at 500 while SuSE starts at 1000. To be honest, I used the SuSE NFS server and NFS client config modules in YaST2. They allowed me to search the network for NFS shares in the dialog and configured /etc/exports and /etc/fstab for me.

I didn't have that many files to get across and I just couldn't get rsync to work right, so I used the cp command and I am done, I will have to read up more on rsync and try it sometime when I don't have a lot of work to do.

Thanks for your help