Support LQ: Use code LQ3 and save $3 on Domain Registration
Go Back > Forums > Linux Forums > Linux - Newbie
User Name
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!


  Search this Thread
Old 06-03-2012, 08:00 PM   #1
Registered: Sep 2003
Posts: 80

Rep: Reputation: 0
Question How to check file integrity after transfer

Hey Guys

So here is the scenario. Going to do transfer of huge files in a directory via either scp or rsync (You can suggest) from one server to another remote server. We need to check the data integrity of the file. What is the best way to do it?

The OS is RHEL5 on both servers.. The folder has few files in it - around 10-20 of them .. We cannot zip the whole folder and send it as one file.. as the files itself inside them are quite huge and they are individually gzipped with compression 9 themselves .. but if highly recommended than we can do that..

What I can think of is

md5sum localfolder/
scp localfolder/ remotesite:
login to remotesite
md5sum localfolder/ (on remote site)
compare manually hash of each file in the folder
Now ofcourse I was looking for

1) md5sum localfolder/ does not works
2) easy way to dump all files md5sum in a file, scp that file as well and then run a command to compare against the file??
3) overall easy way to do this or less commands or more cleaner way if possible

Can someone help on what should be the exact steps here to make sure data got across properly!!

Old 06-03-2012, 08:10 PM   #2
LQ Guru
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.7, Centos 5.10
Posts: 16,916

Rep: Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213Reputation: 2213
rsync using ssh transport. rsync does chksums automatically to ensure a clean copy.
I think ssh may do the same, its pretty solid.
The main difference is ssh only copies entire files, rsync will copy differences.
rsync is mainly used to update files.


check, md5sum, rhel, rsync, scp

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
file integrity check packets Linux - Security 4 08-18-2010 10:11 PM
How can I check the integrity Mandriva ISO file alejandroye Mandriva 2 07-11-2010 07:47 PM
File Integrity Check of Proftpd linuxsrc Linux - Software 2 03-04-2008 08:24 PM
File Integrity Check of Proftpd linuxsrc Linux - Software 2 03-03-2008 04:04 AM
File System Integrity Check Palula Linux - Newbie 13 08-07-2005 05:07 AM

All times are GMT -5. The time now is 05:17 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration