Transfer 1000000 files (130GB) server to server via shell
Hi guys!
I am having a problem. I have had some server problems with one (located in USA) of my two servers, and need to transfer all files to the other server (located in Germany). I've tried using Rsync, but it would take days to transfer this data (only get approx 500KB/sec). I have tried using several rsync sessions to transfer different folders to increase speed using parallel transfers, and it speeds up things alot. The problem is that folders are so different in sizes, so I it is not very practical to start a new rsync for every folder or so.
To the question: Is there any shell program that I can use to parallel transfer all these files (maybe 10-15 at a time) to speed up this process?
Thanks in advance
Masali
|