ftp/scp tool and technique

ufmale · 07-24-2007, 09:10 PM

I am trying to download a bunch of data with subdir (hundreds Gb) over the network from AIX machines to my windows and Linux computers.
I run into a lot of obstrucle. The gftp on Linux keeps corrupting. On windows, the tools (filezilla,cubeftp) I download from the Internet keeps crashing.

Does anyone have any recommendation how to download the data robustly on Windows, and Linux?

lazlow · 07-24-2007, 09:23 PM

IF I remember correctly AIX can use nfs. This would allow the Linux boxes to mount the directories and do a normal copy.

gloriant · 07-25-2007, 06:47 AM

this seems like an excellent job for rsync....

Code:

rsync -avH aixmachine:/some/dir/to/get/from /mnt/backupdisk/today

and many other possibilities.

if your aix machine supports ssh, use

Code:

rsync -avH -e 'ssh -l user_on_aix' aixmachine:/some/dir/to/get/from /mnt/backupdisk/today

Your aix machine should (also) have rsync installed. (check it with which rsync.

on linux rsync is (distribution specific) straightforward to install.
to install rsync on windows, I'd suggest installing cygwin (and rsync in cygwin).

bakfupai · 07-25-2007, 07:11 AM

NFS is not really a good solution for a windows computer. If it was me I'd just use scp on GNU/Linux and WinSCP on Windows. Rsync would work too but it sounds like a lot of hassle just to download files.

Anyway, I don't see any reason why gftp would corrupt the files. And FileZilla was rock stable last time I tried it so have maybe there is something wrong with your computer. A failing disk could cause the problems you describe.