Website Transfers

Randvegeta · 10-03-2005, 03:15 PM

Hi. I'm trying to transfer 50GB of files from server to server. I do NOT want to download 50GB to my comp and upload it to the new server. I rather just transfer it directly to the server.

I'm using a CentOS 4.1 CPanel machine with no diskspace left. Im trying to transfer it to (I think) a Redhat9 Direct Admin machine. That has an empty 200GB drive. Ive tried FXP but I cant seem to get that working on the DA machine. FXP works fine on my CPanel box. My DA box uses ProFTP. The 50GB is seperated into about 500 different files so I cant transfer 1 by one. I cant zip it and transfer the zip because i have NO diskspace left on my CP server. I was wandering if anyone had any ideas how to transfer?

I'm willing to configure proftp again if anyone knows a working setting for DA. And I'm willing to try many other things. My latest idea was use the built in command line ftp client. If i can download entire folders, i should be fine.

Thanx alot.

ilikejam · 10-03-2005, 04:32 PM

Hi.

Can you ssh from the source machine to the target machine?

Dave

Randvegeta · 10-03-2005, 05:45 PM

Via command line? I'm not sure. How do I use command line to ssh into another server?

ilikejam · 10-03-2005, 05:48 PM

'ssh username@serveraddress'

For example, "ssh alanjef@ilikejam.dyndns.org"

Dave

Randvegeta · 10-03-2005, 05:53 PM

Oh. Yes i can login

Randvegeta · 10-03-2005, 06:06 PM

The suspense is killing me! LOL. So whats the plan?

ilikejam · 10-03-2005, 06:06 PM

OK. Here's what to do.

On the source machine:

Code:

mkfifo tarfifo
tar cjvf tarfifo /path/to/files &
[hit return to get your prompt back]
cat tarfifo | ssh user@redhatmachine "cat - > /path/to/empty/disk/out.tar.bz2"
[enter your password, and wait for the transfer to finish]
rm tarfifo

That will create a tar.bzip2 file called 'out.tar.bz2' on the empty disk on the target machine, which will contain the contents of /path/to/files. All the disk space you'll need on the source machine is enough inodes to make a single named pipe (tarfifo).

Dave

Randvegeta · 10-03-2005, 06:15 PM

is there supposed to be a status bar to see how the transfer is going?

ilikejam · 10-03-2005, 06:25 PM

Nope. You should see the filenames of the files being compressed in your shell. Everything's sent as it compresses.

ilikejam · 10-03-2005, 06:31 PM

You could always ssh into the target machine in a different shell, and check up on the size of the tar.bz2 file too.

Randvegeta · 10-03-2005, 06:34 PM

Yes, i just did that. I dont see anything happening on source machine but file is getting bigger on target machine. I just hope it continues uploading the whole 50gig

.

ilikejam · 10-03-2005, 06:59 PM

Let me know how you get on. Hope you're not doing this over 56k modems....

Randvegeta · 10-06-2005, 12:14 PM

Hi. err im having some problems.

1. Connections keep breaking. After i transfered 18GB it just broke. I started transfering each section individually to solve the problem

2. when i transfered a complete .tar.bz2 file, it wudnt extract.

There was sumthin else... but i forgot. Any way. Is there a way to transfer it over ssh without compressing it? just transfer the entire folder and its contents?

ilikejam · 10-07-2005, 09:09 AM

You could try 'scp -r'. That should copy whole directories.

Randvegeta · 10-07-2005, 09:55 AM

how do i use scp - r?