LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices

Reply
 
LinkBack Search this Thread
Old 10-30-2009, 11:03 AM   #1
bsteiner
LQ Newbie
 
Registered: Oct 2009
Posts: 2

Rep: Reputation: 0
Need reccommendation for a LARGE file transfer in SLES 10 SP 1


I am trying to copy the entire contents of one partition on one machine to a partition on another machine. It is a bunch of video footage in avi format and can be sized anywhere from 12 - 24 Tb worth of data. The partitions may not be the same size on both machines, but will be enough to hold the data on either machine. I am trying to avoid installing any additional software on these machines as well. As far as physical connection, I was going to connect both machines gigabit ethernet cards together with a cat6 crossover cable and set the ip addresses to talk to each other. Unless there is a better method for this. I am open to the connection types, methods, and transfer methods. I would like a reccommendation on the best way to get this transfer completed. Secure connections arent necessary as this is on a network with only these machines at the moment. I am a little new to linux, so a detailed command example would be most appreciated.

I was thinking of setting up a ssh connection folder (from network servers menu) and then just click and drag, but I have a feeling this will be slow.

Also looked at rsync and scp commands, but I think I could gain some efficiencies by not utilizing ssh.

Please help.
 
Old 10-30-2009, 12:07 PM   #2
archangel_617b
Member
 
Registered: Sep 2003
Location: GMT -08:00
Distribution: Kubuntu, RHEL/CentOS
Posts: 233

Rep: Reputation: 42
Quote:
Originally Posted by bsteiner View Post
Also looked at rsync and scp commands, but I think I could gain some efficiencies by not utilizing ssh.

Please help.
I would have one side share it's volume with NFS to the other side. NFS will be fast. And I would use rsync to copy from the mounted volume to the local volume (or vise versa). rsync is great for local / mounted directory copying without the overhead of piping through SSH.

- Arch
 
Old 10-30-2009, 12:24 PM   #3
bsteiner
LQ Newbie
 
Registered: Oct 2009
Posts: 2

Original Poster
Rep: Reputation: 0
Any good resources on the setup of NFS, or could you give me a quick walkthrough? As I said I am a little green on linux. Thank you for your help.
 
Old 10-31-2009, 02:02 PM   #4
archangel_617b
Member
 
Registered: Sep 2003
Location: GMT -08:00
Distribution: Kubuntu, RHEL/CentOS
Posts: 233

Rep: Reputation: 42
Quote:
Originally Posted by bsteiner View Post
Any good resources on the setup of NFS, or could you give me a quick walkthrough? As I said I am a little green on linux. Thank you for your help.
NFS is pretty simple. Edit /etc/exports (man exports for info) and list the directories to share with the hosts to share them to. On the client side, "mount nfsserver:/path /localpath" and that's about it. The docs for /etc/exports I think are complete enough to get you going.

Here's a share from a system I manage:

/data/backups \ 10.1.0.0/24(rw,root_squash,no_all_squash,sync,anonuid=65534,anongid=65534)

But you don't need basically any of the options I've given, probably:

/path/to/files ho.st.i.p

Is all you need in your case

Ciao,
- Archangel

Last edited by archangel_617b; 10-31-2009 at 02:02 PM. Reason: typo
 
  


Reply

Tags
transfer


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
network drops during large file transfer Phathead Slackware 4 06-04-2006 12:06 AM
prematurely terminated connection during a large file transfer rob_xx17 Linux - Networking 7 03-22-2006 10:15 AM
Large file transfer hang adrielus Linux - Networking 0 12-21-2003 06:50 PM


All times are GMT -5. The time now is 08:28 PM.

Main Menu
 
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: @linuxquestions
Open Source Consulting | Domain Registration