LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 05-28-2010, 12:25 PM   #1
linuxguy08
Member
 
Registered: Apr 2008
Posts: 155
Blog Entries: 2

Rep: Reputation: 15
copy big file from linux box


Hi ,

I have few files of size 40GB more which has to be copied from linux server to another linux box. i used scp and rsync for that but both methoed gave some connection lost error . I could not able to copy the whole file

while using SCP it shows " connection lost .."
while rsync , it shows rsync: connection unexpectedly closed (12282 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]


why it so? is there a way to copy such a big size?
pls suggest me
Thanks
 
Old 05-28-2010, 01:39 PM   #2
pljvaldez
LQ Guru
 
Registered: Dec 2005
Location: Somewhere on the String
Distribution: Debian Wheezy (x86)
Posts: 6,094

Rep: Reputation: 281Reputation: 281Reputation: 281
Can you split the file, transfer the smaller files, and then stitch it back together on the other side?
 
Old 05-28-2010, 01:54 PM   #3
nikwax
LQ Newbie
 
Registered: May 2009
Posts: 25

Rep: Reputation: 0
Quote:
Originally Posted by linuxguy08 View Post
Hi ,

I have few files of size 40GB more which has to be copied from linux server to another linux box. i used scp and rsync for that but both methoed gave some connection lost error . I could not able to copy the whole file

while using SCP it shows " connection lost .."
while rsync , it shows rsync: connection unexpectedly closed (12282 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [sender=2.6.8]


why it so? is there a way to copy such a big size?
pls suggest me
Thanks
Sounds like you might have network problems - I'd check that first.
Can you describe the network between the two servers?
 
Old 05-28-2010, 02:20 PM   #4
linuxguy08
Member
 
Registered: Apr 2008
Posts: 155

Original Poster
Blog Entries: 2

Rep: Reputation: 15
both are in local network which is 192.168.0.X. Not sure what information you would need
 
Old 05-28-2010, 03:21 PM   #5
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,974

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
I'd use ftp but that may just be me. Some ftp servers and clients do have some odd issues so be sure you know it isn't the problem before you start.

Can the other system support 40G files?
 
Old 05-28-2010, 04:09 PM   #6
nikwax
LQ Newbie
 
Registered: May 2009
Posts: 25

Rep: Reputation: 0
Quote:
Originally Posted by linuxguy08 View Post
both are in local network which is 192.168.0.X. Not sure what information you would need
How long does it take before it fails?

If you try a few times does it always fail after the same amount of time?

Have you tried copying some smaller files?
 
Old 05-28-2010, 04:58 PM   #7
tredegar
LQ 5k Club
 
Registered: May 2003
Location: London, UK
Distribution: Fedora38
Posts: 6,147

Rep: Reputation: 435Reputation: 435Reputation: 435Reputation: 435Reputation: 435
40GB is a big file.

Most filesystems currently in common use have lower limits much less than that (but it, depends ...)

What filesystems are you copying from, and to?

I suspect you will have reached a filesystem "Maximum file size of ... ".
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How to copy files from a usb pen drive to my linux box? HelpMe2877 Linux - Newbie 4 08-20-2008 02:54 AM
How to copy/save a file from a Linux box to a local drive exl75 Linux - General 11 04-10-2007 12:52 PM
scp file from a linux box to a windows box? cucolin@ Linux - General 1 03-25-2007 10:07 PM
Very Strange MySQL Problem...works fine on small box, terrible on big box DukeLeto Linux - Software 2 01-01-2007 08:14 AM
Copy directory from Linux box to Windows Share joshnya Linux - Newbie 2 11-10-2006 12:58 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 04:31 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration