Linux - NewbieThis Linux forum is for members that are new to Linux.
Just starting out and have a question?
If it is not in the man pages or the how-to's this is the place!
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
While I can't tell you exactly why it stopped without more information,.. when it comes down to massive files like this, i always break them up into 1Gb chunks, so its more easily recoverable.
10 hours for 15GB? That's half a MB/s, are you trying to send this over the internet (rather than a local network)? If so, there's your problem. Internet connections can be spotty, hesitations and interruptions happen all the time, and will stop an SCP transfer dead in its tracks. You'll need to split up the file to something more manageable in order to reliably transfer it over. You can also try adding compression to speed up the transfer with the -C flag, assuming the data is somewhat compressible.
If, however, this is a transfer over your local network, then it's time to do some serious digging into your speed problems.
Last edited by suicidaleggroll; 07-11-2013 at 10:18 AM.
10 hours for 15GB? That's half a MB/s, are you trying to send this over the internet (rather than a local network)? If so, there's your problem. Internet connections can be spotty, hesitations and interruptions happen all the time, and will stop an SCP transfer dead in its tracks. You'll need to split up the file to something more manageable in order to reliably transfer it over.
If, however, this is a transfer over your local network, then it's time to do some serious digging into your speed problems.
I'm using the following command to transfer huge tar files about 15 GB The session stopped after 10 hours or something
scp -c 3des filepathname root@destip:/destdir &
Please help ASAP
We volunteer our time here...asking for ASAP help is fairly rude, as has been explained to you before.
Quote:
Originally Posted by akamel
Thanks for the replies!
I'm trying to copy the 15 GB through the Internet (2 tar files every one is about 7 GB)
Right...we understand what you're trying to do. Did you understand what you were told about splitting the files up? Uploading over the internet is ALWAYS going to be slower than downloading. What is your upload connection speed to the internet?
I really appreciate what you are doing guys!
How can I know the upload speed as I'm ssh to the server.
the status now is:
File 1 (7 GB) -- > Transferred 1.3 GB
File 2 (8 GB) -- > Transferred 1.1 GB
I hope this will be finished in the coming 48 hours without issues
Well first off, send one file at a time. It'll run twice as fast and have half the risk of stalling during the transfer.. Second, did you not read what was suggested above about splitting the file into multiple parts?
I really appreciate what you are doing guys!
How can I know the upload speed as I'm ssh to the server.
the status now is:
File 1 (7 GB) -- > Transferred 1.3 GB
File 2 (8 GB) -- > Transferred 1.1 GB
I hope this will be finished in the coming 48 hours without issues
Well, we've given you advice on splitting the file, but you seem unwilling to take it. Yes, it will take more time to compress it, so either you need to transfer more slowly and have it WORK, or transfer quicker, and maybe have it fail. Your choice.
Quote:
Originally Posted by akamel
Yeah but it will take another time to compress. How I know the upload speed please?
You ask your ISP, or run one of the MANY easily-found Internet speed tests, like this: http://www.speedtest.net/
There are several ways...have you bothered to try to look them up??? Putting "linux command line speed test" into Google will (AMAZINGLY) give you answers, like: http://www.cyberciti.biz/faq/linux-u...-upload-speed/
This goes along with your other thread that you opened, where you said you were in a hurry, and didn't want to look it up yourself. Please, show some effort on your own.
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.