Linux - SoftwareThis forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
Hi, I have a remote web server (running Ubuntu) and a local server (running Gentoo). Im looking for a way to keep the files on the remote box synced with the local box.
There's a large database to keep synced, some images and some larger files that Id like backed up at a pre defined time. Ive tried rsync but its painfully slow, especially with the images.
So Ideally a fast alternative to rsync, perhaps SFTP, but is it possible to have multi threads running on SFTP when its running from a script? Then how does it keep check of the new files and ignore ones already pulled down?
I think you can do it in two steps: 1: rsync everything without images and 2: rsync only images. In the second step you can try "whole-copy", so rsync will not try to find matching blocks.
Hmm, but rsync is soo slow. Remote has a ridiculous connection and I have 60mb here. Remote is easily capable of maxing mine so ideally in the middle of the night Id like it doing just that. I do it currently with an FTP client. Id like it to be set and forget.
rsync is definitely planned for low bandwidth connections and to minimize the amount of the transferred data. Using -W (whole-file) will switch off rsync's optimizing algorithm and will transfer every file one by one (if required). You can give a try, probably it runs faster, it is quite similar to a simple ftp (just it will skip identical files)
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.