LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices

Reply
 
Search this Thread
Old 10-04-2007, 04:51 PM   #1
kapilcool
Member
 
Registered: Dec 2005
Posts: 32

Rep: Reputation: 15
rsync buffer issue


Hi,
I am trying to trransfer a directory with lots of files. Rsync come up with out of buffer error after 2 hours. Is teher any way to avoid the memory buffer issue on rsync? Can you force rsync to dump the files after 1 hour or after set number of MBs?

Thanks
Kapil
 
Old 10-05-2007, 11:12 AM   #2
Quigi
Member
 
Registered: Mar 2003
Location: Cambridge, MA, USA
Distribution: Ubuntu (Dapper and Heron)
Posts: 377

Rep: Reputation: 31
Hi Kapil,
I never got that memory buffer error myself. What do you mean with "dump the files"? Maybe you want option --partial?
/Quigi
 
Old 10-08-2007, 03:00 PM   #3
kapilcool
Member
 
Registered: Dec 2005
Posts: 32

Original Poster
Rep: Reputation: 15
I mean rsync is getting out of swap space as it collects the name of the files before starting the file move/sync. is there any way to start and empty the list os files from the buffer to the destination directory so the next batch of transfer can carry on.
 
Old 10-08-2007, 08:34 PM   #4
chrism01
Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.5, Centos 5.10
Posts: 16,269

Rep: Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028Reputation: 2028
You can call it in a bash loop and pass it some kind of wildcard that indicates a sub-list of all the files you want txfrd; eg by name or date.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Memory Buffer Issue ahpin Linux - Server 1 08-09-2007 01:13 AM
What is the difference between the free buffer and buffer in the buffer hash queue? Swagata Linux - Enterprise 0 05-25-2006 11:57 PM
rsync + ssh = backslash issue mrjamin Linux - Software 1 05-24-2006 02:16 AM
Some sort of buffer issue with terms and vi? stardotstar Linux - Software 3 04-22-2006 08:40 PM
performance issue: rsync sends existing files microtim Linux - Networking 1 12-02-2004 02:27 AM


All times are GMT -5. The time now is 09:54 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration