LinuxQuestions.org
Download your favorite Linux distribution at LQ ISO.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 12-03-2015, 07:10 PM   #16
chrism01
LQ Guru
 
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.9, Centos 7.3
Posts: 17,418

Rep: Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398Reputation: 2398

Just had an idea (if the prob comes back); could be a power glitch during the backup.
That could maybe cause a sudden corruption of an open file and could affect any disk at all.

Again, just speculation on my part

Do please keep this thread updated; I'm intrigued now ...
 
Old 05-17-2017, 10:00 AM   #17
Alfe
LQ Newbie
 
Registered: May 2017
Location: Berlin, Germany
Posts: 2

Rep: Reputation: Disabled
Question Marked as SOLVED?

Why is this thread marked as solved? Sounds like an unsolved issue to me.

The rsync might hang in a call to select() (which strace -p <pid> should show you). You should then figure out which file descriptor it is trying to write to or read from. That might give a clue on why it is hanging.

For rsyncs running headless (e. g. via cron) you should redirect all of its output (stdout + stderr) to /dev/null, otherwise the caller of rsync (e. g. cron) might try to gather its output in some too-small buffer in order to, for instance, send it via mail to some user. On buffer full, this might hang.
 
Old 05-17-2017, 10:26 AM   #18
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,569

Original Poster
Rep: Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129
I marked it as solved because the problem went away as soon as I excluded /var/log/journal from the transfer. While the underlying cause isn't solved, the symptoms are, and I moved on. It hasn't hung again in the year and a half since making that change.

The output of rsync was already being redirected to a log file so I could keep track of where the transfer was failing, so cron's internal buffer wasn't an issue.
 
Old 05-17-2017, 11:24 AM   #19
Alfe
LQ Newbie
 
Registered: May 2017
Location: Berlin, Germany
Posts: 2

Rep: Reputation: Disabled
I would be interested in a thorough solution because we experience a similar situation here.

When investigating, we found out that there are three rsync processes which are waiting for each other in a cycle, each hanging in a select(), waiting for a local socket which is connected to the next. This sounds rather uncanny and weird. (A self-made deadlock?)

We have not yet investigated which current file might be involved because it didn't seem like the input was the source of the problem, and stdout and stderr were currently just thrown away. But the ACL might be part of the problem with us, too, as our nfs is somehow providing these (but this is not my field of expertise, so I lack the basics to have a clear idea).
 
Old 12-19-2017, 12:05 AM   #20
stewba
LQ Newbie
 
Registered: Feb 2016
Posts: 2

Rep: Reputation: Disabled
This is a very old thread, but this may help someone else. I've encountered the same thing, with rsync getting stuck on the select system call at around the same file everytime. The only thing to note in my case is that there were a lot of failed chgrp operations due to the -a flag and rsync trying to change the group on the destination side and failing due to lack of permissions.

In this case removing the -a flag and using the equivalent (from the man page) and dropping the -g stops the error messages from appearing and avoids the problem with stopping part way through the sync.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Strange Mount Behavior After Unexpected Shutdown Mid File Transfer bdjnk Linux - Desktop 2 08-06-2010 05:05 PM
transfer rates using rsync BroX Linux - Networking 5 06-07-2007 11:00 PM
Data transfer stops after few minutes in Ubuntu 6.06 bnchakraborty Linux - Networking 2 07-25-2006 09:37 AM
Data transfer stops in Broadband after some-time ! bnchakraborty Linux - Networking 4 03-31-2006 07:27 AM
PPP/modem data transfer always stops jayrusman Linux - Networking 1 12-22-2001 01:13 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 12:54 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration