Visit Jeremy's Blog.
Go Back > Forums > Linux Forums > Linux - General
User Name
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.


  Search this Thread
Old 12-03-2015, 06:10 PM   #16
LQ Guru
Registered: Aug 2004
Location: Sydney
Distribution: Centos 6.10, Centos 7.3
Posts: 17,524

Rep: Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417Reputation: 2417

Just had an idea (if the prob comes back); could be a power glitch during the backup.
That could maybe cause a sudden corruption of an open file and could affect any disk at all.

Again, just speculation on my part

Do please keep this thread updated; I'm intrigued now ...
Old 05-17-2017, 09:00 AM   #17
LQ Newbie
Registered: May 2017
Location: Berlin, Germany
Posts: 2

Rep: Reputation: Disabled
Question Marked as SOLVED?

Why is this thread marked as solved? Sounds like an unsolved issue to me.

The rsync might hang in a call to select() (which strace -p <pid> should show you). You should then figure out which file descriptor it is trying to write to or read from. That might give a clue on why it is hanging.

For rsyncs running headless (e. g. via cron) you should redirect all of its output (stdout + stderr) to /dev/null, otherwise the caller of rsync (e. g. cron) might try to gather its output in some too-small buffer in order to, for instance, send it via mail to some user. On buffer full, this might hang.
Old 05-17-2017, 09:26 AM   #18
LQ Guru
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,569

Original Poster
Rep: Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129Reputation: 2129
I marked it as solved because the problem went away as soon as I excluded /var/log/journal from the transfer. While the underlying cause isn't solved, the symptoms are, and I moved on. It hasn't hung again in the year and a half since making that change.

The output of rsync was already being redirected to a log file so I could keep track of where the transfer was failing, so cron's internal buffer wasn't an issue.
Old 05-17-2017, 10:24 AM   #19
LQ Newbie
Registered: May 2017
Location: Berlin, Germany
Posts: 2

Rep: Reputation: Disabled
I would be interested in a thorough solution because we experience a similar situation here.

When investigating, we found out that there are three rsync processes which are waiting for each other in a cycle, each hanging in a select(), waiting for a local socket which is connected to the next. This sounds rather uncanny and weird. (A self-made deadlock?)

We have not yet investigated which current file might be involved because it didn't seem like the input was the source of the problem, and stdout and stderr were currently just thrown away. But the ACL might be part of the problem with us, too, as our nfs is somehow providing these (but this is not my field of expertise, so I lack the basics to have a clear idea).
Old 12-18-2017, 11:05 PM   #20
LQ Newbie
Registered: Feb 2016
Posts: 2

Rep: Reputation: Disabled
This is a very old thread, but this may help someone else. I've encountered the same thing, with rsync getting stuck on the select system call at around the same file everytime. The only thing to note in my case is that there were a lot of failed chgrp operations due to the -a flag and rsync trying to change the group on the destination side and failing due to lack of permissions.

In this case removing the -a flag and using the equivalent (from the man page) and dropping the -g stops the error messages from appearing and avoids the problem with stopping part way through the sync.
Old 03-18-2018, 02:51 PM   #21
LQ Newbie
Registered: Oct 2005
Distribution: Ubuntu 5.10
Posts: 2

Rep: Reputation: 0
Piling onto the "very old thread but may help someone else"; I was seeing the same problem with rsync hanging while trying to backup a large NTFS volume over NFS to an ext4 filesystem. I was erroneously using the -X option on rsync (not supported over NFS) and getting tons of errors of the form:

rsync: rsync_xal_set: lsetxattr(""/mnt/volume/Desktop/a.jpg"","user.$CmdZnID") failed: Operation not supported (95)
Removing the -X option eliminated all the errors and resolved the issue.

I suspect there may be some kind of bug in rsync that can cause it to hang indefinitely when it hits failures in lsetxattr/chgrp/ACL.


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] Strange Mount Behavior After Unexpected Shutdown Mid File Transfer bdjnk Linux - Desktop 2 08-06-2010 04:05 PM
transfer rates using rsync BroX Linux - Networking 5 06-07-2007 10:00 PM
Data transfer stops after few minutes in Ubuntu 6.06 bnchakraborty Linux - Networking 2 07-25-2006 08:37 AM
Data transfer stops in Broadband after some-time ! bnchakraborty Linux - Networking 4 03-31-2006 06:27 AM
PPP/modem data transfer always stops jayrusman Linux - Networking 1 12-22-2001 12:13 AM > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 05:34 AM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration