I am running a HP DL320e Gen8 v2 server with Centos 6.6. I don't log into this machine very often as the service it offers doesn't take much input from me to operate. Lately though, I'd say the last 3-4 times I have tried to log in, I have encountered a situation where my putty session will freeze after logging in. Sometimes it freezes right away on log in. Sometimes I can type a few letters before it freezes. other times I can actually get an ls in before it the session freezes.
Even if my current SSH session freezes, the system will respond to me trying to open up a new session only to freeze once the session is opened. Here's the output from the logs:
Code:
Dec 8 11:06:07 ns3 kernel: INFO: task sshd:2115 blocked for more than 120 seconds.
Dec 8 11:06:07 ns3 kernel: Not tainted 2.6.32-504.1.3.el6.x86_64 #1
Dec 8 11:06:07 ns3 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Dec 8 11:06:07 ns3 kernel: sshd D 0000000000000004 0 2115 2112 0x00000080
Dec 8 11:06:07 ns3 kernel: ffff8802062e5728 0000000000000086 0000000000000000 0000000000000000
Dec 8 11:06:07 ns3 kernel: ffff8802062e57f8 ffffffff8105ca34 00012d205564f3d1 ffff8802062e5708
Dec 8 11:06:07 ns3 kernel: ffff8802062e5880 0000000113b5461e ffff880203db1058 ffff8802062e5fd8
Dec 8 11:06:07 ns3 kernel: Call Trace:
Dec 8 11:06:07 ns3 kernel: [<ffffffff8105ca34>] ? find_busiest_group+0x244/0x9e0
Dec 8 11:06:07 ns3 kernel: [<ffffffff8152a8e5>] schedule_timeout+0x215/0x2e0
Dec 8 11:06:07 ns3 kernel: [<ffffffff8106cbd3>] ? dequeue_entity+0x113/0x2e0
Dec 8 11:06:07 ns3 kernel: [<ffffffff8105e0d0>] ? __dequeue_entity+0x30/0x50
Dec 8 11:06:07 ns3 kernel: [<ffffffff8152a563>] wait_for_common+0x123/0x180
Dec 8 11:06:07 ns3 kernel: [<ffffffff81064b90>] ? default_wake_function+0x0/0x20
Dec 8 11:06:07 ns3 kernel: [<ffffffff8152a67d>] wait_for_completion+0x1d/0x20
Dec 8 11:06:07 ns3 kernel: [<ffffffff81098bf7>] flush_work+0x77/0xc0
Dec 8 11:06:07 ns3 kernel: [<ffffffff81098460>] ? wq_barrier_func+0x0/0x20
Dec 8 11:06:07 ns3 kernel: [<ffffffff81098e14>] flush_delayed_work+0x54/0x70
Dec 8 11:06:07 ns3 kernel: [<ffffffff81339315>] tty_flush_to_ldisc+0x15/0x20
Dec 8 11:06:07 ns3 kernel: [<ffffffff81333ce7>] n_tty_poll+0x67/0x1d0
Dec 8 11:06:07 ns3 kernel: [<ffffffff8132f82a>] tty_poll+0x8a/0xa0
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a68b5>] do_select+0x3c5/0x7c0
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a5a10>] ? __pollwait+0x0/0xf0
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a5b00>] ? pollwake+0x0/0x60
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a5b00>] ? pollwake+0x0/0x60
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a5b00>] ? pollwake+0x0/0x60
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a5b00>] ? pollwake+0x0/0x60
Dec 8 11:06:07 ns3 kernel: [<ffffffff8108df74>] ? complete_signal+0x124/0x200
Dec 8 11:06:07 ns3 kernel: [<ffffffff8108e1eb>] ? __send_signal+0x19b/0x390
Dec 8 11:06:07 ns3 kernel: [<ffffffff8108e41e>] ? send_signal+0x3e/0x90
Dec 8 11:06:07 ns3 kernel: [<ffffffff8108e4e0>] ? do_send_sig_info+0x70/0x90
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a6e3a>] core_sys_select+0x18a/0x2c0
Dec 8 11:06:07 ns3 kernel: [<ffffffff81331f55>] ? tty_ioctl+0x785/0x950
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a3772>] ? vfs_ioctl+0x22/0xa0
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a3914>] ? do_vfs_ioctl+0x84/0x580
Dec 8 11:06:07 ns3 kernel: [<ffffffff811a71c7>] sys_select+0x47/0x110
Dec 8 11:06:07 ns3 kernel: [<ffffffff810e5c87>] ? audit_syscall_entry+0x1d7/0x200
Dec 8 11:06:07 ns3 kernel: [<ffffffff810e5a7e>] ? __audit_syscall_exit+0x25e/0x290
Dec 8 11:06:07 ns3 kernel: [<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
The system will still be working from the services perspective (the service works, and I wouldn't even notice the issue if I didn't try to ssh into the system). I just can't get in via SSH or the console until I do a system reboot. Then the system is fine for a while (I havn't been able to observe how long it takes for the system to go into it's freakout state). Googling hasn't really turned up much as every thread I've seen has had their issue solved via yum update. I have done this and still see the issue.
Anyone seen this before and have guidance? Let me know if I need to provide more information, any help is greatly appreciated.