I have and application that monitors status of the servers by getting tcp heartbeats and sends alerts if it does not get a heartbeat in 25 seconds. For most of the day this works fine but once in a while I get alerts because of the 25 seconds threshold. I don't know what is causing the delay and hope you guys can help me. Dist. RHEL ES 3 UPDATE 5.
Here is the output from netstat -i and netstat -s
Kernel Interface table
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR
Flg
eth1 1500 0 447508351 0 0 0 437169111 0 0
0 BMRU
lo 16436 0 3893186 0 0 0 3893186 0 0 0
LRU

Ip:
448507086 total packets received
4 with invalid headers
0 forwarded
4 incoming packets discarded
444652075 incoming packets delivered
441007133 requests sent out
233 reassemblies required
89 packets reassembled ok
9146 fragments received ok
47449 fragments created
Icmp:
24619 ICMP messages received
0 input ICMP message failed.
ICMP input histogram:
destination unreachable: 413
echo requests: 24131
echo replies: 59
address mask request: 16
24309 ICMP messages sent
0 ICMP messages failed
ICMP output histogram:
destination unreachable: 178
echo replies: 24131
Tcp:
4176448 active connections openings
273554 passive connection openings
11 failed connection attempts
6420 connection resets received
167 connections established
447471025 segments received
440352299 segments send out
71057 segments retransmited
0 bad segments received.
25190 resets sent
Udp:
750677 packets received
178 packets to unknown port received.
4 packet receive errors
626328 packets sent
TcpExt:
738 invalid SYN cookies received
33089 resets received for embryonic SYN_RECV sockets
11 ICMP packets dropped because socket was locked
ArpFilter: 0
4109900 TCP sockets finished time wait in fast timer
21 time wait sockets recycled by time stamp
7 packets rejects in established connections because of timestamp
12526195 delayed acks sent
8340 delayed acks further delayed because of locked socket
Quick ack mode was activated 287 times
414926963 packets directly queued to recvmsg prequeue.
1362445018 packets directly received from backlog
129733783 packets directly received from prequeue
351374223 packets header predicted
4387043 packets header predicted and directly queued to user
TCPPureAcks: 9379743
TCPHPAcks: 323917643
TCPRenoRecovery: 94
TCPSackRecovery: 0
TCPSACKReneging: 0
TCPFACKReorder: 0
TCPSACKReorder: 0
TCPRenoReorder: 0
TCPTSReorder: 0
TCPFullUndo: 0
TCPPartialUndo: 0
TCPDSACKUndo: 0
TCPLossUndo: 465
TCPLoss: 0
TCPLostRetransmit: 0
TCPRenoFailures: 19
TCPSackFailures: 27
TCPLossFailures: 47
TCPFastRetrans: 123
TCPForwardRetrans: 0
TCPSlowStartRetrans: 93
TCPTimeouts: 15345
TCPRenoRecoveryFail: 3
TCPSackRecoveryFail: 0
TCPSchedulerFailed: 1547
TCPRcvCollapsed: 0
TCPDSACKOldSent: 289
TCPDSACKOfoSent: 0
TCPDSACKRecv: 2
TCPDSACKOfoRecv: 0
TCPAbortOnSyn: 0
TCPAbortOnData: 19
TCPAbortOnClose: 6
TCPAbortOnMemory: 0
TCPAbortOnTimeout: 13841
TCPAbortOnLinger: 0
TCPAbortFailed: 0
TCPMemoryPressures: 0

please do not mark threads as urgent. it is not urgent for any members here who kindly donate their time to help others.