RHEL6.5, System instability
Hi.
I will be questions about an issue that caused the stress test results.
*System Information
Java version: 1.70_80 (64bit)
Kernel version: RHEL6.5
A system consists of server A, server B, server C, server D.
Server A spec cpu: 28core, memory: 32G
Server B spec cpu: 28core, memory: 32G
Server C spec cpu: 36core, memory:128G
Server D spec cpu: 28core, memory: 32G
All servers execute the Java Application that uses the JNI library.
However, difference is the transmission method.
The Server A, B, C transmits the data to a distributed DB, but Server D transmits the data to a network drive.
In general, the server A, B, C of the system resource is cpu utilization:15% ~ 20%, memory utilization : 50%.
Service is normally performed.
*System configurations
Vm.max_map_count=262144, Vm.swqppiness=1, limits.conf (user hard nofile=65535, user soft nofile=65535)
*Stress test conditions
In order to perform the stress test, Server A, B ,C sends array of type int. array of type int size is 10,000,000.
When during stress test, i was monitoring the system resource such as cpu utilization, memory utilization.
*Stress test result
In a normal PC and server D is carried out within 0.5 seconds.
But problem is server A, B, C.
The server A,B,C is carried out between 2 and 40 seconds.
At this time, the syscpu utilization increased more than 90%...
also futex errors occur more than 50% of the entire errors, and all ETIMEDOUT errors occur.
****** Disk I/O is normal, swap is not being generated.
how can i solve this problem ?
|