10G network & performance tuning

Ammad · 03-09-2014, 08:31 AM

Hi,

We have recently installed the 10G Qlogic network adapters on Linux Server having more than 20GB of memory. i am using RHEL 6.4 on servers. the performance of 10G interface is not what i as expecting.

i used iperf to the case scenarios on Linux Server.

the maximum transfer rate is 4.50 Gbit/sec.

i have tuned the following

Code:

sysctl -w net.core.rmem_max=134217728
sysctl -w net.core.wmem_max=134217728
sysctl -w net.ipv4.tcp_rmem="4096 87380 134217728"
sysctl -w net.ipv4.tcp_wmem="4096 65536 134217728"
sysctl -w net.core.netdev_max_backlog=300000
sysctl -w net.ipv4.tcp_moderate_rcvbuf=1

MTU=9000

can any one help on this to achieve the 9.5Gbbit/s results.

smallpond · 03-10-2014, 11:20 AM

Is it plugged into a PCIe gen 2 x8 slot?
What CPU? Memory?
What does ethtool -k report?
How many iperf threads are you running?

suicidaleggroll · 03-10-2014, 11:34 AM

And what length/type of interconnects are you using?

badtlc · 03-10-2014, 01:14 PM

Just out of curiosity, can you perform a CIFS file transfer on the network and post the speeds?

Also, run the UDP test in iperf. You have to set the size to at least 10G, though.