Uneven spread of throughput for similar processes
Hi all,
We are in the process of configuring and tuning a beefy RHEL 6.4 server for datawarehousing purposes. The nature of this makes I/O a critical performance factor. Now we are doing some crude testing using multiple parallel dd executions to get a feel for the scalability and raw performance of the I/O to a 24TB HDS SAN box. We see a strange effect that we cannot explain. We're hoping someone can give that explanation.
If we spawn 8 or 9 parallel dd executions (dd if=/dev/zero of=somefile$$ bs=64k count=50000 &) we see an uneven spread of throughput and elapsed times. Often but not always the first execution gets much more attention and reports 800+MB/s whereas the others only get 70 MB/s. Similar things happen when reading or doing a mixed I/O pattern.
We have tuned with high-performance and use the deadline scheduler.
Release is 2.6.32-358.23.2.el6.86_64, #cpu's=80, memory 256GB
What could explain this effect?
Thanks in advance for any input
|