Linux - NetworkingThis forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
I am struggling trying to understand the reason for a fairly slow data transfer rate between two machines. ( tried point to point and also via a 1 gb switch )
One is nfs/http/ftp server ( with raid1 and lvm on top ), the other one my desktop pc.
Both OS with default options, no changes to kernel in proc or other sort of thing.
Hardware is full recognized and perfectly working:
The server has 4gb ram, Intel Core 2 Duo CPUE6850 @ 3.00GHz, 1000Mb/s NIC card and Lucid 10.04 64 bit, 250Giga Hard disk.
The client has 3gb ram, Intel Core 2 CPU 6320 @ 1.86GHz, 1000Mb/s NIC card and Ubuntu Maverick 32bit , 150Gb Hard disk.
Raw data is good:
gettons@gettons-desktop:~$ iperf -c MYSERVER
------------------------------------------------------------
Client connecting to MYSERVER, TCP port 5001
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[ 3] local 192.168.3.4 port 48906 connected with 192.168.3.2 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 1.09 GBytes 938 Mbits/sec
Tests on the local disk:
root@MYSERVER:~# bonnie++ -d /mnt/ -r `free -m | grep 'Mem:' | awk '{print $2}'` -s $(echo "scale=0;`free -m | grep 'Mem:' | awk '{print $2}'`*2" | bc -l) -u gettons
Using uid:1000, gid:1000.
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
MYSERVER 7888M 754 97 64825 9 31211 4 3479 88 102054 5 258.5 2
Latency 15626us 4693ms 2346ms 52158us 102ms 236ms
Version 1.96 ------Sequential Create------ --------Random Create--------
MYSERVER -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 18344 25 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
Latency 254us 568us 430us 262us 30us 40us
1.96,1.96,MYSERVER,1,1299098739,7888M,,754,97,64825,9,31211,4,3479,88,102054,5,258.5,2,16,,,,,18344, 25,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,15626us,4693ms,2346ms,52158us,102ms,236ms,254us ,568us,430us,262us,30us,40us
Again, tests on the local disk:
root@MYSERVER:/mnt# date && dd if=/dev/zero of=ddfile bs=1M count=7888 && sync && date
Wed Mar 2 20:54:22 GMT 2011
7888+0 records in
7888+0 records out
8271167488 bytes (8.3 GB) copied, 113.39 s, 72.9 MB/s
Wed Mar 2 20:56:27 GMT 2011
Write over nfs3 default options from desktop to server :
root@gettons-desktop:/mnt# date && dd if=/dev/zero of=ddfile bs=1M count=6030 && sync && date
Wed Mar 2 21:00:23 GMT 2011
6030+0 records in
6030+0 records out
6322913280 bytes (6.3 GB) copied, 179.152 s, 35.3 MB/s
Wed Mar 2 21:03:22 GMT 2011
Conclusion:
Read speed with http, ftp, nfsv3 are 55~60 MB/s
I am not expecting 100MB/s but a good 80 maybe yes.
Thanks in advance
Last edited by gettons1980; 03-02-2011 at 04:23 PM.
Try to mount NFS wit the following options: -orsize=1048576,wsize=1048576 and see if this helps. These are max values, you may want to try with smaller as well. Also, could improve some networking options like tcp window size with sysctl, but since iperf is already good, don't know it makes sense...
cables are not cat 6 ( got them from work ;-) ) .
Ipv6 is not disabled at the moment, but I will do this asap.
My switch can disable auto negotiation only for 10 half and full duplex, 100 half and full duplex, but for 1 gigabit there is not such an option, you have to leave auto.
But I think I found the bottleneck:
cables are not cat 6 ( got them from work ;-) ) .
Ipv6 is not disabled at the moment, but I will do this asap.
My switch can disable auto negotiation only for 10 half and full duplex, 100 half and full duplex, but for 1 gigabit there is not such an option, you have to leave auto.
But I think I found the bottleneck:
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.