LinuxQuestions.org
Did you know LQ has a Linux Hardware Compatibility List?
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Networking
User Name
Password
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.

Notices

Reply
 
LinkBack Search this Thread
Old 03-21-2013, 10:26 AM   #1
bradvan
Member
 
Registered: Mar 2009
Posts: 167

Rep: Reputation: 28
Actual bandwidth vs rated


I have an HP c7000 blade system with some BL460 G5 and G7 blades and a couple of VC FLEX-10 switches. The blades are running RHEL 6 and the current network is running at 5000Mb/s full duplex. I created a 10GB file and scp'd it from one blade to another. I got an aggregate of about 50MB/s throughput. 5000Mb/s should correspond to 625MB/s. I know I'm not going to get the whole bandwidth, but shouldn't be getting a little more than about 12% of the bandwidth?
 
Old 03-22-2013, 02:14 PM   #2
suicidaleggroll
Senior Member
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 2,406

Rep: Reputation: 883Reputation: 883Reputation: 883Reputation: 883Reputation: 883Reputation: 883Reputation: 883
As far as I can tell, those blades only have 1GbE ports...are you running a separate 10GbE network card in them? What makes you think your network is running at 5Gb?

Also, the SCP encryption has a lot of overhead. Check top while running it, if the processors in the machines aren't up to the task you'll be limited by their encryption/decryption speed. You can try changing the SSH cypher to blowfish to reduce processor overhead, assuming that's your bottleneck...otherwise you'll need to change protocols.
 
Old 03-22-2013, 06:59 PM   #3
baldy3105
Member
 
Registered: Jan 2003
Location: Cambridgeshire, UK
Distribution: Mint (Desktop), Debian (Server)
Posts: 875

Rep: Reputation: 179Reputation: 179
Test it first with iperf. Memory to memory over the network, removing all the IO subsystems from the equation and issues with encryption etc. Bear in mind that if you are running port channeled gig links, and I assume you are if you have a 5G connection to the network, you will still be limited to 1Gbps for a single session, you need multiple sessions to make use of multiple links.
 
Old 03-23-2013, 10:09 AM   #4
bradvan
Member
 
Registered: Mar 2009
Posts: 167

Original Poster
Rep: Reputation: 28
Hi guys, I'll give iperf a shot. It is a 10Gb on board NIC. The flex-10 splits that into two 5Gb connections. So, the single NIC is on a 5Gb connection and it is not bonded. I was thinking of bonding the two.

I'll run top at the some time. I can also try an nfs connection and remove the encryption overhead.

Thanks for the suggestions!
 
Old 03-25-2013, 03:30 PM   #5
jefro
Guru
 
Registered: Mar 2008
Posts: 10,246

Rep: Reputation: 1255Reputation: 1255Reputation: 1255Reputation: 1255Reputation: 1255Reputation: 1255Reputation: 1255Reputation: 1255Reputation: 1255
My guess would be that you could never get full bandwidth on that nic. Either backplane/cpu or hard drive would be slower than nic. If you had some huge file in ram or ramdrive then maybe it might get close to or maybe 70% of simple transfer speeds.
 
Old 03-25-2013, 06:56 PM   #6
suicidaleggroll
Senior Member
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 2,406

Rep: Reputation: 883Reputation: 883Reputation: 883Reputation: 883Reputation: 883Reputation: 883Reputation: 883
Quote:
Originally Posted by jefro View Post
If you had some huge file in ram or ramdrive then maybe it might get close to or maybe 70% of simple transfer speeds.
Good point, regular platter drive sequential read is only around 100 MB/s (give or take), so in order to exceed that with any kind of file transfer you're going to need to be pulling off of a ramdrive, SSD, or a RAID array.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: 5 highly rated Linux OS distributions LXer Syndicated Linux News 0 09-17-2012 05:50 AM
[SOLVED] CPU rated 1100MHz but runs @735MHz. stf92 Linux - Hardware 10 08-22-2011 06:09 AM
Slackware rated number one Stroker Slackware 11 03-08-2009 10:48 AM
LXer: Bastille: rated security with education LXer Syndicated Linux News 0 12-05-2006 08:54 AM
Do you think slashdot is over rated? speel General 14 03-20-2005 05:20 AM


All times are GMT -5. The time now is 05:34 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration