LinuxQuestions.org
Welcome to the most active Linux Forum on the web.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Networking
User Name
Password
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.

Notices

Reply
 
Search this Thread
Old 02-02-2008, 07:24 PM   #1
jackpal
Member
 
Registered: Oct 2003
Location: Florida USA
Distribution: Fedora, RHEL
Posts: 57

Rep: Reputation: 15
Transfer Speeds


Hello everybody. I'm building an iSCSI array for an ESX server setup at home. The iSCSI array is built on Fedora 8. Right now I'm just trying to baseline expected File transfer speeds. Here is what I have so far:

1 8 port Gig Netgear Switch
6 Intel Gig nics
2 Fedora 8 Fresh installs

-Each Fedora box has 3 Intel gig nics. 2 of the nics are bonded together in each box (bond0). The third nic is one another network and used for management only. The idea is to have a private network for the iscsi traffic using the bonded nics or bond0.

-The iSCSI box has a Raid0 array consisting of 2 SATA2 drives. No iscsi target set up yet but I've shared the array via NFS. Here is my mount command: mount -o rsize=32768 -o wsize=32768 iscsi:/array /mnt/array

Now from the other machine I mount up the iscsi machine through the bonded nics. Then I perform a file transfer. I'm getting a transfer rate reported by midnight commander of 35-38mbs. I'm transferring a 3.5 gig iso file. What I want to know is if this is what I should expect. I'm at home so traffic is not an issue. I'm thinking I might want to upgrade my switch. Can somebody that has a gig network transfer a large file and let me know the speed results? I think I can live with 35 mbs but looking to make it the best I can.

I just made a blog which is still pretty basic that should describe my setup. http://jackpalmadesso.blogspot.com/
 
Old 02-03-2008, 01:30 PM   #2
traene
Member
 
Registered: Jan 2005
Distribution: Archlinux, Debian, grml
Posts: 210

Rep: Reputation: 33
How much is your local write speed to the Raid0? I am not familiar with Raid systes, but would be a Raid10 give better writing speeds?
 
Old 02-03-2008, 02:01 PM   #3
lazlow
Senior Member
 
Registered: Jan 2006
Posts: 4,362

Rep: Reputation: 171Reputation: 171
Considering the speed of most drives is sub 70 megs/sec even raid0 you are only looking at roughly a 120megs/sec. The theoretical limit for GigE is 125 megs/sec. What mode of bonding are you using(1-6)? If you are running mode 5(?) you can get maximum transfer throughput(250megs/sec in theory) but all the computers connecting to it must also be running mode 5.If you are running mode 1(?) you can serve multiple single nics with each at a max transfer of 125megs/sec. Is the second machine(or machines) also running Raid0? Your transfer rate will be limited by the slowest part in the system. If the receiving drive is not Raid0 that will be the limiting factor. How much ram are you running? To buffer things properly at high speed, 4GB would be a bare minimum. Is the raid software raid or hardware raid? If you try and run software raid you will run into speed and reliability issues vs hardware raid. You are running 64 bit? Running 32bit with above 3GB ram will cause issues.

Just what I could think of off the top of my head.
 
Old 02-05-2008, 05:39 PM   #4
jackpal
Member
 
Registered: Oct 2003
Location: Florida USA
Distribution: Fedora, RHEL
Posts: 57

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by lazlow View Post
Considering the speed of most drives is sub 70 megs/sec even raid0 you are only looking at roughly a 120megs/sec. The theoretical limit for GigE is 125 megs/sec. What mode of bonding are you using(1-6)?

I'm using mode ALB. Here is the line from my /etc/modprobe.connf
options bond0 mode=balance-alb miimon=100
I'm not sure what number that is but I'm pretty sure its just round robin.


If you are running mode 5(?) you can get maximum transfer throughput(250megs/sec in theory) but all the computers connecting to it must also be running mode 5.If you are running mode 1(?) you can serve multiple single nics with each at a max transfer of 125megs/sec. Is the second machine(or machines) also running Raid0?

The Second machine is not using raid at all. Just a sata drive. Local transfer speeds are about 68 mb sec according to midnight commander. I was hoping to get near that.

Your transfer rate will be limited by the slowest part in the system. If the receiving drive is not Raid0 that will be the limiting factor. How much ram are you running?

The systems are pretty lightweight. 2 gigs for the machine with the array.

To buffer things properly at high speed, 4GB would be a bare minimum. Is the raid software raid or hardware raid?

Running software RAID

If you try and run software raid you will run into speed and reliability issues vs hardware raid. You are running 64 bit? Running 32bit with above 3GB ram will cause issues.

I'm using 32 bit . I know, not the ideal setup. I guess I could step up to 64 bit fedora with no problems. I really don't know why I did not do that in the first place. Time to reinstall.

Just what I could think of off the top of my head.
Thanks for the advice.

Jack

Last edited by jackpal; 02-05-2008 at 05:44 PM.
 
Old 02-05-2008, 05:42 PM   #5
jackpal
Member
 
Registered: Oct 2003
Location: Florida USA
Distribution: Fedora, RHEL
Posts: 57

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by traene View Post
How much is your local write speed to the Raid0? I am not familiar with Raid systes, but would be a Raid10 give better writing speeds?
Local write speeds are about 69 mbs according to midnight commander. Thats without raid0. I do not have enough drives to do a multiple raid0 setup. I'm looking for bang for the buck right now. RAID10 will be a little much.
 
Old 02-05-2008, 07:51 PM   #6
lazlow
Senior Member
 
Registered: Jan 2006
Posts: 4,362

Rep: Reputation: 171Reputation: 171
Jackpal

If your receiving speed is limited to sub 70MB/s then there is no point in using bonding. GigE will easily out run that without issue.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
CoLo transfer speeds blizunt7 Linux - Networking 3 04-19-2007 12:02 AM
FTP Transfer Speeds Only 3-4MB/s anwar Linux - Server 1 03-17-2007 10:14 AM
NFS and transfer speeds ! crispyleif Linux - Networking 1 10-31-2005 08:59 AM
Very slow transfer speeds via LAN TBomb Linux - Networking 6 07-26-2005 08:34 AM
Poor network transfer speeds bleunuit Linux - Networking 0 07-11-2005 08:52 AM


All times are GMT -5. The time now is 02:01 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration