LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Networking
User Name
Password
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.

Notices


Reply
  Search this Thread
Old 10-25-2011, 06:01 PM   #1
d072330
Member
 
Registered: Nov 2007
Location: USA
Distribution: CentOS 5/6
Posts: 186

Rep: Reputation: 6
Bonding for Bandwidth


I want to bond for bandwidth. Here are my ifcfg-* files.

Quote:
::::::::::::::
ifcfg-bond0
::::::::::::::
# Intel Corporation 80003ES2LAN Gigabit Ethernet Controller (Copper)
DEVICE=bond0
BOOTPROTO=none
ONBOOT=yes
NETMASK=255.255.255.0
IPADDR=192.168.7.214
GATEWAY=192.168.7.1
TYPE=Ethernet
USERCTL=no
Quote:
::::::::::::::
ifcfg-eth0
::::::::::::::
# Intel Corporation 80003ES2LAN Gigabit Ethernet Controller (Copper)
DEVICE=eth0
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no
TYPE=Ethernet
ETHTOOL_OPTS="autoneg off speed 1000 duplex full"
Quote:
::::::::::::::
ifcfg-eth1
::::::::::::::
# Intel Corporation 80003ES2LAN Gigabit Ethernet Controller (Copper)
DEVICE=eth1
BOOTPROTO=none
ONBOOT=yes
MASTER=bond0
SLAVE=yes
USERCTL=no
TYPE=Ethernet
ETHTOOL_OPTS="autoneg off speed 1000 duplex full"

Here is my /etc/modprobe.conf file:

Quote:
alias eth0 e1000e
alias eth1 e1000e
alias bond0 bonding
options bond0 miimon=100 mode=0 (think this needs to be mode=4 but not sure).
alias scsi_hostadapter arcmsr
alias scsi_hostadapter1 ahci
alias scsi_hostadapter2 usb-storage
Does everything look correct? When I restart the network services or reboot this is what is in the /var/log/messages:

Quote:
Oct 25 15:31:24 server1 kernel: bonding: bond0: Removing slave eth0
Oct 25 15:31:24 server1 kernel: bonding: bond0: Warning: the permanent HWaddr of eth0 - 00:00:00:00:00:00 - is still in use by bond0. Set the HWaddr of eth0 to a different address to avoid conflicts.
Oct 25 15:31:24 server1 kernel: bonding: bond0: releasing active interface eth0
Oct 25 15:31:24 server1 kernel: eth0: changing MTU from 1500 to 1500
Oct 25 15:31:24 server1 kernel: bonding: bond0: Removing slave eth1
Oct 25 15:31:24 server1 kernel: bonding: bond0: releasing active interface eth1
Oct 25 15:31:24 server1 kernel: eth1: changing MTU from 1500 to 1500
Oct 25 15:31:24 server1 kernel: ADDRCONF(NETDEV_UP): bond0: link is not ready
Oct 25 15:31:24 server1 kernel: bonding: bond0: Adding slave eth0.
Oct 25 15:31:24 server1 kernel: bonding: bond0: enslaving eth0 as an active interface with a down link.
Oct 25 15:31:24 server1 kernel: bonding: bond0: Adding slave eth1.
Oct 25 15:31:24 server1 kernel: bonding: bond0: enslaving eth1 as an active interface with a down link.
Oct 25 15:31:27 server1 kernel: e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
Oct 25 15:31:27 server1 kernel: bonding: bond0: link status definitely up for interface eth0.
Oct 25 15:31:27 server1 kernel: ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
From my understanding for this type of bonding I do not have to do anything special to the switch ports so I have not. If I was going to be doing VLAN tagging then I would have to trunk the ports together. Is this correct?

Is the messages in the messages file normal or do I have something misconfigured?

Last edited by d072330; 10-25-2011 at 06:03 PM.
 
Old 10-25-2011, 09:01 PM   #2
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,974

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
http://www.cyberciti.biz/tips/linux-...interface.html
 
Old 10-26-2011, 01:09 PM   #3
d072330
Member
 
Registered: Nov 2007
Location: USA
Distribution: CentOS 5/6
Posts: 186

Original Poster
Rep: Reputation: 6
Ok so I followed those instructions. This is the output from messages file when restarting the network service.

Quote:
Oct 26 11:04:43 server1 kernel: bonding: bond0: Removing slave eth0
Oct 26 11:04:43 server1 kernel: bonding: bond0: Warning: the permanent HWaddr of eth0 - 00:00:00:00:00:00 - is still in use by bond0. Set the HWaddr of eth0 to a different address to avoid conflicts.
Oct 26 11:04:43 server1 kernel: bonding: bond0: releasing active interface eth0
Oct 26 11:04:44 server1 kernel: eth0: changing MTU from 1500 to 1500
Oct 26 11:04:44 server1 kernel: bonding: bond0: Removing slave eth1
Oct 26 11:04:44 server1 kernel: bonding: bond0: releasing active interface eth1
Oct 26 11:04:44 server1 kernel: eth1: changing MTU from 1500 to 1500
Oct 26 11:04:44 server1 kernel: ADDRCONF(NETDEV_UP): bond0: link is not ready
Oct 26 11:04:44 server1 kernel: bonding: bond0: Adding slave eth0.
Oct 26 11:04:44 server1 kernel: bonding: bond0: enslaving eth0 as an active interface with a down link.
Oct 26 11:04:44 server1 kernel: bonding: bond0: Adding slave eth1.
Oct 26 11:04:44 server1 kernel: bonding: bond0: enslaving eth1 as an active interface with a down link.
Oct 26 11:04:47 server1 kernel: e1000e: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
Oct 26 11:04:47 server1 kernel: bonding: bond0: link status definitely up for interface eth0.
Oct 26 11:04:47 server1 kernel: ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
Couple problems from log file:
It shows an error with eth0 MAC still in use and wants me to change the MAC address of eth0. Is this necessary?

It shows enslaving eth0 and eth1 but it only states brining up eth0 in the bond. Is this a normal output for bonding 2 NIC's together for bandwidth?
 
Old 10-26-2011, 10:06 PM   #4
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,974

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
"Oct 26 11:04:43 server1 kernel: bonding: bond0: Warning: the permanent HWaddr of eth0 - 00:00:00:00:00:00 - is still in use by bond0. Set the HWaddr of eth0 to a different address to avoid conflicts."

Wonder if the nic or driver can't support bonding?
 
Old 10-27-2011, 03:31 AM   #5
simonmcnair
LQ Newbie
 
Registered: Oct 2011
Posts: 17

Rep: Reputation: Disabled
Just my 2p....

this is my debian \etc\network\interfaces config and it's working with LACP through my switch


auto lo
iface lo inet loopback

iface eth0 inet manual

iface eth1 inet manual

auto bond0
iface bond0 inet manual
slaves eth0 eth1
bond_miimon 100
bond_mode 802.3ad

auto vmbr0
iface vmbr0 inet static
address 192.168.1.253
netmask 255.255.255.0
gateway 192.168.1.254
dns-nameservers 192.168.1.1 8.8.8.8
dns-search home.mcnair.co.uk
bridge_ports bond0
bridge_stp off
bridge_fd 0

The last thing though, is this, 802.11d will, I believe only share the connection, it will not increase your bandwidth PER CONNECTION. so if you bond 2x1gbps interfaces the max throughput you will get through a single connection is 1gbps, but you could have 2x1gbps connections to the same address. I bonded so see what the max bandwidth I could get was from my 10 disk raid array, but this would still saturate the single connection I could get to the machine (if that makes sense).

Simon
 
Old 10-27-2011, 03:37 AM   #6
simonmcnair
LQ Newbie
 
Registered: Oct 2011
Posts: 17

Rep: Reputation: Disabled
regarding your error "permanent HWaddr of eth0 - 00:00:00:00:00:00 - is still in use by bond0". No network card should have a blank mac address afaik. Also, once you've created a bond, unless you bring it down properly bond0 will remain intact and you'll be reconfiguring it. I would recommend, if you can, doing a reboot (or maybe a /etc/init.d/networking restart at the very least) to ensure that bond0 is destroyed across reconfiguration attempts
 
Old 10-27-2011, 01:58 PM   #7
d072330
Member
 
Registered: Nov 2007
Location: USA
Distribution: CentOS 5/6
Posts: 186

Original Poster
Rep: Reputation: 6
have already rebooted and restarted the network service. How can I test if the bond is working?
 
Old 10-27-2011, 03:23 PM   #8
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,974

Rep: Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623Reputation: 3623
Pull the plug on one of them or wireshare the data.
Depending one the setup, you might notice more bandwidth. I doubt it as most other parts are slower than the bond.
 
Old 10-27-2011, 04:06 PM   #9
simonmcnair
LQ Newbie
 
Registered: Oct 2011
Posts: 17

Rep: Reputation: Disabled
mii-tool should tell you....as would looking at ifconfig -a as would looking at the end of syslog as would pulling the network cable out of one.
 
Old 10-27-2011, 04:08 PM   #10
simonmcnair
LQ Newbie
 
Registered: Oct 2011
Posts: 17

Rep: Reputation: Disabled
regarding
Quote:
options bond0 miimon=100 mode=0 (think this needs to be mode=4 but not sure).
This page will tell you what number you need in there

http://www.howtoforge.com/nic-bonding-on-debian-lenny
 
Old 10-27-2011, 05:12 PM   #11
d072330
Member
 
Registered: Nov 2007
Location: USA
Distribution: CentOS 5/6
Posts: 186

Original Poster
Rep: Reputation: 6
yeah thx figured that one out. I am using mode=6 so I did not have to make any changes on the switch.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
bonding bonding-xor and bonding-alb Chrysalis Linux - Networking 1 10-24-2009 02:14 PM
NIC Bonding, bandwidth merging gudboy Linux - Newbie 1 03-13-2009 04:32 AM
Infiniband Bonding and Ethernet Bonding edcrozer Linux - Networking 0 11-07-2007 03:57 PM
Bonding Links Together for increased bandwidth? cussy Linux - Networking 1 09-19-2005 02:56 PM
Vsftpd - how to limit download bandwidth but unlimited upload bandwidth? mpls mikeg Linux - Software 3 08-13-2005 01:52 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Networking

All times are GMT -5. The time now is 12:41 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration