KVM networking - using VLAN and Bridges on Debian/Ubuntu
Linux - Virtualization and CloudThis forum is for the discussion of all topics relating to Linux Virtualization and Linux Cloud platforms. Xen, KVM, OpenVZ, VirtualBox, VMware, Linux-VServer and all other Linux Virtualization platforms are welcome. OpenStack, CloudStack, ownCloud, Cloud Foundry, Eucalyptus, Nimbus, OpenNebula and all other Linux Cloud platforms are welcome. Note that questions relating solely to non-Linux OS's should be asked in the General forum.
Notices
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
KVM networking - using VLAN and Bridges on Debian/Ubuntu
hello
i have tried to setup an environment using Debian 6 and Ubuntu 12.04 (both x64), using VLAN to manage networks between storage server and host/node servers.
then created bridges to enable guests to access the networks - br10, br1000
and a bridge to allow untagged traffic to host - br1
Problem:
guests can not receive any traffic
i have tried checking for traffic on the port connected to br10, and no packets are received.
i am checking this while testing (ping, ssh, nmap, http) to connect to this guest host.
i would really appreciate if somebody could provide a link to some other posts/article on how to get this setup working.
It sounds good to me. Can you post the full output of "ifconfig -a" and "brctl show" on the host. You've checked the port? That's as in inside the vm? What about tcpdumping on the virtual interface on the host side, and also on the bridge, and the bond (when testing from a physically remote machine)
i will get those outputs that you asked later today.
this is the network file on one of the hosts/nodes:
Code:
# The loopback network interface
auto lo
iface lo inet loopback
iface bond0 inet manual
pre-down ethtool -s $IFACE wol g
bond-slaves eth0 eth1
bond-primary eth0
bond-mode 1
bond-miimon 100
bond-downdelay 100
bond-updelay 100
iface bond0.10 inet manual
iface bond0.100 inet manual
auto virbr1
iface virbr1 inet static
address 192.168.1.3
broadcast 192.168.1.255
netmask 255.255.255.0
gateway 192.168.1.1
dns-search home.brain
dns-nameservers 192.168.1.1 8.8.8.8
bridge_ports bond0
bridge_stp off # disable Spanning Tree Protocol
bridge_waitport 0 # no delay before a port becomes available
bridge_fd 0 # no forwarding delay
## un-tagged packets have to have the same MAC as the bond (NICs)
## hwaddress ether 02:01:02:03:04:a1
auto virbr10
iface virbr10 inet static
address 10.1.10.3
broadcast 10.1.10.255
netmask 255.255.255.0
gateway 10.1.10.254
dns-search mngt.brain
dns-nameservers 10.1.10.253
bridge_ports bond0.10
bridge_stp off # disable Spanning Tree Protocol
bridge_waitport 0 # no delay before a port becomes available
bridge_fd 0 # no forwarding delay
hwaddress ether 02:01:02:03:04:a2
auto virbr100
iface virbr100 inet static
address 10.1.100.3
netmask 255.255.255.0
broadcast 10.1.100.254
network 10.1.100.0
bridge_ports bond0.100
bridge_stp off # disable Spanning Tree Protocol
bridge_waitport 0 # no delay before a port becomes available
bridge_fd 0 # no forwarding delay
hwaddress ether 02:01:02:03:04:a3
i have added the hwaddress ether as there were lots of entries on /var/log/syslog of packets originating with same MAC as detination. this seems to solve this issue.
thanks,
Last edited by nicolasdiogo; 04-18-2013 at 11:14 AM.
i have restart the whole setup from scratch and it seems that there is an issue with the bodnding.
i can get all the VLANs and bridges working fine against eth0 or eth1.
but as i add eth0 and eth1 to a bond and then VLANs and bridge against it.
i find errors on the logs and connectivity with guests fail.
so for now i will use eth0; and revisit it in the future.
sorry to kick an old topic but did anyone ever find a resloution to this? Im having the exact same problem and i do not wish to settle for unbonded nics because a switch failure will result in the loss of the host which is the exact reason we purchase redundant switches for. i would be absolutely grateful if anyone has any futher information on this
i will have a look on this setup; it is a while since i last checked.
and there were a number of packages updates, and other people who looked into this matter.
if there are any changes - i will post back here.
from the top of my head, i recall having somebody who was an expert on Cisco switches changing some settings trying to solve this matter.
thus keep in mind that you may find your switch not playing correctly - do not think the problem is on the box alone.
tchau
Last edited by nicolasdiogo; 02-05-2014 at 06:55 AM.
Reason: english language mistakes
our problem isnt the cisco switch some of our ceph nodes use lacp bonding and that works, and we can get all of our hypervisor nodes to work on active-backup i.e. pull cables and not lose packets, we can even get to the point where some of the bridges pass traffic. here is what one of our attempts at a conf file looks like (there are many many others) this is for cloudstack btw
auto em1
iface em1 inet manual
bond-master bond0
bond-primary em1
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.