two NICs problem

sheldonbai · 03-15-2010, 03:27 PM

I have a linux workstation running RHEL5 Client. It has two NICs, Broadcom NetXtreme BCM5761 at PCI:9:0:0 and BCM5722 at PCI:23:0:0. The drivers are both tg3 from broadcom. Is there a way to make both NICs recognizable by the system?

frieza · 03-15-2010, 03:43 PM

welcome to lq
yes it is possible, what you would do with both nics is the question since you really only need dual nics in specialized circumstances such as using your computer as a firewall/router or if you have a public web server that you want to restrict remote administration to within your physical lan
you might want to try editing /etc/network/interfaces (or whatever the equivilent is in RHEL) for something like this

Code:

auto eth0;
iface eth0 inet dhcp
auto eth1
iface eth1 inet static
address 192.168.2.1
netmask 255.255.255.0

or something like that
for the firewall
assuming that eth0 is the internet facing interface and eth1 is attached to your lan and then configure firewall rules to allow connections from your lan using eth0 as your gateway
otherwise you would want to configure BOTH static and configure your remote administration tools to only listen on eth1 and not allow communication between the 2 nics

note i'm not an expert in this area so i apologise for not being more specific but thats the best i can offer

jefro · 03-15-2010, 06:03 PM

Let me ask a dumb question.

Why are they not being recognized?

sheldonbai · 03-15-2010, 07:36 PM

That was my dumb question. It seemed that only one card could be recognized at a time. Any ideas how to make both recognizable? Thanks.

Quote:

Originally Posted by jefro

Let me ask a dumb question.

Why are they not being recognized?

nimnull22 · 03-15-2010, 08:33 PM

Ok, that do mean by "be recognized"?
Can you post output of the command:
ifconfig -a

Thanks.

jefro · 03-15-2010, 09:20 PM

Might also see lspci results after ifconfig.

Drakeo · 03-16-2010, 12:07 AM

in red hat it uses the /etc/rc.d/rc.inet1.conf by default only one eth0 is enabled during install. so I would edit the /etc/rc.d/rc.inet1.conf like this

Quote:

# Config information for eth0:
IPADDR[0]=""
NETMASK[0]=""
USE_DHCP[0]="yes"
DHCP_HOSTNAME[0]=""

# Config information for eth1:
IPADDR[1]=""
NETMASK[1]=""
USE_DHCP[1]="yes" <--- you can use "no" if there is a conflict of irq at boot time.
DHCP_HOSTNAME[1]=""

# Config information for eth2:
IPADDR[2]=""
NETMASK[2]=""
USE_DHCP[2]=""
DHCP_HOSTNAME[2]=""

# Config information for eth3:
IPADDR[3]=""
NETMASK[3]=""
USE_DHCP[3]=""
DHCP_HOSTNAME[3]=""

note only the first device eth0 will try to connect at boot. the other device should load but just listen. if you put yes on both they will both load and the first one will try to connect first
Please do like the others asked open a console and type lspci. and post it.
lets see if your modules and firm ware is loaded for the second device. lsmod for drivers look in your dmesg log for errors.

sheldonbai · 03-16-2010, 07:50 AM

Here are the output of ifcontig and lspci.

***
ifcontig -a

eth0 Link encap:Ethernet HWaddr 00:25:64:A4:C4:14
inet6 addr: fe80::225:64ff:fea4:c414/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1026264 errors:67 dropped:0 overruns:0 frame:0
TX packets:61 errors:0 dropped:0 overruns:0 carrier:0
collisions:7 txqueuelen:1000
RX bytes:108833306 (103.7 MiB) TX bytes:18360 (17.9 KiB)
Interrupt:185

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:1346 errors:0 dropped:0 overruns:0 frame:0
TX packets:1346 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:2153428 (2.0 MiB) TX bytes:2153428 (2.0 MiB)

sit0 Link encap:IPv6-in-IPv4
NOARP MTU:1480 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)

***
lspci | grep Ethernet

09:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5761 Gigabit Ethernet PCIe (rev 10)
23:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5722 Gigabit Ethernet PCI Express

sheldonbai · 03-16-2010, 08:22 AM

***lspci -vv***
09:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5761 Gigabit Ethernet PCIe (rev 10)
Subsystem: Dell Unknown device 026d
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 162
Region 0: Memory at f0ae0000 (64-bit, non-prefetchable) [size=64K]
Region 2: Memory at f0af0000 (64-bit, non-prefetchable) [size=64K]
Capabilities: [48] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [40] Vital Product Data
Capabilities: [60] Vendor Specific Information
Capabilities: [50] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable+
Address: 00000000fee06000 Data: 40a2
Capabilities: [cc] Express Endpoint IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag+
Device: Latency L0s <4us, L1 unlimited
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable- Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 128 bytes, MaxReadReq 4096 bytes
Link: Supported Speed 2.5Gb/s, Width x1, ASPM L0s L1, Port 0
Link: Latency L0s <1us, L1 <64us
Link: ASPM L0s L1 Enabled RCB 64 bytes CommClk+ ExtSynch-
Link: Speed 2.5Gb/s, Width x1
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Virtual Channel
Capabilities: [160] Device Serial Number 14-c4-a4-fe-ff-64-25-00
Capabilities: [16c] Power Budgeting

23:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5722 Gigabit Ethernet PCI Express
Subsystem: Broadcom Corporation NetXtreme BCM5722 Gigabit Ethernet PCI Express
Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR-
Interrupt: pin A routed to IRQ 122
Region 0: Memory at cfdf0000 (64-bit, non-prefetchable) [disabled] [size=64K]
Capabilities: [48] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [50] Vital Product Data
Capabilities: [58] Vendor Specific Information
Capabilities: [e8] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Address: 6695825ee4191df0 Data: 720f
Capabilities: [d0] Express Endpoint IRQ 0
Device: Supported: MaxPayload 128 bytes, PhantFunc 0, ExtTag+
Device: Latency L0s <4us, L1 unlimited
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable- Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 128 bytes, MaxReadReq 4096 bytes
Link: Supported Speed 2.5Gb/s, Width x1, ASPM L0s, Port 0
Link: Latency L0s <4us, L1 <64us
Link: ASPM Disabled RCB 64 bytes CommClk+ ExtSynch-
Link: Speed 2.5Gb/s, Width x1
Capabilities: [100] Advanced Error Reporting
Capabilities: [13c] Virtual Channel
Capabilities: [160] Device Serial Number 00-00-00-fe-ff-00-00-00

***/etc/sysconfig/hwconf (only network related stuff is shown. nowhere to find anything related to eth1)***
class: NETWORK
bus: PCI
detached: 0
device: eth0
driver: tg3
desc: "Broadcom Corporation NetXtreme BCM5761 Gigabit Ethernet PCIe"
network.hwaddr: 00:25:64:a4:c4:14
vendorId: 14e4
deviceId: 1681
subVendorId: 1028
subDeviceId: 026d
pciType: 1
pcidom: 0
pcibus: 9
pcidev: 0
pcifn: 0

***lsmod output***
Module Size Used by
vfat 46401 0
fat 85873 1 vfat
usb_storage 116641 1
ip6table_filter 36033 1
ip6_tables 50049 1 ip6table_filter
ip_conntrack_netbios_ns 36033 0
xt_state 35265 4
ip_conntrack 91109 2 ip_conntrack_netbios_ns,xt_state
nfnetlink 40457 1 ip_conntrack
iptable_filter 36161 1
ip_tables 55329 1 iptable_filter
libphy 53825 0
nls_utf8 35137 1
autofs4 57033 2
hidp 83521 2
rfcomm 104809 0
l2cap 89281 10 hidp,rfcomm
bluetooth 118597 5 hidp,rfcomm,l2cap
sunrpc 197897 1
ipt_REJECT 38849 1
ip6t_REJECT 38849 1
xt_tcpudp 36289 14
x_tables 50377 6 ip6_tables,xt_state,ip_tables,ipt_REJECT,ip6t_REJECT,xt_tcpudp
mptctl 116104 0
dm_multipath 55257 0
scsi_dh 41665 1 dm_multipath
video 53197 0
hwmon 36553 0
backlight 39873 1 video
sbs 49921 0
i2c_ec 38593 1 sbs
button 40545 0
battery 43849 0
asus_acpi 50917 0
acpi_memhotplug 40133 0
ac 38729 0
ipv6 424609 77 ip6t_REJECT
xfrm_nalgo 43333 1 ipv6
crypto_api 42945 1 xfrm_nalgo
lp 47121 0
snd_hda_intel 481777 1
snd_seq_dummy 37061 0
snd_seq_oss 65473 0
snd_seq_midi_event 41025 1 snd_seq_oss
snd_seq 87777 5 snd_seq_dummy,snd_seq_oss,snd_seq_midi_event
snd_seq_device 41557 3 snd_seq_dummy,snd_seq_oss,snd_seq
snd_pcm_oss 77377 0
nvidia 9656168 42
snd_mixer_oss 49985 1 snd_pcm_oss
sr_mod 50789 1
snd_pcm 116681 2 snd_hda_intel,snd_pcm_oss
cdrom 68713 1 sr_mod
snd_timer 57161 2 snd_seq,snd_pcm
snd_page_alloc 44113 2 snd_hda_intel,snd_pcm
snd_hwdep 43593 1 snd_hda_intel
serio_raw 40517 0
i2c_i801 41813 0
pcspkr 36289 0
parport_pc 62312 1
i2c_core 56129 3 i2c_ec,nvidia,i2c_i801
parport 73165 2 lp,parport_pc
snd 99433 11 snd_hda_intel,snd_seq_oss,snd_seq,snd_seq_device,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_timer,snd_hwd ep
tg3 154628 0
ohci1394 67672 0
sg 69993 0
ieee1394 132720 1 ohci1394
soundcore 41825 1 snd
dm_raid45 99025 0
dm_message 36161 1 dm_raid45
dm_region_hash 46145 1 dm_raid45
dm_mem_cache 38977 1 dm_raid45
dm_snapshot 51465 0
dm_zero 35265 0
dm_mirror 53065 0
dm_log 44865 3 dm_raid45,dm_region_hash,dm_mirror
dm_mod 100369 11 dm_multipath,dm_raid45,dm_snapshot,dm_zero,dm_mirror,dm_log
mptspi 54032 0
scsi_transport_spi 59841 1 mptspi
ahci 68809 2
libata 208721 1 ahci
shpchp 70637 0
mptsas 86288 5
mptscsih 73216 2 mptspi,mptsas
mptbase 121636 4 mptctl,mptspi,mptsas,mptscsih
scsi_transport_sas 66753 1 mptsas
sd_mod 56385 13
scsi_mod 196569 12 usb_storage,mptctl,scsi_dh,sr_mod,sg,mptspi,scsi_transport_spi,libata,mptsas,mptscsih,scsi_transport _sas,sd_mod
ext3 168017 6
jbd 94257 1 ext3
uhci_hcd 57433 0
ohci_hcd 55925 0
ehci_hcd 65741 0

***/etc/sysconfig/networking-scripts/ifcfg-eth0***
# Please read /usr/share/doc/initscripts-*/sysconfig.txt
# for the documentation of these parameters.
TYPE=Ethernet
DEVICE=eth0
HWADDR=00:25:64:a4:c4:14
BOOTPROTO=dhcp
ONBOOT=yes
USERCTL=no
IPV6INIT=no
PEERDNS=yes

**/etc/sysconfig/networking-scripts/ifcfg-eth1***
# Please read /usr/share/doc/initscripts-*/sysconfig.txt
# for the documentation of these parameters.
TYPE=Ethernet
DEVICE=eth1
HWADDR=00:10:18:59:d7:23
BOOTPROTO=dhcp
ONBOOT=yes
USERCTL=no
IPV6INIT=no
PEERDNS=yes

nimnull22 · 03-16-2010, 10:41 AM

It can be one driver for 2 cards or it needs to 2 drivers?

Check, may be your card in black list?

Search through all LOG files for anything about ethernet cards. May be there is some information why second one does not use or load driver.

Thanks

sheldonbai · 03-16-2010, 01:29 PM

The card is not in the blacklist. In the "messages" file, it simply said that "Device eth1 does not seem to present. delay initialization...". Does anyone experience anything like this before???

Quote:

Originally Posted by nimnull22

It can be one driver for 2 cards or it needs to 2 drivers?

Check, may be your card in black list?

Search through all LOG files for anything about ethernet cards. May be there is some information why second one does not use or load driver.

Thanks

nimnull22 · 03-16-2010, 01:35 PM

Do you have any BIOS settings regarding ethernet cards?

sheldonbai · 03-16-2010, 02:54 PM

Quote:

Originally Posted by nimnull22

Do you have any BIOS settings regarding ethernet cards?

I cannot get the BIOS settings. The startup screen shows up only for half a second or something. None of the F# buttons works.

jefro · 03-16-2010, 03:10 PM

Since lspci sees it, I'd assume bios has it enabled but I could be wrong on that.

My guess is there isn't a native driver in your distro or a bug in the distro. Try a live cd or two to see if another config's it.

nimnull22 · 03-16-2010, 03:45 PM

There is another thing we can do:
modprobe -r tg3
modprobe tg3

After it, please check dmesg.
Also please post output of: modinfo tg3

Thanks