LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Networking
User Name
Password
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.

Notices


Reply
  Search this Thread
Old 06-20-2019, 06:51 PM   #1
road hazard
Member
 
Registered: Nov 2015
Posts: 145

Rep: Reputation: Disabled
Question Need help understanding how to make two Linux boxes talk over matching 10Gbps NICs


Current state:

Server A has a built in 1 gig NIC and talks to the LAN/WAN.

Server B has a built in 1 gig NIC that isn't wired to anything.

I'm getting ready to jump onto the 10Gbps bandwagon and will be adding a 10 gig card to each server but need help figuring something out.

Server A is always turned on. Is it possible to do some network magic so server B (using the 10 gig NIC) can route out to the internet via server A? Bridging?

AND, how (if possible) do I make server A and B talk to each other over the 10 gig (DAC) link? Since these two servers will be sending massive amounts of data back and forth, when they talk to each other, I need them to strictly talk on the 10 gig cards. For server B this won't be a problem since the 10 gig card will be the only NIC it has wired but server A will have the 1 gig card talking to the LAN/WAN and a 10 gig card that will be directly wired to server B.

Right now, I have an 8 port, 1 gig switch. I was looking at getting a switch that has 24 1 gig ports and 2, SFP+ ports. Hooking everything into this would solve all my problems but if I can accomplish my goal without having to buy that type of switch, I'd rather spend my monies on more HDDs.

All this possible or should I just drop a couple hundred on a switch that has some SFP+ ports and save myself some headaches?
 
Old 06-20-2019, 07:09 PM   #2
frankbell
LQ Guru
 
Registered: Jan 2006
Location: Virginia, USA
Distribution: Slackware, Ubuntu MATE, Mageia, and whatever VMs I happen to be playing with
Posts: 15,431
Blog Entries: 25

Rep: Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438Reputation: 4438
You can set up Server A as a router, but I think that will require two network cards in Server A.

I've never needed to do that, but this looks like a good intro to the concept: https://www.computernetworkingnotes....-a-router.html
 
Old 06-20-2019, 08:35 PM   #3
BW-userx
LQ Guru
 
Registered: Sep 2013
Location: Somewhere in my head.
Distribution: FreeBSD/Slackware-14.2+/ArcoLinux
Posts: 9,135

Rep: Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926Reputation: 1926
do corssovers still work? Ethernet crossover cable, or are they a thing of the past?

CAT-5 Wiring Diagram & Crossover Cable Diagram

that is just me spit balling
 
Old 08-21-2019, 05:26 PM   #4
bsdaemon
LQ Newbie
 
Registered: Aug 2019
Location: The People's Republic of Boulder, CO
Distribution: Slackware 14.2
Posts: 17
Blog Entries: 2

Rep: Reputation: Disabled
UTP crossovers

Yup, a x-over cable is still a necessity to direct-wire two boxes, NIC-to-NIC. Most modern hubs and switches (even eBay offshore types) will auto-sense and flip TxD and RxD.
 
Old 08-21-2019, 06:15 PM   #5
road hazard
Member
 
Registered: Nov 2015
Posts: 145

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by frankbell View Post
You can set up Server A as a router, but I think that will require two network cards in Server A.

I've never needed to do that, but this looks like a good intro to the concept: https://www.computernetworkingnotes....-a-router.html
I'm leaning towards just picking up a Dell PowerConnect 5524 swith off eBay. When it comes to 10Gbps NICs, does the Kernel support any of them "out of the box" or more than likely, will I have to re-compile the Kernel to support whatever 10Gbps NIC I go with? (If so, a newbie question.... when new Kernel's are downloaded, will I have to repeat that step or will the new Kernel see that I'm using a driver for whatever and scoop that up from then on?)
 
Old 08-21-2019, 06:42 PM   #6
michaelk
Moderator
 
Registered: Aug 2002
Posts: 19,028

Rep: Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890Reputation: 2890
Pretty much crossover cables are a thing of the past unless you are still using fairly old hardware.

Most 100 base-t adapters these days as far as I know are MDI-X i.e. auto crossover detection as well as all 1 GB or 10 GB devices so no crossover cable is required. Some adapters that are directly connected together may not be able to auto-detect but you probably will not find that out until you actually plug it in. None of the equipment that I have used had a problem but I don't have 10GB yet.

Last edited by michaelk; 08-21-2019 at 06:50 PM.
 
Old 08-21-2019, 10:27 PM   #7
jefro
Moderator
 
Registered: Mar 2008
Posts: 19,217

Rep: Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926Reputation: 2926
"AND, how (if possible) do I make server A and B talk to each other over the 10 gig (DAC) link? Since these two servers will be sending massive amounts of data back and forth, when they talk to each other, I need them to strictly talk on the 10 gig cards. For server B this won't be a problem since the 10 gig card will be the only NIC it has wired but server A will have the 1 gig card talking to the LAN/WAN and a 10 gig card that will be directly wired to server B.
"

You normally set up the correct ip range and subnet. If lan/wan is on 192.x.x.x then use 10.x.x.x for 10g. One could maybe use some sort of vpn between but you may have to break one side to get into lan. Many other ways to set this connection private. Firewall rules may help isolate this connection.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
How much throughput can you get from a 1Gbps and 10Gbps network interface ? exceed1 Linux - Hardware 2 02-19-2012 11:00 AM
10Gbps NIC initialization failed austinbravo Linux - Newbie 2 05-20-2011 08:02 PM
[SOLVED] Matching two tables of non-matching sizes astroumut Programming 3 03-03-2011 07:05 AM
configuring 2 nics to talk to two different subnets on a sles10sp3 server lodonnel Linux - Networking 3 11-30-2009 09:22 AM
3 Ubuntu boxes with Samba - One finds all XP shares - Two UltraSparc64 boxes do not mwx Linux - Server 1 01-28-2009 06:03 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Networking

All times are GMT -5. The time now is 01:48 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration