Visit Jeremy's Blog.
Go Back > Forums > Linux Forums > Linux - Networking
User Name
Linux - Networking This forum is for any issue related to networks or networking.
Routing, network cards, OSI, etc. Anything is fair game.


  Search this Thread
Old 04-26-2015, 09:22 PM   #1
Registered: Jan 2010
Posts: 121

Rep: Reputation: 16
How can I test Infiniband?

I am in the process of moving a ROCKS cluster that uses Red Hat 5.4 to a new Cluster using the same hardware, but Red Hat 6,6, and Rocks 6.1.1. I am slowly moving each node to the new cluster. I have very old Infiniband HBAs connected to a switch. That switch can see the nodes that remain in the old cluster, and the new ones that have been moved. I downloaded and installed MVAPICH2 from OSU and its benchmarking. I had a user compile his software with OpenMPI and the MVAPICH2. I looked at the libraries being called by his very of OpenMPI and didn't see and Infiniband libraries being used. They were clearly used in MVAPICH2, yet the OpenMPI compile ran faster.

We have another small cluster using IB. This is my first use. Should an IP address be assigned to each IB HBA? I am not sure than I have thing installed correctly. I tried downloading and installed the Melanox software and it could upgrade the firmware and just puked. At least Red Hat's support 'seems' to work. If I selected nodes to process the data that doesn't have IB, it blows up. If I stick to nodes with IB HBAs in them, the program runs, but I am convinced the first version compiled with OpenMPI is using ethernet and not Infiniband, but runs faster.


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
Can't ping the Infiniband network wegadnie Linux - Networking 1 08-06-2013 02:37 PM
Load test, boundary test & stress test for USB EHCI/xHCI driver rama_toshiba Linux - Kernel 5 02-29-2012 02:43 PM
infiniband error pankajd Linux - Software 1 10-08-2009 09:47 AM
Infiniband, and what it means quentusrex Debian 3 03-17-2005 11:32 AM > Forums > Linux Forums > Linux - Networking

All times are GMT -5. The time now is 06:17 PM.

Main Menu
Write for LQ is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration