LinuxQuestions.org
Visit the LQ Articles and Editorials section
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Hardware
User Name
Password
Linux - Hardware This forum is for Hardware issues.
Having trouble installing a piece of hardware? Want to know if that peripheral is compatible with Linux?

Notices

Reply
 
LinkBack Search this Thread
Old 11-09-2012, 11:20 AM   #1
icoming
Member
 
Registered: Feb 2004
Posts: 96

Rep: Reputation: 15
IRQ affinity doesn't work


Hello,

I have 5 SSDs connect to 1 LSI 9207-8e card. When MSI-X is enabled (by default), the LSI card registers 16 IRQs in the kernel. When I read data from SSDs, all interrupts from the SSDs go to the same IRQ, which makes one CPU too busy to handle all interrupts. I want to distribute interrupts from SSDs to cores evenly. One way I tried is to set smp_affinity, so interrupts with the same IRQ number will be distributed to cores evenly, which is basically IRQ-affinity's job. However, I tried that, for example, I set
echo f > /proc/irq/48/smp_affinity
so ideally, all interrupts of IRQ 48 should be distributed to first 4 cores. However, when I read data again, I still see interrupts sent to only the first core.
I tried a few ways and hope to make it work. e.g., I closed irqbalance, disabled hot-pluggable CPU feature in the kernel, disable or enable MSI-X of the LSI driver. None of them make IRQ affinity work.
Has anyone made IRQ affinity work? Could you show me how to make it work?

Thanks a lot!
Da
 
Old 11-10-2012, 10:07 AM   #2
business_kid
Guru
 
Registered: Jan 2006
Location: Ireland
Distribution: Slackware & Android
Posts: 5,953

Rep: Reputation: 496Reputation: 496Reputation: 496Reputation: 496Reputation: 496
Quote:
echo f > /proc/irq/48/smp_affinity
You might be onto something with this. But I have never played with irq_affinity and I have smp_affinity files in every /proc/irq/ subdir and a default_smp_affinity in /proc/irq/ itself. All have the digit three, and I have 2 cores. Are you sure about the 'f'?
 
Old 11-13-2012, 07:20 PM   #3
icoming
Member
 
Registered: Feb 2004
Posts: 96

Original Poster
Rep: Reputation: 15
Quote:
Originally Posted by business_kid View Post
You might be onto something with this. But I have never played with irq_affinity and I have smp_affinity files in every /proc/irq/ subdir and a default_smp_affinity in /proc/irq/ itself. All have the digit three, and I have 2 cores. Are you sure about the 'f'?
The machine I use have 64 logical processors, so yes. I set it right.

What I found is that if I only specify one core for each IRQ, then it works as expected. The interrupts are sent to the cores I specified. When I disabled the feature of hot-pluggable CPU in the kernel, it seems MSI-X works: interrupts are delivered to the cores where requests are issued. So even IRQ affinity doesn't work properly, interrupts can still be distributed to multiple cores when accessing multiple SSDs, which is good enough for me.

Last edited by icoming; 11-13-2012 at 07:28 PM.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Keyboard doesn't work right click on mouse doesn't work ramblinrick Linux Mint 2 10-15-2010 01:10 AM
CPU affinity / taskset does not always work. lwi Ubuntu 3 03-01-2010 12:49 PM
iPod mount troubles and too much work for irq 10 jwestlak Linux - Hardware 4 01-25-2006 10:19 AM
IRQ Sharing to get the sound work zaltar Linux - Newbie 3 12-06-2003 09:45 AM
BCM5702 ethernet doesn't work IRQ problem David_99 Linux - Hardware 4 06-17-2003 08:10 AM


All times are GMT -5. The time now is 07:57 PM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration