LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Server
User Name
Password
Linux - Server This forum is for the discussion of Linux Software used in a server related context.

Notices


Reply
  Search this Thread
Old 01-20-2021, 02:57 PM   #1
road hazard
Member
 
Registered: Nov 2015
Posts: 257

Rep: Reputation: Disabled
Question How to make MDADM not consume so much I/O bandwidth during a reshape?


My Plex server is running Debian 10 and I'm using mdadm for RAID 6. I recently added 2 more drives to the array and during the reshape, when I was watching a movie via my Plex client, streaming would frequently pause. Some times Plex would just stop playing back and give me an error. Under normal circumstances, my RAID array can sustain 500MB/s read/write. When I add a drive or 2 and mdadm is doing a reshape, that speed drops like a rock, which is understandable.

But, is there a command(s) I can issue to mdadm while it's adding drives to say..."hey, if something needs to read data from the array....slow down on the reshape"?
 
Old 01-20-2021, 04:14 PM   #2
berndbausch
LQ Addict
 
Registered: Nov 2013
Location: Tokyo
Distribution: Mostly Ubuntu and Centos
Posts: 6,316

Rep: Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002Reputation: 2002
See if changing speed_limit_max has an effect.
 
Old 01-21-2021, 02:32 PM   #3
jefro
Moderator
 
Registered: Mar 2008
Posts: 22,012

Rep: Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630Reputation: 3630
"Raid 6 is the only raid level where mdadm may complain that it cannot carry out a conversion directly between levels 4, 5 and 6. This is down to the way the parity blocks are scattered amongst the devices. The reshape is almost certainly possible, but it may require doing it in a couple of stages rather than directly."

https://raid.wiki.kernel.org/index.php/A_guide_to_mdadm

Basically saying it takes a lot of movements and that those require overheard to perform.
 
Old 01-21-2021, 07:58 PM   #4
road hazard
Member
 
Registered: Nov 2015
Posts: 257

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by berndbausch View Post
See if changing speed_limit_max has an effect.
Next time I do a re-shape, I'll give that try, thanks!

Quote:
Originally Posted by jefro View Post
"Raid 6 is the only raid level where mdadm may complain that it cannot carry out a conversion directly between levels 4, 5 and 6. This is down to the way the parity blocks are scattered amongst the devices. The reshape is almost certainly possible, but it may require doing it in a couple of stages rather than directly."

https://raid.wiki.kernel.org/index.php/A_guide_to_mdadm

Basically saying it takes a lot of movements and that those require overheard to perform.
Thanks for the link! If berndbausch's tip doesn't help, guess I'll just let my Plex streamers know that the server might be slow for a couple of days the next time I expand the array.
 
Old 01-21-2021, 08:14 PM   #5
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,149

Rep: Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124Reputation: 4124
I was wondering if you were subject to a yo-yo effect. The reshape is trundling along then Plex reads a bunch of content into memory. mdadm sees that and throttles itself - then while Plex is serving that content, mdadm sees no (disk) I/O so ramps back up. Then Plex wants more content ...

I'd simply run mdadm at the min (set max equal to the current min) while people are glued to their devices, then when they all go to bed set min and max to current max. Couple of simple timers or cron. Only needed when you need to reshape.
 
  


Reply

Tags
mdadm



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Any way to make mdadm (raid-5) reshape run faster? MikeyCarter Linux - Software 1 08-28-2011 08:28 PM
How to find which block of my program consume how much memory ? dtustudy68 Programming 1 04-15-2011 07:07 PM
How to find which part of my program consume how much memory ? dtustudy68 LinuxQuestions.org Member Intro 2 04-15-2011 06:51 PM
Azureus to much memory consume vladoportos Debian 1 02-28-2006 06:20 PM
HTB: how to shape the bandwidth the router may consume? meks Linux - Networking 1 04-30-2004 03:42 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Server

All times are GMT -5. The time now is 01:12 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration