LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie
User Name
Password
Linux - Newbie This Linux forum is for members that are new to Linux.
Just starting out and have a question? If it is not in the man pages or the how-to's this is the place!

Notices


Reply
  Search this Thread
Old 02-11-2018, 10:26 AM   #1
road hazard
Member
 
Registered: Nov 2015
Posts: 242

Rep: Reputation: Disabled
How to speed up RAID 6 reshape?


OS: Antergos (Arch)
MDADM 4
Original RAID 6 array was 8, 4TB drives

I added 4 more 4TB drives (12 total) and the reshape seems a bit slow to me:

active raid6 sdn[11] sdi[10] sdh[9] sdc[8] sdj[1] sdp[4] sdm[7] sdf[6] sde[5] sdd[2] sdo[0] sdk[3]
23441323008 blocks super 1.2 level 6, 512k chunk, algorithm 2 [12/12] [UUUUUUUUUUUU]
[===========>.........] reshape = 56.2% (2199298560/3906887168) finish=1029.3min speed=27648K/sec
bitmap: 0/30 pages [0KB], 65536KB chunk

It's been running for about 18 hours. Reading around on the interwebs, I issued this command: sysctl -w dev.raid.speed_limit_max=500000 (max was set for 200000) and no surprise, this didn't make any difference.

Next up, I was going to try:

echo 4096 > /sys/block/md0/md/stripe_cache_size

(or using the value of 16384 or 32768) but, I'd like to know what the current value is. I thought this was the command:

cat /sys/block/md0/md/stripe_cache_size (yes, I'm a Linux newbie), and I got back: 643 (really odd number....doesn't seem right so I think that wasn't the command I was looking for.)

Lastly, read ahead. blockdev --getra /dev/md0
.....my current value for that is 12288

If it matters, all of these drives are in a SuperMicro 846 with a SAS2 backplane and a single SFF-8087 cable that goes to my LSI 9207-8i HBA. This is a media server in my house.
 
Old 02-11-2018, 11:37 PM   #2
AwesomeMachine
LQ Guru
 
Registered: Jan 2005
Location: USA and Italy
Distribution: Debian testing/sid; OpenSuSE; Fedora; Mint
Posts: 5,524

Rep: Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015
You have the cat command correct. If you want to dig into the raid modules, install the kernel source and look at the comments in the raid module source files. The speed of reshaping seems about right for the size of the array.
 
Old 02-12-2018, 05:01 PM   #3
road hazard
Member
 
Registered: Nov 2015
Posts: 242

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by AwesomeMachine View Post
You have the cat command correct. If you want to dig into the raid modules, install the kernel source and look at the comments in the raid module source files. The speed of reshaping seems about right for the size of the array.
Forgot to write sooner but when it got to about 60-70%, speed jumped up to 80-90MBs. It's all done now. I really didn't do anything though?!
 
Old 02-12-2018, 09:30 PM   #4
AwesomeMachine
LQ Guru
 
Registered: Jan 2005
Location: USA and Italy
Distribution: Debian testing/sid; OpenSuSE; Fedora; Mint
Posts: 5,524

Rep: Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015Reputation: 1015
OK, glad it works!
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: 5 Things You Need to Know About Massive Announcements that Might Reshape the Mobile Web LXer Syndicated Linux News 0 04-26-2013 05:50 PM
Any way to make mdadm (raid-5) reshape run faster? MikeyCarter Linux - Software 1 08-28-2011 08:28 PM
How to test the RAID speed videoclock Linux - Software 5 08-26-2009 05:35 AM
LXer: Light and Cheap, Netbooks Are Poised to Reshape PC Industry LXer Syndicated Linux News 1 04-03-2009 07:28 AM
LXer: Debian founder wants to 'reshape' OpenSolaris LXer Syndicated Linux News 0 03-07-2008 07:50 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Newbie

All times are GMT -5. The time now is 04:49 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration