LinuxQuestions.org
Review your favorite Linux distribution.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat
User Name
Password
Red Hat This forum is for the discussion of Red Hat Linux.

Notices


Reply
  Search this Thread
Old 05-08-2015, 11:59 AM   #1
leniviy
Member
 
Registered: Jul 2009
Distribution: Archlinux
Posts: 69

Rep: Reputation: 4
Can't activate any thin volume after pool repair


Hi.
I'm on Rhel 6.5. There was not enough space for pool metadata, neither free space to extend pool lv:
Code:
May  8 03:28:02 oktest-stage-db-1 rhsmd: In order for Subscription Manager to provide your system with updates, your system must be registered with the Customer Portal. Please enter your Red Hat login to ensure your system is up-to-date.

May  8 16:58:09 oktest-stage-db-1 lvm[896]: No longer monitoring thin vg_oktestdb1-pool-tpool.
May  8 16:58:09 oktest-stage-db-1 lvm[896]: Monitoring thin vg_oktestdb1-pool-tpool.

May  8 17:49:11 oktest-stage-db-1 kernel: device-mapper: thin: dm_thin_insert_block() failed
May  8 17:49:12 oktest-stage-db-1 kernel: device-mapper: block manager: recursive lock detected in pool metadata
May  8 17:49:12 oktest-stage-db-1 kernel: device-mapper: thin: dm_thin_insert_block() failed
May  8 17:49:12 oktest-stage-db-1 kernel: db2sysc[9152]: segfault at 0 ip 00007ffff2d6ecd0 sp 00007ffef640fc38 error 6 in libdb2e.so.1[7fffecce4000+a55b000]
May  8 17:49:13 oktest-stage-db-1 abrt[830]: Can't open 'core.2077': Permission denied
After hard reset tried to activate volume:
Code:
[root@oktest-stage-db-1 ~]# lvchange -ay vg_oktestdb1/lv_ibm
  Check of thin pool vg_oktestdb1/pool failed (status:1). Manual repair required (thin_dump --repair /dev/mapper/vg_oktestdb1-pool_tmeta)!
Tried to repair:
Code:
[root@oktest-stage-db-1 ~]# thin_dump --repair /dev/mapper/vg_oktestdb1-pool_tmeta
<superblock uuid="" time="23" transaction="34" data_block_size="512" nr_data_blocks="1808288">
</superblock>
[root@oktest-stage-db-1 ~]# lvconvert --repair vg_oktestdb1/pool
  Volume group "vg_oktestdb1" has insufficient free space (0 extents): 28 required.
  WARNING: If everything works, remove "vg_oktestdb1/pool_tmeta0".
  WARNING: Use pvmove command to move "vg_oktestdb1/pool_tmeta" on the best fitting PV.
The output of thin_dump --repair is too short! There should be thousands of lines.


Free some space:
Code:
[root@oktest-stage-db-1 ~]# swapoff /dev/mapper/vg_oktestdb1-lv_swap
[root@oktest-stage-db-1 ~]# lvreduce -l 90%LV vg_oktestdb1/lv_swap
  WARNING: Reducing active logical volume to 7.03 GiB
  THIS MAY DESTROY YOUR DATA (filesystem etc.)
Do you really want to reduce lv_swap? [y/n]: y
  Reducing logical volume lv_swap to 7.03 GiB
  Logical volume lv_swap successfully resized
[root@oktest-stage-db-1 ~]# mkswap /dev/mapper/vg_oktestdb1-lv_swap
Retry repair and reboot:
Code:
[root@oktest-stage-db-1 ~]# lvconvert --repair vg_oktestdb1/pool
  Logical volume "lvol0" created
  Logical volume "lvol1" created
  WARNING: If everything works, remove "vg_oktestdb1/pool_tmeta1".
  WARNING: Use pvmove command to move "vg_oktestdb1/pool_tmeta" on the best fitting PV.
[root@oktest-stage-db-1 ~]# reboot
Trying to activate:
Code:
[root@oktest-stage-db-1 ~]# lvchange -ay vg_oktestdb1/lv_ibm
  device-mapper: reload ioctl on  failed: No data available
Dmesg shows:
Code:
device-mapper: thin: Data device (dm-3) discard unsupported: Disabling discard passdown.
device-mapper: table: 253:5: thin: Couldn't open thin internal device
device-mapper: ioctl: error adding target to table

Last edited by leniviy; 05-08-2015 at 01:52 PM.
 
Old 07-12-2018, 08:01 PM   #2
jotamolas
LQ Newbie
 
Registered: Jul 2018
Posts: 1

Rep: Reputation: Disabled
Hi leniviy, Three years later I have the same problem.
Could you solve it?
 
Old 07-13-2018, 01:54 AM   #3
leniviy
Member
 
Registered: Jul 2009
Distribution: Archlinux
Posts: 69

Original Poster
Rep: Reputation: 4
Quote:
Originally Posted by jotamolas View Post
Hi leniviy, Three years later I have the same problem.
Could you solve it?
Sorry, no. Luckily this was a database host so I had backups. In the end we migrated to a scheme with btrfs and btrfs-sxbackup over ssh.
 
Old 07-29-2018, 08:04 PM   #4
charlesg
LQ Newbie
 
Registered: Jul 2018
Posts: 1

Rep: Reputation: Disabled
Just ran into the same issue. Should I understand from this that all my data is gone?

I filled up the metadata space and in the process of trying the repair ended-up in this situation where none of my THIN provisioned volumes can be mounted.

root@pve1:~# lvchange -ay pve/vm-100-disk-5
device-mapper: reload ioctl on failed: No data available
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
SAN storage pool for VM Guest OS images - which pool type is best practice myc5 Linux - Virtualization and Cloud 1 11-23-2014 09:14 PM
RHEL6 KVM: Add dir based pool volume to guest: CLI HOWTO? chrism01 Linux - Virtualization and Cloud 7 09-09-2012 11:31 PM
To activate volume control in fedora10 Rose Gandhi Linux - Desktop 1 12-07-2009 03:33 AM
I need a Linux OS other than Ubuntu which has a repair disk or repair software jhmac77 Linux - Newbie 1 03-17-2008 07:04 AM
How can I tell Fedora to activate a non-standard logical volume during boot? PTrenholme Fedora 1 02-26-2006 08:55 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Red Hat

All times are GMT -5. The time now is 01:43 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration