LinuxQuestions.org
Did you know LQ has a Linux Hardware Compatibility List?
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices

Reply
 
Search this Thread
Old 05-28-2010, 10:49 AM   #1
daniela1611
LQ Newbie
 
Registered: May 2010
Location: Venezuela
Posts: 14

Rep: Reputation: 1
Angry I can't remove a pv from LVM it shows no space left but i don't have any data!


Hello all,
I saw another threads about something like this but it wasn't helpful for me.
I have a lvm with 5 disk, I've been doing some benchmarks on the file-system with this lvm know I would like to remove one pv from the volume, I've tried

Code:
# pvmove -v /dev/sde1
    Finding volume group "test-vol"
  No extents available for allocation
and also
Code:
# pvremove -ff /dev/sde1
Really WIPE LABELS from physical volume "/dev/sde1" of volume group "test-vol" [y/n]? y
  WARNING: Wiping physical volume label from /dev/sde1 of volume group "test-vol"
  Can't open /dev/sde1 exclusively - not removing. Mounted filesystem?
I have no data on the volume, but when I run pvdisplay it shows this

Code:
--- Physical volumes ---
  PV Name               /dev/sda1
  PV UUID               A5ljkF-gUm9-kLy9-F7Hs-09BF-3Sb9-8P5gre
  PV Status             allocatable
  Total PE / Free PE    119234 / 0

  PV Name               /dev/sdb1
  PV UUID               03CsaT-lSBX-UpWM-wrKx-AF7B-GMkh-oGXWDg
  PV Status             allocatable
  Total PE / Free PE    119234 / 0

  PV Name               /dev/sdc1
  PV UUID               1toYE5-i3Bq-1ctT-pJdl-ALQa-IBvY-2e0oLa
  PV Status             allocatable
  Total PE / Free PE    119234 / 0

  PV Name               /dev/sdd1
  PV UUID               1IfPhl-EIfB-1P7r-Apr0-bpPM-RFKW-SwTsNO
  PV Status             allocatable
  Total PE / Free PE    119234 / 0

  PV Name               /dev/sde1
  PV UUID               zq9NMn-8R3o-cs8S-fZdl-ITBv-AR9t-LOrDfj
  PV Status             allocatable
  Total PE / Free PE    119234 / 21910
I don't understand why it is full because I've removed all the data.

Thanks so much for your help

Daniela
 
Old 05-29-2010, 04:41 AM   #2
smoker
Senior Member
 
Registered: Oct 2004
Distribution: Fedora Core 4, 12, 13, 14, 15, 17
Posts: 2,279

Rep: Reputation: 248Reputation: 248Reputation: 248
AFAIK the only way to remove a physical volume is to assign its extents to another physical volume. This is a serious shortcoming of LVM in my opinion. Your drive sde has 97324 physical extents still assigned to it, which have to be reallocated to another drive, as I know of no way to remove them otherwise. None of your other PVs have any free extents to use for this purpose.

The way LVM works is to use multiple disks as a single volume, so once you have written any data to the volume, the data could be spread over all the disks. This is why you can't wipe just one of the disks.

http://www.tldp.org/HOWTO/LVM-HOWTO/removeadisk.html

The most straight forward way to reduce the number of disks in a logical volume would be to buy a bigger disk, and migrate all the extents from 2 existing PVs to the new disk. then you can remove the 2 old disks. LVM seems to be predicated on ever increasing disk capacity.

Another way around the issue (in the future) would be to build the LVM volume onto a raid set, so that the raid takes care of keeping the data safe when removing a disk. This also has its pitfalls of course.

Last edited by smoker; 05-29-2010 at 04:51 AM.
 
Old 06-08-2010, 10:25 AM   #3
daniela1611
LQ Newbie
 
Registered: May 2010
Location: Venezuela
Posts: 14

Original Poster
Rep: Reputation: 1
Thanks Smoker your response was pretty helpfull, I'm gonna use RAID so I would have mirroring then I will make some test because I would like to know how to restore after a system failure.

Thanks again

Daniela
 
Old 06-09-2010, 12:02 AM   #4
catkin
LQ 5k Club
 
Registered: Dec 2008
Location: Tamil Nadu, India
Distribution: Servers: Debian Squeeze and Wheezy. Desktop: Slackware64 14.0. Netbook: Slackware 13.37
Posts: 8,524
Blog Entries: 27

Rep: Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175
Quote:
Originally Posted by smoker View Post
AFAIK the only way to remove a physical volume is to assign its extents to another physical volume.
More specifically, it must be empty and so any required extents must be moved (= assigned) to another PV; the others can simply be removed by removing the associated LV(s).

In other words, from an LV perspective rather than an extents perspective ...

A PV may be removed from a VG when it is empty, that is contains no LVs or parts of LVs. LVs which are not required can be removed using lvremove. Any parts of LVs which are required can be moved off the PV by the pvmove command.

Last edited by catkin; 06-09-2010 at 12:14 AM. Reason: clarity - removed "within the VG" regards pvmove
 
Old 06-09-2010, 12:12 AM   #5
catkin
LQ 5k Club
 
Registered: Dec 2008
Location: Tamil Nadu, India
Distribution: Servers: Debian Squeeze and Wheezy. Desktop: Slackware64 14.0. Netbook: Slackware 13.37
Posts: 8,524
Blog Entries: 27

Rep: Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175Reputation: 1175
Quote:
Originally Posted by daniela1611 View Post
I don't understand why it is full because I've removed all the data.
Presumably you have removed all the data from the file systems but that leaves the volumes (in his case the LVs) unchanged.

An LVM LV is equivalent to a HDD partition; deleting all the files in its file system or reformatting it doesn't affect the partition itself.

The OP is equivalent to saying for example "I've removed all the data from /dev/sdb but fdisk -l /dev/sdb still shows partitions".
 
Old 11-05-2010, 09:04 AM   #6
dkerr
LQ Newbie
 
Registered: Nov 2010
Posts: 1

Rep: Reputation: 0
Yesterday I successfully removed a hard disk from a LVM volume. My LVM of approx 2TB was on two hard disks (PVs) one of 500GB, the other 1.5TB. I wished to remove the 1.5TB disk. Here is what I did.


1) Backup everything.
2) Delete enough files from the filesystem so that everything would fit on the disk I was leaving behind. To be save I reduced files to under 400GB.
3) Boot from a CD ROM (my LVM volume was the root filesystem so I couldn't just unmount it). I used the Ubuntu server boot disk and entered the recovery command line console.
4) check the disk for errors... e2fsk -f /dev/VolGrp/root
5) Resize the filesystem on the logical volume to fit the remaining disk... resize2fs -p /dev/VolGrp/root 450G
6) Resize the logical volume to be slightly bigger than the filesystem (just in case)... lvm lvresize -L 455G /dev/VolGrp/root
7) Align the end of the filesystem with the end of the LV... resize2fs -p /dev/VolGrp/root
8) run lvm pvdisplay to check the "allocated PE" on the disk you want to remove. It needs to be zero. As I want to remove /dev/sdb1 I was lucky, as everything moved onto /dev/sda1 so my allocated PEs were zero on the disk I wanted to remove. If it is not zero, then you either have to use pvmove or do steps 5 to 7 again.
9) Assuming allocated PEs are now zero... lvm vgreduce /dev/VolGrp/root /dev/sdb1

and you are done. I was able to remove /dev/sdb1 physically from the system and reboot.

DAK
 
  


Reply

Tags
lvm, lvm2, space


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
No space left on device and df shows 50% available Ladowny Linux - General 6 02-04-2010 10:48 AM
HELP I don't understand my LVM, no space left?? pobman Linux - Enterprise 4 11-19-2008 09:01 PM
LVM and No Space Left On Device llin Linux - Software 4 07-29-2008 01:04 AM
is there a terminal command that shows how much space is left in my partitions lemuel Linux - Newbie 3 01-23-2005 07:16 PM
"no space left on device" - But df shows free space! monita Linux - General 7 03-30-2004 01:14 PM


All times are GMT -5. The time now is 05:25 AM.

Main Menu
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
identi.ca: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration