Thursday, January 24, 2008

How to add disk space with LVM on Linux

I have often had the need to add disk space to a server. The newer distributions of Linux (SUSE Linux Enterprise Server - "SLES" 9 and greater, Red Hat Enterprise Linux - "RHEL" 4 and greater) use Logical Volume Manager (LVM) which makes this a fairly simple task.
The general steps are:
  1. Physically put the disk in the server and make it available either in an array or some other way.
  2. Use fdisk to create new partition on the disk.
  3. Extend existing volume group onto new partition.
  4. Extend existing logical volume onto new space.
  5. Extend filesystem.
I'll go into more detail how to do each of these steps on SLES and RHEL. For this example we are going to assume that our new disk that has been added to our server is /dev/sdc. We will also assume that we have a volume group named rootvg and a logical volume on that volume group named homelv. Also in this example, /dev/rootvg/homelv is mounted on our Linux system as /home. Let's get started.
  1. Physically put the disk in the server and make it available either in an array or some other way.
    • This can vary widely depending on what hardware you are on, so we will not cover this portion in this tutorial. You may want to use Google to search for how to do this on your hardware.
  2. Use fdisk to create new partition on the disk.
    • As root run fdisk on the new disk. For example you would run fdisk /dev/sdc.
    • On this new disk you will create a new partition. Inside of the fdisk program you create a new partition by typing the letter "n" followed by the enter key.
    • It will then ask you if you want it to be a primary partition or an extended partition. For this example we will just assume we want it to be a primary partition. To do this we type the letter "p" followed by the enter key.
    • Next it will ask for the starting point and ending point of this partition. For this example, we will simply select the defaults by hitting the enter key twice.
    • If you want to view the details of the new partition, you can type the letter "p" from the fdisk prompt.
    • Next we need to change the type for this new partition. We do this by typing the letter "t" followed by the enter key.
    • It asks to enter in what type we want it to be. We need it to be of the Linux LVM type. The Hex code for Linux LVM is 8e. We type in "8e" followed by the enter key and it will tell us that it changed the system type for this partition to Linux LVM.
    • We then need to save these changes and exit fdisk. We do this by typing the letter "w" (for write) followed by the enter key.
  3. Use pvcreate to lay down the "setup" on the physical partition.
    • This sets up physical extents and other things that LVM needs. The command we run is "pvcreate /dev/sdc1"
  4. Extend existing volume group onto new partition.
    • For this example we are going to assume that we have an existing volume group named rootvg. We can display information about this volume group using the vgdisplay command. If we type "vgdisplay" without any arguments, it will display all the volume groups. If we just want information about the "rootvg" volume group, we would type "vgdisplay rootvg".
    • To extend the rootvg volume group onto the new partition, we use the vgextend command. Type "vgextend rootvg /dev/sdc1" followed by the enter key. This will extend the rootvg volume group onto the new partition, /dev/sdc1.
  5. Extend existing logical volume onto new space.
    • For this example we are going to assume that we have an existing logical volume on the rootvg volume group that is named homelv. The full path to this logical volume would be "/dev/rootvg/homelv". We can view information about this logical volume by typing "lvdisplay /dev/rootvg/homelv".
    • To extend this existing logical volume onto the new space we use the lvextend command. Type "lvextend -L +20G /dev/rootvg/homelv /dev/sdc1". This command says that we want to increase the /dev/rootvg/homelv logical volume by 20GB. This is only possible if /dev/sdc1 is a member of volume group rootvg and there is enough free disk space on it.
  6. The last thing we need to do is increase the filesystem.
    • Which command we use to increase the filesystem depends on what filesystem type we are currently using. If we are using reiserfs, we will use the "resize_reiserfs" command. If we are using ext3, we will use either the "ext2online" or the "resize2fs" command. On RHEL 5, we can use the "resize2fs" command, which will recognize that the filesystem is currently mounted and perform an "on-line" resize.
    • On both resize_reiserfs and ext2online, the size is optional. If we want the filesystem to take up all the available space on our logical volume, we don't need to put the size. To extend the filesystem type either "ext2online /dev/rootvg/homelv" or "resize_reiserfs /dev/rootvg/homelv".
You should now be able to run "df -h" and see the additional disk space available in the /home directory.

13 comments:

Muthukumar Krithivasan said...

After fdisk i had use pvcreate for the new partition before doing lvextend. This is for RHEL4.

Thad said...

Thanks for pointing that out. For some reason I always miss that step. I always seem to run vgextend and get the error that the physical volume doesn't exist and that prompts me to run pvcreate. I have edited the post to add that in.

Sean said...

Thanks Thad, this is the only sensible step by step guide I've found for to this procedure.

Nice work.

Kemi said...

Thanks Thad, helped out with a task I needed to do on RHAS4.

Brian Chostner said...
This post has been removed by the author.
ProudPapa said...

Worked like a charm first time with no data loss. Thanks Thad!

Anonymous said...

Thanks Thad

I've played this game with Fedora9 running on VMVare.

Actually you simply extend VMVare virtual disk, start machine and .... before pvcreate you need reboot :)

Tnaks - simple clean and easy

viswa08 said...

Dear Thad,
Thanks for sharing broad steps,wel Iam basically Oracle DBA,need your valuable suggestion,to proceed with RAID5,our server admin says its not possible to add in RAID 5 we are using redhat linux 4.0.

Thanks in advance.

Regards,
Viswanath.

Available Internet said...

Thanks for a nice walktrough :-) How long does it take to format and online resize if I add 200G?

Dale B said...

I had space added to netapp partition and I can't see it on linux. I've tried to recreate partition using fdisk and fdisk only sees 100 GB and netapp partition is supposed to be 300 GB. Any idea of how I can get Linux to see additional 200 GB of space added or can you point me to some docs? I am stumped and exhausted.

Thad said...

In my environment, our netapp partitions are shared to us via NFS, so we don't have any problems seeing the new space. Outside of a reboot, I'm not sure how to fix the problem you are experiencing. Maybe a call to NetApp is in order?

Stefan said...

Thank you a lot for this walkthru. All the necessary "side info" is described! Not too much, not too less info, perfect! Successfully resized my very first logical volume using this info.

martyn said...

Thank you for your information. That was very usefully on my job! Thank you.