LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud
User Name
Password
Linux - Virtualization and Cloud This forum is for the discussion of all topics relating to Linux Virtualization and Linux Cloud platforms. Xen, KVM, OpenVZ, VirtualBox, VMware, Linux-VServer and all other Linux Virtualization platforms are welcome. OpenStack, CloudStack, ownCloud, Cloud Foundry, Eucalyptus, Nimbus, OpenNebula and all other Linux Cloud platforms are welcome. Note that questions relating solely to non-Linux OS's should be asked in the General forum.

Notices


Reply
  Search this Thread
Old 03-06-2012, 11:21 AM   #1
Nick_C
Member
 
Registered: Jan 2012
Location: London, England, UK
Distribution: CentOS 6, CentOS 7
Posts: 299

Rep: Reputation: Disabled
Installing latest VMM & libvirt on CentOS + performance tests


Any thoughts on whether I would be able to install the latest VMM/libvirt on CentOS 6.2 and whether there are any other modules which would also need updating?

I need to use some of the latest virtualization feattures like
USB support which is not available by default in the versions used in CentOS.

The reason for choosing CentOS for the virtualization Host is explained below:

I have run some hypervisor speed tests based on the time Win 7 Pro install takes to complete 'Expanding Windows files', which as many of you know can be very sloww using KVM on many distros. These were all run with two CPU's active and 2Gb RAM except the native ones which had 8Gb RAM.

Code:
         mins : secs
Fedora / KVM - 29:40
Native from DVD - 14:00
MS Hyper-V - 12:30
Native from HDD - 7:20 (setup started from Server 2k8)
CentOS / KVM - 7:00

Last edited by Nick_C; 03-06-2012 at 11:22 AM.
 
Old 03-07-2012, 12:50 AM   #2
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
Have all these benchmarks been done on the same hardware, under similar conditions? For example, there's a huge difference especially during windows VM installation, between usinf an actual CD and an ISO image, and the mount options of the mountpoint where the ISO is located also matter. a lot.

In any case, RHEL and derivatives definitely do have the best packaged and most polished builds of kvm and libvirt - this is where they are intended to run. This comes at a cost of raw edge features that make it into RHEL only when they become stable enough
 
Old 03-07-2012, 08:09 AM   #3
Nick_C
Member
 
Registered: Jan 2012
Location: London, England, UK
Distribution: CentOS 6, CentOS 7
Posts: 299

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by dyasny View Post
Have all these benchmarks been done on the same hardware, under similar conditions? For example, there's a huge difference especially during windows VM installation, between usinf an actual CD and an ISO image, and the mount options of the mountpoint where the ISO is located also matter. a lot.

In any case, RHEL and derivatives definitely do have the best packaged and most polished builds of kvm and libvirt - this is where they are intended to run. This comes at a cost of raw edge features that make it into RHEL only when they become stable enough
Yes same hardware all the way through. You can see the difference between 'Native from DVD - 14:00' and 'Native from HDD - 7:20' which was from an iso. What different mount options are possible? All of these tests were done using standard (GUI) mounts with whatever default mount options that particular distro uses. Are there any specific mount options I should be looking for to ensure these results are comparible?
 
Old 03-07-2012, 10:20 AM   #4
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
well, comparing native DVD passthrough into a VM and an ISO file or a loop mount is not correct. There are very different drivers involved in accessing this data, the one for ISO files and loop mounts being more efficient because it has no need to issue so many ioctl()'s, which in turn cause a vm_exit().

The typical mount options to speed up performance is "noatime" and "nodiratime", using elevator=deadline on the host side.

As for why Fedora was slow for you, that needs to be investigated, probably something to do with disk caching or VM misconfiguration, it should definitely be as fast as a RHEL machine, or at least close, if not actually faster. This comes at the price of stability though.
 
Old 03-07-2012, 11:33 AM   #5
Nick_C
Member
 
Registered: Jan 2012
Location: London, England, UK
Distribution: CentOS 6, CentOS 7
Posts: 299

Original Poster
Rep: Reputation: Disabled
Just to try Fedora again I have just done a clean install of Fedora 17. Install the necessary, copied the iso locally and tried to install a Win 7 virtual machine from that loacl iso. Windows installer Expanding files took over an hour! This compared to just seven minutes with CentOS as the VM host. There must be a reason for this difference but I can't see any obvious cause apart from Fedora using the workstation kernel and CentOS using the server kernel.
 
Old 03-07-2012, 01:34 PM   #6
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
workstation kernel? server kernel? what does it mean anyway?

There must be a reason, and it can be found, but that requires investigation
 
Old 03-07-2012, 02:24 PM   #7
Nick_C
Member
 
Registered: Jan 2012
Location: London, England, UK
Distribution: CentOS 6, CentOS 7
Posts: 299

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by dyasny View Post
workstation kernel? server kernel? what does it mean anyway?

There must be a reason, and it can be found, but that requires investigation
When I was originally looking into using Ubuntu for virtualization I was informed that there were both generic and server kernels. Maybe that isn't correct then?

If there is a reason how do I go about finding it. There are no differences that I can see in the virtualization environments between the different distros. But there is obviously something going on to make CentOS perform ten times faster than others! Where else can I look to find this difference?

There are many reports in both the Fedora and Ubuntu world about Win 7 being extremely slow at Expanding Files, unfortunately no solutions that I have found yet. As I said also same issue in Fedora 17 which was why I was surprised to find CentOS install Win 7 at almost native speed. I agree there must be a difference but have no idea how to go about finding the cause of it, if you have any ideas let me know.
 
Old 03-07-2012, 02:52 PM   #8
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
I'd start with kvm_stat, and with monitoring the host for io bottlenecks during the VM setup.

As for kernels, well, centos is a RHEL clone, and RHEL is specifically built optimized for server loads. There is no such thing as a "server" or "desktop" kernel as such, but Linux is very flexible, and specific sets of drivers, compiled and patched properly, can definitely increase performance under specific loads, and this is what happens in RHEL - the kernel is built to accomodate serious hardware performing serious tasks. On the other hand, this means that in order to keep the kernel small and directed towards the right type of hardware, less relevant stuff is removed. I doubt for example, that a RHEL kernel contains joystick drivers.

Leaving philosophy aside, if centos works for you - great, that only shows how much better RHEL is built than other distros.
 
Old 03-08-2012, 05:33 AM   #9
Nick_C
Member
 
Registered: Jan 2012
Location: London, England, UK
Distribution: CentOS 6, CentOS 7
Posts: 299

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by dyasny View Post
I'd start with kvm_stat, and with monitoring the host for io bottlenecks during the VM setup.

As for kernels, well, centos is a RHEL clone, and RHEL is specifically built optimized for server loads. There is no such thing as a "server" or "desktop" kernel as such, but Linux is very flexible, and specific sets of drivers, compiled and patched properly, can definitely increase performance under specific loads, and this is what happens in RHEL - the kernel is built to accomodate serious hardware performing serious tasks. On the other hand, this means that in order to keep the kernel small and directed towards the right type of hardware, less relevant stuff is removed. I doubt for example, that a RHEL kernel contains joystick drivers.

Leaving philosophy aside, if centos works for you - great, that only shows how much better RHEL is built than other distros.
Sad to say that although it is multiple times faster than everything else as a virtualization host, CentOS just doesn't quite work for me. A couple of small unsolved bugs that I could live with at a push but biggest drwaback is that it only has older versions of virt-manager/qemu-kvm/libvirt available which do not support USB in the VMs. Hence the reason I am still searching for an alternative but all the alternatives seem to suffer from this same incredibly slow windows expanding files problem.

Will see if I can obtain any clues from kvm_stat.

Last edited by Nick_C; 03-08-2012 at 05:34 AM.
 
Old 03-08-2012, 05:40 AM   #10
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
Stable code comes at a price of missing the latest features
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Libvirt installation from source - CentOS sethusubbiah Linux - Software 1 08-03-2011 04:34 PM
Please help me install latest JDK & JRE on my CentOS server xNuManx Linux - General 5 10-04-2008 04:49 AM
LXer: Opera tests latest mobile browser LXer Syndicated Linux News 0 11-28-2006 10:54 AM
Performance tests. Thetargos Linux - Kernel 4 07-02-2006 11:20 AM
Simple Performance Tests with AMD64 & Suse SML SUSE / openSUSE 3 04-05-2005 10:03 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud

All times are GMT -5. The time now is 05:42 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration