LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud
User Name
Password
Linux - Virtualization and Cloud This forum is for the discussion of all topics relating to Linux Virtualization and Linux Cloud platforms. Xen, KVM, OpenVZ, VirtualBox, VMware, Linux-VServer and all other Linux Virtualization platforms are welcome. OpenStack, CloudStack, ownCloud, Cloud Foundry, Eucalyptus, Nimbus, OpenNebula and all other Linux Cloud platforms are welcome. Note that questions relating solely to non-Linux OS's should be asked in the General forum.

Notices


Reply
  Search this Thread
Old 09-28-2015, 07:06 AM   #1
Dman58
Member
 
Registered: Nov 2010
Location: The Danger Zone
Distribution: Slackware & everything else in a VM
Posts: 294

Rep: Reputation: 31
How many VMs are you running simultaneously and how responsive are they?


Hi all,

Just looking into ideas for now but would love to hear/ read experiences of other users. So as the title reads:

How many VMs are you running simultaneously and how responsive are they?

Do you allocate the same RAM for each machine or have them specifically configured uniquely?

Do you leave the Host with more RAM for all the workload or just the bare minimum?

Do you find yourself in the VMs more than the Host?

What kind of CPU are you using and are you satisfied with the performance?

Any and all feedback is welcome.
 
Old 09-28-2015, 07:40 AM   #2
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
errr... really? no starting conditions? I am running about 80000 VMs right now, they are all responsive and happily puffing away.
 
Old 09-28-2015, 07:44 AM   #3
Dman58
Member
 
Registered: Nov 2010
Location: The Danger Zone
Distribution: Slackware & everything else in a VM
Posts: 294

Original Poster
Rep: Reputation: 31
Quote:
Originally Posted by dyasny View Post
errr... really? no starting conditions? I am running about 80000 VMs right now, they are all responsive and happily puffing away.
Whoa! I guess I didn't realize the computing power of some.

Could you clarify on the starting conditions? Is this one Host or many?
 
Old 09-28-2015, 07:52 AM   #4
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
of course it's many hosts, many datacenters in fact. This is why I ask, you have a very YMMV-ish question, with no actual background described.
 
Old 09-28-2015, 08:07 AM   #5
Dman58
Member
 
Registered: Nov 2010
Location: The Danger Zone
Distribution: Slackware & everything else in a VM
Posts: 294

Original Poster
Rep: Reputation: 31
How many on a single host?

Quote:
Originally Posted by dyasny View Post
of course it's many hosts, many datacenters in fact. This is why I ask, you have a very YMMV-ish question, with no actual background described.
Well I meant on any single Host, how many are running efficiently?
 
Old 09-28-2015, 08:15 AM   #6
pan64
LQ Addict
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 21,930

Rep: Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321Reputation: 7321
it highly depends on the hardware itself. Usually every VM need at least one core, but it also depends on the usage, what is installed.... (not to speak about nested VMs)
 
Old 09-28-2015, 08:22 AM   #7
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
I run between one and four... But I also have a dual quad core Xeon.

But since I only allocate one core per VM I expect some sluggishness - depending on what I'm doing. GUI testing is sucky, but general applications are reasonable for single core operation.
 
Old 09-28-2015, 09:05 AM   #8
Dman58
Member
 
Registered: Nov 2010
Location: The Danger Zone
Distribution: Slackware & everything else in a VM
Posts: 294

Original Poster
Rep: Reputation: 31
Is it safe for me to assume that for a consumer grade PC (AMD FX 8350 Vishera 8 core) it can run a max of 7 VMs? And 1 core left for the host...

Last edited by Dman58; 09-28-2015 at 09:07 AM. Reason: 4got about the host machine.
 
Old 09-28-2015, 09:17 AM   #9
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Depends on what you are doing in addition to that "1".

If you have situations that need two or more active VMs, then another core for the host is more useful as they can handle the necessary memory scheduling and I/O support that may also be needed.

Specially when that host is also performing GUI control functions (one core ends up mostly handling the GUI).

That was why I try to limit myself to 4 VMs. That leaves one for GUI control, one for I/O and and another if necessary, and a spare if things get busy.

The usual problem with consumer grade PCs is that they have really crappy I/O capability. And that causes a lot of contention. The only way it can be reduced is by using more host memory for buffers... which limits the VMs memory use.

Last edited by jpollard; 09-28-2015 at 09:20 AM.
 
Old 09-28-2015, 09:41 AM   #10
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
Quote:
Originally Posted by Dman58 View Post
Well I meant on any single Host, how many are running efficiently?
on a typical 2 socket pizzabox, you could run up to a few hundred VMs, it all depends on what these VMs do and how they are configured. As long as you don't overcommit the CPU on any single VM, you can go very far with (mostly) idle machines.

For typical office worked VDI, for example, the standard calculation is 1:10 (i.e. 10 desktop VMs for every physical core, HT not counted of course)
 
Old 09-28-2015, 10:58 AM   #11
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Quote:
Originally Posted by dyasny View Post
on a typical 2 socket pizzabox, you could run up to a few hundred VMs, it all depends on what these VMs do and how they are configured. As long as you don't overcommit the CPU on any single VM, you can go very far with (mostly) idle machines.

For typical office worked VDI, for example, the standard calculation is 1:10 (i.e. 10 desktop VMs for every physical core, HT not counted of course)
That 10 to 1 assumes efficient I/O which does not exist in a pizzabox. And you can't run a few hundred VMs in even an 8GB workstation efficiently - it would be thrashing the disks to death.
 
Old 09-28-2015, 11:41 AM   #12
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,573

Rep: Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142
The question is way too broad to answer. It all depends on the resources available on the host and what you want these VMs to do.

If you have a host with 128 GB of RAM and 20+ CPU cores and your VMs will be CLI-only providing basic command line services with minimal load (git server, svn server, dns server, etc.) then you can run hundreds at the same time without issue.

If you have a host with 4 GB of RAM and 2 cores and you want to run a Windows 7 VM to play games - you probably won't even be able to run that one effectively.

Last edited by suicidaleggroll; 09-28-2015 at 11:45 AM.
 
Old 09-28-2015, 11:44 AM   #13
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,573

Rep: Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142
Quote:
Originally Posted by Dman58 View Post
Is it safe for me to assume that for a consumer grade PC (AMD FX 8350 Vishera 8 core) it can run a max of 7 VMs? And 1 core left for the host...
It depends on the expected load on those VMs and what you want the host to be able to do while they're running. Assigning a core to the VM does not remove it from the host, it's more of a CPU usage cap on the VM. There's no reason you couldn't have 20 VMs with 1 core each on an 8 core machine, as long as all of them don't fire up and try to saturate their CPU at the exact same time. RAM is usually the limitation, not CPU, unless you're running some very CPU-intensive VMs.
 
Old 09-28-2015, 02:50 PM   #14
dyasny
Member
 
Registered: Dec 2007
Location: Canada
Distribution: RHEL,Fedora
Posts: 995

Rep: Reputation: 115Reputation: 115
Quote:
Originally Posted by jpollard View Post
That 10 to 1 assumes efficient I/O which does not exist in a pizzabox. And you can't run a few hundred VMs in even an 8GB workstation efficiently - it would be thrashing the disks to death.
A typical VDI workload for up to 100 desktop VMs, doing office work (MS office, web browsing etc) does not generate enough IOPS to overwhelm a locally accessible (6Gbps SAS) 6 disk raid10. Yes, there are pizzaboxes with 6-8 disk slots easily available from most server vendors. Should I add SSD or FusionIO into consideration as well?
 
Old 09-28-2015, 03:01 PM   #15
jpollard
Senior Member
 
Registered: Dec 2012
Location: Washington DC area
Distribution: Fedora, CentOS, Slackware
Posts: 4,912

Rep: Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513Reputation: 1513
Quote:
Originally Posted by dyasny View Post
A typical VDI workload for up to 100 desktop VMs, doing office work (MS office, web browsing etc) does not generate enough IOPS to overwhelm a locally accessible (6Gbps SAS) 6 disk raid10. Yes, there are pizzaboxes with 6-8 disk slots easily available from most server vendors. Should I add SSD or FusionIO into consideration as well?
I've not even seen advertised a pizzabox with enough room for 6 to 8 disks... That usually requires a 2U (to 4U) slot server...

And note - you said SERVER, not PC. PC workstations tend not to have SAS in the first place.
 
  


Reply

Tags
performance, ram allocation, virtual machine



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
VirtualBox - teleport running VMs WarTurkey General 2 09-08-2014 06:40 PM
How to communicate between two VirtualBox VMs running on same host chakra1 Linux - Virtualization and Cloud 5 12-09-2013 02:43 AM
[SOLVED] Accessing services running inside Vms. xeon123 Linux - Networking 1 08-16-2012 07:45 PM
Running multiple desktop VMs lmann Linux - Virtualization and Cloud 3 07-01-2012 11:04 AM
Running Multiple VMs on a Limited RAM Hi_This_is_Dev Linux - Virtualization and Cloud 7 09-26-2010 08:39 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud

All times are GMT -5. The time now is 09:23 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration