ESX Server 3.0.1 vs XenEnterprise 3.2 performance comparison
One of virtualization.info most visited articles since February has been VMware ESX Server 3.0.1 vs Xen 3.0.3 performance comparison.
In that article I reported about a VMware paper highlighting ESX Server 3.0.1 commercial hypervisor performances superiority over Xen 3.0.3 open source hypervisor.
Such claims from VMware cannot be easily confuted because of company's EULA, which prevents anybody publishing of any comparison without explicit permission. But XenSource, which founded the Xen project and is currently offering a commercial solution based on it, found such behaviour pretty unfair and VMware paper's conclusions misleading, so that, in March, challengingly published a similar paper, this time comparing ESX Server 3.0.1 against its XenEnterprise 3.2.
To avoid any lawsuit XenSource ripped off ESX Server benchmarking, and asked VMware for full publishing permission.
Now VMware, possibly under the community pressure waiting to see real numbers or just to limit negative advertising its EULA is providing, allowed publishing of XenSource complete comparison.
This document reveals very similar performances between two virtualization platforms, and in some tests shows XenEnterprise 3.2 (which is still in beta and it's based on Xen 3.0.4) outperforming ESX Server 3.0.1, so that you can read in conclusion:
VMware appears to have failed to appreciate the difference between our Xen open source code base and our commercial XenServer products. For example, had they read the release notes for Xen 3.0.3, they would quickly have established that Intel VT was only partially supported in that release. Moreover, XenSource's Xen Tools for Windows, which optimize the I/O path, were not installed. The VMware benchmarks should thus be disregarded in their entirety.
Our performance results show convincingly that XenEnterprise 3.2 performs equally well or better than VMware ESX Server 3.0.1 in all but a couple of tests. Given that we have not spent much time on optimizing our product for traditional benchmarks we are pleased to see that there is essentially no difference between the two products. Our tests highlighted a couple of areas in which ESX marginally outperforms XenEnterprise, namely on compile time, and for Netperf TX. XenEnterprise outperforms ESX on the Passmark memory operations. XenEnterprise scales well to utilize multiple CPUs to allow a wide variety of workloads to be run. Additionally the scalability testing found that XenEnterprise provides similar scalability to ESX when additional virtual machines are added to the platform.
VMware also appears to have under-appreciated the performance advantages of the latest generation of Intel and AMD processors with built-in support for virtualization. Although VMware's legacy technology cannot exploit these features, XenEnterprise's high performance is proof that these technologies deliver tremendous price/performance advantages to end users...
Read the whole comparison whitepaper here.
Sitemap


Comments
One significant distinction both companies are glossing over:
- VMware published a "Xen (open source) versus ESX" comparison.
- XenSource published a "XenSource versus ESX" comparison.
Neither company is technically lying. They're both misleading, however.
By
Anonymous, at Thursday, March 22, 2007 6:09:00 PM
This looks especially bad for VMware for a variety of reasons: 1. VMware know the importance of installing the guest side components within a VM. VMware have similar components with their VMTOOLS. I'm not buying that they played dumb and didn't know that they needed to install these guest side components for Xen. They clearly wanted to show Xen as unfavorably as they could and this backfired in a very big way. 2. This also puts a fine point on the price of virtualization. Namely, it's a commodity. It should be free. Red Hat, Suse, Microsoft and every OS either does or will have integrated virtualization. The fact that VMware is continuing to charge RIDICULOUS sums of money for VI3 is ludicrous. For those that haven't figured out why EMC is spinning off VMware, it's obvious. They want to milk every last dollar out of VMware while they still can.
By
RobS, at Thursday, March 22, 2007 6:13:00 PM
I don't think it is fair to say they are spinning off VMWare "while they can". Having read both of these and managing a deployment which spans north america I would say that Xen and MS's solution lack the Virtual Center aspect and that has a huge added value for people managing many systems.
Fine on a one to one comparison ESX and Xen are a wash but the toolset to get 40 ESX hosts each running 10-30 VMs deployed is just not there with Xen.
By
JB, at Monday, April 16, 2007 6:49:00 PM
I thought the whole point of Xen and paravirtualisation was to give a huge performance improvement over VMwares 'legacy' technology. Sounds to me as if the performance of the two is by both accounts similar, so why should i risk my environment by switching to Xen when i know VMware works.
By
GA, at Monday, June 04, 2007 3:47:00 PM
Post a new comment