Microsoft migrates MSDN and TechNet on Hyper-V virtual machines

Posted by Alessandro Perilli   |   Friday, May 23, 2008   |   6 Comments

For a prospect customer there's nothing better than a real-world implementation to realize the potential or a certain technology. And this is very true in an almost unexplored technology like virtualization.

Microsoft, which eats its own dog food since the Virtual Server 2005 era, just announced the complete migration of both MSDN and TechNet, two of the most popular web sites in the world, on virtual machines.

Microsoft kept the back-end database on physical boxes, but moved 100% of its IIS7 frond-ends on Hyper-V RC0 VMs with 4 virtual CPUs and 10GB RAM.
The virtualization hosts (no mention of the brand obviously) are powered by 2 Intel quad-core CPUs and 32GB RAM (2GB are reserved for the Windows Server 2008 parent partition).

MSDN on Hyper-V

The performance report after this migration is very interesting:

  • Hyper-V CPU overhead (as measured by the parent partition utilization) was 5% to 6% with linear progression as the number of requests increased.
  • CPU oversubscription (three four-processor VMs on an eight-processor physical server) resulted in 3% lower overall performance per physical server based on overall requests per second per 1 percent CPU.
  • Requests per second per 1% CPU performance of MSDN over the previous physical server platform improved. This demonstrates to us the viability of efficient consolidation from dedicated older physical servers to shared virtualized platforms.
  • Physical MSDN handled 21% more requests per second per 1% CPU than virtualized MSDN.

Since this data would be much more meaningful knowing some details about the guest OS workloads (which are not published), virtualization.info reached Microsoft and received the following numbers:

  • the MSDN front-end serves more than 3 million page views per day
  • the TechNet front-end serves more than 1 million page views per day

Read the whole report here.

It would be interesting reading something similar from VMware, which so far never disclosed anything about how its own technology is used inside the company.

6 Comments

Anonymous Rick Friday, May 23, 2008 7:51:00 PM  
So they lost 1/4 to 1/5 the capacity by virtualizing on Hyper-V?? Ouch! 'Physical MSDN handled 21% more requests per second per 1% CPU than virtualized MSDN'
Anonymous Hierogli Tuesday, May 27, 2008 8:18:00 AM  
'Physical MSDN handled 21% more requests per second per 1% CPU than virtualized MSDN.'

Ouch! Whats are the benefits of this change? This seems simply painful!
Anonymous Z3rochilled Tuesday, May 27, 2008 4:08:00 PM  
Physical servers are bound to handle move requests. Thats part of the virtualisation overhead. So, you may end up with a few more OS instances but as long as the overall hardware and management overhead has reduced, and the system has equal reliability, you can consider your virtualisation project a success.
Anonymous Christopher G. Lewis Thursday, May 29, 2008 8:04:00 PM  
I see from the diagram that Global Load Balancing is used (I'm assuming either the Cisco or F5 product), but what about local load balancing. Per the diagram, NLB is used for the back end SQL servers, but what about the IIS servers? NLB is a pain to work with on VMs that use virtual nics on VMWare's ESX (getting unicast to work breaks VMotion, Multicast brings in all sorts of networking issues). How does NLB work with HyperV, if that's what you're using? Thanks Christopher Lewis
Anonymous Sartain Friday, May 30, 2008 3:06:00 PM  
Z3: Microsoft.com's architecture uses NLB and no Local load balancers. They group 8 servers in a cluster and maintain multiple cluster groups with their own DNS entry. For heavilly utilized servers, Virtualization doesn't make sense. If you had lots of smaller sites on individual boxes, then consolidating those on a 2x4Core box seems pretty practical. In absolute terms, 79% of 3 million hits/day is still pretty impressive.
Anonymous Mike Volodarsky Saturday, June 28, 2008 6:14:00 PM  
The last two bullets contradict each other: 1) Requests per second per 1% CPU performance of MSDN over the previous physical server platform improved. This demonstrates to us the viability of efficient consolidation from dedicated older physical servers to shared virtualized platforms. 2) Physical MSDN handled 21% more requests per second per 1% CPU than virtualized MSDN So the virtualized platform handles more requests per 1% CPU, yet the physical platform handled 20% more requests per 1% CPU. Which one is it? Thanks, Mike

Add New Comment