VMworld Europe 2008 – AP03 – Virtualization of Microsoft Exchange Server ( the 16.000 mailboxes story)

VMworld Europe 2008 – AP03 – Virtualization of Microsoft Exchange Server ( the 16.000 mailboxes story)

 

 

After the keynotes this was my first session of the day and I was pleasantly surprised by the high technical level. If all sessions are like this one, VMworld will be a great event for me :-) David Korsunsky and Scott Drummonds talked about the performance benefits you can have when virtualizing Exchange. I was surprised to hear this, because although I was a big fan of virtualizing Exchange and just go and do it, I’ve also kept in mind that I might need more Exchange VMs than physical VMs. According to Scott and David, we don’t.

 

 

First they made it clear that virtualizing Exchange 2007 is much easier then virtualizing Exchange 2003. Exchange 2003 is a heavy hitter in the storage area because of 4k disk block size, where Exchange 2007 uses 8k blocks and write coalescing. With Exchange 2007 previous I/O challenges have been addressed.

 

At their desk the idea was born to just test the limits of Exchange 2007 in a virtual environment and together with some enthusiastic IBM engineers, they started collecting hardware to build their own big fat ESX hosts. It turned out to be an IBM x3850M2, with four quad-core Xeon 7350 CPU’s and a total of 128Gb RAM. When writing their test plan they had one big criteria that all tests should pass: “Microsoft’s LoadGen Exchange test tool, has to pass the test”.

 

 

Next step was to define what virtual machines to create to run Exchange in. According to MS guidelines, a heavy Exchange user will sent 30 e-mails and receive 120 messages (a day???) and Exchange will need about 5Mb cache for this user. The base memory requirement for Exchange is 2Gb and for 4 cpu’s the max estimated amount of mailboxes is 2000. So they decided to create VMs with 2Gb + 2000x 5Mb = 12Gb RAM and 4 vCPUs.

 

 

Normally when scaling an Echange Server, the MS recommendation is to not go beyond 8 cores and 32GB of RAM per server. When using these figures, a physical Exchange 2007 server can only go to a max of 8000 mailboxes. Although there are very few stories about physical machines running this number of mailboxes, there is some reference about 6000 mailboxes per host. David and Scott decided to take it even further. Using the VM building block they created, the managed to put 4 VMs on this physical server without problems, latency times (key measurement factor for the Exchange admin) remained very low. When adding VM number 6, latency went up a little but was still well below the limits. VM number 7 showed there was trouble on the road ahead, latency doubled to 400ms and VM number 8 turned out to be the limit with 16.000 mailboxes !!!! and 900 ms latency. Even a 900 ms latency is below the MS limits of what is acceptable, but it was obvious that adding a ninth VM would go over this limit of 1000ms. All VMs together were now using 140Gb RAM, made possible by VMware transparent page sharing.

 

 

I was surprised to see such very good results on running Exchange in a virtual environment, this really is a great breakthrough and might help Exchange admins to take the step to and no longer be afraid to run their business critical app in a virtual environment. Once, they mind switch is made, Exchange can benefit from all the extras a virtual environment can offer.

 

 

For the RDM users among us, all test have been conducted on VMFS volumes! No need for RDM if you’re concerned about performance.

 

7 thoughts on “VMworld Europe 2008 – AP03 – Virtualization of Microsoft Exchange Server ( the 16.000 mailboxes story)

  1. While this is a fun test, most of us are tied to vendor supportability of the product. Exchange 2007 is not supported by Microsoft in a virtualized environment (as of yet) For some, that may not be a deterrent.

    On smaller scale tests, I don’t see a ‘performance benefit’. Also, Exchange 2007 being role-based has some roles more suited to virtualization than others. I can see mailbox servers held out of the virtualization realm while the service roles of client access and transport more commonly virtualized in the near future. At least until as you say, people lose more of their fear of running mission critical apps in a virtualized environment.

  2. Hi
    I ofcourse asked the question about support and David and Scott told me that they confirmed that they have also worked with some MS Exchange engineers and they confirmed that MS really does its best to support Exchange on VMware. That is, they do their best to help you and it surely is not that with your first phone-call they will ask you to reproduce the problem on physical hardware. This only happens when the support engineer is convinced it should be a (virtual) hardware problem.

    I also visited a presentation by Microsoft about their Hyper-V and vNext and they confirmed that MS will really do a great effort before asking you to go back to physical hardware. Plus, they will soon start a certification program which allows vendors like VMware to certify their hypervisor for MS products.

    Gabrie

  3. Hello All !

    We are running exchange 2K3 on an HP c7000 blade with 2×4 QUAD core CPU and 14GB RAM. There are 150 users and about 150 GB mail total. Everything has current patches/SP’s.

    Seems ok except when I run a nitely backup which uses a snapshot. AT this point ESE 509 errors are logged suggesting a hardware error. Best guess this is caused by the snapshot which creates a queueing affect for writes.

    Recommendatuions anyone ?

Comments are closed.