My new whitebox ESX home lab

Last week I was finally ably to buy the whiteboxes I wanted for my homelab. Untill then I had one ESX host at home that hosted my basic environment but because of that I couldn’t try other hypervisors they way I wanted to. So I decided to add two more hosts to my lab.

This is what I bought:

- Asus Barebone V3-P5G45 iG45, SATA2 RAID, HDMI (zilver)

- Intel Core 2 Quad Q9400 2.66GHz FSB1333 Box

- Intel PCI-e Adapter Pro1000PT Dual Port LAN 1000Mbit Bulk

– 2x OCZ 2x2GB DDR2 SDRAM PC6400 CL5.0 Platinum (Total 8GB)

- Western Digital 640GB SATA300 16MB, WD6400AACS

Remarks:

* The 640GB harddisk is way to much since I already have a 1TB Iomega StorCenter X2, but the 640GB was only 10 Euro more expensive then a 80GB harddisk.

* The onboard 1GB nic will only work during PXE boot. It will not work once ESX is running, so you need to get extra Nics.

* Be carefull when selecting the barebone. Check the memory configuration. I made the mistake of first selecting the older P5-G41 and it could only hold a max 2 double sides DIMMS which limited the choice in memory and would make 8GB cost me almost 400 Euro. Now with the P5G45 I can use almost any type and payed 80 Euro for 8GB. So, check the ASUS site for compatible memory on the mainboard you choose.

* VMware Fault Tolerant WORKS !!! :-)

Now I have this lab running I have quit some things on my whish list. I want to test performance differences between with and without Jumbo frames, different storage setups, Hyper-V, XenServer 5.5, disaster recovery scenario’s, new backup tooling I’ve seen from Veeam  / esXpress / vizioncore, etc, etc, etc. Still there are only 24hrs in a day.

Well, first job will be to clean up the mess I made by just unpacking the hosts and connecting them. See picture :-)

my home datacenter

47 thoughts on “My new whitebox ESX home lab

  1. Hi Gabe
    First – great blog post – thanks for sharing this with us!
    Two questions that I am curious about…
    1. If you go into vmDirectPath configuration, do you see any devices or does it say that the hardware doesn't support directpath?
    2. I am assuming that the SATA2 RAID controller works fine when installing ESX? You didn't have to modify any of the PCI config or do anything weird to get the storage recognized, did you?
    Thanks again,
    David Davis

  2. Hi David
    1- On configuration page on the host, hardware section -> advanced it says:
    Host does not support passthrough authentication

    2- Storage was immediately available, no problems there.

    Gabrie

  3. Hi Gabe
    First – great blog post – thanks for sharing this with us!
    Two questions that I am curious about…
    1. If you go into vmDirectPath configuration, do you see any devices or does it say that the hardware doesn't support directpath?
    2. I am assuming that the SATA2 RAID controller works fine when installing ESX? You didn't have to modify any of the PCI config or do anything weird to get the storage recognized, did you?
    Thanks again,
    David Davis

  4. Hi David
    1- On configuration page on the host, hardware section -> advanced it says:
    Host does not support passthrough authentication

    2- Storage was immediately available, no problems there.

    Gabrie

  5. Hey slacker, did you ever test Jumbo Frames? I've got a vSphere 2 node cluster in my lab with two linux VPS'es. One via NFS and one via iSCSI. In my case iSCSI is like 3x faster and I'd really like to try Jumbo Frames and teamed NIC's but I don't have a gbit switch yet.

  6. Hey slacker, did you ever test Jumbo Frames? I've got a vSphere 2 node cluster in my lab with two linux VPS'es. One via NFS and one via iSCSI. In my case iSCSI is like 3x faster and I'd really like to try Jumbo Frames and teamed NIC's but I don't have a gbit switch yet.

  7. Hi,
    Not tested the Jumbo frames yet. Working on something else now. The GBit switch I got was quite cheap, supports VLANs and JumboFrames. The Linksys Switch SLM2008 8 Ports, 1000Mbit.

    Gabrie

  8. I just ordered a 24 port gbit switch that supports Jumbo Frames, trunks, QoS, trunking, etc. So as soon as it comes in I'll be putting the NAS on a gbit jumbo frame network. I'll write back about my performance with jumbo packets and how a mixed MTU environment works.

  9. Hi,
    Not tested the Jumbo frames yet. Working on something else now. The GBit switch I got was quite cheap, supports VLANs and JumboFrames. The Linksys Switch SLM2008 8 Ports, 1000Mbit.

    Gabrie

  10. I just ordered a 24 port gbit switch that supports Jumbo Frames, trunks, QoS, trunking, etc. So as soon as it comes in I'll be putting the NAS on a gbit jumbo frame network. I'll write back about my performance with jumbo packets and how a mixed MTU environment works.

  11. how did you know what SATA controller would work for VMware? Looking to do the same but don't want to get burned on the SATA controller.

  12. how did you know what SATA controller would work for VMware? Looking to do the same but don't want to get burned on the SATA controller.

  13. Just like almost all the others, wait for some pioneers to buy and
    test and after they confirmed it works its save to buy :-)

    I had much help from Eric Sloof from http://www.ntpro.nl

    You can also find a lot of info by searching google on “VMware whitebox”

    Gabrie

  14. Good ole trial and error. At least we know that those chipsets *should* work.

    Thanks for the information.

  15. Just like almost all the others, wait for some pioneers to buy and
    test and after they confirmed it works its save to buy :-)

    I had much help from Eric Sloof from http://www.ntpro.nl

    You can also find a lot of info by searching google on “VMware whitebox”

    Gabrie

  16. Good ole trial and error. At least we know that those chipsets *should* work.

    Thanks for the information.

  17. you have done well, getting ESX onto a desktop machine.

    i tried to do that last year and failed. i even tried to use the intel pro 1000 network card, but the problem must have been my choice of motherboard.

    what are the secrets to spec'ing a whitebox? do you need a certain chipset on the motherboard? what else do you need?

  18. Secret is mostly the SATA controller and chipset. But to be honest I don't
    know that much about different types of mainboards anymore. I had some tips
    from Eric Sloof (http://www.ntpro.nl) on what mainboard he had chosen. In
    other words, just find out what others are running and buy the same :-) When
    you search for Whitebox ESX on google you will find plenty of links to good
    sites that give you info on what works and what doesn't.

    Gabrie

  19. you have done well, getting ESX onto a desktop machine.

    i tried to do that last year and failed. i even tried to use the intel pro 1000 network card, but the problem must have been my choice of motherboard.

    what are the secrets to spec'ing a whitebox? do you need a certain chipset on the motherboard? what else do you need?

  20. Secret is mostly the SATA controller and chipset. But to be honest I don't
    know that much about different types of mainboards anymore. I had some tips
    from Eric Sloof (http://www.ntpro.nl) on what mainboard he had chosen. In
    other words, just find out what others are running and buy the same :-) When
    you search for Whitebox ESX on google you will find plenty of links to good
    sites that give you info on what works and what doesn't.

    Gabrie

  21. I'd love to build my own ESX host around an HP P400 controller. What would you advice me to use as the motherboard ? I also already have a Q9450 cpu lying around, ready to be plugged into that :)

    I've read that certain ASUS mobos aren't working well with this P400 controller. What's your advice ?

  22. When you say virtual FT works. Are “Intel Core 2 Quad Q9400 2.66GHz” support FT? I thought they have to be FT also.

  23. Pingback: VMpros: My Homelab
  24. In 1989, Maurizio managed to persuade Dawn Mello, Gucci Tote

    whose revival of New York’s Bergdorf Goodman in the 1970s made her a star in the retail business, to join the newly formed gucci handbags on saleGroup as

    Executive Vice President and Creative Director Worldwide. At the helm of Gucci America was Domenico De Sole, a former lawyer who helped oversee Maurizio’s

    takeover of ten 1987 and 1989.coach carryalls

    The last addition to the creative team,designer gucci already included designers from Geoffrey Beene and Calvin Klein, was a young designer named Tom

    Ford.Raised in Texas and New Mexico, Gucci Canvas Bags

    he had been interested in fashion since his early teens but only decided to pursue a career as a gucci bag saledesigner after dropping out of Parsons School

    of Design in 1986 as an architecture major. gucci outlet online Dawn Mello hired Ford in 1990 at the urging of

    his partner, writer and editor Richard Buckley.
    cheap gucci

Comments are closed.