VMware ESX(i) Home Lab – Why, What and How? Considerations when building your own home lab.

I thought I’d put a post together to discuss what I have learnt whilst running a home virtualization lab along any hints or tips I thought may be of use to others considering building their own.  I’ve already written a number of posts (see bottom of this post for links) around ‘how’ to build a VMware ESX(i) lab using my favourite server(s) of choice the HP Proliant ML110 and ML115 range though thought a higher level perspective on ‘why’ and ‘what’.

First of all here’s a couple of pictures of my home lab.  As you can see it is definitely a ‘working’ (aka messy) lab which gets used on a daily basis.  The kit you see has been accumulated over the last couple of years with some of it being given to me and some bought from EBay and from brand new.

 

VMware ESX Home Lab VMware ESX Home Lab

 

If there is interest I will put together a post dedicated to what I run and how I have things setup – though this does tend to change day to day depending on what I am doing. :)  Let me know if that would be of interest?

Also, check out the recent VMware Community Roundtable podcast on running your own VMware home lab.  I was invited by VMware’s John Troyer (Twitter: @jtroyer) to participate which was a fun experience with some great questions and conversations had.

So, let’s move onto the question of…..

 

Why?

When considering building your own home lab first ask yourself, as is the case with many decisions, why?  There are many reasons why someone would want to buy their own home virtualization lab but here are some of the more common ones:

 Good VMware ESX Study Resouces – Exam Study: To provide yourself with an environment where you can build a mock production environment to follow examples in any study material you may have and to also confirm to yourself that what you have read actually works as described.

– Hand On Learning: Probably the most common reason for putting together your own virtualization lab is to jump onto the kit, wrestle and get your hands dirty with it – breaking it, fixing it and then breaking it again in the process.  This is my preferred option for learning about a product or new item of technology, though obviously you do need the luxury of time.  Very few of us in IT have the opportunity or access to the necessary non-production hardware during the working day to spend any meaningful length of time in doing this.

– Centralised Home Infrastructure: Perhaps you are running a home office or need a centralised environment from which to run your home PCs (eg: centralised monitoring and management of your kids access to the internet, family file repositories for music, photos, etc from which online backups can be taken).

And finally…

– Because It’s There (ie: Why Not?): Some of you, like myself, are probably just total tech junkies and like playing with new technology even if it doesn’t have direct application to your personal or work life. A virtualised home lab provides an excellent platform from which to do this from.

VMware ESX Home Lab

 

Whatever your reason running your own home virtualization lab will provide you with a valuable increase in product and technology understanding that will most likely assist you in your day to day job whether it be an working on the service desk, a second or third line engineer, technical architect or professional pre-sales.

 

What?

So what do you need to kick off your own virtualization lab? 

The good news is that you don’t actually need much to start with.  A home lab can consist of anything from a single machine through to a rack of servers humming away in your basement or garage (along with a rather large power bill).

Your actual hardware from which you run your hypervisor could be a laptop running VMware Workstation which in turn is running VMware ESXi with nested VMs or it could be some old server kit that you ‘liberated’ when your work was performing their recent server hardware refresh and was going to end up in the skip. There are also some good deals to be had on entry level server hardware which can be as cheap as a couple of hundred pounds/dollars/euros (delete where appropriate).  I maintain a list of any hot deals I come across or am told about on this site which can be found at the top of the page in the ‘Hot Deals’ section.

Booo ! So, before we go any further lets acknowledge the 2 ton elephant sitting in the corner of room… This elephant being ‘official’ VMware support and licensing…

 

 

Support – The ‘Official’ Line

VMware HCLTo gain ‘official’ support from VMware for a ESX(i) implementation whether it be in a production or lab environment you need to, as would be expected, pay for it.  Purchasing support, I would suggest, isn’t at all necessary for a home lab and as will be discussed below probably wouldn’t able to be obtained in most home lab instances anyway due to the hardware you’ll be running it on.

For VMware vSphere to be ‘officially’ supported in either your work/home lab or production environment the hardware involved with the virtualization solution needs to have undergone strict compliance testing and be on VMware’s compatibility guide which can be found here.

In reality it is unlikely that your home lab server, network and storage hardware is going to be ‘officially’ approved to run the latest version of ESX(i) but don’t let this stop you as ESX(i) will often still work despite your hardware not being on the supported list.

With every new version of VMware ESX(i) that comes out the list of compatible devices and components officially supported, or otherwise, grows ever longer.  It was often the case with VMware ESX(i) 3 and 3.5 that the majority of components would work on your un-supported server hardware but either the disk controller, network controller or both would not work.  To get around this would usually involve some (unsupported) hacking to the ESX(i) ISO build to modify or inject drivers or inserting compatible components to get around the issue.  With the release of ESX(i) 4 it is more common than not for server based components to be successfully detected and work without the need for any undesirable hacking to the build.

Licensing

VMware Licensing You can download a permanent licensed version of the free edition of ESXi though this to be honest doesn’t really give you much to play with in your home lab, at least not long term.  The real ‘fun’ stuff such as HA, DRS and FT along with other VMware products such as SRM, CapacityIQ and AppSpeed are only available for download, as would be expected, as time limited evaluations.  What this means in reality is that you will probably be looking at using multiple email accounts to download a fresh evaluation copy when your original copy expires.  This can prove to be a hassle if you’re wanting to run a product longer than the 30 or 60 day evaluation period for testing, etc.  In the absence of any MS TechNet type subscription this is the only real option open to you and your home lab.

Of course, some people have access to permanent VMware license keys from their work though this would obviously be in breach of the VMware licensing agreement to use these in your home labs.

Microsoft TechNet Subscription Another consideration when planning your lab is that once your ESX(i) host or hosts are up and running you are going to want to install VMs running an OS in your new lab.  Unless you are using an open source OS such as Linux you are most probably going to be looking at a Microsoft Server based OS.  By far the most (legal) cost effective way of gaining access to your own Microsoft licenses for use in a lab environment is via a Microsoft TechNet subscription. For a few hundred pounds/dollars/euros a TechNet subscription will gain you access to the vast majority of Microsoft’s operating systems and applications with your own unique license keys – this is a total bargain and a good investment of money in my opinion.  There are regular TechNet discount codes that can be applied to new subscriptions – check out the ‘Hot Deals’ section at the top of this page as I keep this updated with the latest TechNet discount codes I come across.

 

The Shopping List – What Do I Need?

Still like the sound of building your own lab but are not sure what you need?

Before taking the plunge and parting with your hard-earned money do a little homework to ensure the hardware your looking at purchasing will actually work with ESX(i).  Check out these following useful resources which list the PC and server hardware that people have found to work with the different versions of ESX(i):

To get a basic idea of what you will require for your home lab here’s a basic shopping list covering both a single ESX(i) and basic  multiple ESX(i) host lab configuration.

 

VMware ESX(i) Shopping List

The first and most obvious thing that you’ll need for your home VMware ESX(i) lab is of course a copy of ESX(i) itself.  Most home ESX(i) home labs are running copies of the free downloadable ESXi version which can be found here.

As mentioned at the start of this post ESX(i) can now be run from within VMware Workstation though as you’d expect the performance wouldn’t be as good as running the ESX(i) hypervisor directly on PC/server hardware.  The following list is assuming that you will be running ESX(i) on its own dedicated PC/server and are outlining a basic lab configuration only:

 

Basic – Single ESX(i) Host Lab:

From this straight forward ESX(i) lab configuration you will be able to run a single or multiple nested VMware ESX(i) instances – memory permitting.  This will be sufficient for most basic requirements though depending on the level of performance from the hardware on which you are running it you may find that running nested ESX(i) instances a little slow.

 Quantity:Item:
VMware ESX Home Lab - Server

1

PC/Server (Able to run VMware ESX(i) – see the previous section for how to find this out if not using VMware approved server hardware or components).
– CPU: Multi-Core (ie: 2+)
– Memory: 2GB+ (2GB is a bare minimum).
– Storage (Array) Controller: Although not essential a hardware based RAID controller is desirable.
– Disks: SATA or ideally iSCSI or SAS based disks – the faster the better.
Network Card: A single port 1Gb NIC
and  
VMware ESX Home Lab - Cable

1

Cross-Over Cable (Cat 6 or 5e) – if you don’t have a network switch – for connectivity between the ESX(i) host and the managing PC/Laptop running the vSphere Client.
or  
VMware ESX Home Lab - Switch
VMware ESX Home Lab - Cable

1

Network Switch & Cat 6 or 5e Ethernet Cables (ideally a smart or fully managed switch with Layer 3 capabilities)

 

Multiple ESX(i) (Basic) Host Lab:

 

 Quantity:Item:
VMware ESX Home Lab - Server

2+

PC/Server (Able to run VMware ESX(i) – see the previous section in this post for how to find this out if not using VMware approved server hardware or components).
– CPU: Multi-Core (ie: 2+)
– Memory: 2GB+ (2GB is a bare minimum).
– Storage (Array) Controller: Although not essential a hardware based RAID controller is desirable.
– Disks: SATA or ideally iSCSI or SAS based disks – the faster the better if using these to host and run your VMs from.
Network Card: A single port 1Gb NIC
and  
VMware ESX Home Lab - Switch
VMware ESX Home Lab - Cable

1

Network Switch & Cat 6 or 5e Ethernet Cables (ideally a smart or fully managed switch with Layer 3 capabilities)

 

Multiple ESX(i) Host Enhancements:

The following are some additional items that can further enhance your home lab.  Although not essential they can enable you to comfortably start using some of VMware ESX(i)’s more enterprise level features such as HA, DRS and Fault Tolerance (FT) along with larger more elaborate configurations.

 Quantity:Item:
Shared Storage

1 (1+ for testing SAN/NAS resilience features)

Shared Storage – This can be a small NAS appliance such as the iomega (EMC) IX2-200 SATA based NAS or its bigger brother the IX4-200d or even a spare PC running a free SAN/NAS software based appliance such as Openfiler or the free version (2TB limit) of Star Wind.

Instead of running a physical shared storage appliance there are an increasing amount of free SAN/NAS virtual appliances available which can be run on your ESX(i) host. This is a topic that warrants its own dedicated post.

Extra NICs

1+

Additional Network Ports:  These can be provided via inserting extra network cards into your ESX(i) host and in doing so means you can separate out ESX(i), FT, vMotion and VM traffic providing increased available bandwidth.
Extra Memory

1+

Additional Memory:  VMware ESX(i) loves memory and depending on the number of VMs you are running adding extra physical memory to your ESX(i) hosts is never a bad thing.  Increasing the ESX(i) host’s memory can be expensive when wanting to add over 8GB as more costly high capacity DIMMS will likely be needed (assuming your host can take this much memory in the first place).
APC UPS

1

Uninterruptable Power Supply (UPS):  Although not essential and depending on the quality of the power feed into your home you may want to consider a small UPS to clean the power to your lab appliances whilst providing an element of resilience in the event of power failure.
Power Meter

1

Power Meter:  These great little devices will keep track of how much power your home lab kit is drawing (Watts, AMPs).  Well worth the investment so you don’t get any nasty surprises when the power bill comes in.

 

Home Lab Considerations:

There are some important considerations to take into account when planning your home ESX(i) lab which can ultimately determine the success of it:

– Noise:  If using an enterprise level server you’ll most likely find that the noise it generates, let alone two or more of them, is significant.  This is fine if you are fortunate enough to have a basement or garage in which to run it from though I can almost guarantee that your other-half won’t see the fascination of hosting your own lab server in the corner of your lounge.  🙂

PCs or smaller entry level servers such as the HP Proliant ML110 or ML115 run quietly enough that you can get away with having them run in most rooms.  See my video here to see how much noise an HP ML115 makes when starting up and then running normally.

Power:  Running your own home lab can be a costly affair though it really does depend on whether you leave it on 24 x 7 or not.  Each of my ESX(i) hosts which are running on an HP Proliant ML110/ML115 G5 with 8GB memory and 1 x SATA disk consume on average 85W of power.  Add your management PC, TFT, network switch and any share storage into the mix and you can easily chew through 350W-500W of power. If running your lab 24×7 check that you are getting the best deal from your electricity supplier.

Time: Building and running your own home lab can become something of a time-sink due to its flexibility and the enormous list of interesting things you can do with it. You can get totally absorbed in running and trying out new applications or utilities resulting in the hours just flying by.

– Money: Depending on the server, network and storage hardware you decide to go for you can end up spending  a decent amount on it.  That said, it is just as easy to put together a lab solution by keeping your ear to the ground for any appropriate hardware that your work may be looking at dumping during a hardware refresh cycle.  At the end of the day though you can start as small as you want and slowly add extra pieces of hardware or upgrades over time – just remember, you don’t have to do it all at once!

 VMware ESX Home Lab

How?

Once you have decided to build your own home lab and what hardware to use the next step is to figure out how to put it all together so that (A) it works and (B) it is configured correctly so that you get maximum benefit out of it.

I have a number of articles already covering the topic of how to install VMware ESX(i) onto your home lab server.  Check out these for more details and the other great articles from other bloggers listed below.  Please let me know if I’ve left any other good home lab related articles off of this list as I know I have likely accidently overlooked some.

 

I hope in you found this post of use whether you already run your own home VMware lab or have just started thinking about it.  Running your own home lab is a lot of fun and there is a great supportive community around it.  Why not give it a go?  🙂

 

 

About Simon Seagrave 706 Articles
Simon is a UK based Virtualization, Cloud & IT Technology Evangelist working as a Senior Technology Consultant and vSpecialist for EMC. He loves working in the ever changing IT industry & spends most of his time working with Virtualization, Cloud & other Enterprise IT based technologies, in particular VMware, EMC and HP products. As well as on this site, you can find him on Twitter and Google+

13 Comments

  1. Simon, Another great post and great VMTN call yesterday. I have an old ML110 server, but it must not be supported, because when I tried to install ESXi, I got a “Failed to load lvmdriver’ error. I am not sure of the specs of that box, but I think that it may be about 3 years old. So I will continue my search for servers to setup a lab of my own.

  2. When using the free version of esxi and shared storage is it possible for multiple hosts to access vms on the shared storage or is that limited to the paid version. I have have configured two esxi free host using iscsi and I am unable to see the shared storage on both host. If I remove the free license and use the eval license I can see the storage. So I am doing something wrong or is this how it is supposed to work?

  3. I’ve just completed my VCP Install, Configure, Manage exam (4.1). I was looking for a way I could set the network up at home – this is perfect! It just so happens I have a couple of old ML115’s that I was going to throw away!

  4. Great article. I’m wanting to do the same with ESXi 5.0 do you know if current crop of ML150s (G6) will work? VMware only lists the ML350 series as supported. At work I once tried to get VMware going on a DL350G1 and it was endless Purple-Screen-Of-Death problems. I don’t want to buy an ML150 and find it doesn’t work.

    Thanks!

  5. I was able to pick up a couple ML110 G5’s. Can’t wait for them to get here so I can setup my home lab. Thanks for the article and info – very helpful.

    Thanks!

  6. Hi Brian,
    I am interested in learning vmware and want to install ESXi 5.5. Your article was several years old. Can you recommend a server that doesnt cost too much to run this and updated? My friend said he had some Dell T7400, but not sure if this is compatible or not. I dont want to build a desktop or server like most people on the net seem to do. I want to start learning vmware right away.

  7. Hi! Nice article, nice lab. Congrats – nice to see setups like this.

    I’m not doing any virtualization, but now that we own instead of rent, and have the space, I have a server room with a Win 2K8 AD domain (2 DCs, custom builds), a combined print server / image server / patch server, and a couple of experimental Linux boxes.

    Four user PCs (we wired the house with gigabit switches / routers and CAT 6), 3 or 4 laptops, and the usual phones, tablets, smart TVs and Blu-Ray players on the net.

    Next up is a Synology DS1813+ NAS. You are quite correct, a working lab is near impossible to keep neat. “No combat-ready unit ever passed inspection; no inspection-ready unit ever passed combat.”

  8. Hi All,

    My Nested ESXi hosts frequently disconnects from vsphere client and i can’t connect back to it until i restart

    The below error is popping up along with the regular host disconnected window.

    call “propertycollector.createfilter” for object “ha-property-collector failed

    I would be really greatful if anyone help me to resolve this issue.

    Thanks in advance
    Madhu

15 Trackbacks / Pingbacks

  1. Tweets that mention VMware ESX(i) Home Lab – Why, What and How? Considerations when building your own home lab. | TechHead.co.uk -- Topsy.com
  2. Podcast 79 – Building your homelab » Yellow Bricks
  3. White boxes and home labs – Community Podcast #79 | VMvisor
  4. Rack Your Home Lab With $8 IKEA Lack Tables | VM /ETC
  5. VMpros: My Homelab | VMpros.nl
  6. I definitely need a new home lab! « VirtualByte
  7. Home Lab « Virtualised Reality
  8. VIDEO: vChat – Episode 3 – vSphere Home Labs
  9. VIDEO: vChat – Episode 3 – vSphere Home Labs | TechHead.co.uk
  10. VMpros: My Homelab
  11. links for 2011-01-08
  12. Building a Home Lab 101 « vDestination: you're virtually there
  13. Learning Powershell « VirtualisedReality.com
  14. Jase's Place » Home Lab Hosts – Just in time for vSphere 5
  15. I am planning to build a small home sever, What would be best configuration? - Admins Goodies

Leave a Reply

Your email address will not be published.


*


This site uses Akismet to reduce spam. Learn how your comment data is processed.