{"id":1022,"date":"2013-02-06T20:54:04","date_gmt":"2013-02-06T19:54:04","guid":{"rendered":"http:\/\/www.bussink.ch\/?p=1022"},"modified":"2018-05-23T17:57:20","modified_gmt":"2018-05-23T15:57:20","slug":"2013-homelab-refresh","status":"publish","type":"post","link":"https:\/\/www.bussink.ch\/?p=1022","title":{"rendered":"2013 Homelab refresh"},"content":{"rendered":"<p><strong>Preamble<\/strong><\/p>\n<p>It&#8217;s now 2013, and it&#8217;s time to have a peak at my homelab refresh for this year.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Background<\/strong><\/p>\n<p>In the past three years, I&#8217;ve ran a very light homelab with VMware ESXi. I mainly used my workstation (<a title=\"X8DTH-6F\" href=\"http:\/\/www.supermicro.com\/products\/motherboard\/qpi\/5500\/x8dth-6f.cfm\" target=\"_blank\">Supermicro X8DTH-6F<\/a>) with Dual <a title=\"Intel Xeon 5520\" href=\"http:\/\/ark.intel.com\/products\/40200\/Intel-Xeon-Processor-E5520-8M-Cache-2_26-GHz-5_86-GTs-Intel-QPI\" target=\"_blank\">Xeon 5520<\/a> @2.26Ghz (8-Cores) and 72GB of RAM to run most of the virtual machines and for testing within VMware Workstation, and only ran domain controllers and 1 proxy VM on a small ESXi machine, a <a title=\"Shuttle XG41\" href=\"http:\/\/us.shuttle.com\/barebone\/Models\/XG41.html\">Shuttle XG41<\/a>. This gives a lot of flexibilty to run nearly all the virtual machines on a large beefed up workstation. There are quiet a few posts on this topic on various vExpert websites (I highly recommend Eric Sloof&#8217;s <a title=\"A whitebox is for sissies - Real men use a Super Workstation\" href=\"http:\/\/www.ntpro.nl\/blog\/archives\/2077-A-whitebox-is-for-sissies-Real-men-use-a-Super-Workstation.html\" target=\"_blank\">Super-Workstation<\/a>).<\/p>\n<p>I sometimes do play games (I&#8217;m married with a gamer), and when I do I have to ensure my virtual machines are powered down within VMware Workstation, as my system could and has crashed during games. Having corrupted VM is no fun.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Requirements<\/strong><\/p>\n<p>What I want for 2013 in the homelab, is a flexible environment composed of a few quiet ESXi hosts with my larger workstation being able to add new loads or test specific VM configuration. For this I need a infrastructure that is small, quiet and stable. Here are the requirements for my 2013 homelab infrastructure<\/p>\n<ol>\n<li><strong>Wife Acceptance Factor<\/strong> (<a title=\"Wife Acceptance Factor\" href=\"http:\/\/en.wikipedia.org\/wiki\/Wife_acceptance_factor\" target=\"_blank\">WAF<\/a>)<\/li>\n<li><strong>Small<\/strong><\/li>\n<li><strong>Quiet<\/strong><\/li>\n<li><strong>Power Efficient<\/strong><\/li>\n<\/ol>\n<p>Having purchased a flat, I don&#8217;t have a technical room (nothing like my <a title=\"2006 Computer room\" href=\"http:\/\/www.bussink.ch\/?p=7\" target=\"_blank\">2006 computer room<\/a>) or a basement. So having a few ESXi hosts on 24 hours a day, requires a high Wife Acceptance Factor. The system have to be small &amp; quiet. In addition, if they are power efficient, it will make the utility bill easier.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Shuttle XH61V<\/strong><\/p>\n<p>The<a title=\"Shuttle XH61V\" href=\"http:\/\/us.shuttle.com\/barebone\/Models\/XH61V.html\" target=\"_blank\"> Shuttle XH61V<\/a> is small black desktop based on the Intel H61 chipset. It comes in a 3.5L metal case with very quiet ventilators. You just need to purchase the Shuttle XH61V, a Intel 1155 Socket <a title=\"65W Processors list for Shuttle XH61V\" href=\"http:\/\/global.shuttle.com\/products\/productsSupportListUS?productId=1628\" target=\"_blank\">65W processor<\/a>, two memory SODIMMs (laptop memory) and local storage. Assembly can be done in less than 30 minutes.<\/p>\n<div id=\"attachment_1027\" style=\"width: 310px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_large.jpg\"><img aria-describedby=\"caption-attachment-1027\" loading=\"lazy\" class=\"size-medium wp-image-1027\" alt=\"Shuttle XH61V\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_large-300x131.jpg\" width=\"300\" height=\"131\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_large-300x131.jpg 300w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_large.jpg 431w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-1027\" class=\"wp-caption-text\">Shuttle XH61V<\/p><\/div>\n<p>The Shuttle XH61V comes with two NICs and support for a mSATA (Bootable) connector, a PCIe x1 slot, and two 2.5&#8243; Devices. The Shuttle XH61V comes with two gigabit network cards. They are Realtek 8168 cards. These work flawlessly, but they do not support Jumbo frames.<\/p>\n<div id=\"attachment_1028\" style=\"width: 380px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_back.jpg\"><img aria-describedby=\"caption-attachment-1028\" loading=\"lazy\" class=\"size-full wp-image-1028\" alt=\"Shuttle XH61V Back\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_back.jpg\" width=\"370\" height=\"146\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_back.jpg 370w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_back-300x118.jpg 300w\" sizes=\"(max-width: 370px) 100vw, 370px\" \/><\/a><p id=\"caption-attachment-1028\" class=\"wp-caption-text\">Shuttle XH61V Back<\/p><\/div>\n<p>For storage, I decided to boot from a mSATA device, and to keep a Intel SSD for a fast upper-tier local storage, and one large Hybrid 2.5&#8243; Harddisk for main storage.\u00a0I do have a <a title=\"Synology DS1010+\" href=\"http:\/\/www.synology.com\/us\/products\/DS1010+\/index.php\" target=\"_blank\">Synology DS1010+<\/a> on the network that is the centralized NFS storage, but I want some fast local storage for specific virtual machines. It&#8217;s still early 2013, so I have not yet upgraded my older Synology or created a new powerful &amp; quiet <a title=\"Nexenta Community Edition\" href=\"http:\/\/www.nexentastor.org\/projects\/1\/wiki\/CommunityEdition\" target=\"_blank\">Nexenta Community Edition<\/a> home server. On the next image you can see that three Shuttle XH61V take less space than a Synology DS1010+<\/p>\n<p><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/3xXH61v_ds1010+.jpg\"><img loading=\"lazy\" class=\"alignnone  wp-image-1119\" alt=\"Three Shuttle HX61V with Synology DS1010+\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/3xXH61v_ds1010+.jpg\" width=\"565\" height=\"230\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/3xXH61v_ds1010+.jpg 1009w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/3xXH61v_ds1010+-300x121.jpg 300w\" sizes=\"(max-width: 565px) 100vw, 565px\" \/><\/a><\/p>\n<p><strong>VMware ESXi installation<\/strong><\/p>\n<p>Installing VMware ESXi is done quickly as all the devices drivers are on the ESXi 5.1 VMware-VMvisor-Installer-5.1.0-799733.x86_64.iso install cdrom.<\/p>\n<div id=\"attachment_1025\" style=\"width: 588px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_esxi_summary.jpg\"><img aria-describedby=\"caption-attachment-1025\" loading=\"lazy\" class=\" wp-image-1025  \" alt=\"ESXi 5.1 on XH61V\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_esxi_summary.jpg\" width=\"578\" height=\"402\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_esxi_summary.jpg 722w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_esxi_summary-300x208.jpg 300w\" sizes=\"(max-width: 578px) 100vw, 578px\" \/><\/a><p id=\"caption-attachment-1025\" class=\"wp-caption-text\">ESXi 5.1 on XH61V<\/p><\/div>\n<p>Here is the Hardware Status for the Shuttle XH61V<\/p>\n<p><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_hardware_status.jpg\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-1032\" alt=\"ESXi XH61V Hardware Status\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61v_hardware_status-187x300.jpg\" width=\"187\" height=\"300\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_hardware_status-187x300.jpg 187w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_hardware_status-638x1024.jpg 638w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61v_hardware_status.jpg 851w\" sizes=\"(max-width: 187px) 100vw, 187px\" \/><\/a><\/p>\n<p>Here is an updated screenshot of my vSphere 5.1 homelab cluster.<\/p>\n<p><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/management_cluster.jpg\"><img loading=\"lazy\" class=\" wp-image-1120 alignnone\" title=\"Management Cluster\" alt=\"Management Cluster\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/management_cluster.jpg\" width=\"567\" height=\"496\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/management_cluster.jpg 810w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/management_cluster-300x262.jpg 300w\" sizes=\"(max-width: 567px) 100vw, 567px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Bill of Materials (BOM)<\/strong><\/p>\n<p>Here is my updated bill of materials (BOM) for my ESXi nodes.<\/p>\n<ul>\n<li>Shuttle <a title=\"HX61V\" href=\"http:\/\/us.shuttle.com\/barebone\/Models\/XH61V.html\" target=\"_blank\">XH61V<\/a><\/li>\n<li>Intel Core\u00a0<a title=\"Intel Core i7-3770S\" href=\"http:\/\/ark.intel.com\/products\/65524\/Intel-Core-i7-3770S-Processor-8M-Cache-up-to-3_90-GHz\" target=\"_blank\"> i7-3770S<\/a> CPU @3.1Ghz<\/li>\n<li>Two Kingston 8GB DDR3 SO-DIMM <a title=\"Kingston Value RAM Notebook\" href=\"http:\/\/www.kingston.com\/us\/memory\/valueram\/notebook\" target=\"_blank\">KVR1333D3S9\/8G<\/a><\/li>\n<li>Kingston 16GB USB 3.0 Key to boot ESXi (Change BIOS as you cannot boot a USB key in USB3 mode)<\/li>\n<li>Local Storage Intel SSD 525 120GB<\/li>\n<li>Local Storage Intel SSD 520 240GB<\/li>\n<li>Local Storage <a title=\"Seagate Momentus XT Hybrid\" href=\"http:\/\/www.seagate.com\/internal-hard-drives\/laptop-hard-drives\/momentus-xt-hybrid\/\" target=\"_blank\">Seagate Momentus XT 750GB<\/a><\/li>\n<\/ul>\n<p>Planned upgrade: I hope to get new<a title=\"Intel SSD 525\" href=\"http:\/\/www.intel.com\/content\/www\/us\/en\/solid-state-drives\/solid-state-drives-525-series.html\" target=\"_blank\"> Intel SSD 525 mSATA<\/a> boot devices to replace the older Kingston SSDnow when they become available.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Performance &amp; Efficiency<\/strong><\/p>\n<p>In my bill of materials, I selected the most powerful Intel Core i7 processor that I could fit in the Shuttle XH61V. Because I&#8217;m running virtual appliances and virtual machines like vCenter Operations Manager, SQL Databases, Splunk. There are some less expensive Core i3 (3M Cache), Core i5 (6M Cache) or Core i7 (8M Cache) processor that would work great.<\/p>\n<p>What is impressive, is that the Shuttle XH61V comes with a 90W power adapter. We are far from the 300W mini-boxes\/XPC or even the HP MicroServer with their 150W power adapters. Only the <strong>Intel NUC<\/strong> comes lower with a 65W power adapter and a single gigabit network (<a href=\"https:\/\/twitter.com\/alexgalbraith\" target=\"_blank\">@AlexGalbraith<\/a> has a great series of post on running <a title=\"Nanolab running vSphere on Intel NUC\" href=\"http:\/\/www.tekhead.org\/blog\/2013\/01\/nanolab-running-vmware-vsphere-on-intel-nuc-part-1\/\" target=\"_blank\">ESXi on his Intel NUC<\/a> ).<\/p>\n<p>Just for info, the Intel Core i7-3770S has a cpubenchmark.net score of <a href=\"http:\/\/cpubenchmark.net\/cpu.php?cpu=Intel+Core+i7-3770S+%40+3.10GHz&amp;id=897\" target=\"_blank\">9312<\/a>. Which is really good for a small box that uses 90W.<\/p>\n<p>The Shuttle XH61V is also <strong>very quiet.<\/strong>.. it&#8217;s barely a few decibels above the noise of a very quiet room. To tell you the thru&#8230; the WAF is really working, as my wife is now sleeping with two running XH61V at less than 2 meters away. And she does not notice them&#8230; \ud83d\ude42<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Pricing<\/strong><\/p>\n<p>The pricing for a Shuttle XH61V with 16GB memory and a USB boot device (16GB Kingston USB 3.0) can be kept to a about $350 on newegg. What will increase the price is the performance of the LGA 1155 Socket 65W processor ( Core\u00a0i3-2130 from $130 to Core\u00a0 i7-3770S at $300) and what additional local storage you want to put in.<\/p>\n<p><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/ESXi_Management_Cluster.jpg\"><img loading=\"lazy\" class=\"alignnone  wp-image-1039\" alt=\"vSphere 5.1 Cluster XH61V\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/ESXi_Management_Cluster-1024x725.jpg\" width=\"574\" height=\"406\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/ESXi_Management_Cluster-1024x725.jpg 1024w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/ESXi_Management_Cluster-300x212.jpg 300w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/ESXi_Management_Cluster.jpg 1418w\" sizes=\"(max-width: 574px) 100vw, 574px\" \/><\/a><\/p>\n<p>The sizing of the homelab in early 2013 is so far from the end of 2006 when I moved out of my first flat, when I had a <a title=\"Moving out after 11 years...\" href=\"http:\/\/www.bussink.ch\/?p=7\">dedicated Computer room<\/a>.<\/p>\n<p><strong>Update 18\/03\/2012. <\/strong>DirectPath I\/O Configuration for Shuttle XH61v BIOS 1.04<\/p>\n<div id=\"attachment_1111\" style=\"width: 500px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61b_directpath_io_config.jpg\"><img aria-describedby=\"caption-attachment-1111\" loading=\"lazy\" class=\" wp-image-1111 \" alt=\"XH61v DirectPath I\/O Configuration\" src=\"http:\/\/www.bussink.ch\/wp-content\/uploads\/\/2013\/02\/xh61b_directpath_io_config.jpg\" width=\"490\" height=\"490\" srcset=\"https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61b_directpath_io_config.jpg 613w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61b_directpath_io_config-150x150.jpg 150w, https:\/\/www.bussink.ch\/wp-content\/uploads\/2013\/02\/xh61b_directpath_io_config-300x300.jpg 300w\" sizes=\"(max-width: 490px) 100vw, 490px\" \/><\/a><p id=\"caption-attachment-1111\" class=\"wp-caption-text\">XH61v DirectPath I\/O Configuration<\/p><\/div>\n<p>&nbsp;<\/p>\n<p><strong>Update 22\/03\/2013.<\/strong>\u00a0 mSATA SSD Upgrade<\/p>\n<p>I&#8217;ve decided to replace the Intel 525 30GB mSATA SSD that is used for booting ESXi and to store the Host Cache with a larger Intel 525 120GB mSATA SSD. This device will give me more space to store the Host Cache and will be used as a small Tier for the Temp scratch disk of my SQL virtual machine.<\/p>\n<p>The <a href=\"http:\/\/www.intel.co.uk\/content\/www\/us\/en\/solid-state-drives\/solid-state-drives-525-series.html\" target=\"_blank\">&#8216;published&#8217; performance<\/a> for the Intel 525 120GB mSATA are<\/p>\n<div>\n<table width=\"100%\" border=\"1\" cellspacing=\"0\" cellpadding=\"1\">\n<tbody>\n<tr>\n<th><b>Capacity<br \/>\n<\/b><\/th>\n<th><b>Sequential<br \/>\nRead\/Write (up to)<\/b><\/th>\n<th><b>Random 4KB<br \/>\nRead\/Write (up to)<\/b><\/th>\n<th><b>Form Factor<\/b><\/th>\n<\/tr>\n<tr>\n<td>30 GB<\/td>\n<td width=\"294\">SATA 6 Gb\/s\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 500 MB\/s \/ 275 MB\/s<\/td>\n<td width=\"312\">\u00a05,000 IOPS \/ 80,000 IOPS<\/td>\n<td width=\"234\">mSATA<\/td>\n<\/tr>\n<tr>\n<td>60 GB<\/td>\n<td width=\"294\">SATA 6 Gb\/s\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 550 MB\/s \/ 475 MB\/s<\/td>\n<td width=\"312\">15,000 IOPS \/ 80,000 IOPS<\/td>\n<td width=\"234\">mSATA<\/td>\n<\/tr>\n<tr>\n<td width=\"90\">120 GB<\/td>\n<td width=\"294\">SATA 6 Gb\/s\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 550 MB\/s \/ 500 MB\/s<\/td>\n<td width=\"312\">25,000 IOPS \/ 80,000 IOPS<\/td>\n<td width=\"234\">mSATA<\/td>\n<\/tr>\n<tr>\n<td width=\"90\">180 GB<\/td>\n<td width=\"294\">SATA 6 Gb\/s\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 550 MB\/s \/ 520 MB\/s<\/td>\n<td width=\"312\">50,000 IOPS \/ 80,000 IOPS<\/td>\n<td width=\"234\">mSATA<\/td>\n<\/tr>\n<tr>\n<td width=\"90\">240 GB<\/td>\n<td width=\"294\">SATA 6 Gb\/s\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 550 MB\/s \/ 520 MB\/s<\/td>\n<td width=\"312\">50,000 IOPS \/ 80,000 IOPS<\/td>\n<td width=\"234\">mSATA<\/td>\n<\/tr>\n<tr>\n<td colspan=\"4\">\u00a0<a href=\"http:\/\/ark.intel.com\/products\/family\/56572\/Intel-SSD-500-Family\" target=\"_blank\">Show More Detailed Product Specifications\u00a0&gt;<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<div>\n<div data-component=\"contentwithimage\" data-component-id=\"6\">\n<p>&nbsp;<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Preamble It&#8217;s now 2013, and it&#8217;s time to have a peak at my homelab refresh for this year. &nbsp; Background In the past three years, I&#8217;ve ran a very light homelab with VMware ESXi. I mainly used my workstation (Supermicro X8DTH-6F) with Dual Xeon 5520 @2.26Ghz (8-Cores) and 72GB of RAM to run most of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1036,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[11,9],"tags":[80,25,77,79,74,78,76,75],"_links":{"self":[{"href":"https:\/\/www.bussink.ch\/index.php?rest_route=\/wp\/v2\/posts\/1022"}],"collection":[{"href":"https:\/\/www.bussink.ch\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bussink.ch\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bussink.ch\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bussink.ch\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1022"}],"version-history":[{"count":25,"href":"https:\/\/www.bussink.ch\/index.php?rest_route=\/wp\/v2\/posts\/1022\/revisions"}],"predecessor-version":[{"id":1939,"href":"https:\/\/www.bussink.ch\/index.php?rest_route=\/wp\/v2\/posts\/1022\/revisions\/1939"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.bussink.ch\/index.php?rest_route=\/wp\/v2\/media\/1036"}],"wp:attachment":[{"href":"https:\/\/www.bussink.ch\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1022"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bussink.ch\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1022"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bussink.ch\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1022"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}