• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

Yellow Bricks

by Duncan Epping

  • Home
  • Unexplored Territory Podcast
  • HA Deepdive
  • ESXTOP
  • Stickers/Shirts
  • Privacy Policy
  • About
  • Show Search
Hide Search

Archives for February 2011

vSphere 4.1 Performance Troubleshooting Guide

Duncan Epping · Feb 18, 2011 ·

Today I received an email from Chethan Kumar who is part of Performance Engineering. Chethan rewrote the vSphere Performance Troubleshooting guide so that it contains all the nitty gritty details there are to know about vSphere 4.1 when it comes to performance related problems.

source
The hugely popular Performance Troubleshooting for VMware vSphere 4 guide is now updated for vSphere 4.1 . This document provides step-by-step approach for troubleshooting most common performance problems in vSphere-based virtual environments. The steps discussed in the document use performance data and charts readily available in the vSphere Client and esxtop to aid the troubleshooting flows. Each performance troubleshooting flow has two parts:

  1. How to identify the problem using specific performance counters.
  2. Possible causes of the problem and solutions to solve it.

Now the cool thing about this document is that it not only shows you some of the key metrics to look at but it also provides you with workflows that contains the steps required to analyze these types of issues and of course ultimately solve them. Just download the paper and as an example look at figure 3 on page 16 or figure 5 on page 19 and you’ll know why I love this document.

This performance troubleshooting guide is one of the most invaluable documents out there as it will also give you a better in-sight of how some of the metrics are constructed. Something that I did not know but just discovered is the following:
If you have a snapshot and are experiencing high I/O response times validate the following:

LAT/rd and LAT/wr columns indicate the average response time of read and write I/O commands seen by the VM. Compare these with DAVG/rd and DAVG/rw. If LAT/rd > DAVG/rd or LAT/rw > DAVG/rw and QUED = 0 than the latency is more than likely cause by the snapshot as DAVG/rd and DAVG/rw is device latency and LAT/rd and LAT/rw is the latency observed by the guest.

You see, you can learn something new every day.

Anti-virus and the impact in virtualized environments

Duncan Epping · Feb 16, 2011 ·

I was reading Richard Garsthagen’s article about anti-virus solutions yesterday and decided that this deserved a little bit of extra attention as it is an often overlooked area when it comes to architecture and impact. As Richard points out the difference in terms of load that it generates and overhead is enormous. All of these combined will most definitely result in an increase of consolidation ratio. Not only that but is will also seriously lower the risk during for instance a VDI boot storm but also think about the impact of HA initiated restarts. This could cause an enormous amount of IOps and CPU/Memory overhead which in its turn could impact the other virtual machines.

I guess there is no point in rehashing what is written in the whitepaper of what Richard wrote, I just want to point out the whitepaper as I believe it is a good read. As always results may vary but it is pretty obvious that from an architectural and operational perspective End Point Security is most definitely worth looking into and I cannot wait for more vendors to jump on the bandwagon. Download the tolly report here. (I personally found the disk results very interesting…)

E-Book version of the HA/DRS Deepdive?

Duncan Epping · Feb 16, 2011 ·

I’ve had this question too many times over the last couple of weeks and instead of answering all of them separately I figured I would dedicate a blog article to it so that I can reference to that. Here we go:

Q) Will the e-book version of the HA/DRS deepdive be available soon?

A) No. We have decided that we will not release an e-book (including pdf, ibook, kindle) version of the book. It required a full reformatting of the book which is simple not feasible at this point in time. As it is a “self published” book we are responsible for not only the content but also the formatting etc. Sorry about that, for “Volume 2” however we will reconsider this.

 

I hope this answers your question(s). Thanks and again our apologies, the only option is the paper version.

UPDATE: http://www.yellow-bricks.com/2011/04/05/what-an-ebook-is-this-a-late-april-fools-joke/

What have you’ve been up to?

Duncan Epping · Feb 15, 2011 ·

I got a couple of questions around what I have been up to lately as some noticed there was a slight decrease in volume from a blogging perspective on yellow-bricks. (from 4 articles per week to 2-3 article per week) Well I have been reading up on my new role but on top of that also started blogging for the ESXi Chronicles blog (add it to your RSS reader) and created a VMware Storage centric twitter account. (Follow me if you want to keep up to date on VMware storage initiatives!) The things that I’ve worked on the last couple of weeks:

  • VMware ESXi: Planning, implementation and security
    The week before VMware Partner Exchange I decided that it was time to start brushing up my ESXi knowledge. I usually dig up all the manuals and presentations I can find and start from there. This time I took a different approach however, I bought a book. The book is titled “VMware ESXi: Planning, Implementation, and Security” and is authored by a true VMTN Community hero, Dave Mishchenko.
  • Scripted install with ESXi
    Now you can kick off the automated install of your ESXi server. But wait, you probably want to see what script I used? That is what I figured, here is the script I wrote to automatically install and configure the ESXi host, it is just a simple script that I used and tested in my lab with the main purpose of showing what is possible with ESXi today. The configuration of the server will run after the first boot. I have added several “comment lines” to explain what I am doing and why.
  • Adopting ESXi, now is the time!
    Within the virtualization community we have been seeing more and more people adopting ESXi. Not only adopting it but also actively evangelizing the use of ESXi over ESX classic. The main argument being of course the reduction in operational effort involved with maintaining the platform. Last week two excellent articles were published. The first article was by Bob Plankers of LoneSysAdmin.net fame. Bob wrote an excellent article countering all often heard complaints about ESXi.

I also wrote my first KB article which discusses the impact of CPU/Memory limits with help from someone from the the GSS team. You would expect that a KB article describing the impact already existed but surprisingly enough it did not. Hence the reason I felt an official statement could prevent some of the issues we see in the field on a daily basis.

  • Impact of virtual machine memory and CPU resource limits

Of course that’s not it, I am working on multiple other projects which I cannot discuss yet unfortunately and participated in the VCDX Defenses at PEX. One of the things I can reveal though is that Frank and I are make plans for a volume 2 of the HA/DRS Tech Deepdive and that the sales is still going strong, thanks everyone for your help/support! (No, there will not be an e-book unfortunately, the amount of time/reformatting required did not fit our current schedule.) Keep those reviews and pictures coming though.

Management Cluster / vShield Resiliency?

Duncan Epping · Feb 14, 2011 ·

I was reading Scott’s article about using dedicate clusters for management applications. Which was quickly followed by a bunch of quotes turned into an article by Beth P. from Techtarget. Scott mentions that he had posed the original question on twitter if people were doing dedicated management clusters and if so why.

As he mentioned only a few responded and the reason for that is simple, hardly anyone is doing dedicated management clusters these days. The few environments that I have seen doing it were large enterprise environments or service providers where this was part of an internal policy. Basically in those cases a policy would state that “management applications cannot be hosted on the platform it is managing”, and some even went a step further where these management applications were not even allowed to be hosted in the same physical datacenter. Scott’s article was quickly turned in to a “availability concerns” article by Techtarget to which I want to respond. I am by no means a vShield expert, but I do know a thing or two about the product and the platform it is hosted on.

I’ll use vShield Edge and vShield Manager as an example as in Scott’s article vCloud Director is mentioned which leverages vShield Edge. This means that vShield Manager needs to be deployed in order to manage the edge devices. I was part of the team who was responsible for the vCloud Reference Architecture but also part of the team who designed and deployed the first vCloud environment in EMEA. Our customer had their worries as well about resiliency of vShield Manager and vShield Edge, but as they are virtual they can easily be “protected” by leveraging vSphere features. One thing I want to point out though, if vShield Manager is down vShield Edge will continue to function so no need to worry there. I created the following table to display how vShield Manager and vShield Edge can be “protected”.

Product vShield Manager VMware HA VM Monitoring VMware FT
vShield Manager Yes (*) Yes Yes Yes
vShield Edge Yes (*) Yes Yes Yes

Not only would you be able to leverage these standard vSphere technologies there is more that can be leveraged:

  • Scheduled live clone of vShield Manager through vCenter
  • Scheduled configuration back up of vShield Manager (*)

Please don’t get me wrong here, there are always methods to get locked out but as Edward Haletky stated “In fact, the way vShield Manager locks down the infrastructure upon failure is in keeping with longstanding security best practices”. (Quote from Beth P’s article) I also would not want my door to be opened up automatically when there is something wrong with my lock. The trick though is to prevent a “broken lock” situation from occurring and to utilize vSphere capabilities in such a way that the last known state can be safely recovered if it would.

As always an architect/consultant will need to work with all the requirements and constraints  and based on the capabilities of a product come up with a solution that offers maximum resiliency and with the mentioned options above you can’t tell me that VMware doesn’t provide these

  • « Go to Previous Page
  • Page 1
  • Page 2
  • Page 3
  • Go to Next Page »

Primary Sidebar

About the Author

Duncan Epping is a Chief Technologist and Distinguished Engineering Architect at Broadcom. Besides writing on Yellow-Bricks, Duncan is the co-author of the vSAN Deep Dive and the vSphere Clustering Deep Dive book series. Duncan is also the host of the Unexplored Territory Podcast.

Follow Us

  • X
  • Spotify
  • RSS Feed
  • LinkedIn

Recommended Book(s)

Also visit!

For the Dutch-speaking audience, make sure to visit RunNerd.nl to follow my running adventure, read shoe/gear/race reviews, and more!

Do you like Hardcore-Punk music? Follow my Spotify Playlist!

Do you like 80s music? I got you covered!

Copyright Yellow-Bricks.com © 2026 · Log in