Protecting VMFS Datastores

A couple of months ago Mike La Spina wrote a cool article titled “Understanding VMFS volumes“. This articles explained the concept of UUID’s and even explained how you could create a backup of your VMFS metadata. I haven’t personally ever encountered VMFS metadata corruption but it’s better to be safe than sorry.

Today Mike wrote a follow up which contains a script that can backup your metadata on a regular base by using cron. The script does a DD of each VMFS volume header and copies the vh.sf file of the VMFS volume to local disk. If you haven’t got a clue what I’m talking about I suggest Head over to Mike’s blog and read the articles!

It can’t be a coincidence that the script has been released shortly after VMware released the VMware VMFS Volume Management PDF… And is it a coincidence that Eric Sloof wrote about VMFS metadate files yesterday? Eric’s also posted a link to Mostafa Khalil’s VMworld 2007 presentation on VMFS volumes and how to backup metadata by the way.

All very useful documents/articles if you want to know the ins and out of the VMFS filesystem.

SRM: Changing the admin email address after installation

One of my customers asked me how they could change the administrator email address after the installation of SRM. He turned the GUI upside down but couldn’t find it anywhere. Extension.xml is the configuration xml file where you can change the Administrator Email:

<adminEmail>admin@yellow-bricks.com</adminEmail>

Resizing your VMFS the right way, exploring the next version of ESX/vCenter

I’ve been playing around with my vSphere/Next gen ESX lab. I was replaying the VMworld lab and one of the assignments was to  resize a VMFS volume. Yes that’s correct, resize not extent. Extents have been discussed by many and the general consensus is avoid them if/when possible. But when running out of diskspace you don’t always have the option to avoid them. Some can’t afford the downtime that comes with a “cold migration”, and most aren’t willing to take the risk of using storage vmotion when running out of diskspace. (Snapshot is placed on source VMFS volume) This has all been solved in the next version of ESX/vCenter. You can resize your VMFS volume without resorting to extents, and you can do this with the vCenter client.

The original size:

First thing you will need to do is increase the size of the LUN on your SAN. If your SAN doesn’t support LUN resizing you can still do it the old fashion way, extent. [Read more...]

VCB Management Console 1.0.6 Beta

@lamw pointed me out via twitter to the “diy” VCB Management Console. The “vcbMC” is a front end  for scheduling and creating backup jobs based on VMware Consolidated Backup. As “athlon_crazy” points out you don’t need to remember all the VCB commands and parameters. You can use vcbMC to browse all your VM’s and back them up according to the schedule you created:

I haven’t tested it myself so far unfortunately, make sure to test the results of the backup.

An 8MB VMFS blocksize doesn’t increase performance?

VMFS Blocksizes have always been a hot topic regarding storage performance. It has been discussed by many including Eric Siebert on ITKE and Gabe also opened a topic on VMTN and he answered  his own question at the bottom. Steve Chambers wrote a great article about Disk Alignment and Blocksize on VI:OPS which also clearly states:”the VMFS block size is irrelevant for guest I/O.” Reading these articles/topics we can conclude that an 8MB blocksize opposed to a 1MB blocksize doesn’t increase performance.

But, is this really the case? Isn’t there more to it than meets the eye?

Think about thin-provisioning for a second. If you create a thin provisioned disk on a datastore with a 1MB blocksize the thin provisioned disk will grow with increments of 1MB. Hopefully you can see where I’m going. A thin provisioned disk on a datastore with an 8MB blocksize will grow in 8MB increments. Each time the thin-provisioned disk grows a SCSI reservation takes place because of meta data changes. As you can imagine an 8MB blocksize will decrease the amount of meta data changes needed, which means less SCSI reservations. Less SCSI reservations equals better performance in my book.

For the current VI3 environments, besides VDI, I hardly have any customers using thin provisioned vmdk’s. But with the upcoming version of ESX/vCenter this is likely to change because the GUI will make it possible to create thin provisioned vmdk’s. Not only during the creation of vmdk’s will thin provisioned disks be an option, but also when you initiate a Storage VMotion you will have the option to migrate to a thin provisioned disk. It’s more than likely that thin provisioned disks will become a standard in most environments to reduce the storage costs. If it does, remember that when a thin provisioned disk grows a SCSI reservation takes place and less reservations is definitely beneficial for the stability and performance of your environment.

mbrscan, mbralign and RCU

A while back I wrote an article on checking your disk alignment and even changing the disk alignment from the service console. Since then a lot of people asked me for the exact link, because I don’t have a now.NetApp.com account I wasn’t able to provide it. Today I received an email from the developer, Eric Forgette, with a link to a community article which contains links to both tools, mbralign and mbrscan.

Eric is also the one who developed RCU(Rapid Cloning Utilities). I just watched the demo video on youtube. In short: It’s a vCenter pluging which enables you to deploy hundreds of VDI desktops by utilizing the capabilities of the array. Keith Aasen wrote a blog article on this plugin which has some more details. I guess with the vStorage API coming up we can expect more vendors to add storage capabilities to the vCenter GUI, think snapshots / clones and more…

Pluggable Storage Architecture, exploring the next version of ESX/vCenter

The next version of ESX has a totally different architecture for storage. The new architecture is called “Pluggable Storage Architecture”. For my own understanding I wanted to write down how this actually works and what all the different abbreviations/acronyms mean:

  • PSA = Pluggable Storage Architecture
  • NMP = Native Multipathing
  • MPP = Multipathing Plugin
  • PSP = Path Selection Plugin
  • SATP = Storage Array Type Plugin

At the top level we have “Pluggable Storage Architecture”. This is just the name of the new concept, but it’s a well chosen name cause that’s what it is… a new storage architecture that uses plugins. Let’s start with the native VMware plugins. [Read more...]