Yellow Bricks

by Duncan Epping

Data Recovery

Startup intro: SaaS-based backup solution Clumio

· · 2 Comments

Last week I saw an update from one of the Clumio founders on twitter. It reminded me that I had promised to take a look at their product. This week I had a meeting set up with Clumio and we went over their product and how to configure it briefly. Clumio is a SaaS based backup solution that was founded in 2017 by former PernixData, Nutanix, EMC folks. The three founders are Poojan Kumar, Kaustubh Patil, and Woon Jung, and those three you may remember from PernixData. One thing to point out is that they had 3 rounds of funding (~190 million dollars) so far and they came out of stealth around VMworld 2019. Coincidentally they won the Gold award for Best of VMworld in the data protection category, and best of show for the entire show, not bad for a first VMworld. I guess that I have to point out that although I would classify them as backup/recovery today, they are adding new functionality weekly and “backup/recovery” is probably not a fair category, data protection is more appropriate and it would not surprise me if that evolves to data management and protection over time. If you are not a fan of reading, simply head over to my youtube video on Clumio, otherwise, just continue below.

So how does it work conceptually? Well they basically have a SaaS solution, but you will need to install an OVA (they call it a cloud connector) in your environment to connect to the SaaS platform for VMware on-premises and VMware Cloud on AWS. When you connect AWS EBS they use a cloud formation template. This cloud connector is a 4 vCPU/8GB virtual machine that then needs the ability to connect to “the outside world” of course. The Cloud Connector is stateless and requires no updates. You can run this Cloud Connector appliance in multiple clusters, on-prem, or in VMware Cloud on AWS and once they are registered you will see those data sources in your portal.  This is nice as you can see all your data sources across public and private clouds in one single pane of glass. You will have the ability to define “backup schemes” by creating policies. These policies can of course then be associated with objects. These objects can be VMs, Clusters and even vCenter Server instances. This means that if you assign a policy to vCenter Server that every new VM created will inherit the policy automatically. You may wonder, where is your data stored? Your data is stored in S3 buckets that are part of the Clumio SaaS-based platform. Customers are isolated from each other, they will have their own dedicated S3 buckets, and these buckets are created and maintained by Clumio, you as a customer only interact with Clumio! [Read more…] about Startup intro: SaaS-based backup solution Clumio

My recommended sessions for VMworld Europe 2019!

· · 2 Comments

I created a list of recommended sessions for VMworld US, so I figured I would do the same for VMworld Europe. I am limiting it to 15 sessions for Europe and removed some of the sessions I had listed for the US and added some others for EMEA. I personally have 2 sessions scheduled at the moment, and they filled up rather fast in the US, so make sure to register early: HCI1870BE and HBI2186BE.

Okay, here’s my top 15 list, please note that this is pretty much in random order:

  • 60 Minutes of Non-Uniform Memory Architecture [HBI2278BE] by Frank Denneman
    This session got raving reviews in the US, I attended it personally and I can highly recommend it. That is if you think your brain can handle it… it is deep!
  • PowerCLI Deep Dive [HBI1729BE] by Luc Dekens and Kyle Ruddy
    What can I say? These guys speak PowerCLI. They know it inside out, just make sure you are ready to go deep!
  • VMware Cloud Foundation Deep Dive [HBI2044BE] by Jason Shaw
    I am a big fan of full-stack HCI solutions, and in this session, Jason talks about what VMware Cloud Foundation brings to the table.
  • HCI Management: Current and Future [HCI1207BE] by JunChi Zhang and Christian Dickmann
    Every year these guys bring some really cool demos and they expect you to provide feedback at the end of the session. So if you want to have a chance to influence vSAN/vSphere, attend this one!
  • Project Pacific Technical Overview: Unifying vSphere and Kubernetes [HBI4500BE] by Michael West and Jared Rosoff
    There was a lot of buzz surrounding the announcement of Project Pacific. I managed to sit in one or two sessions in the US, and knowing Jared was the lead engineering on this project I suspect that this session may even go deeper than the ones I attended in the US.
  • The Virtually Speaking Podcast Live: The Future of Storage [HCI1894PE] by Pete Flecha, John Nicholson, and guests
    I was a guest on the US in this session, it was a lot of fun. A lively discussion, and great questions from the audience on top of that. Plus, it is amazing to see Pete Flecha do the intro and outro live, I always thought that was pre-recorded!
  • The Cloud Backbone Network: A Paradigm Shift in Corporate WAN [OCTO1911BE] by Israel Cidon
    I have seen a session on this topic by Israel at an internal conference and it was nothing short of mind-blowing. I would highly recommend attending this if you want to learn more about how we could potentially improve corporate WANs in the future by leveraging SD-WAN technology. Mind, this session is foreward looking!
  • Showcase Keynote: HCI – The Foundation for your Future-proof Infrastructure [HCI3551KE] by Cormac Hogan and John Gilmartin
    I presented this session in the US with John, Cormac will be presenting it in Europe with John. I am sure it will be filled with great demos once again, and I will definitely try to attend this one in person
  • Leveraging the Latest Server Technologies in vSphere [HBI2362BE] by Niels Hagoort
    This session wasn’t on my list for the US, but after watching the recording I feel it is worth attending in person! A good overview of what we are doing with the latest HW technologist in vSphere.
  • vSphere Virtual Volumes: Technical Deep Dive [HBI2853BE] by Jason Massae and Thiruvengada Govinda Thirumal
    The adoption of vVols is growing fast, and it is for a good reason. Jason and Thiruvengada will explain in-depth what vVols is and how it works, and of course what the benefits are of adopting it.
  • Tech Preview of Site Recovery Manager with Virtual Volumes [HCI2894BE] by Stefan Tsonev and Velina Krasteva
    The tech preview of SRM for vVols has been discussed various times, but in this session by Stefan and Velina it is also demonstrated. So if you are interested in disaster recovery solutions in combination with vVols then this is one to attend!
  • Meet the [ML] Driver of the Self-Driving Datacenter [MLA1904BE] by Jad El-Zein and Arun Annavarapu
    At VMworld US Project Magna was unveiled, VMware’s effort to deliver the self-driving datacenter. A very interesting concept, which is explained in this session by Jad and Arun. I’ve seen some of the work, and it has a lot of potential, highly recommend attending this session!
  • Technical Deep Dive on Cloud Native Storage 1.0 [HCI2763BE] by Cormac Hogan and Myles Gray
    Cormac and Myles are the Cloud Native experts in our business unit, and I can guarantee that this will be a great session filled with cool demos.
  • Optimizing vSAN for Performance [HCI1757BE] by Paudie ORiordan
    If anyone can explain how to optimize vSAN, how to do benchmarking, and what to avoid… it is Paudie. On top of that, he is a great speaker and you can basically ask him anything on the topic of storage. Must see!
  • Innovations in vMotion: Features, Performance, and Best Practices [HBI1421BE] by Sreekanth Setty and Arunachalam Ramanathan
    I watched this session in the US, it provides an excellent overview of the enhancements introduced for vMotion to improve vMotion (and switch over) times. They also talk about some enhancements coming in the near future. Very interesting stuff.

Scheduling opens up tomorrow (24th of September), so make sure to hit the portal early. I guarantee that many of the sessions above will be full in a matter of days. So don’t say I did not warn you in advance!

New book: VMware vSAN 6.7 U1 Deep Dive

· ·

Cormac Hogan and I have been working late nights and weekends over the past months to update our vSAN book material. Thanks Cormac, it was once again a pleasure working with you on this project! As you may know, we released two versions of a vSAN based book through VMware Press. The book was titled vSAN Essentials. As mentioned before, after restructuring and rewriting a lot of the content we felt that the title of the book didn’t match the content, so we decided to rebrand it to vSAN 6.7 U1 Deep Dive. After receiving very thorough reviews by Frank Denneman and Pete Koehler (Thanks guys!) we managed to complete it this week after we added a great foreword by our business unit’s SVP and General Manager, Yanbing Li.

Cormac and I decided to take the self-publishing route for this book, which allows us to set a great price for the ebook and enable the Amazon matchbook option, giving everyone who buys the paper version through Amazon the option to buy the e-book with a nice discount! As prices will vary based on location I am only going to list the USD prices. Please check your local Amazon website for localized prices. Oh, and before I forget, I would like to recommend buying the ebook flavor! Why? Well:

“On average, each printed book releases 8.85 pounds of carbon dioxide into the environment. Together, the newspaper and book-printing industries cut down 125 million trees per year and emit 44 million tons of CO2.”

We appreciate all support, but we prefer the cleanest option from an environmental stance, this is also the reason we priced the ebook a lot cheaper than the paper version. Anyway, here are the links to the US store, we hope you enjoy the content, and of course as always an Amazon review would be appreciated! Interestingly, it seems we already reached number 1 in the category Virtualization and the category Storage before this announcement, thanks everyone, we really appreciate it! (Please note, as an Amazon Associate I earn from below qualifying purchases.)

 

UPDATE:

It appears that some Amazon stores take a bit longer to index the content, so listing all the different versions below for the different stores that sell it:

VMworld Video: vSphere 6.7 Clustering Deep Dive

· ·

As all videos are posted for VMworld (and nicely listed by William), I figured I would share the session Frank Denneman and I presented. It ended up in the Top 10 Sessions on Monday, which is always a great honor. We had a lot of positive feedback and comments, thanks for that! Most importantly, it was a lot of fun again to be up on stage at VMworld talking about this content after 6 years of absence or so. For those who missed it, watch it here:

Also very much enjoyed the book signing session at the Rubrik booth with Niels and Frank. I believe Rubrik gave away around 1000 copies of the book. Hoping we can repeat this huge success in EMEA. But more on that later. If you haven’t picked up the book yet and won’t be at VMworld Europe, consider picking it up through Amazon, e-book is 14.95 USD only.


VMworld – VMware vSAN Announcements: vSAN 6.7 U1 and beta announced!

· ·

VMworld is the time for announcements, and of course for vSAN that is no different. This year we have 3 major announcements and they are the following:

  • VMware vSAN 6.7 U1
  • VMware vSAN Beta
  • VMware Cloud on AWS new features

So let’s look at each of these, first of all, VMware vSAN 6.7 U1. We are adding a bunch of new features, which I am sure you will appreciate. The first one is various VUM Updates, of which I feel the inclusion of Firmware Updates through VUM is the most significant one. For now, this is for the Dell HBA330 only, but soon other controllers will follow. On top of that there now also is support for custom ISO’s. VUM will recognize the vendor type and validate compliance and update accordingly when/if needed.

The other big thing we are adding os the “Cluster Quickstart wizard“. I have shown this at various sessions already, so some of you may be familiar with it. It basically is a single wizard that allows you to select the required services, add the hosts and configure the cluster. This includes the configuration of HA, DRS, vSAN and the network components needed to leverage these services. I recorded a quick demo that actually shows you what this looks like

One of the major features in my opinion that is introduced is UNMAP. Yes, unmap for vSAN. So as of 6.7 U1 we are now capable of unmapping blocks when the Guest OS sends an unmap/trim command. This is great as it will greatly enhance/improve space efficiency. Especially in environments where for instance large files or many files are deleted. You need to enable it, for now, through “rvc”. And you can do this as follows:

/localhost/VSAN-DC/computers/6.7 u1> vsan.unmap_support -e .

When you run the above command you should see the below response.

Unmap support is already disabled
6.7 u1: success
VMs need to be power cycled to apply the unmap setting
/localhost/VSAN-DC/computers/6.7 u1>

Pretty simple right? Does it really require the VM to be power cycled? Yes, it does, as during the power-on the Guest OS actually queries for the unmap capability, there’s no way for VMware to force that query without power cycling the VM unfortunately. So power it off, and power it on if you want to take advantage of unmap immediately.

There are a couple smaller enhancements that I wanted to sum up for those who have been waiting for it:

  • UI Option to change the “Object Repair Timer” value cluster-wide. This is the option which determines when vSAN starts repairing an object which has an absent component.
  • Mixed MTU support for vSAN Stretched Clusters (different MTU for Witness traffic then vSAN traffic)
  • Historical capacity reporting
  • VROps dashboards with vSAN stretched cluster awareness
  • Additional PowerCLI cmdlets
  • Enhanced support experience (Network diagnostic mode, specialized dashboards), you can find the below graphs under Monitor/vSAN/Support
  • Additional health checks (storage controllers firmware, unicast network performance test etc)

And last but not least, with vSAN Stretched we have the capability to protect data within a site. As of vSAN 6.7 U1 we also now have the ability to protect data within racks, it is however only available through an RPQ request. So if you need protection within a rack, contact GSS and file an RPQ.

Another announcement was around a vSAN Beta which is coming up. This vSAN Beta will have some great features, three though have been revealed:

  • Data Protection (Snapshot based)
  • File Services
  • Persistent Storage for Containers

I am not going to reveal anything about this, simply to avoid violating the NDA around this. Sign up for the Beta so you can find out more.

And then the last set of announcements was around functionality introduced for vSAN in VMware Cloud on AWS. Here there were two major announcements if you ask me. The first one is the ability to use Elastic Block Storage (EBS volumes) for vSAN. Meaning that in VMware Cloud on AWS you are no longer limited to the storage capacity physically available in the server, no you can now extend your cluster with capacity delivered through EBS. The second one is the availability of vSAN Encryption in VMware Cloud on AWS. This, from a security perspective, will be welcomed by many customers.

That was it, well… almost. This whole week many sessions will reveal various new potential features and futures. I aim to report on those when sitting in on those presentations, or potentially after VMworld.