• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

Yellow Bricks

by Duncan Epping

  • Home
  • ESXTOP
  • Stickers/Shirts
  • Privacy Policy
  • About
  • Show Search
Hide Search

Which vSAN policy changes will trigger a rebuild?

Duncan Epping · Nov 10, 2020 ·

A couple of years ago I did a VMworld session with Cormac and we discussed the top things everyone should know about vSAN. One of the items discussed was which policy changes would trigger a rebuild. We tested the various situations and documented them. Two weeks ago a question around this was asked on a VMware internal Slack channel so I shared our findings. Considering it is already a few years ago, I wanted to make sure that our documented findings were still valid, so I redid the tests.

Now before I provide a table with the findings, I just want to explain what I tested, what I did is I created a VM with a default policy. I dumped a bunch of random data on the two VMDKs attached to the VM, and I then changed the policy of the VM while the VM is running. After changing the policy I verified through the command-line, and UI, if a rebuild of the objects was occurring or not. In some cases a policy change does not require a rebuild, while in other cases it does. This, of course, depends on what is being changed within the policy, and what that means for the objects associated with the policy. Hopefully, you will find the below table useful.

 

FromToResync
RAID-1RAID-1 with higher FTTYes
RAID-1RAID-1 with lower FTTNo
RAID-1RAID-5/6Yes
RAID-5/6RAID-1Yes
RAID-5RAID-6Yes
RAID-6RAID-5Yes
Stripe width 1Stripe width increase by 1 (or more)Yes
Stripe width xStripe width decrease by 1 (or more)Yes
Space Reservation 0Increase to larger than 0No
Space Reservation >= 1Increase by 1 (or more)No
Space reservation > 0Decrease to 0No
Read Cache 0Increase to larger than 0No
Read Cache >= 1Increase by 1 (or more)No
Read Cache >= 1Decrease by 1 (or more)No
Checksum enabledChecksum disabledNo
Checksum disabledChecksum enabledYes

Related

Server 7.0, 7.0 u1, spbm, vsan

Reader Interactions

Comments

  1. James Doyle says

    10 November, 2020 at 15:13

    Hi Duncan,

    Good post and very pertinent information.

    By rebuild, though, do you mean resync? From my understanding, increasing a RAID-1 FTT value will trigger a resync operation, but not a rebuild. When you increase FTT value, additional mirrors are added to the existing RAID tree, with data copied from the existing mirrors (i.e. a resync). However, the original mirrors are not removed at the end of the process. The only additional capacity that is required for this operation is the capacity for the extra mirror.

    However, a change from RAID-1 to a RAID-5/6 layout requires that an entirely new RAID structure to be built (a rebuild). This means that the original RAID tree remains in place and are marked as transient data, while data is copied to the new RAID tree structure. At the end of the process, the original RAID tree is removed. This means that you need additional capacity for a complete new RAID structure in place before the operation is started. This has a significant impact if you plan to perform this on multiple objects at the same time.

    I think it might be a good idea to update the table to show which operations require transient capacity during the rebuild, as well as operations which create resync traffic on the backend.

    • Duncan Epping says

      10 November, 2020 at 16:10

      Ah yes, I should have fixed the table with “Resync” instead of rebuild indeed. And I was planning on having a row with an explanation around what happens, but didn’t get to it.

Primary Sidebar

About the author

Duncan Epping is a Chief Technologist in the Office of CTO of the Cloud Platform BU at VMware. He is a VCDX (# 007), the author of the "vSAN Deep Dive", the “vSphere Clustering Technical Deep Dive” series, and the host of the "Unexplored Territory" podcast.

Upcoming Events

May 24th – VMUG Poland
June 1st – VMUG Belgium

Recommended Reads

Sponsors

Want to support Yellow-Bricks? Buy an advert!

Advertisements

Copyright Yellow-Bricks.com © 2023 · Log in