vSAN 6.x cluster shut down and power on procedures

Shutting down the vSAN 6.x cluster

To shut down the vSAN cluster:

1. Shut down all virtual machines running on the vSAN Cluster.
   
   Note:The vCenter Server virtual machine must be shut down at the end.
   
   
2. Note the host that your vCenter Server virtual machine resides on. 
   
   Note: VMware recommends to migrate the vCenter Server virtual machine to the first ESXi host, so you can easily find the virtual machine when powering on your vSAN cluster again.
   
   
3. Ensure that there are no vSAN components currently resynching. For more information, see the Monitor the Resynchronization Tasks in the Virtual SAN Cluster section in the Administering VMware Virtual SAN.
4. Shut down the vCenter Server virtual machine. This makes the vSphere Web Client unavailable.
5. Connect to the ESXi host shell. For more information, see  Using ESXi Shell in ESXi 5.x and 6.0 (2004746).
6. Place all ESXi hosts into Maintenance Mode. This operation must be done using one of the CLI methods that supports setting the vSAN mode when entering Maintenance Mode. You can either do this by logging directly in to the ESXi Shell and running the ESXCLI command locally or you can invoke this operation on a remote system using ESXCLI.
7. Run this ESXCLI command and ensure that the No Action option is selected when you enter Maintenance Mode:
   
   # esxcli system maintenanceMode set -e true -m noAction
   
   
8. Shut down all ESXi hosts. You can log in to each ESXi hosts using either the vSphere Client or the ESXi shell. You can also perform this operation remotely using a vSphere API, such as PowerCLI.

Powering on the vSAN 6.x cluster

To power on your vSAN cluster:

1. Boot up the ESXi hosts through remote console session or physically.
2. Connect to the shell of each ESXi host and run this command to exit maintenance mode:
   
   # esxcli system maintenanceMode set -e false
   
   
3. Locate your vCenter virtual machine and power it on using a vSphere client connection directly to the host.
4. Using the vSphere Client, connect to the ESXi host that contains your vCenter virtual machine. Power on your vCenter Server
   
   Note: This should be on the first ESXi host, If you moved this virtual machine to that host in step 2 of the shut down procedure.
   
   
5. Connect to your vCenter Server using the vSphere Web Client.
   
   Note: It may take a few minutes for vCenter Server to become available again
   
   
6. Do a quick health check on the vSAN cluster. Check for network partitions and resyncing components. For more information, see the Monitoring Virtual SAN section of the Administering VMware Virtual SAN.
7. Power on the remaining virtual machines in the vSAN cluster.

Power off a Virtual SAN Cluster

Power off a Virtual SAN Cluster

Prerequisites

If the vCenter Server VM is running on the Virtual SAN cluster, migrate the VM to the first host, or record the host where it is currently running.

Procedure

1	Power off all virtual machines that are running on the Virtual SAN cluster. The vCenter Server virtual machine must be powered off last.
2	Place all ESXi hosts that compose the cluster in maintenance mode. Run the esxcli command to set the Virtual SAN mode for entering the maintenance state. esxcli system maintenanceMode set -e true -m noAction
3	Power off the ESXi hosts.

Power off a Virtual SAN Cluster

Power off a Virtual SAN Cluster

Prerequisites

If the vCenter Server VM is running on the Virtual SAN cluster, migrate the VM to the first host, or record the host where it is currently running.

Procedure

1	Power off all virtual machines that are running on the Virtual SAN cluster. The vCenter Server virtual machine must be powered off last.
2	Place all ESXi hosts that compose the cluster in maintenance mode. Run the esxcli command to set the Virtual SAN mode for entering the maintenance state. esxcli system maintenanceMode set -e true -m noAction
3	Power off the ESXi hosts.

Power off a Virtual SAN Cluster

Power off a Virtual SAN Cluster

Prerequisites

If the vCenter Server VM is running on the Virtual SAN cluster, migrate the VM to the first host, or record the host where it is currently running.

Procedure

1	Power off all virtual machines that are running on the Virtual SAN cluster. The vCenter Server virtual machine must be powered off last.
2	Place all ESXi hosts that compose the cluster in maintenance mode. Run the esxcli command to set the Virtual SAN mode for entering the maintenance state. esxcli system maintenanceMode set -e true -m noAction
3	Power off the ESXi hosts.

Power off a Virtual SAN Cluster

Power off a Virtual SAN Cluster

Prerequisites

If the vCenter Server VM is running on the Virtual SAN cluster, migrate the VM to the first host, or record the host where it is currently running.

Procedure

1	Power off all virtual machines that are running on the Virtual SAN cluster. The vCenter Server virtual machine must be powered off last.
2	Place all ESXi hosts that compose the cluster in maintenance mode. Run the esxcli command to set the Virtual SAN mode for entering the maintenance state. esxcli system maintenanceMode set -e true -m noAction
3	Power off the ESXi hosts.

vSAN troubleshooting Commands

RVC login

localhost:~ #rvc

localhost:~ #domain\user@localhost

Disk Component Resync

Show component resync status

vsan.resync_dashboard .

Show all disk status (used/reserved, disk health, disk version)

vsan.disks_stats .

Disk Rebalance

Start Rebalance disks

vsan.proactive_rebalance --start --time-span 86400 --variance-threshold 0.30 --time-threshold 1800 --rate-threshold 100000 <cluster path>

Stop Rebalance disks

vsan.proactive_rebalance --stop <cluster path>

Check Rebalance status

vsan.proactive_rebalance_info /localhost/SouthEast/computers/Raleigh

vsan.resync_dashboard /localhost/SouthEast/computers/Raleigh

Cluster

Remove host or witness from fault domain

esxcli vsan cluster leave

Troubleshoot

esxcli vsan cluster get

vsan.check_state .

vsan.disks_info <host path>

Stress Test

/localhost/SouthCentral/computers/Houston> vsan.health.cluster_load_test_run -r houston_stress -t "Stress test" -d 28800 ./

Check vSAN upgrade status

vsan.upgrade_status -r 60 /localhost/VSAN-DC/computers/VSAN-Cluster/ 

Remove a host from vSAN cluster

1. Run 'esxcli vsan cluster get' and note the number of hosts it sees in the cluster.
2. Place host in maintenance mode and select full data migration option. 3.3.
3. Remove the disk group.
4. Take it out of the cluster.
5. Run 'esxcli vsan cluster get' again and note the number of hosts it sees in the cluster. Should be one less.