Note: Removing a node from a cluster is supported only in configurations with separate "database-only" and "storage-only" nodes. It is not supported with standard 2-node or 3-node clusters that have data disks attached to database nodes.
Before You Start
- FlashGrid Cluster software must be on version 24.1.108 or newer
- All cluster nodes must be online
- Cluster status reported by flashgrid-cluster command must be Good
- Further in this article the hostname of the storage node being removed will be referred to as <target hostname>
Steps for Removing a Storage Node
1) Drop the target VM disks from ASM
To drop disks belonging to the storage node being removed, execute the specified commands on the first database node.
- Generate "drop" statements for the disks that are attached to the node that needs to be removed:
# su - grid $ sqlplus / as sysasm SQL> SELECT 'alter diskgroup ' || group_name || ' drop disk ' || list || ' rebalance wait;' AS "Drop statement" FROM(SELECT group_name ,listagg(disk_name, ', ') within group (order by disk_name) list FROM(SELECT g.name AS group_name ,d.name AS disk_name FROM v$asm_diskgroup g, v$asm_disk d WHERE g.group_number=d.group_number AND d.name like '<uppercase target hostname>%') group by group_name );
Drop statement -------------------------------------------------------------------------------- alter diskgroup DATA drop disk <target hostname>$<LUN#>, <target hostname>$<LUN#>, <target hostname>$<LUN#> rebalance wait; alter diskgroup GRID drop disk <target hostname>$<LUN#> rebalance wait;
- Run drop statements, generated above, from sqlplus as grid user
- Ensure that the disks, attached to the node that needs to be removed, are not part of any DiskGroup by verifying that the corresponding column has the N/A value, run as fg user
$ flashgrid-cluster drives
2) Delete the target storage node from FlashGrid configuration
Connect to any database node and run:
# flashgrid-remove-node-from-cluster <target hostname>
3) Confirm that the node was removed successfully
- Wait for one minute
- As user fg make sure the cluster status is Good. All diskgroups have zero offline disks and Resync = No
$ flashgrid-cluster
If the removed node still appears in the node list and the status is Inaccessible, wait for some time and retry the command. - Ensure that the command completes without errors and no disks are related to the removed node
$ flashgrid-node
4) After all the steps above are complete, you can delete the target VM.
5) Upload diags to FlashGrid support