Skip to main content
FlashGrid.io

Resizing database node VMs (FlashGrid Cluster on Azure)

  • Updated
  • Products: FlashGrid Cluster on Azure

Resizing database node VMs may be needed for performance or cost reasons. Resizing can be done for one node at a time without causing database downtime.

Preparation

Prior to resizing nodes, first confirm that your chosen instance type is supported by FlashGrid software. 

On the nodes that are to be resized, execute the following command to display a list of supported instance types:

$ flashgrid-clan-cfg show-supported-instance-types 
Detected Azure instance type: Standard_D8s_v5
Supported instance types:
Standard_D16ads_v5
Standard_D16as_v4
Standard_D16as_v5
[...]

You can use grep to find a particular instance type, i.e.

$ flashgrid-clan-cfg show-supported-instance-types | grep E48bs
Standard_E48bs_v5

If your chosen instance type is not shown in the output then it is not supported by the installed version of FlashGrid CLAN software. 

You can review Release Notes: Cloud Area Network software to determine if the instance type has been added in a newer release. To check which version you have installed, run:

$ rpm -qa flashgrid-clan
flashgrid-clan-21.8.292.58899.3a5ad336.release-1.el8.x86_64

For access to download a newer version of FlashGrid software, or to request a review of your resizing options, raise a support case with FlashGrid.

Resize Node

To resize database node VMs in a running cluster repeat the following steps on each database node, one node at a time

  1. Update SGA and PGA sizing parameters for the databases according to the new VM memory size

  2. Skip this step unless you have vm.nr_hugepages parameter in /etc/sysctl.conf manually configured. If you have it manually configured then update the parameters according to the new VM size. Note that starting with Storage Fabric 19.02 HugePages are configured automatically by default and manual change is not required.

  3. Make sure there are no other nodes that are in offline or re-syncing state. All disk groups must have zero offline disks and Resync = No:

    # flashgrid-cluster

  4. Stop all local database instances running on the node.

  5. Stop Oracle CRS on the node:

    # crsctl stop crs

  6. Stop the FlashGrid Storage Fabric services on the node:

    # flashgrid-node stop

  7. Stop the VM using Azure console

  8. Resize the VM using Azure console

  9. Start the VM using Azure console

  10. Wait until all disks are back online and resyncing operations complete on all disk groups. All disk groups must have zero offline disks and Resync = No.

    # flashgrid-cluster

  11. Start all database instances on the node

  12. Proceed to the next node

Troubleshooting

Unsupported instance type

If you have resized to an instance type that is unsupported by the current FlashGrid software installation, FlashGrid software will not start after the server is powered on:

# flashgrid-cluster
FlashGrid 21.11.23.45125 #xxxxxxxxxxxxxxxxxxxxxxxx
License: Active, Expires 2022-09-29
Licensee: Company_test
Support plan: Demo
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
FlashGrid service is not running on this node. To start the service:
$ sudo flashgrid-node start
================================================================================

 

A check of system services (journalctl -xe) shows that the instance type is not supported:

# journalctl -xe
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit flashgrid-clan.service has finished starting up.
--
-- The start-up result is done.
Aug 30 05:11:06 rac1 flashgrid-clan-daemon[2986]: 2022-08-30 05:11:06+0000 [-] Log opened.
Aug 30 05:11:06 rac1 flashgrid-clan-daemon[2986]: 2022-08-30 05:11:06+0000 [-] GCP API failed with code 404
Aug 30 05:11:06 rac1 flashgrid-clan-daemon[2986]: 2022-08-30 05:11:06+0000 [-] EC2 token fetch failed with code 400
Aug 30 05:11:06 rac1 flashgrid-clan-daemon[2986]: 2022-08-30 05:11:06+0000 [-] Detected Azure instance type: Standard_E8bds_v5
Aug 30 05:11:06 rac1 flashgrid-clan-daemon[2986]: 2022-08-30 05:11:06+0000 [-] Starting ebpf filter...
[...]
Aug 30 05:11:07 rac1 flashgrid-clan-daemon[2986]: builtins.Exception: Azure instance type 'Standard_E8bds_v5' is not supported!
Aug 30 05:11:07 rac1 flashgrid-clan-daemon[2986]: 2022-08-30 05:11:07+0000 [-] Main loop terminated.
Aug 30 05:11:07 rac1 flashgrid-clan-daemon[2986]: 2022-08-30 05:11:07+0000 [-] Exiting with code 1
Aug 30 05:11:07 rac1 systemd[1]: flashgrid-clan.service: main process exited, code=exited, status=1/FAILURE
Aug 30 05:11:07 rac1 systemd[1]: Unit flashgrid-clan.service entered failed state.
Aug 30 05:11:07 rac1 systemd[1]: flashgrid-clan.service failed.

 

Remediation options

  • Rollback to previous instance type, and review instructions at the top of this document to review supported instance types,
  • Run "flashgrid-clan-cfg show-supported-instance-types" to identify supported instance types, and re-size to one that is listed,
  • Review Release Notes: Cloud Area Network software to determine if the instance type has been added in a newer release.  If it has, you may be able to update the FlashGrid software in-place. Raise a ticket to FlashGrid Support requesting access to the newer release (the new release software can be installed, and node will require a reboot. The remaining nodes in the cluster should be upgraded before resizing any other nodes).