Summary
Using the "flashgrid-diags upload-all" command to upload flashgrid diagnostics logs may result in "AccessDenied" error code and a failed upload of the file.
Symptoms
When executing "flashgrid-diags upload-all" or "flashgrid-diags upload-files" command it shows an error similar to the below:
[root@database_node01 ~]# flashgrid-diags upload-all
FlashGrid Diagnostics 23.11.64.77575 ###
License: Active, Marketplace
Licensee: Company
Support plan: 24x7
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Processing nodes: quorum_node01, database_node01, database_node02 ...
quorum_node01 OK
database_node01 OK
database_node02 OK
Packing files ...
<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>Invalid according to Policy: Policy expired.</Message><RequestId>MSXXXXXXXXXXXXXX</RequestId><HostId>XXXXXXXXX=</HostId></Error>Uploading /tmp/tmpsqt1rn61 as flashgrid-cluster-diags-cluster1_20240314031306.tar.gz ... OK
[root@database_node01 ~]#
The error appears at the end. The upload attempt is not successful.
Affected Products
FlashGrid Cluster on AWS/Azure/GCP
FlashGrid Storage Fabric (on-premises)
Affected Versions
Affected flashgrid-diags RPM versions:
- 24.1.x if lower than 24.1.78.
- 23.11.x if lower than 23.11.139.
- 23.9.x if lower than 23.9.200.
- 23.6.x if lower than 23.6.292.
- 23.4.x if lower than 23.4.353.
- 23.2.x if lower than 23.2.412.
- 22.12.x if lower than 22.12.474.
- 22.9.x if lower than 22.9.565.
- 22.6.x if lower than 22.6.657.
- 22.3.x or lower.
To confirm version of installed flashgrid-diags RPM run:
rpm -q flashgrid-diags
Root Cause
Expired access policy
Resolution
Apply full FlashGrid software update with the latest node_update package of version 24.01 or newer.
If the full software update is not practical then:
- For flashgrid-diags versions 22.06 or newer: update the flashgrid-diags RPM with a hotfix of the same version. Request the hotfix RPM from FlashGrid Support.
- For flashgrid-diags versions 22.03 or earlier: modify DIAGS_UPLOAD parameter in /etc/flashgrid_debug_env on each node of the cluster. The new value:
DIAGS_UPLOAD=ewogICAgJ3VybCc6ICdodHRwczovL2ZsYXNoZ3JpZC1zdXBwb3J0LnMzLmFtYXpvbmF3cy5jb20nLAogICAgJ21hbnVhbCc6ICcvdXBsb2FkX2Zvcm1zL2ViODU2OTJmLTJiMDYtNGUzNy04ODVhLWFiNWM1Njc5MjJmOS5odG1sJywKICAgICdmb3JtJzogKCdrZXk9dXBsb2Fkcy9uZXdfdXBsb2Fkcy8lKGZpbGVuYW1lKXMnLAogICAgICAgICAgICAgJ0FXU0FjY2Vzc0tleUlkPUFLSUFJVlRTUldEUjQ1V0pNQVlBJywKICAgICAgICAgICAgICdhY2w9cHJpdmF0ZScsCiAgICAgICAgICAgICAneC1hbXotc2VydmVyLXNpZGUtZW5jcnlwdGlvbj1BRVMyNTYnLAogICAgICAgICAgICAgJ3BvbGljeT1leUpsZUhCcGNtRjBhVzl1SWpvZ0lqSXdNekF0TVRFdE1UUlVNREE2TURBNk1EQmFJaXdLSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSW1OdmJtUnBkR2x2Ym5NaU9pQmJDaUFnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdleUFpWW5WamEyVjBJaUE2SUNKbWJHRnphR2R5YVdRdGMzVndjRzl5ZENJZ2ZTd0tJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQmJJQ0p6ZEdGeWRITXRkMmwwYUNJc0lDSWthMlY1SWl3Z0luVndiRzloWkhNdmJtVjNYM1Z3Ykc5aFpITXZJbDBzQ2lBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnZXlBaVlXTnNJaUE2SUNKd2NtbDJZWFJsSW4wc0NpQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ2V5QWllQzFoYlhvdGMyVnlkbVZ5TFhOcFpHVXRaVzVqY25sd2RHbHZiaUlnT2lBaVFVVlRNalUySWlCOUxBb2dJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lGc2dJbU52Ym5SbGJuUXRiR1Z1WjNSb0xYSmhibWRsSWl3Z01Dd2dOVE0yT0Rjd09URXlNQ0JkQ2lBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJRjBLSUNBZ0lDQWdJQ0FnSUNBZ0lDQWdJQ0FnZlE9PScsCiAgICAgICAgICAgICAnc2lnbmF0dXJlPVAxZlRMLzhpYnJYVnR1UzY1a21GL2diMTVpST0nKQp9Cg==
Workaround:
Use "flashgrid-diags collect-all" command and upload files using curl (see instructions) or using browser through the Secure Upload Form.