Operational Defect Database
BugZero found this defect 20 days ago.
Data sources
All data on this page is proprietary to BugZero® or gathered from public sources
Hewlett Packard Enterprise | a00139083en_us
Advisory: HPE SimpliVity – After Upgrading to OmniStack 5.0.0 and Before Committing, SVTFS May Unexpectedly Stop Responding and Not Restart When Using StoreOnce for Backups
Last update date:
4/30/2024
Affected products:
SimpliVity Omnistack for HPE
Affected releases:
No affected releases provided.
Fixed releases:
No fixed releases provided.
Description:
Info
In some HPE SimpliVity clusters where StoreOnce backups are used, there may be an issue where SVTFS services will not start after upgrading Omnistack to version 5.0.0, but before committing the upgrade. The error message "Huge alloc mmap failed" can be observed in the svtfs.log.
Scope
SimpliVity Nodes upgrading to OmniStack version 5.0.0, but still uncommitted.
Resolution
If this issue has already occurred after upgrading to the HPE SimpliVity 5.0.0 version, contact HPE SimpliVity support . Before Upgrading to HPE SimpliVity 5.0.0 Proceed with the following steps using either the CLI or the vSphere Client graphical UI: Suspend policy-based backup activities destined to StoreOnce external store. GUI: Right-click on the cluster of interest > All HPE SimpliVity Actions > Suspend Policy-Based Backups > Click Suspend. Repeat the same with other clusters, if required. CLI: Use the " svt-policy-suspend " command with appropriate arguments based on the scope of the upgrade operation - " omnicube " or " cluster " or " all ". Repeat the same with other nodes or clusters, if required. Verify that no backups are currently in progress to StoreOnce, i.e., backups with status such as - "NEW", "QUEUED", "REBUILDING", "SAVING". Either wait for these to complete and their status to change to "PROTECTED", or cancel/delete the backups not in a "PROTECTED" state. GUI: Select cluster > Configure (tab) > HPE SimpliVity/External Storage > Click HPE StoreOnce Catalyst > Search Backups > Add Filter, Status = NEW", "QUEUED", "REBUILDING", "SAVING" > Click Search > All of which may selected for deletion, with "Delete Backups" under BACKUP ACTIONS CLI: Use the command " svt-backup-show --status new,queued,rebuilding,saving --backup-store-type storeonceonprem ", to list the StoreOnce backups of interest. Use the commands " svt-backup-cancel " or " svt-backup-delete ", with appropriate arguments to cancel or delete the backups, respectively. The StoreOnce appliance can be powered off if deemed acceptable, such as in the case of a federation-wide upgrade. Alternatively, it can be isolated from the identified select individual SimpliVity nodes by appropriately modifying the firewall rules. Start the operations associated with upgrading to the HPE SimpliVity 5.0.0 version. Once all nodes in the cluster have been successfully upgraded, proceed with committing the upgrade operation. Power on the StoreOnce appliance or alternatively, revert the firewall rules to their original state. Resume the policy-based backup activities, by following the same method as was used for suspending backups. NOTE: It is also worth considering that a thorough review and analysis of the configured StoreOnce backup policies, rules, frequencies, and schedules may help determine the ideal maintenance window for the 5.0.0 upgrade operation. By identifying a period during which no StoreOnce-related operations are scheduled, the upgrade will complete successfully within this timeframe and committed before any StoreOnce operations are generated. This proactive approach may eliminate the need for the prevention steps outlined above. NOTE: Another symptom of the same issue is that after successfully upgrading to version 5.0.0 and before committing the upgrade, StoreOnce operations may not complete and stay in a "QUEUED" state, despite SimpliVity remaining fully functional. This problem manifests with the same failure message as described earlier. Committing the upgrade operation is expected to resolve this issue. RECEIVE PROACTIVE UPDATES : Receive support alerts (such as Customer Advisories), as well as updates on drivers, software, firmware, and customer replaceable components, proactively in your e-mail through HPE Support Alerts. Sign up for Support Alerts at the following URL: HPE Email Preference Center. NAVIGATION TIP: For hints on navigating HPE.com to locate the latest drivers, patches and other support software downloads, refer to the Navigation Tips document. SEARCH TIP: For hints on locating similar documents on HPE.com, refer to the Search Tips document.
