Operational Defect Database
BugZero found this defect 138 days ago.
Data sources
All data on this page is proprietary to BugZero® or gathered from public sources
Hewlett Packard Enterprise | a00121027en_us
Advisory: (Revision) HPE Synergy 480 Gen10 Compute Modules and ConvergedSystem 750 - CPLD Update Required to Prevent Unexpected Power Off of Server
Last update date:
1/3/2024
Affected products:
HPE ConvergedSystem 750 for Virtualization
HPE Synergy 480 Gen10 Compute Module
Affected releases:
No affected releases provided.
Fixed releases:
No fixed releases provided.
Description:
Info
Document Version Release Date Details 6 January 3, 2024 Added a note to the scope section 5 August 31, 2022 Updated CPLD version number in Option 2 of the Resolution 4 May 12, 2022 Added instructions to deploy using HPE OneView 3 March 23, 2022 Added an optional download link for the example PowerShell script CPLD-fix-for-HPE-Synergy-480-Gen10.ps1 2 March 11, 2022 Updated to add CS750 Platform 1 February 15, 2022 Original document release On any HPE Synergy 480 Gen10 Compute Modules or HPE ConvergedSystem 750, the system may power off abruptly during runtime and require an E-fuse reset to restart it. A similar failure may also occur if the server is in Standby mode, which will prevent the server from powering on. When this occurs, the IML will display a message similar to the following: "Server Critical Fault (Service Information: Runtime Fault, System Board, AUX/Main EFUSE (04h))"
Scope
Any HPE ConvergedSystem 750 or any of the following HPE Synergy 480 Gen10 Compute Modules in which the fourth through sixth digits of the serial number are in the range of 112 through 208 (inclusive): NOTE: Even if the Synergy module is NOT in the affected range, but is experiencing similar symptoms, it is recommended to attempt the CPLD upgrade outlined in the resolution section below, as this may solve the same issue for any modules not in the above range as well. For example, serial number MXQ 810 0M7D is not affected because the digits 810 are outside the affected range. Serial number MXQ 121 0M7D is affected because the digits 121 are within the affected range. Compute Module serial numbers are displayed in iLO and HPE OneView as shown in the following examples:
Resolution
This advisory provides three alternate procedures for updating the CPLD firmware on HPE Synergy 480 Gen10 compute modules. The first option uses HPE OneView 6.6 together with HPE SUT. The second option uses HPE OneView with the iLO UI. The third option uses the RESTful interface tool. Choose the option which best meets your requirements. Option 1:CPLD Deployment Option Using HPE OneView Updating HPE Synergy compute module CPLD using HPE OneView requires at least HPE OneView version 6.6, HPE SUT version 2.9.0, and HPE iLO 5 version 2.44. Compute modules running iLO 5 version prior to 2.44 must use the HPE iLO Restful Interface Tool method as described in option 3. HPE OneView 6.6 may be used in combination with Synergy Service Pack (SSP) 2022.02.01, 2021.11.01, or 2021.05.04 to update compute module CPLD. HPE recommends the compute modules be fully updated to one of the supported SPPs prior to updating the CPLD. The compute module CPLD update may be applied by creating either an HPE OneView custom firmware bundle or by creating a custom SSP ISO file, both methods are described in the HPE Synergy Hotfixes document https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=a00114984en_us HPE Synergy SSP 2021.05.04 includes a prior version of HPE SUT and must be updated to version 2.9.0 by creating a custom SSP ISO. The set of packages to include for HPE SUT 2.9.0 are: ESXi 6.5 https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_aa489937b5e9421caf467227ab ESXi 6.7 https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_9a21f1dbcd59443da4c60ffeb1 ESXi 7.0 https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_7f852b2dec7e4b139dd76bf7f6 Windows x64 https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_8a0b3156be774e96a56aea3bb1 Linux x64 https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_1313ed49b04f414f901f3e94a3 The set of CPLD packages that must be included in the custom SSP ISO (all OS packages should be included) for HPE SY480 Gen10: ESXi https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX-82b53f00662944558a0a7dc191 Windows x64 https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_06ca00d57f6c4483b8bf4c97df Linux x64 https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_c7278135c98c4451bd0cc23fbc Follow the instructions in the HPE Synergy Hotfixes document and apply the custom baseline or custom SSP to your compute modules as required. Option 2: PREPARATIONS PRIOR TO CPLD FLASH Using iLO: IMPORTANT: A prerequisite of iLO 5 firmware version 2.33 (or later) is required before applying the firmware. The System Programmable Logic Device (CPLD) Version "0F" (or later) is REQUIRED for HPE Synergy 480 Gen10 Compute Modules as a permanent fix for the above AUX/MAIN EFUSE error. All servers should be powered on at either RBSU or the server OS prior to the CPLD flash. However, if you have any servers that are unable to power on, follow the instructions for "CPLD DEPLOYMENT OPTION FOR INDIVIDUAL SERVERS" and note the additional step for those servers. When updating servers, be aware that the server will be rebooted, and a maintenance window is required for the servers being flashed. Special care should be taken when updating clusters, VM farms, and other business applications so that appropriate downtime and capacity evaluations are understood. Download the firmware package from here Optionally, download the example PowerShell script CPLD-fix-for-HPE-Synergy-480-Gen10.ps1 from the HPE Github . You can revise this script for your environment as an alternative to automate the manual CPLD installation process described in this advisory. CPLD DEPLOYMENT USING iLO FOR INDIVIDUAL SERVERS: HPE iLO 5 version 2.31 or later: NOTE: If a server will not power on but has a functioning iLO, then the CPLD can be flashed using the following steps: 1. Navigate to the selected server using either HPE OneView or the iLO web interface directly with administrative credentials. 2. Navigate to "Firmware & OS Software": 3. Click on "Update Firmware": 4. Select Local file Location and then click the "Choose File" button (Windows will pop-up to select the desired file ("CPLD_SY480_Gen10_v0F0F.fwpkg") and click the "Open" button: 5. Click the "Flash" button: 6. After the flash is completed, reboot the server. NOTE: If the server is unable to power on, then reset the iLO by navigating to the Information page and the Diagnostics tab and click the Reset button as shown: During the reboot or iLO reset, an auxiliary power-cycle will occur. In HPE OneView, monitor the server status on the Activity page. During the auxiliary power-cycle, the servers will be removed from the HPE OneView inventory and then returned once the power-cycle is complete. It is possible that HPE OneView may not appear to remove and add the server. This can occur if the iLO 5 is resetting when HPE OneView attempted the removal and add. Follow the verification steps below to confirm that the CPLD update has completed successfully. If a server does not automatically power on, power it on. Wait until the server completes POST. IMPORTANT: do not proceed until POST is complete. 7. For verification after the server powers up and boots into the OS, Navigate to "Firmware & OS" -> "Firmware" page and verify the System Programmable Logic Device version as shown below: NOTE: For the CPLD update to take effect, an auxiliary power-cycle is required and is included in the steps above. OPTION 3: CPLD DEPLOYMENT FOR MULTIPLE SERVERS - HPE iLO 5 version 2.31 or later Using the RESTful Interface Tool . RESTful Interface Tool When using the scripting method with the RESTful Interface Tool, create or collect all iLO administrator credentials and iLO IP addresses. In addition, when updating servers, be aware that the server will be rebooted, and a maintenance window is required for the servers being flashed. Special care should be taken when updating clusters, VM farms, and other business applications so that appropriate downtime and capacity evaluations are understood. In addition, identify a client server from which the RESTful Interface Tool for Windows can be run with management network access to the HPE Synergy compute module iLOs: 1. Identify the location of the RESTful Interface Tool that is installed in the system. 2. Copy the CPLD firmware package to a local directory. 3. Execute the following command, targeting each server to be updated using the RESTful Interface Tool location and the CPLD firmware package file location. Use the HPE iLO IP and administrator credentials: "C:\Program Files\Hewlett Packard Enterprise\RESTful Interface Tool\ilorest" flashfwpkg "D:\CPLD_SY480_Gen10_v0F0F.fwpkg" --url <iLO IP> -u <administrator> -p <password> For Example: Documentation for the Restful Interface Tool is located here https://hewlettpackard.github.io/python-redfish-utility/#flashfwpkg-command After the flash iscompleted, reboot the server using the following command. "C:\Program Files\Hewlett Packard Enterprise\RESTful Interface Tool\ilorest" reboot -url <iLO IP> -u <administrator> -p <password> During the reboot, an auxiliary power-cycle will occur. In HPE OneView, monitor the server status on the Activity page. During the auxiliary power-cycle, the servers will be removed from the HPE OneView inventory and then returned once the power-cycle is complete. It is possible that HPE OneView may not appear to remove and add the server. This can occur if the iLO 5 is resetting when HPE OneView attempted the removal and add. Follow the verification steps below to confirm that the CPLD update has completed successfully.. If the servers do not automatically power on, power them on. Wait until the servers complete POST. In the HPE OneView Activity page, each server will go through a Remove and Add cycle as shown here: IMPORTANT: DO NOT proceed until POST is complete. For verification of multiple servers, in HPE OneView refresh the enclosure and then navigate to the HPE OneView report for "Server firmware inventory" or inspect each Server Hardware page Firmware & Drivers tab. For verification of an individual server, navigate to the iLO web interface "Firmware & OS" -> "Firmware" page and verify the System Programmable Device version as shown below. NOTE: For the CPLD update to take effect, an auxiliary power-cycle is required and is included in the steps above.
