MI300X GPU problems
Use this information to resolve problems that are related to GPU and heat sink modules and the GPU baseboard.
Health check for GPUs
Use one of the following utilities to check the GPU health status. Make sure to update GPU driver, which includes the following utilities required. Latest driver can be found at Drivers and Software download website for ThinkSystem SR685a V3.
For more information about System Management Interface (SMI) information, see AMD System Management Interface.
- GPU numbers (0 to 7) in the output are the logical numbers. The following table shows the mapping information between the logical numbers and physical GPU sockets.
Logical number Physical GPU socket Location of the GPU socket 0 GPU 2 
1 GPU 3 2 GPU 1 3 GPU 0 4 GPU 6 5 GPU 7 6 GPU 5 7 GPU 4
rocm-smi
Run the rocm-smi utility to display the eight GPUs online.
Figure 1. rocm-smi
rocm-smi --showrasinfo
Run the rocm-smi --showrasinfo utility to display hardware details of the eight GPUs.
Figure 2. rocm-smi --showrasinfo
rocm-smi --showhw
Run the rocm-smi --showhw utility to display error counters of the eight GPUs.
Figure 3. rocm-smi --showhw
rocm-smi -a
Run the rocm-smi -a utility to display status of the eight GPUs.
Figure 4. rocm-smi -a
System fails to detect a specific GPU
When one of the events appears in the XCC web event log, it indicates the system fails to detect one or more specific GPUs.
- When event FQXSPIO0015M: Fault in slot [PhysicalConnectorSystemElementName] on system [ComputerSystemElementName]. appears, see FQXSPIO0015M to solve the problem.
- When event FQXSFIO0010M: An Uncorrectable PCIe Error has Occurred at Bus [arg1] Device [arg2] Function [arg3]. The Vendor ID for the device is [arg4] and the Device ID is [arg5]. The physical [arg6] number is [arg7]. appears, see FQXSFIO0010M to solve the problem.NoteParameters:
- [arg1] Bus
- [arg2] Device
- [arg3] Function
- [arg4] VID
- [arg5] DID
- [arg6] Slot/Bay
- [arg7] Instance number
- When event FQXSPUN0019M : Sensor [SensorElementName] has transitioned to critical from a less severe state. appears, see FQXSPUN0019M to solve the problem.
| Slot numbering in XCC | Physical GPU sockets | Location of the GPU sockets |
|---|---|---|
| Slot 17 | GPU 7 | |
| Slot 18 | GPU 6 | |
| Slot 19 | GPU 4 | |
| Slot 20 | GPU 5 | |
| Slot 21 | GPU 3 | |
| Slot 22 | GPU 2 | |
| Slot 23 | GPU 0 | |
| Slot 24 | GPU 1 |