GPU processor mapping and adapter population rules (4-slot PCIe expansion cage)

Use the information in this topic to understand adapter-to-processor mapping and the GPU adapter population order for adapters in the 4-slot PCIe expansion cage.

Note

PCIe expansion cage 1 and PCIe expansion cage 2 must be the same type, either 4-slot PCIe expansion cages or 3-slot PCIe expansion cages

The following figure illustrates the numbering for the PCIe slots in the server (when 4-slot PCIe expansion cages are installed).

Figure 1. Numbering of the PCIe slots on the server (4-slot PCIe expansion cage)
Front view of the server with PCIe slots numbered

The following table shows how the PCIe adapter slots are mapped to the system processors.

Table 1. PCIe adapter-to-processor mapping
Adapter slot	Description	Processor mapping
I/O expansion cage
Slot 1	PCIe 3.0 x16 (full-height, half-length). Typically, a network adapter is installed in this slot.	1
Slot 2	PCIe 3.0 x16 (full-height, half-length). Typically, a RAID adapter or a network adapter is installed in this slot.	2
Slot 3	PCIe 3.0 x4 (full-height, half-length). Typically, a 1GbE network adapter is installed in this slot.	Onboard chipset, also known as the Platform Controller Hub (PCH)
4-slot PCIe expansion cage 1
Slot 4 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	1
Slot 5 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	1
Slot 6 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	1
Slot 7 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	1
4-slot PCIe expansion cage 2
Slot 8 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	2
Slot 9 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	2
Slot 10 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	2
Slot 11 ^*	PCIe 3.0 x16 for a GPU (full-height, half-length, single-width)	2
System board
Slot 12 (internal)	M.2	Onboard chipset, also known as the Platform Controller Hub (PCH)

Note

^* Slots 4 through 11 operate in x8 mode. If an x16 adapter is installed in one of these slots, the adatper will function as a x8 adapter in these slots.

The following table defines the population order for the GPU adapters in the PCIe expansion cages 1 and 2.

Table 2. GPU adapter population order. The GPU adapter population order varies depending on adapter-to-processor utilization goals:
**Concentrated utilization**. Adapters are connected to the PCIe busses from CPU1 until all PCIe busses on CPU1 is consumed before populating adapters against the CPU2 PCI Express busses.
**Distributed utilization**. Adapters are populated as equally as possible between the CPU1 and CPU2 PCIe Express busses
Number of PCIe adapters	Concentrated	Distributed
1 GPU adapter	Slot 4	Slot 4
2 GPU adapters	Slot 4, slot 5	Slot 4, slot 8
3 GPU adapters	Slot 4, slot 5, slot 6	Slot 4, slot 5, slot 8
4 GPU adapters	Slot 4, slot 5, slot 6, slot 7	Slot 4, slot 5, slot 8, slot 9
5 GPU adapters	Slot 4, slot 5, slot 6, slot 7, slot 8	Slot 4, slot 5, slot 6, slot 8, slot 9
6 GPU adapters	Slot 4, slot 5, slot 6, slot 7, slot 8, slot 9	Slot 4, slot 5, slot 6, slot 8, slot 9, slot 10
7 GPU adapters	Slot 4, slot 5, slot 6, slot 7, slot 8, slot 9, slot 10	Slot 4, slot 5, slot 6, slot 7, slot 8, slot 9, slot 10
8 GPU adapters	Slot 4, slot 5, slot 6, slot 7, slot 8, slot 9, slot 10, slot 11	Slot 4, slot 5, slot 6, slot 7, slot 8, slot 9, slot 10, slot 11

Give feedback