PCIe adapter in compute node cable routing

Use this information to route the cables for PCIe adapters in the compute node.

PCIe adapter configuration and cable routing

This configuration supports ConnectX-6 that comes with the auxiliary adapter kit.

Attention

Shared I/O configuration requires specific power on and power off sequence for the two nodes, see below:

Power on sequence: first, power on the node with main adapter (right node); then, power on the node with auxiliary adapter (left node).
Power off sequence: first, power off the node with auxiliary adapter (left node); then, power off the node with main adapter (right node).

Figure 1. Cable routing—Shared I/O configuration for ConnectX-6 with the auxiliary adapter kit

1 Main adapter with riser

2 Auxiliary adapter with riser

3 350 mm IPEX cable (CX-6)

This configuration supports the following adapters:

Attention

Shared I/O configuration requires specific power on and power off sequence for the two nodes, see below:

Power on sequence: first, power on the node with main adapter (right node); then, power on the node with auxiliary adapter (left node).
Power off sequence: first, power off the node with auxiliary adapter (left node); then, power off the node with main adapter (right node).

Figure 2. Cable routing—Shared I/O configuration for ConnectX-6 without auxiliary adapter kit, ConnectX-7 NDR 200, and ConnectX-7 NDR 400

1 Main adapter with riser (right node)

2 SD650 V3 Shared I/O cable (190 mm). The cable is directly connected to PCIe riser 1 slot on system board of the left node.

This configuration supports ConnectX-7 NDR 200 and ConnectX-7 NDR 400.

Figure 3. Cable routing—Socket direct configuration for ConnectX-7 NDR 200/ConnectX-7 NDR 400 cable routing

1 Main adapter with riser

2 SD650 V3 Share I/O cable (190 mm). The cable is directly connected to PCIe riser 1 slot on the system board of the left node or right node.

Give documentation feedback