PCIe adapter in compute node cable routing

Use this information to route the cables for PCIe adapters in the compute node.

PCIe adapter configuration and cable routing

This configuration supports ConnectX-6.

Attention

Shared I/O configuration requires specific power on and power off sequence for the two nodes, see below:

Power on sequence: first, power on the node with main adapter (right node); then, power on the node with auxiliary adapter (left node).
Power off sequence: first, power off the node with auxiliary adapter (left node); then, power off the node with main adapter (right node).

Figure 1. Shared I/O configuration for ConnectX-6 cable routing
PCIe adapter with an Aux Kit—Shared I/O configuration

1 Main adapter with riser

2 Auxiliary adapter with riser

3 350 mm IPEX cable (CX-6)

This configuration supports ConnectX-7 NDR 200 and ConnectX-7 NDR 400.

Attention

Shared I/O configuration requires specific power on and power off sequence for the two nodes, see below:

Power on sequence: first, power on the node with main adapter (right node); then, power on the node with auxiliary adapter (left node).
Power off sequence: first, power off the node with auxiliary adapter (left node); then, power off the node with main adapter (right node).

Figure 2. Shared I/O configuration for ConnectX-7 NDR 200/ConnectX-7 NDR 400

1 Main adapter with riser (right node)

2 SD650 V3 Shared I/O cable (190 mm). The cable is directly connected to PCIe riser 1 slot on system board of the left node.

This configuration supports ConnectX-7 NDR 200 and ConnectX-7 NDR 400.

Figure 3. Socket direct configuration for ConnectX-7 NDR 200/ConnectX-7 NDR 400 cable routing

1 Main adapter with riser

2 SD650 V3 Share I/O cable (190 mm). The cable is directly connected to PCIe riser 1 slot on the system board of the left node or right node.

Give documentation feedback