Skip to main content

Install a HL PCIe adapter

Follow the instructions in this section to install a half-length (HL) PCIe adapter.

About this task

S002
disconnect all power
CAUTION
The power-control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
Attention

  • Read Installation Guidelines and Safety inspection checklist to ensure that you work safely.

  • Power off the server and disconnect all power cords for this task. See Power off the server.

  • Prevent exposure to static electricity, which might lead to system halt and loss of data, by keeping static-sensitive components in their static-protective packages until installation, and handling these devices with an electrostatic-discharge wrist strap or other grounding system.

Note

PCIe installation rules with one processor​

Rules and priority for PCIe slots with one processor

When only one processor is installed, PCIe slots 1 to 4 and 9 are supported.

Listed by priority:

  1. Double-width, FH/FL GPU:1 Slot 1 >> 3

  2. Retimer: Slot 1 >> 3

  3. ThinkSystem Broadcom 57508 100GbE QSFP56 2-port PCIe 4 Ethernet Adapter: Slot 1 >> 3

  4. Single-width, HH/HL GPU:2

    • ThinkSystem NVIDIA A2 Passive GPU: Slot 2 >> 4 >> 1 >> 3
    • ThinkSystem NVIDIA L4 Passive GPU: Slot 1 >> 3 >> 2 >> 4

  5. ThinkSystem RAID 940-32i 8GB Flash PCIe Gen4 12Gb Adapter: Slot 9 only

  6. Other external RAID/HBA adapters: Slot 9 >> 1 >> 2 >> 3 >> 4

    • Follow the principles of priority listed below:

      • RAID adapters or HBAs with 3-digit model name should be installed before those with 4-digit model name. For models with the same number of digits, the one with the higher number should be installed before those with the lower.

        • For example:

          ThinkSystem RAID 540-16i PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 9350-16i 4GB Flash PCIe 12Gb Adapter

          ThinkSystem 440-8i SAS/SATA PCIe Gen4 12Gb HBA >> ThinkSystem 4350-8i SAS/SATA 12Gb HBA

          ThinkSystem RAID 940-16i 4GB Flash PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 540-16i PCIe Gen4 12Gb Adapter

      • 16i >> 8i

        • For example:

          ThinkSystem RAID 940-16i 4GB Flash PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 940-8i 4GB Flash PCIe Gen4 12Gb Adapter

      • For RAID adapters or HBAs of the same model, install first the ones with higher capacity.

        • For example:

          ThinkSystem RAID 940-16i 8GB Flash PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 940-16i 4GB Flash PCIe Gen4 12Gb Adapter

  7. Other Ethernet adapters: Slot 9 >> 2 >> 3 >> 4

  8. Other external RAID adapters, HBAs, and Ethernet adapters of lower priority: Slot 9 >> 1 >> 2 >> 3 >> 4

Back to top

　

PCIe installation rules with two processors​

Rules and priority for PCIe slots with two processors

With two processor installed, all 9 PCIe slots are supported.

Listed by priority:

  1. Double-width, FH/FL GPU:1 Slot 1 >> 3 >> 7 >> 5

  2. Retimer: Slot 7 >> 5 >> 1 >> 3

  3. ThinkSystem Broadcom 57508 100GbE QSFP56 2-port PCIe 4 Ethernet Adapter: Slot 1 >> 3 >> 7 >> 5

  4. Single-width, HH/HL GPU:2

    • ThinkSystem NVIDIA A2 Passive GPU: Slot 2 >> 4 >> 7 >> 5 >> 1>> 3 >> 6 >> 8
    • ThinkSystem NVIDIA L4 Passive GPU: Slot 1 >> 3 >> 7 >> 5 >> 2 >> 4 >> 6 >> 8

  5. ThinkSystem RAID 940-32i 8GB Flash PCIe Gen4 12Gb Adapter: Slot 9 >> 5 >> 6 >> 7 >> 8

  6. Other external RAID/HBA adapters: Slot 9 >> 1 >> 2 >> 3 >> 4 >> 5 >> 6 >> 7 >> 8

    • Follow the principles of priority listed below for installation:

      • RAID adapters or HBAs with 3-digit model name should be installed before those with 4-digit model name. For models with the same number of digits, the one with the higher number should be installed before those with the lower.

        • For example:

          ThinkSystem RAID 540-16i PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 9350-16i 4GB Flash PCIe 12Gb Adapter

          ThinkSystem 440-8i SAS/SATA PCIe Gen4 12Gb HBA >> ThinkSystem 4350-8i SAS/SATA 12Gb HBA

          ThinkSystem RAID 940-16i 4GB Flash PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 540-16i PCIe Gen4 12Gb Adapter

      • 16i >> 8i

        • For example:

          ThinkSystem RAID 940-16i 4GB Flash PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 940-8i 4GB Flash PCIe Gen4 12Gb Adapter

      • For RAID adapters or HBAs of the same model, install first the ones with higher capacity.

        • For example:

          ThinkSystem RAID 940-16i 8GB Flash PCIe Gen4 12Gb Adapter >> ThinkSystem RAID 940-16i 4GB Flash PCIe Gen4 12Gb Adapter

  7. Other Ethernet adapters: Slot 9 >> 2 >> 3 >> 4 >> 6 >> 7 >> 8

  8. Other external RAID adapters, HBAs, and Ethernet adapters of lower priority: Slot 9 >> 1 >> 2 >> 3 >> 4 >> 5 >> 6 >> 7 >> 8

Back to top

　

GPU installation rules​

GPU installation rules

  1. The installation of a full-length double-width GPU adapter should follow the rules specified below:

    • Follow the installation sequence: slot 1 >> 3 >> 7 >> 5

    • One or two FL PCIe adapter holders are required to have been installed corresponding to the PCIe slot(s) for the FL GPU adapter(s) to be installed. See FL PCIe adapter holder replacement for the installation and removal of a PCIe adapter holder.

    • When a FL DW GPU adapter is installed in PCIe slot 1, only the same type of GPU can be installed in slot 3; different types of FL DW GPUs can be installed in slot 7 and then slot 5.

    • When there is only one FL GPU installed between PCIe slots 1 and 4 or between slots 5 and 8, one or two FL GPU fillers are required to be installed on the air baffle on the same side of the FL GPU for proper cooling and airflow.

    • See FL GPU filler replacement for the installation and removal of a FL GPU filler.

  2. The installation of a ThinkSystem NVIDIA A2/L4 GPU adapter should follow the rules specified below:

    • When a ThinkSystem NVIDIA A2/L4 GPU is installed—

      • between PCIe slots 1 and 4: the other slots between slots 1 and 4 only support low-profile PCIe adapters

      • between PCIe slots 5 and 8: the other slots between slots 5 and 8 only support low-profile PCIe adapters

    • When one or more A2/L4 GPUs are installed between PCIe slots 1 and 4 or between PCIe slots 5 and 8, one or two A2/L4 GPU air ducts are required to be installed on the fan cage at the same side as the installed A2/L4 GPU for proper cooling and airflow. See A2/L4 GPU air duct replacement for the installation and removal of an A2/L4 GPU air duct.

    • A T4 filler is required to be installed onto the server cover for proper cooling and airflow when one or more A2/L4 GPU adapters are installed. See T4 filler replacement for the installation and removal of a T4 filler.

  3. Active GPUs can be installed in PCIe slots 1, 3, 5, and 7; ThinkSystem NVIDIA A2/L4 GPUs can be installed in PCIe slots 1 to 8.

  4. ThinkSystem ST650 V3 does not support mixing GPUs between PCIe slots 1 and 4 or between slots 5 and 8.

    • When a GPU is installed between PCIe slots 1 and 4, only the same type of GPUs can be installed in other slots between 1 and 4.

    • When a GPU is installed between PCIe slots 5 and 8, only the same type of GPUs can be installed in other slots between 5 and 8.

  5. When GPUs (NVIDIA RTX A6000/A4500/A2/L4) are installed between PCIe slots 1 and 4, these slots do not support any RAID adapter, HBA, or Retimer.

  6. When GPUs (NVIDIA RTX A6000/A4500/A2/L4) are installed between PCIe slots 5 and 8, these slots do not support any RAID adapter, HBA, or Retimer.

  7. To prevent potential thermal issues, change the Misc setting in the BIOS from Option3 (default value) to Option1 if the following two conditions are met:

    • The server is equipped with a GPU adapter.

    • The UEFI firmware version is ESE122T or later.

    For the method of changing the Misc setting, see https://support.lenovo.com/us/en/solutions/TT1832.

Back to top

　

Installation procedure​

  1. Locate the applicable PCIe slot based on the above-noted rules.
  2. If a bracket has been installed in the PCIe slot, remove it. Store the bracket for the PCIe slot in case it should be needed later.
  3. Install the PCIe adapter.
    Note

    • Make sure that the PCIe adapter retainer is in the open position.

    1. Align the PCIe adapter to the PCIe slot; then, gently press both ends of the PCIe adapter until it is securely seated in the PCIe slot.
    2. Tighten the screw to secure the PCIe adapter.
    3. Close the PCIe adapter retainer.
      Figure 1. Installation of a HL PCIe adapter
      PCIe adapter installation

After you finish

  1. Connect all required cables to the PICe adapter. See Internal cable routing.

  2. If the fan cage and fans are not installed in the chassis, reinstall them. See Install the fan cage assembly and Install a fan module.

  3. If one or more A2/L4 GPU adapters are installed, install one ore two A2/L4 GPU air ducts to the corresponding slot on the fan cage, and install a T4 filler to the server cover. See Install an A2/L4 GPU air duct and Install a T4 filler.

  4. Reinstall the air baffle. See Install an air baffle.

  5. Reinstall all the flash power modules, if necessary. See Install a flash power module.

  6. Reinstall the server cover. See Install a server cover.

  7. Complete the parts replacement. See Complete the parts replacement.

Back to top

Demo video

Watch the procedure on YouTube