Skip to main content

Install the OSFP module

Use this information to install the OSFP module.

About this task

Required tools

Make sure that you have the SD665-N V3 OSFP Putty Pad Kit to properly replace the component.

Attention
Important
Gap pad/putty pad replacement guidelines
  • To identify the gap pad/putty pad location and orientation, see:

  • Before replacing the gap pad/putty pad, gently clean the interface plate or the hardware surface with an alcohol cleaning pad.

  • Hold the gap pad/putty pad carefully to avoid deformation. Make sure no screw hole or opening is blocked by the gap pad/putty pad material.

  • Do not use expired putty pad. Check the expiry date on putty pad package. If the putty pads are expired, acquire new ones to properly replace them.

Firmware and driver download: You might need to update the firmware or driver after replacing a component.
Prepare the following screwdrivers to ensure you can install and remove corresponding screws properly.
Screw Type/UsageScrewdriver Type
Hex screw4.5 mm hex head screwdriver

Procedure

  1. Replace the putty pad on the OSFP module conduction plate with a new one. Make sure to follow Gap pad/putty pad replacement guidelines.
    Attention
    Putty pad cannot be reused. Whenever the water loop is removed, putty pads must be replaced with new ones before reinstalling the water loop.
    Figure 1. Replacing the putty pad on the OSFP module
    Replacing the putty pad on the OSFP module
  2. Connect the two OSFP module power cables. Connect power cable labeled as P1 to Power connector 1 on the OSFP module, and P2 to Power connector 2.
    OSFP moduleconnects toPower cable
    1 Power connector 12 P1
    4 Power connector 24 P2
    Figure 2. OSFP module power cables installation
    OSFP power cable installation
  3. Install the OSFP module.
    1. Align the OSFP module to the guide pins, and install the OSFP module to the compute node.
    2. Tighten the three screws to secure the OSFP module to the compute node.
    Figure 3. OSFP module installation
    OSFP module installation
  4. Connect the OSFP module cables to the network board on the GPU node.
    CAUTION
    • Hold the cable connector at 45 degree angle when inserting it into the port.

    • Have extremely precaution when reseating the connectors that have a 45 degree label on them as they are fragile and will get damage if not installed in the correct 45 degree angle.



    Figure 4. Connecting the OSFP module cables to the network board
    Connecting the OSFP module cables to the network board
    CableFrom

    OSFP module connectors

    To

    Network board connectors

    1 Network cable (long)Network connector (near GPU node)Port 0
    2 Power cablePower connector P1OOB port 0
    3 Power cablePower connector P2OOB port 1 (on network board) and power connector (on carrier board)
    4 Network cable (short)Network connector (near Compute node)Port 1
  5. Press the network cable connector to properly connect the cable plug to the connector. Make sure the latch is fully engaged to the connector.
    Figure 5. Pressing network cable plug

  6. Connect MCIO cables to the carrier board. Carrier board cable routing is different for one-processor configuration and two-processor configuration, see the following for details.
    One-processor configuration: connect all MCIO cables to the carrier board
    Figure 6. One-processor configuration—Connecting all MCIO cables to the carrier board
    One-processor configuration—Connecting all MCIO cables to the carrier board
    Cable indexFrom (carrier board in GPU node)To (system board in compute node)
    1MCIO 1 cablePCIe 4
    2MCIO 2 cable
    3MCIO 3 cablePCIe 3
    4MCIO 4 cable
    Two-processors configuration: connect MCIO 1, MCIO 2, and MCIO 3 cables
    Figure 7. Two-processor configuration—Connecting MCIO 2, MCIO 3, and MCIO 4 cable to the GPU node

    Make sure to follow the sequence 312.


    Two-processor configuration—Connecting MCIO 2, MCIO 3, and MCIO 4 cable to the GPU node
    Cable indexFrom (carrier board in GPU node)To (system board in compute node)
    1MCIO 2 cablePCIe 5
    2MCIO 3 cablePCIe 4
    3MCIO 4 cablePCIe 3
  7. Connect the drive cable.
    Figure 8. Connecting drive cage cables
    Disconnecting drive cable
    Figure 9. Connecting 7mm drive cage cables
    Disconnecting drive cable
    Figure 10. E3.S drives cable routing
    E3.S drives cable routing
After you finish
  1. Install the cross braces. See Install the cross braces.

  2. Install the tray cover. See Install the tray cover.

  3. Install the tray into the enclosure. See Install a DWC tray in the enclosure.

  4. Connect all required external cables to the solution.
    Note
    Use extra force to connect QSFP cables to the solution.
  5. Check the power LED on each node to make sure it changes from fast blink to slow blink to indicate all nodes are ready to be powered on.

Demo video

Watch the procedure on YouTube