Install the OSFP module and the network board (trained technician only)

Procedure

1. Align the network board to the guide holes on the carrier board; then, place the network board onto the carrier board.
   Figure 1. Installing the network board
   
   
2. Follow the sequence shown in the illustration below to fasten the network board screws (x4 Torx T15 screws) to the carrier board.
   Note

   For reference, the torque required for the screws to be fully tightened/removed is 0.9 newton-meters, 7.96 inch-pounds.

   Figure 2. Network board screws installation
   
   

GPU node water loop gap pad/putty pad replacement. Make sure to follow Gap pad/putty pad replacement guidelines.

3. Replace the Phase Change Material (PCM) and putty pads on the GPU node water loop with new ones.
   1. Install the PCM jig on the GPU cold plate.
   2. Attach the PCM to the square opening of the jig.
   3. Repeat to replace the PCM of all four GPU cold plates.
      Attention

      • PCM cannot be reused. PCM must be replaced with new ones every time the water loop is removed.

      • After PCM is replaced, there is an expected short duration of throttling before the GPU returns to normal operation. This is due to the PCM requiring a break-in period after being replaced.

      Figure 3. Water loop GPU cold plate PCM replacement (GPU node)
      
      
   4. Replace the putty pads on the GPU node water loop.
      Attention

      Putty pad cannot be reused. Whenever the water loop is removed, putty pads must be replaced with new ones before reinstalling the water loop.

      Figure 4. Water loop putty pads replacement (GPU node)
      
      
   5. Replace the putty pads (x5) on the GPU. Make sure to align the putty pads to the GPU VR (1) and the markings on GPU. Repeat to replace all putty pads on the four GPUs.

      1 GPU VR (Cover the GPU VR with putty pad)

      Attention

      Putty pad cannot be reused. Whenever the water loop is removed, putty pads must be replaced with new ones before reinstalling the water loop.

      Figure 5. GPU putty pads replacement
      
      
4. Unfold the water loop and place it onto the GPU node.
   Figure 6. Unfolding the water loop to GPU node
   
   
5. Loosen water loop carrier screws (x20 Phillips #2 screws).
   Figure 7. Water loop screws and quick connect screws installation (GPU node)
   
   
6. Remove the water loop carrier from the GPU node.
   Figure 8. Water loop carrier removal (GPU node)
   
   
7. Install GPU cold plate screws (x16 T10 screws).
   1. Install GPU cold plate screws following the GPU cold plates installation sequence: GPU 2 > GPU 4 > GPU 1 > GPU 3
      Figure 9. GPU numbering
      
      
   2. Set the torque screwdriver to 1.5 +/- 0.5 lb-In (0.1 +/- 0.06 N-m); then, fasten the GPU cold plate screws.
   3. Set the torque screwdriver to 3.5 +/- 0.5 lb-In (0.4 +/- 0.06 N-m); then, fasten the GPU cold plate screws until all screws are fully tightened.
      Note

      Make sure to follow the screw sequence on the GPU cold plate label: → → →

      Figure 10. GPU cold plate screw installation
      
      
8. Follow the screw installation sequence specified on the network board label, and install network cold plate screws (x8 Torx T10 screws) with a torque screwdriver set to the proper torque.
   Note

   For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

   Figure 11. Network card screw installation
   
   
9. Install the quick connect screws (x4 Torx T10) with a torque screwdriver set to the proper torque.
   Note

   For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

   Figure 12. Quick connect screw installation (GPU node)
   
   
10. Install water loop screws and quick connect screws (x13 Torx T10 screws) with a torque screwdriver set to the proper torque.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 13. Water loop Torx T10 screws installation (GPU node)
    
    
11. Install the Hex screw (x1) and the PH1 screws (x3).
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 14. Water loop Hex and PH1 screws installation (GPU node)
    
    
12. Install the cable tie to the GPU board.
    Figure 15. Installing the cable tie
    
    
13. Connect the carrier board power cable.
    Figure 16. Connecting carrier board power cable
    
    

    Cable	From (carrier board)	To (GPU node power distribution board)
    1 Carrier board power cable	Power and side band connector	Power connector

1. Replace the putty pad on the OSFP module conduction plate with a new one. Make sure to follow Gap pad/putty pad replacement guidelines.
   Attention

   Putty pad cannot be reused. Whenever the water loop is removed, putty pads must be replaced with new ones before reinstalling the water loop.

   Figure 17. Replacing the putty pad on the OSFP module
   
   
2. Connect the two OSFP module power cables. Connect power cable labeled as P1 to Power connector 1 on the OSFP module, and P2 to Power connector 2.

   OSFP module	connects to	Power cable
   1 Power connector 1		2 P1
   4 Power connector 2		4 P2

   Figure 18. OSFP module power cables installation
   
   
3. Install the OSFP module.
   1. Align the OSFP module to the guide pins, and install the OSFP module to the compute node.
   2. Tighten the three screws to secure the OSFP module to the compute node.
   Figure 19. OSFP module installation
   
   
4. Connect the OSFP module cables to the network board on the GPU node.
   CAUTION

   • Hold the cable connector at 45 degree angle when inserting it into the port.

   • Have extremely precaution when reseating the connectors that have a 45 degree label on them as they are fragile and will get damage if not installed in the correct 45 degree angle.

     
     
     

   Figure 20. Connecting the OSFP module cables to the network board
   
   

   Cable	From OSFP module connectors	To Network board connectors
   1 Network cable (long)	Network connector (near GPU node)	Port 0
   2 Power cable	Power connector P1	OOB port 0
   3 Power cable	Power connector P2	OOB port 1 (on network board) and power connector (on carrier board)
   4 Network cable (short)	Network connector (near Compute node)	Port 1

5. Press the network cable connector to properly connect the cable plug to the connector. Make sure the latch is fully engaged to the connector.
   Figure 21. Pressing network cable plug
   
   
6. Connect MCIO cables to the carrier board. Carrier board cable routing is different for one-processor configuration and two-processor configuration, see the following for details.
   One-processor configuration: connect all MCIO cables to the carrier board

   Figure 22. One-processor configuration—Connecting all MCIO cables to the carrier board
   
   

   Cable index	From (carrier board in GPU node)	To (system board in compute node)
   1	MCIO 1 cable	PCIe 4
   2	MCIO 2 cable
   3	MCIO 3 cable	PCIe 3
   4	MCIO 4 cable

   Two-processors configuration: connect MCIO 1, MCIO 2, and MCIO 3 cables

   Figure 23. Two-processor configuration—Connecting MCIO 2, MCIO 3, and MCIO 4 cable to the GPU node

   Make sure to follow the sequence 3 → 1 → 2.

   
   
   

   Cable index	From (carrier board in GPU node)	To (system board in compute node)
   1	MCIO 2 cable	PCIe 5
   2	MCIO 3 cable	PCIe 4
   3	MCIO 4 cable	PCIe 3

7. Connect the drive cable.
   Figure 24. Connecting drive cage cables
   
   

   Figure 25. Connecting 7mm drive cage cables
   
   

   Figure 26. E3.S drives cable routing