Remove the water loop

Use this information to remove the water loop.

Procedure

1. Make preparations for this task.
   1. Remove the tray from the enclosure. See Remove a DWC tray from the enclosure.
   2. Remove the tray cover. See Remove the tray cover.
   3. Remove the cross braces. See Remove the cross braces.
   4. Remove the DIMM comb. See Remove a DIMM comb.
   5. Remove memory modules. See Remove a memory module.
   6. Remove the M.2 backplane assembly. See Remove the M.2 backplane assembly.
      Note

      The M.2 backplane cold plate needs to be removed as well.
   7. Remove the bus bar. See Remove the bus bar.
   8. Remove the MCIO cables. Follow the guidance and routing information in Internal cable routing.
   9. Remove the drive cage. Depending the system configurations, see Remove a drive cage assembly, Remove a 7mm NVMe drive cage assembly, or Remove the E3.S drive cage assembly.
   10. Remove the OSFP module. See Remove the OSFP module.

Separate the water loop from the GPU node.

2. Remove the carrier board power cable from the GPU node.
   Figure 1. Carrier board power cable removal
   
   

   From (carrier board)	To (GPU node power distribution board)
   1 Power and side band connector	1 Power connector

3. Remove cable tie from the GPU board.
   Figure 2. Cable tie removal
   
   
4. Remove the Hex screw (x1) and the PH1 screws (x3) from the water loop with a torque screwdriver set to the proper torque.
   Note

   For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

   Figure 3. Water loop Hex and PH1 screws removal (GPU node)
   
   
5. Remove water loop screws and quick connect screws (x11 Torx T10 screws) with a torque screwdriver set to the proper torque.
   Note

   For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

   Figure 4. Water loop Torx T10 screws removal (GPU node)
   
   
6. Remove the quick connect screws (x4 Torx T10) with a torque screwdriver set to the proper torque.
   Note

   For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

   Figure 5. Quick connect screw removal (GPU node)
   
   
7. Follow the screw removal sequence specified on the network board label, and remove network cold plate screws (x8 Torx T10 screws) with a torque screwdriver set to the proper torque.
   Note

   For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

   Figure 6. Network card screw removal
   
   
8. Loosen GPU cold plate screws (x16 Torx T10 screws) in the diagonal pattern with a torque screwdriver set to the proper torque.
   Note

   For reference, the torque required for the screws to be fully tightened/loosened is 0.4+/-0.05 N-m, 3.5+/-0.5 lb-In.

   Figure 7. Loosening GPU cold plate screw
   
   
9. Release the front and rear MISC conduction plates of the water loop from the GPU board.
   1. Insert a flat head screwdriver into the gaps between the MISC conduction plates (front and rear) and the GPU board. Then, slightly rotate the flat head screwdriver.
      Note

      Locations of the gaps for inserting flat head screwdriver is shown in the illustration below.
   2. The front and rear MISC conduction plates release from the GPU board slightly.
      Figure 8. Releasing the front and rear MISC conduction plates release from the GPU board
      
      
10. Release the GPU cold plates from the GPUs.
    1. There are notches on the sides of the GPU cold plates for inserting a flat head screwdriver. The locations of the notches are shown in the illustration below.
       Attention

       Inserting the flat head screwdriver ONLY to the notches circled in the illustration below. Otherwise, the screwdriver may damage the GPUs.

       Figure 9. Notches for releasing GPU cold plates
       
       
    2. Insert a flat screwdriver into all the notches shown in the illustration; then, slightly rotate the screwdriver to release the GPU cold plates from the GPUs.
       Figure 10. Releasing the GPU cold plate from the GPU
       
       
11. Gently put the water loop carrier down onto the water loop and ensure it is seated firmly on the water loop.
    Figure 11. Water loop carrier installation (GPU node)
    
    
12. Tighten water loop carrier screws (x20 Phillips #2 screws) with a torque screwdriver set to the proper torque.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 12. Tightening water loop carrier screws (GPU node)
    
    
13. Carefully rotate the GPU node side water loop so that it is sitting on top of the Compute node side water loop.
    Figure 13. Folding the GPU node side water loop onto the Compute node side water loop
    
    
14. Immediately clean the PCM off all the GPUs with alcohol cleaning pads. Gently clean the PCM to avoid GPU damages.
    Attention

    • It is recommended to clean the PCM while it is in liquid state.

    • The electrical components around the die on the GPUs are extremely delicate. When removing the PCM and cleaning the GPU die, avoid touching the electrical components to prevent damages.

    Figure 14. Cleaning PCM off from all GPUs
    
    
15. With alcohol cleaning pads, wipe off any remaining putty pad and PCMs from the water loop and components in the GPU node.
    Figure 15. Cleaning putty pads from water loop
    
    

    Figure 16. Cleaning putty pads and PCM from the components in the GPU node
    
    
16. Flip the GPU node water loop back to the GPU node.
    Figure 17. Flipping GPU node water loop to the GPU node
    
    

Separate the water loop from the compute node.

17. Remove the two Hex screws from the OSFP module with a 4.5 mm hex head screwdriver.
    Figure 18. OSFP module conduction plate Hex screws removal
    
    
18. Remove the OSFP module conduction plate. With alcohol cleaning pads, wipe of any remaining putty pads from the conduction plate.

    Screw Type	Screwdriver Type
    1 M3x5 screw (x3)	Phillips #1 head screwdriver
    2 M3 screw (x2)	T10 screwdriver

    Figure 19. OSFP module conduction plate removal
    
    
19. Remove two Torx T10 screws (per node); then, remove the VR (voltage regulator) clamp plate out of the node.
    Figure 20. VR clamp plate removal
    
    
20. Remove water loop screws (x9 Torx T10 screws for two nodes) with a torque screwdriver set to the proper torque.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 21. Water loop screw removal
    
    
21. Remove Torx T10 screws (x7 screws) to loosen the quick connect.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 22. Quick connect screw removal (Compute node)
    
    
22. Orient two water loop carriers with the guide pins; then, gently put the two water loop carriers down and ensure they are seated firmly on the water loop.
    Figure 23. Water loop carrier installation
    
    
23. Tighten water loop carrier screws (x12 Phillips #2 screws).
    Figure 24. Water loop carrier screws installation
    
    
24. Loosen processors properly.
    1. Fully loosen all Torx T30 captive screws (x8 Torx T30 captive screws) on cold plates with a general screwdriver, following the removal sequence shown on the cold plate label.
       Note

       For reference, the torque required for the screws to be fully tightened/removed is 10+/- 2.0 lbf-in, 1.1+/- 0.2 N-m.

       Attention

       To prevent damage to components, make sure that you follow the indicated loosening sequence.
    2. Rotate all anti-tilt wire bails (16x anti-tilt wire bails for two nodes) inwards to the unlocked position.

       Figure 25. Loosening Torx T30 captive screws
       
       
25. Carefully rotate the water loop so one half is sitting on top of the other half.
    Figure 26. Folding the water loop
    
    
26. Fasten two captive thumbscrews to secure water loop carriers to each other.
    Figure 27. Tightening captive thumbscrews
    
    
27. Remove the processor from the retainer. This process differs by processor SKU. Check the processor SKU and follow the applicable procedure.
    Note

    Do not touch the contacts on the processor.

    For non Intel® Xeon® CPU Max processor

    1. Lift the handle to release the processor from the retainer.

    2. Carefully hold the processor by its edges; then, lift the processor from the retainer.

       Figure 28. Processor removal
       
       

    For Intel® Xeon® CPU Max processor

    1. Insert a flat head screwdriver into the TIM breaking cam on the retainer; then, slightly rotate the flat head screwdriver to release the processor from the retainer.

    2. Carefully hold the processor by its edges; then, lift the processor from the retainer.

       Figure 29. Processor removal (Intel® Xeon® CPU Max processor)
       
       

       1 TIM breaking cam

28. Without putting the processor down, wipe the thermal grease from the top of the processor with an alcohol cleaning pad; then, place the processor on a static protective surface with the processor-contact side up.
29. Remove the processor retainer from the underside of the cold plate.
    Note

    The processor retainer will be discarded and replaced with a new one.
    1. Carefully release the retaining clips from the cold plate.
    2. Lift the retainer from the cold plate.
    Figure 30. Processor retainer removal
    
    
30. Wipe the thermal grease from the bottom of the cold plate with an alcohol cleaning pad.
31. Carefully lift the water loop up off the system board and out of the node.
    Figure 31. Water loop removal