Install the water loop

Use this information to install the water loop to the tray.

Procedure

1. Follow the following steps if you are replacing processors:
   1. If there is any old thermal grease on the processor and the cold plate, gently clean the top of the processor and the cold plate using an alcohol cleaning pad.
   2. Remove the processor identification label from the water loop and replace it with the new label that comes with the replacement processor. If you are unable to remove the label and place it on the new water loop, or if the label is damaged during transfer, write the processor serial number from the processor identification label on the new water loop in the same location as the label would be placed using a permanent marker.
   3. Apply the thermal grease on the top of the processor with syringe by forming four uniformly spaced dots, while each dot consists of about 0.1 ml of thermal grease
      Note

      Carefully place the processor and retainer on a flat surface with the processor-contact side down.

      Figure 1. Thermal grease application
      
      
2. Install processor retainers onto processor if needed.
   1. Align the triangular mark on the processor retainer with the triangular mark on the processor corner edge.
   2. (Intel® Xeon® CPU Max only) Make sure the slot on the TIM breaking cam is vertical. See Figure 4.
   3. Gently place the processor retainer on the processor; then, carefully press the four sides of the processor retainer to secure the processor.

      Figure 2. Installing a processor retainer

      Figure 3. Installing a Intel® Xeon® CPU Max processor retainer 1 TIM breaking cam

   4. (Intel® Xeon® CPU Max only) After installing the retainer onto processor, make sure the slot on the TIM breaking cam is vertical.
      Figure 4. TIM breaking cam on processor retainer

      1 TIM breaking cam

      
      
      
3. When removing the water loop from the package box, make sure to hold the touch points marked in grey in the illustration below.
   Attention

   Holding the water loop anywhere other than the touch points may cause damage to it.

   Figure 5. Touching points when removing water loop from package box

   Top image	Isometric view of water loop
   Bottom image	Top view of the water loop

   
   
   
4. If needed, remove plastic grease covers from the underside of processor cold plates.
   Figure 6. Plastic grease covers removal
   
   
5. Remove two plastic grease covers if needed.
   1. Use a pair of scissors to cut off the tape.
   2. Remove plastic grease covers from the underside of water loop cold plates.
   Note

   The right node is shown as example. Remove plastic grease covers if needed when installing processor in either node.

   Figure 7. Plastic grease covers removal
   
   
6. Align the triangular marks on the processor retainers with the triangular slots on the underside of the water loop cold plate; then, attach the processors to the underside of the water loop cold plate by inserting the processor retainer posts and clips features into the openings at the four corners of the cold plate.
   Figure 8. Processor installation
   
   
7. Rotate all anti-tilt wire bails (8x anti-tilt wire bails per node) outwards to the unlocked position.
   Figure 9. Processor unlocked position
   
   
8. Check the gap pads on the water loop, if any of them are damaged or detached, replace them with the new ones.
   Figure 10. Water loop gap pads
   
   

GPU node water loop gap pad/putty pad replacement. Make sure to follow Gap pad/putty pad replacement guidelines.

9. Replace the Phase Change Material (PCM) and putty pads on the GPU node water loop with new ones.
   1. Install the PCM jig on the GPU cold plate.
   2. Attach the PCM to the square opening of the jig.
   3. Repeat to replace the PCM of all four GPU cold plates.
      Figure 11. Water loop GPU cold plate PCM replacement (GPU node)
      
      
   4. Replace the putty pads on the GPU node water loop.
      Figure 12. Water loop putty pads replacement (GPU node)
      
      
   5. Replace the putty pads (x5) on the GPU. Make sure to align the putty pads to the GPU VR (1) and the markings on GPU. Repeat to replace all putty pads on the four GPUs.

      1 GPU VR (Cover the GPU VR with putty pad)

      Figure 13. GPU putty pads replacement
      
      

Make sure to follow Gap pad/putty pad replacement guidelines.

10. Fully loosen two captive thumbscrews located at each end of the water loop carrier.
    Figure 14. Loosening water loop captive thumbscrews

    
    
    
11. Install the compute node side of the water loop into the compute node of the tray.
    1. Carefully hold the water loop with both hands and flip it.
    2. Carefully position the water loop onto the two guide pins near the rear of the node; then, gently lower down the water loop and ensure it is seated firmly on the system board.
    Figure 15. Water loop carrier installation
    
    
12. Unfold and install the other side of the water loop as shown.
    Figure 16. Unfolding water loop
    
    
13. Ensure the processors are secured properly.

    1. Rotate 8x anti-tilt wire bails outwards to the locked position.

    2. Fully tighten 8x Torx T30 captive screws on cold plates with a general screwdriver, following the installation sequence shown on the cold plate label.

       Note

       For reference, the torque required for the screws to be fully tightened/removed is 10+/- 2.0 lbf-in, 1.1+/- 0.2 N-m.
       Attention

       To prevent damage to components, make sure that you follow the indicated tightening sequence.
       Figure 17. Securing Torx T30 captive screws
       
       
14. Loosen water loop carrier screws (x12 Phillips #2 screws for two nodes).
    Figure 18. Loosening water loop carrier screws
    
    
15. Carefully lift each water loop carrier up and away from the water loop one at a time.
    Figure 19. Water loop carrier removal
    
    
16. Install water loop screws (9x Torx T10 screws per node) with a torque screwdriver set to the proper torque.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 20. Water loop screws installation
    
    
17. Install the Torx T10 screws (x7 screws) to secure the quick connect.
    Figure 21. Quick connect screw installation
    
    
18. Install two VR clamp plates into the nodes and install Torx T10 screws (4x Torx T10 screws for two nodes).
    Figure 22. VR clamp plate installation
    
    
19. Replace the putty pads on the top side and the bottom side of the OSFP module conduction plate.
    Figure 23. OSFP module conduction plate putty pads replacement
    
    

    1 Conduction plate top putty pad 2 Conduction plate bottom putty pad

Make sure to follow Gap pad/putty pad replacement guidelines.

20. Install the OSFP module conduction plate onto the water loop.

    Screw Type	Screwdriver Type
    1 M3x5 screw (x3)	Phillips #1 head screwdriver
    2 M3 screw (x2)	T10 screwdriver

    Figure 24. Installing the OSFP module conduction plate
    
    
21. Install the two Hex screws to the OSFP module with a 4.5 mm hex head screwdriver.
    Figure 25. OSFP module conduction plate Hex screws installation
    
    

Install water loop to the GPU node

22. Loosen water loop carrier screws (x20 Phillips #2 screws).
    Figure 26. Water loop screws and quick connect screws installation (GPU node)
    
    
23. Remove the water loop carrier from the GPU node.
    Figure 27. Water loop carrier removal (GPU node)
    
    
24. Install GPU cold plate screws (x16 PH2 screws). Install the GPU cold plates in diagonal pattern. Complete installing screws of GPU 2, then proceed to GPU 4 > GPU 1 > GPU 3.
    1. Set the torque screwdriver to 3.5 lb-In, 0.39 N-m.
    2. Fasten the screws for 720 degree following the screw installation sequence: → → →
       Note

       Make sure to follow screw installation sequence to prevent GPU cold plate tilting.
    3. Repeat until all screws on the four GPU cold plates are fully tightened
    Note

    For reference, the torque required for the screws to be fully tightened/loosened is 0.4+/-0.05 N-m, 3.5+/-0.5 lb-In.

    Figure 28. GPU cold plate screw installation
    
    
25. Follow the screw installation sequence specified on the network board label, and install network cold plate screws (x8 Torx T10 screws) with a torque screwdriver set to the proper torque.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 29. Network card screw installation
    
    
26. Install the quick connect screws (x4 Torx T10) with a torque screwdriver set to the proper torque.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 30. Quick connect screw installation (GPU node)
    
    
27. Install water loop screws and quick connect screws (x11 Torx T10 screws) with a torque screwdriver set to the proper torque.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 31. Water loop Torx T10 screws installation (GPU node)
    
    
28. Install the Hex screw (x1) and the PH1 screws (x3).
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5.0+/- 0.5 lbf-in, 0.55+/- 0.05 N-M.

    Figure 32. Water loop Hex and PH1 screws installation (GPU node)
    
    
29. Install the cable tie to the GPU board.
    Figure 33. Installing the cable tie
    
    
30. Connect the carrier board power cable.
    Figure 34. Connecting carrier board power cable
    
    

    From (carrier board)	To (GPU node power distribution board)
    1 Power and side band connector	1 Power connector