Install the water loop

Use this information to install the water loop to the tray.

About this task

Required tools

• Screwdriver for PH 2, T10, and T15 screws

• Water loop shipping bracket

• GPU cold plate handle assembly

• GB200 NVL4 TIM Jig

• T15 screwdriver

• T10 bit together with torque wrench

• SC777 V4 GB200 Grease SE 7921

• Thermal interface materials for MCIO configuration

  • GB200-NVL4 PCM for MCIO Configuration.

  • GB200-NVL4 putty pad on plastic jig

  • Water loop putty pads and gap pads

    • Water loop DCSCM pads

    • (Optional, if E3.S switch board is installed.) Water loop E3.S switch board pad

    • Water loop host board pads

• Thermal interface materials for Dual CX8 mezzanine module configuration

  • GB200-NVL4 PCM for Dual CX8 mezzanine module configuration.

  • GB200-NVL4 putty pad on plastic jig

  • GB200-NVL4 putty pad for Dual CX8 mezzanine module configuration

  • Water loop putty pads and gap pads

    • Water loop DCSCM pads

    • (Optional, if E3.S switch board is installed.) Water loop E3.S switch board pad

    • Water loop host board pads

• ConnectX-7 400 interface plate pad

• OSFP interface plate pads

• ConnectX-7 200 interface plate pads

• ConnectX-8 XDR interface plate pads

• Dual CX8 mezzanine module configuration GB200-NVL4 putty pad

• E3.S drive cage bottom pad

• E3.S drive cage heat pipe gap pad

S038

CAUTION

Eye protection should be worn for this procedure.

S040

CAUTION

Protective gloves should be worn for this procedure.

S042

DANGER

danger

Risk of electric shock due to water or a water solution which is present in this product. Avoid working on or near energized equipment with wet hands or when spilled water is present.

Important

Gap pad, putty pad, and PCM replacement guidelines

• For gap pad, putty pad, and PCM locations and instruction, see Gap pad, putty pad, and PCM identification and location.

• Before replacing the gap pad, putty pad, or PCM, gently clean the surface with an alcohol cleaning pad.

• Hold the gap pad, putty pad, or PCM carefully to avoid deformation. Make sure no screw hole or opening is blocked by the gap pad, putty pad, or PCM material.

Attention

• Read Installation Guidelines and Safety inspection checklist to ensure that you work safely.

• Turn off the corresponding DWC tray that you are going to perform the task on.

• Disconnect all external cables from the enclosure.

• Use extra force to disconnect QSFP cables if they are connected to the solution.

• To avoid damaging the water loop, always use the water loop carrier when removing, installing or folding the water loop.

• A torque screwdriver is available for request if you do not have one at hand.

Procedure

1. Using an alcohol cleaning pad, gently clean the old gap pads and putty pads from the components in the front of the tray.
2. Using an alcohol cleaning pad, gently clean the old PCM and putty pads on the right-side and left-side GB200-NVL4 boards.
   Figure 1. PCM and putty pads on the GB200-NVL4 board
   
   

   1 Only for Dual CX8 Mezzanine Module configuration

3. While the water loop is still in the packaging box, install putty pads and gap pads to the water loop.

   1 System I/O board (DCSCM) putty pads Step 1: If there are old putty pads on the water loop, gently clean the old putty pads using an alcohol cleaning pad. Step 2: Install putty pads to the water loop. Make sure to follow Gap pad, putty pad, and PCM replacement guidelines.

   2 (Optional) E3.S switch board gap pads. These gap pads are required only when the E3.S switch board is installed in the system. 3 Host board gap pads If there is none on the water loop, or if the exiting ones are damaged, install new gap pads. Make sure to follow Gap pad, putty pad, and PCM replacement guidelines.

   Figure 2. Installing gap pads to the water loop
   
   
4. Align the “PIN” markings on the water loop with the two guide pins on the tray; then, install the water loop to the front of tray.
   Figure 3. Place the water loop onto the front of tray
   
   
5. Loosen four (4x) thumbscrews to release the quick connects from the shipping bracket.
   Figure 4. Loosening thumb screws to release the quick connects
   
   
6. Rotate the quick connects and place them on the rear of the tray.
   Figure 5. Placing the quick connects on the rear of the tray
   
   
7. Loosen eight (8x) Ph2 thumbscrews on the shipping bracket to release the GPU cold plate handles.
   Figure 6. Loosening GPU cold plate handle thumb screws
   
   
8. If installing a new water loop, remove the protective film from the water loop.
   Figure 7. Removing the protective film
   
   
9. If re-installing the water loop, clean the PCM and thermal grease from the GPU cold plate using an alcohol cleaning pad. Then, apply new thermal grease to the GPU cold plate.

   1 PCM.

   2 SC777 V4 GB200 Grease SE 7921. Reapply new grease after cleaning off old grease with an alcohol cleaning pad. The SC777 V4 GB200 Grease SE 7921 must be used in this area.

   Figure 8. PCM and thermal grease on the GPU cold plate
   
   

   Figure 9. Applying grease to the GPU cold plate

   Note

   Apply a line of 0.2 ml of grease on the cold plate. Make sure to evenly distribute the grease, and the line of grease does not reach the edges of the cold plate. The SC777 V4 GB200 Grease SE 7921 must be used in this area.

   
   
   
10. Install three PCMs on the GB200-NVL4 boards.
    Note

    Install PCMs to the right-side and left-side GB200-NVL4 boards.
    1. Align the PCM stencil to the guide pins on the GB200-NVL4 board. Then, install the stencil to the board.
    2. Following the stencil cutouts, install three PCM to the GB200-NVL4 board.
    3. Remove the stencil.
    Figure 10. Installing PCM to both GB200-NVL4 boards
    
    
11. Installing putty pads with the plastic jig.
    Note

    Install the putty pads to the right-side and left-side GB200-NVL4 boards.
    1. Keep the pads facing down, and align the plastic jig to the two guide pins on the GB200-NVL4 board. Then, gently place it on the board.
       Figure 11. Placing the plastic jig on the GB200-NVL4 board
       
       
    2. Gently pat each pad to help it stick to the board.
    3. Remove the plastic jig. Inspect the plastic jig to ensure that no putty pads remain on it. If any pads remain on the plastic jig, reapply the jig to stick the putty pads to GB200-NVL4 board.
    Figure 12. Sticking the putty pads to the GB200-NVL4 board
    
    
12. (ONLY for Dual CX8 mezzanine module configuration) Install putty pads and PCM to the CX8 mezzanine module.
    Note

    Install the putty pads and PCM to the right-side and left-side CX8 mezzanine modules.
    1. Install two putty pads to the CX8 mezzanine module.
       Figure 13. Installing CX8 mezzanine module putty pads
       
       
    2. Install two PCM to the CX8 mezzanine module.
       Figure 14. Installing CX8 mezzanine module PCM
       
       
13. Align the water loop to the guide pins; then, flip the water loop to install it to the GB200-NVL4 boards.
    Figure 15. Water loop guide pins
    
    

    Figure 16. Install the water loop to the GB200-NVL4 boards
    
    
14. Place the water loop hoses between the screws as shown in the illustration below.
    Figure 17. Water loop hoses placement
    
    
15. Install the T15 extension bit to the torque screwdriver; then, set the torque screwdriver to the proper torque, and fasten twenty-one (21x) T15 thumbscrews to engage the GPU cold plate to the GB200-NVL4 board. Make sure to follow the sequence shown in the illustration below.
    Note

    • Screw 16, 17, 18, 19, 20, 21 are ONLY for Dual CX8 mezzanine module configuration. Fasten/loosen fifteen (15x) screws for MCIO breakout board.

    • Fasten thumbscrews on the right and left water loops.

    • For reference, the torque required for the screws to be fully tightened/removed is 1.0 +/- 4% in-lbs, 0.11 +/- 4% m.

    • Installing the T15 extension bit to the torque screwdriver before installing the screws.

      Figure 18. T15 extension bit
      
      

    Figure 19. Engage GPU cold plate to the GB200-NVL4 board
    
    
16. Loosen eight (8x) thumbscrews to release the GPU cold plate handle. Make sure to follow the sequence shown in the illustration below.
    Note

    Loosen thumbscrews from the right-side and left-side GPU cold plate handles.

    Figure 20. Loosening eight GPU cold plate handle thumbscrews
    
    
17. Releasing the retaining thumb screw.
    1. Loosen the retaining thumb screw.
    2. Pull the retaining thumbscrew out of the slot.
    Note

    Release the retaining thumb screw from the right-side and left-side GPU cold plate handles.

    Figure 21. Releasing the retaining thumbscrew
    
    
18. Remove the GPU cold plate handles.
    Figure 22. Removing the GPU cold plate handles
    
    
19. With a torque screwdriver set to the proper torque, fasten twenty-one (21x) thumb screws to install the GPU cold plate to the GB200-NVL4 board. Make sure to follow the sequence shown in the illustration below.
    Note

    • Screw 16, 17, 18, 19, 20, 21 are ONLY for Dual CX8 mezzanine module configuration. Fasten/loosen fifteen (15x) screws for MCIO breakout board.

    • Fasten the screws on the right and left water loops.

    • For reference, the torque required for the screws to be fully tightened/removed is 5.2 +/- 4% in-lbs, or 0.58 +/- 4% N-m.

    Figure 23. Installing GPU cold plate to the GB200-NVL4 board
    
    
20. Insert the quick connects to the slots on the rear wall.
    Figure 24. Inserting quick connects to the rear wall
    
    
21. Install the T10 extension bit to the torque screwdriver; then, set the torque screwdriver to the proper torque, and install eight (8x) T10 screws to secure the quick connects to the rear wall.
    Note

    • For reference, the torque required for the screws to be fully tightened/removed is 5 +/- 0.5 in-lbs, or 0.56 +/- 0.056 N-m.

    • Installing the T10 extension bit to the torque screwdriver before installing the screws.

      Figure 25. T10 extension bit
      
      

    Figure 26. Installing the quick connect screws
    
    
22. From the front of the tray, install twenty-three (22x) T10 screws to install the water loop to the tray.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5 +/- 0.5 in-lbs, or 0.56 +/- 0.056 N-m.

    Figure 27. Installing water loop screws
    
    
23. Installing two (2x) PH2 screws and three (3x) PH2 screws to each side of the tray. Install total of four (4x) PH2 screws and six (6x) PHs screws to left-side and right-side.
    Note

    For reference, the torque required for the screws to be fully tightened/removed is 5 +/- 0.5 in-lbs, or 0.56 +/- 0.056 N-m.

    Figure 28. Installing screws to left-side and right-side of the tray
    
    
24. Remove sixteen (16x) PH2 thumbscrews from the shipping bracket.
    Figure 29. Removing shipping bracket screws
    
    
25. Remove the shipping bracket from the tray.
    Figure 30. Removing shipping bracket
    
    
26. Install putty pads to the conduction plates as shown in the illustration below. Make sure to use the correct putty pads and conduction plates according to system configuration. Before installing the putty pads, use an alcohol cleaning pad to gently clean off old putty pads from the bottom side of the conduction plates and from GPU cold plates.
    Figure 31. Conduction plate for GPU cold plate

    • 1 Conduction plate for MCIO breakout board configuration
    • 2 Conduction plate for Dual CX8 mezzanine module configuration

    
    
    
27. Install conduction plates to the GPU cold plates.
    1. Align the conduction plates to the screw holes on the GPU cold plates. Then, place the conduction plates to the GPU cold plates.
       Figure 32. Aligning conduction plate with screw holes on GPU cold plate (MCIO breakout board configuration)
       
       

       Figure 33. Aligning conduction plate with screw holes on GPU cold plate (Dual CX8 mezzanine module configuration)
       
       
    2. Follow the sequence shown in the illustrations below to fasten three Torx T10 screws to secure the conduction plate to the GPU cold plate. Total of two conduction plates need to be installed.
       Figure 34. Aligning cold plate with screw hole on water loop (MCIO breakout board configuration)
       
       

       Figure 35. Aligning cold plate with screw hole on water loop (Dual CX8 mezzanine module configuration)
       
       
28. Install six (6x) screws and six (6x) cable ties to the water loop in the front of the tray.
    Figure 36. Installing cable ties to the water loop
    
    
29. Remove covers from the quick connects.
    Figure 37. Removing quick connect covers