Skip to main content

Install the water loop in SD650-N V2 tray

Use this information to install the water loop in SD650-N V2 tray.

About this task

Attention
  • Read the following sections to ensure that you work safely.
  • Turn off the corresponding DWC tray that you are going to perform the task on.
    Note
    If Shared I/O adapters are installed, power off the auxiliary node (node 1/3/5/7/9/11) first, and then power off the primary node (node 2/4/6/8/10/12).
  • Disconnect all external cables from the enclosure.
    Note
    Use extra forces to disconnect QSFP cables if they are connected to the solution.
  • A torque screwdriver is available for request if you do not have one at hand.

  • To avoid damaging the water loop, always use the water loop carrier when removing, installing or folding the water loop.

Note

Ensure you have “SD650 V2 or SD650-N V2 Neptune DWC Waterloop Service Kit “ in hand to install components.

Prepare the following screwdrivers to ensure you can install and remove corresponding screws properly.
Screwdriver TypeScrew Type
Torx T10 head screwdriverTorx T10 screw
Phillips #1 head screwdriver or 3/16" hex head screwdriverPhillips #1 screw
Phillips #2 head screwdriverPhillips #2 screw

Procedure

  1. Install processor retainers onto processors if you need to install processors.
    1. Align the triangular mark on the processor retainer with the triangular mark on the processor corner edge.
    2. Gently place the processor retainer on the processor; then, carefully press the four sides of the processor retainer to secure the processor.
      Figure 1. Installing a processor retainer
      Installing a processor retainer
  2. Remove two plastic grease covers if needed.
    1. ❶ Use a scissors to cut off tapes.
    2. ❷ Remove plastic grease covers from underside of water loop cold plates.
      Figure 2. Plastic grease covers removal
      Plastic grease covers removal
  3. Align the triangular mark on the processor retainer with the triangular slot on the underside of the water loop cold plate; then, attach the processor to the underside of the water loop cold plate by inserting the processor retainer posts and clips features into the openings at the four corners of the cold plate.
    Figure 3. Processor installation
    Processor installation
  4. Check the gap pads on the water loop, if any of them are damaged or missing, replace them with the new ones.
    Figure 4. Water loop - Gap pads
    Water loop - Gap pads
  5. Rotate eight anti-tilt wire bails outwards to the unlocked position.
    Figure 5. Processor - unlocked position
    Processor - unlocked position
  6. Fully loosen two captive thumbscrews located at each end of the water loop carrier.
    Figure 6. Loosening captive thumbscrews
    Loosening captive thumbscrews
  7. Install the one side of the water loop.
    1. ❶ Carefully hold the water loop and flip it.
    2. ❷ Carefully align the water loop with eight guide pins on four GPU cold plates; then, carefully insert the quick connect tip through the opening in the rear of the tray.
    3. ❸ While holding the water loop with both hands, gently lower down the water loop.
    4. ❹ Gently put the water loop down and ensure it is seated firmly on the system board.
    Figure 7. Water loop carrier installation
    Water loop carrier installation
  8. Apply the new thermal grease on GPUs.
    1. If there is any old thermal grease on four GPUs and the cold plates, gently clean the top of the four GPUs and the cold plates using an alcohol cleaning pad.
    2. If you have cleaned the top of the GPUs with an alcohol cleaning pad, make sure to apply the new thermal grease after the alcohol has fully evaporated.
    3. Apply gray thermal grease to the top of the four GPUs with a syringe by forming four dots spaced as shown below, with each dot consisting of about 0.5 gram (about 0.225 ml) of gray thermal grease. Each syringe contains 1 gram of thermal grease, sufficient for two dots of thermal grease.
    Figure 8. Thermal grease application
    Thermal grease application
  9. Replace the existing putty pad with the new one.
    Figure 9. Putty pad
    Putty pad
  10. Remove all plastic grease covers from underside of water loop cold plates.
    Figure 10. Plastic grease covers removal
    Plastic grease covers removal
  11. Fully loosen two captive thumbscrews located at each end of the water loop carrier.
    Figure 11. Loosening captive thumbscrews
    Loosening captive thumbscrews
  12. Install the other side of the water loop.
    1. ❶ Carefully lift top side of the water loop and rotate it to the other half of the tray.
    2. ❷ Carefully insert the quick connect into the tray opening as shown.
    3. ❸ Carefully position the water loop on two guide pins near the rear of the node; then, gently put the water loop down and ensure it is firmly seated on the system board.
    Figure 12. Water loop rotation
    Water loop rotation
  13. Loosen water loop carrier screws (27x Phillips #2 screws for two nodes).
    Figure 13. Loosening water loop carrier screws
    Loosening water loop carrier screws
  14. Carefully lift each water loop carrier up and away from the water loop one at a time.
    Figure 14. Water loop carrier removal
    Water loop carrier removal
  15. Install water loop screws (21x Torx T10 screws for two nodes) with a torque screwdriver sets to the proper torque.
    Note
    • For reference, the torque required for the screws to be fully tightened/removed is 0.5-0.6 newton-meters, 4.5-5.5 inch-pounds.
    • The screw holes that are circled in blue are meant for 9.5 mm screws, while the others that are circled in red are meant for 8.0 mm ones.
    Figure 15. Water loop screws installation
    Water loop screws installation
  16. Install the following screws.
    • Eight Torx T10 screws to secure the quick connect.

    • Two Phillips #1 screws on the rear of the node.

    Figure 16. Screws installation
    Screws installation
  17. Ensure the processors are secured properly.
    1. ❶ Rotate anti-tilt wire bails (8x anti-tilt wire bails per node) outwards to the locked position.
    2. ❷ Fully tighten all Torx T30 captive screws (8x Torx T30 captive screws per node) with a general screwdriver on cold plates with a general screwdriver until they stop, following the installation sequence shown on the cold plate label.
      Note
      For reference, the torque required for the screws to be fully tightened/removed is 1.1-1.15 newton-meters, 9.8-10.2 inch-pounds.
      Attention
      To prevent damage to components, make sure that you follow the indicated tightening sequence.
      Figure 17. VR clamp plate installation
      VR clamp plate installation
  18. Install the GPU cold plate screws (16x Phillips #1 screws) with a torque screwdriver sets to the proper torque.
    Note
    For reference, the torque required for the screws to be fully tightened/removed is 0.34-046 newton-meters, 3-4 inch-pounds.
    Figure 18. GPU cold plate screw installation
    GPU cold plate screw installation
  19. Slide the VR clamp plates into the node and install Torx T10 screws.
    Figure 19. VR clamp plate installation
    VR clamp plate installation
After you finish
  1. Reinstall DIMMs in both nodes (see Install a memory module).

  2. Reinstall DIMM combs. (see Install a DIMM comb).

  3. Reinstall M.2 backplanes (see Install the M.2 backplane).

  4. Reinstall drive cage assemblies if applicable (see Install a drive cage assembly).

  5. Reinstall PCIe rise assemblies if applicable (see Install a PCIe adapter).

  6. Connect GPU power cable.

    Figure 20. GPU power cable installation
    GPU power cable installation
  7. See Cable installation order to connect and route required cables accordingly.

  8. Reinstall the front and the rear cross braces (11x Phillips #1 screws).

    Figure 21. Cross brace installation
    Cross brace installation
  9. Reinstall the tray cover (see Install the tray cover).

  10. Reinstall the tray (see Install a DWC tray in the enclosure).

    Note
    For safety, use the lift tool to install the tray into the rack.
  11. Connect all required external cables to the enclosure.
    Note
    Use extra forces to connect QSFP cables to the enclosure if Mellanox ConnectX-6 adapters are installed.
  12. Check the power LED on each node to make sure it changes from fast blink to slow blink to indicate all nodes are ready to be powered on.

Demo video

Watch the procedure on YouTube