Thermal rules for server with DWCM
This topic provides thermal rules for the server with a Direct Water Cooling Module (DWCM).
Max.Temp.: Maximum ambient temperature at sea level
FIO = riser 5 + front OCP
4LP = riser 3/4
S/S: SAS/SATA
Any: AnyBay
E: entry
S: standard
P: performance
SW: single-wide
DW: double-wide
NA: not applicable
Y: yes
N: no
- Performance fans are needed for the server having any of the following components:
front PCIe and OCP adapters
OCP module installed in the chassis with 12 x 3.5-inch front drives
rear 7mm NVMe drives installed in the chassis with 12 x 3.5-inch front drives
internal CFF RAID/HBA/expander
parts with active optical cable (AOC) installed in storage configurations
- ThinkSystem 96GB TruDDR5 4800MHz (2Rx4) RDIMM
ThinkSystem 128GB TruDDR5 5600MHz (2Rx4) RDIMM
ThinkSystem 128GB TruDDR5 4800MHz (4Rx4) 3DS RDIMM v1
ThinkSystem 256GB TruDDR5 4800MHz (8Rx4) 3DS RDIMM v1
- the following special network cards installed in storage configurations
Mellanox ConnectX-6 HDR100 IB/100GbE VPI 1-port x16 PCIe 3.0 HCA w/ Tall Bracket L1/SBB with Active Fiber cables
Mellanox ConnectX-6 HDR100 IB/100GbE VPI 2-port x16 PCIe 3.0 HCA w/ Tall Bracket L1/SBB with Active Fiber cables
Mellanox ConnectX-6 HDR IB/200GbE Single Port x16 PCIe Adapter w/ Tall Bracket with Active Fiber cables
Mellanox MCX623106AC-CDAT Dx 100GbE QSFP56 2-port PCIe NIC -CSP I4
ThinkSystem Mellanox ConnectX-6 Dx 100GbE QSFP56 2-port PCIe Ethernet Adapter with Active Fiber cables
ThinkSystem NVIDIA BlueField-2 25GbE SFP56 2-Port PCIe Ethernet DPU w/BMC & Crypto
ThinkSystem NVIDIA ConnectX-7 NDR400 OSFP 1-port PCIe Gen5 Adapter with Active Fiber cables
ThinkSystem NVIDIA ConnectX-7 NDR200/HDR QSFP112 2-port PCIe Gen5 x16 InfiniBand Adapter with Active Fiber cables
ThinkSystem Broadcom 57508 100GbE QSFP56 2-port PCIe 4 Ethernet Adapter V2 with Active Fiber cables
ThinkSystem Broadcom 57454 10GBASE-T 4-port OCP Ethernet Adapter
ThinkSystem Broadcom 57416 10GBASE-T 2-port OCP Ethernet Adapter
ThinkSystem Broadcom 57508 100GbE QSFP56 2-Port OCP Ethernet Adapter
- The ambient temperature is limited to 30°C or lower when any of the following types of RDIMMs are used:
5600 MHz RDIMMs with capacity greater than or equal to 96 GB
- ThinkSystem 96GB TruDDR5 4800MHz (2Rx4) RDIMM
ThinkSystem 128GB TruDDR5 4800MHz (4Rx4) 3DS RDIMM v1
4800 MHz 256 GB RDIMMs (except ThinkSystem 256GB TruDDR5 4800MHz (8Rx4) 3DS RDIMM v1)
Standard configurations
This section provides thermal information for standard configurations with a DWCM.
| Front drive bays | Max. Temp. | CPU TDP (watts) | Air baffle | Fan type | Max. DIMM Qty. |
|---|---|---|---|---|---|
8 x 2.5" 16 x 2.5" 8 x 3.5" | 35°C | All supported | S | S | 32 |
The ambient temperature is limited to 25°C when ThinkSystem 256GB TruDDR5 4800MHz (8Rx4) 3DS RDIMM v1 is used.
Storage configurations
This section provides thermal information for storage configurations with a DWCM.
| Front drive bays | Middle drive bays | Rear drive bays | Max. Temp. | Air baffle | Fan type | Max. DIMM Qty. |
|---|---|---|---|---|---|---|
16 x 2.5" S/S + 8 x 2.5" Any 8 x 2.5" S/S + 16 x 2.5" Any 24 x 2.5" S/S 24 x 2.5" Any | NA | NA | 35°C | S | S | 32 |
NA | 4 x 2.5" S/S 2 x 3.5" S/S | 35°C | S | P | 32 | |
8 x 2.5" NVMe | NA | 30°C | NA | P | 32 | |
8 x 2.5" S/S 4 x 3.5" S/S | 4 x 2.5" S/S 8 x 2.5" S/S | 35°C | NA | P | 32 | |
24 x 2.5" S/S 24 x 2.5" Any | NA | 4 x 2.5" NVMe | 30°C | S | P | 32 |
24 x 2.5" NVMe | 8 x 2.5" NVMe | 4 x 2.5" NVMe | 30°C | NA | P | 32 |
12 x 3.5" S/S 12 x 3.5" Any | NA | NA | 35°C | S | S | 32 |
NA | 2 x 3.5" S/S 4 x 3.5" S/S 4 x 2.5" S/S | 35°C | S | P | 32 | |
8 x 2.5" NVMe | NA | 30°C | NA | P | 32 | |
4 x 3.5" S/S | 4 x 3.5" S/S 4 x 2.5" S/S | 35°C | NA | P | 32 | |
12 x 3.5" S/S | NA | 4 x 2.5" NVMe | 30°C | S | P | 32 |
When the capacity of each RDIMM is less than 64 GB, standard fans are used.
When the capacity of each RDIMM is greater than or equal to 64 GB, performance fans are used.
Storage configurations with a DWCM does not support ThinkSystem 256GB TruDDR5 4800MHz (8Rx4) 3DS RDIMM v1.
- The ambient temperature is limited to 25°C or lower when the following NVMe SSDs are installed in the front 12 x 3.5" SAS/SATA + middle 8 x 2.5" NVMe or front 12 x 3.5" SAS/SATA + rear 4 x 2.5" NVMe configuration:
ThinkSystem 2.5" U.2 P5336 61.44TB Read Intensive NVMe PCIe 4.0 x4 HS SSD
ThinkSystem 2.5" U.2 P5336 30.72TB Read Intensive NVMe PCIe 4.0 x4 HS SSD
ThinkSystem 2.5" U.2 P5336 15.36TB Read Intensive NVMe PCIe 4.0 x4 HS SSD
GPU configurations without FIO and 4LP
This section provides thermal information for GPU configurations without FIO and 4LP.
Single-wide GPU: NVIDIA A2, T1000, T400, L4
Double-wide GPU: NVIDIA A16, A30, A40, A100, A800, H100, H800, L40, L40S, RTX A2000, RTX A4500, RTX A6000, RTX 6000 Ada, H100 NVL; AMD Instinct MI210
| Front drive bays | Max. Temp. | CPU TDP (watts) | Air baffle | Fan type | Max. GPU Qty. | Max. DIMM Qty. | |
|---|---|---|---|---|---|---|---|
| SW | DW | ||||||
8 x 2.5" 8 x 3.5" 16 x 2.5" | 35°C | All supported | S | P | 8 | NA | 32 |
| 35°C | All supported | GPU | P | NA | 3 | 32 | |
24 x 2.5" | 35°C | All supported | S | P | 6 | NA | 32 |
| 35°C | All supported | GPU | P | NA | 3 | 32 | |
- The ambient temperature must be limited to 30°C or lower in the following cases:
Three A40 GPU adapters are installed in 24 x 2.5" configurations.
Three 300 W GPU adapters are installed in 8 x 3.5" or 16 x 2.5" configurations.
The H100 NVL GPU adapter is installed.
- The ambient temperature must be limited to 25°C or lower in the following cases:
Three H100/H800/L40S GPU adapters are installed in 24 x 2.5" configurations.
The server is equipped with ThinkSystem 256GB TruDDR5 4800MHz (8Rx4) 3DS RDIMM v1.
The 24 x 2.5" configurations do not support the H100 NVL GPU adapter and ThinkSystem 256GB TruDDR5 4800MHz (8Rx4) 3DS RDIMM v1.
GPU Configurations with FIO
This section provides thermal information for the GPU configurations with FIO.
Single-wide GPU: NVIDIA A2, T1000, T400, L4
Double-wide GPU: NVIDIA A16, A30, A40, A100, A800, H100, H800, L40, L40S, RTX A2000, RTX A4500, RTX A6000, RTX 6000 Ada, H100 NVL; AMD Instinct MI210
| Front drive bays | Max. Temp. | CPU TDP (watts) | Air baffle | Fan type | Max. GPU Qty. | Max. DIMM Qty. | ||
|---|---|---|---|---|---|---|---|---|
| T1000/T400 | A2/L4 | DW | ||||||
8 x 2.5" + FIO 16 x 2.5" + FIO | 35°C | All supported | GPU | P | NA | NA | 3 | 32 |
| 30°C | All supported | S | P | 8 | 10 | NA | 32 | |
The front riser (riser 5) supports only passive SW GPU adapters.
- The ambient temperature must be limited to 30°C or lower in the following cases:
Three 300 W GPU adapters are installed in 8 x 2.5"+ FIO configurations.
Three A40 GPU adapters are installed in 16 x 2.5" + FIO configurations.
The H100 NVL GPU adapter is installed.
The ambient temperature must be limited to 25°C or lower when three H100/H800/L40S GPU adapters are installed in 16 x 2.5" + FIO configurations.
The 16 x 2.5" + FIO configurations do not support the H100 NVL GPU adapter and ThinkSystem 256GB TruDDR5 4800MHz (8Rx4) 3DS RDIMM v1.
Non-GPU Configurations with FIO or 4LP
This section provides thermal information for non-GPU configurations with FIO or rear 4LP riser.
| Front drive bays | Max. Temp. | CPU TDP (watts) | Air baffle | Fan type | Max. DIMM Qty. |
|---|---|---|---|---|---|
8 x 2.5" + FIO/4LP 16 x 2.5" + FIO/4LP | 35°C | All supported | S | P | 32 |