PNY H100 NVL NVIDIA 94 GB High Bandwidth Memory 3 (HBM3)

SKU
TCSH100NVLPCIE-PB
Login for pricing
In stock
94 GB, HBM3, 350-400 W TDP, 3.9 TB/s GPU memory bandwidth
Unprecedented Performance, Scalability, and Security for Every Data Center
H100 NVL is designed to scale support of Large Language Models in mainstream PCIe-based server systems. With increased raw performance, bigger, faster HBM3 memory and NVLink connectivity via bridges, mainstream systems configured with 8x H100 NVL outperform HGX A100 systems by up to 12X on GPT3-175B LLM throughput.

H100 NVL enables standard mainstream servers to provide high-performance large language model generative AI inference while enabling partners and solution providers the fastest time to market and ease of scale out.
SKU TCSH100NVLPCIE-PB
EAN 3536403396305
Specification
Processor
Graphics processor familyNVIDIA
Parallel processing technology supportNVLink
CUDA cores16896
CUDAYes
Graphics processorH100
Memory
Discrete graphics card memory94 GB
Memory bandwidth (max)3900 GB/s
Graphics card memory typeHigh Bandwidth Memory 3 (HBM3)
Video
Dual Link DVINo
CUDA cores16896
Performance
Dual Link DVINo
TV tuner integratedNo
Design
Cooling typePassive
Form factorFull-Height/Full-Length (FH/FL)
Product colourBrown
Bracket heightFull-Height (FH)
Power
Thermal Design Power (TDP)400 W
Technical details
Cooling typePassive
Form factorFull-Height/Full-Length (FH/FL)
Product colourBrown
TV tuner integratedNo
Manufacturer PNY
Availability N