PNY NVIDIA H200 NVL PCIE 141 GB HBM3e Graphics Card
The NVIDIA H200 NVL supercharges generative AI and high-performance computing (HPC) workloads with game-changing performance and memory capabilities. As the first GPU with HBM3e, the H200's larger and faster memory fuels the acceleration of generative AI and large language models (LLMs) while advancing scientific computing for HPC workloads.
Features:
141GB of HBM3e GPU memory
4.8TB/s of memory bandwidth
4 petaFLOPS of FP8 performance
2X LLM inference performance
110X HPC performance
Up to 600 W Power Consumption
NVIDIA Hopper Architecture
Specifications:
| FP64 |
34 TFLOPS |
| FP64 Tensor Core |
67 TFLOPS |
| FP32 |
67 TFLOPS |
| TF32 Tensor Core² |
989 TFLOPS |
| BFLOAT16 Tensor Core² |
1,979 TFLOPS |
| FP16 Tensor Core² |
1,979 TFLOPS |
| FP8 Tensor Core² |
3,958 TFLOPS |
| INT8 Tensor Core² |
3,958 TFLOPS |
| GPU Memory |
141GB |
| GPU Memory Bandwidth |
4.8TB/s |
| Decoders |
7 NVDEC
7 JPEG |
| Confidential Computing |
Supported |
| Max Thermal Design Power (TDP) |
Up to 600W (configurable) |
| Multi-Instance GPUs |
Up to 7 MIGs @ 18GB each |
| Form Factor |
PCIe |
| Interconnect |
2- or 4-way NVIDIA NVLink bridge: 900GB/s
PCIe Gen5: 128GB/s |
| Server Options |
NVIDIA MGX H200 NVL partner and NVIDIA-Certified Systems with up to 8 GPUs |
| NVIDIA AI Enterprise |
Included |
