NVIDIA H100 NVL 94GB HBM3
$28,970
The NVIDIA H100 GPU delivers exceptional performance, scalability, and security for every workload. H100 uses breakthrough innovations based on the NVIDIA Hopper™ architecture to deliver industry-leading conversational AI, speeding up large language models (LLMs) by 30X. H100 also includes a dedicated Transformer Engine to solve trillion-parameter language models.
Description
| Model | H100 NVL |
| GPU Memory | 94GB HBM3 |
| Memory bandwidth | 3,938 GB/s |
| FP64 Tensor Core | 67 TFLOPS |
| TF32 Tensor Core | 989 TFLOPS |
| FP16 Tensor Core | 1,979 TFLOPS |
| FP8 Tensor Core | 3,958 TFLOPS |
| INT8 Tensor Core | 3,958 TOPS |
| Max thermal design power (TDP) | 400W |
| Multi-Instance GPUs | Up to 7 MIGS @ 12GB each |
| NVLink | 2 -way 2-slot or 3-slot b |
| Form factor | PCIe dual-slot air-cooled |
| Server options | Partner and NVIDIA Certified Systems with 1–8 GPUs |
| Decoders | 7 NVDEC | 7 JPEG |
Additional information
| Weight | 1.3 kg |
|---|---|
| Condition | NEW |
