Intel Gaudi 3 PCIe HL-338
$7,720
The Intel Gaudi 3 PCIe card HL-338 packs 128GB of HBM2e memory, 3.7 TB/s bandwidth, and 24 on-chip 200GbE RoCE v2 networking ports into a standard PCIe Gen5 dual-slot card. It supports PyTorch natively, integrates with Hugging Face and vLLM, and handles LLM inference, fine-tuning, and training workloads with automated FP8 quantization.
Description
Specification
| Model | Gaudi 3 PCIe |
|---|---|
| Architecture | Intel Gaudi 3 (5nm) |
| Compute Engines | 8 MME + 64 TPC |
| Memory | 128GB HBM2e |
| Memory Bandwidth | 3.7 TB/s |
| On-Die SRAM | 96MB (12.8 TB/s) |
| FP8 | 1,835 TFLOPS |
| BF16 | 1,835 TFLOPS |
| Data Types | FP8, BF16, FP16, TF32, FP32 |
| Networking | 24× 200GbE RoCE v2 on-chip (4.8 Tb/s) |
| Host Interface | PCIe Gen5 x16 |
| TDP | Up to 600W |
| Form Factor | Dual-slot, FHFL PCIe |
| Thermal | Passive |
| Software | Intel Gaudi Software, PyTorch, vLLM, Hugging Face |
Additional information
| Weight | 3.0 kg |
|---|---|
| Condition | NEW |
