NVIDIA

Tensor Core accelerators

Hopper and Ampere accelerators for LLM training and scale-out inference.

NVIDIA A100 Tensor Core

Bandwidth: 1.9–2.0 TB/s
Power: 300–400W
Form factor: PCIe / SXM

Configure

NVIDIA H100 Tensor Core

Bandwidth: 3.35 TB/s
Power: ≈700W
Form factor: PCIe / SXM

Configure

NVIDIA H200 Tensor Core

Hopper (enhanced)

Bandwidth: 4.8 TB/s
Power: ≈700–800W
Form factor: PCIe / SXM

Configure