← All chips

AI accelerator · Global

Nvidia H100 SXM

Hopper-generation flagship that anchored the 2023-2024 generative-AI buildout (80GB HBM3, second-generation Transformer Engine). No official list price; 2023 street prices ran ~$25k-46k per card and have since eased toward ~$25k.

GlobalShippingNvidiaHopper familyLaunched 2022-03TSMC 4N

Latest observation ~$25K (per card) as of 2026-08 · researched 2026-08-27

~$25Klatest observation · street price · 2026-08
7dated price observations on record
12sourced specs (all linked below)

Specifications

Sourced specs

SpecValueSource
FP64 compute34 TFLOPSvia nvidia.com2026-08-27
FP64 Tensor Core67 TFLOPSvia nvidia.com2026-08-27
FP32 compute67 TFLOPSvia nvidia.com2026-08-27
TF32 Tensor Core989 TFLOPS with sparsity (~494.5 dense, SXM)via nvidia.com2026-08-27
BF16 Tensor Core1,979 TFLOPS with sparsity (~989.5 dense, SXM)via nvidia.com2026-08-27
FP16 Tensor Core1,979 TFLOPS with sparsity (~989.5 dense, SXM)via nvidia.com2026-08-27
FP8 Tensor Core3,958 TFLOPS with sparsity (~1,979 dense, SXM)via nvidia.com2026-08-27
INT8 Tensor Core3,958 TOPS with sparsity (~1,979 dense, SXM)via nvidia.com2026-08-27
Memory80GB HBM3, 3.35 TB/svia nvidia.com2026-08-27
InterconnectNVLink 900 GB/s (4th gen), PCIe Gen5 128 GB/svia nvidia.com2026-08-27
TDPUp to 700W (configurable)via nvidia.com2026-08-27
Multi-Instance GPUUp to 7 MIG instances at 10GB eachvia nvidia.com2026-08-27

Pricing

Price history, newest first

DatePriceTypeSourceConfidence
2026-08~$25K per cardH100 buy price 'starts at ~$25,000' in 2026; market held roughly $25k-40k from mid-2024 into early 2026Street pricevia Jarvislabs 2026 price guidelow
2025-10~$25K per card~$100B revenue on ~4M Hopper GPUs through Oct 2025 implies ~$25k average selling priceReported contractvia Epoch AI (citing Jensen Huang disclosure)medium
2024-09~$20K per cardSemiAnalysis: H100s sold for $20k-23k after 2024 price cuts amid Blackwell transitionAnalyst estimatevia Epoch AI (citing SemiAnalysis via FT)medium
2024-03~$25K per cardAnalysts: H100s cost between $25k and $40kStreet pricevia Epoch AI (citing CNBC analyst commentary)medium
2024-01~$30K per cardH100 cards listed at $30,000-$40,000+ on eBay; 'peaked beyond $40,000'Street pricevia Tom's Hardwaremedium
2023-05~$24K per GPU (8-GPU HGX H100 baseboard)SemiAnalysis: HGX H100 8-GPU board ~$195k (about $24k/GPU); full server about $272k (~$34k/GPU)Reported contractvia Epoch AI (citing SemiAnalysis)medium
2023-04-14~$40K per cardeBay listings $39,995 to just under $46,000 during the shortageStreet pricevia CNBCmedium

vendor-official or multiple independent reports · single major report or several secondary · estimate or lone secondary source

Prices in USD, converted at each observation year's average exchange rate; the original figure and rate print under every converted price. How prices are sourced and graded ↗

Context

Notes

  • Nvidia lists no official H100 price; all points are reputable reporting or analyst estimates.
  • H100 8-GPU HGX systems were roughly $270k-300k at the 2023 peak (SemiAnalysis).

Where it sits

In the stack

All specs and prices link to their original sources, dated as observed. Figures are market observations, not offers; treat each as of its date.