Latitude.shIn stock
On-Demand from $1.68
From
$1.68 / GPU / hr
On-DemandVisit website →
Rental price index
NVIDIA H100 SXM
🏢The reference datacenter GPU. Underlies the CME H100 rental index.
Prices collected 2026-10-11 · 43 providers, 96 configurations
On-demandOn-demand (archive, Lambda only)ReservedSpot
Index median price per GPU per hour, by billing type. Nothing is interpolated.
At a glance
Median on-demand
$3.50/GPU/hr
Cheapest on-demand
$1.68Latitude.sh
Latitude.shFloor, any billing
$0.79incl. spot
Per month at 720h
$2,520
NVIDIA H100 SXM pricing by provider
One card per provider, cheapest first. A configuration is one priced unit — an instance type, a SKU, a marketplace offer — and the per-GPU price is that unit's price divided by its GPU count. Open a card to see every configuration with its vCPU, RAM and region where the provider publishes them.
43 providers · 84 configurations
HyperAIIn stock
CNChina1 config1xcollected 2026-10-11
On-Demand from $1.80
From
$1.80 / GPU / hr
On-DemandVisit website →
io.netIn stock
USUSA6 configs1x–4xcollected 2026-10-11
On-Demand from $1.99
From
$1.99 / GPU / hr
On-DemandVisit website →
Vast.aiIn stock
USUSA7 configs1x–2xcollected 2026-10-11
On-Demand from $2.04
From
$2.04 / GPU / hr
On-Demand · Germany, DEVisit website →
SeewebIn stock
ITItaly1 config1xcollected 2026-10-11
On-Demand from $2.12
From
$2.12 / GPU / hr
On-DemandVisit website →
TensorDockIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $2.25
From
$2.25 / GPU / hr
On-DemandVisit website →
Denvr DataworksIn stock
CACanada1 config1xcollected 2026-10-11
On-Demand from $2.45
From
$2.45 / GPU / hr
On-DemandVisit website →
OblivusIn stock
GBUK6 configs1x–8xcollected 2026-10-11
On-Demand from $2.49
From
$2.49 / GPU / hr
On-DemandVisit website →
KoyebIn stock
FRFrance4 configs1x–8xcollected 2026-10-11
On-Demand from $2.50
From
$2.50 / GPU / hr
On-DemandVisit website →
HyperstackIn stock
GBUK3 configs1xcollected 2026-10-11
On-Demand from $2.50Reserved from $1.75
From
$2.50 / GPU / hr
On-DemandVisit website →GMI CloudIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $2.60
From
$2.60 / GPU / hr
On-DemandVisit website →
Taiga CloudIn stock
DEGermany1 config1xcollected 2026-10-11
On-Demand from $2.60
From
$2.60 / GPU / hr
On-DemandVisit website →SpheronIn stock
1 config1xcollected 2026-10-11
On-Demand from $2.64
From
$2.64 / GPU / hr
On-DemandVisit website →
RunPod Community CloudIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $2.69
From
$2.69 / GPU / hr
On-DemandVisit website →E2E NetworksIn stock
INIndia1 config1xcollected 2026-10-11
On-Demand from $2.69
From
$2.69 / GPU / hr
On-DemandVisit website →Massed ComputeIn stock
USUSA2 configs1xcollected 2026-10-11
On-Demand from $2.73
From
$2.73 / GPU / hr
On-DemandVisit website →AkashIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $2.73
From
$2.73 / GPU / hr
On-DemandVisit website →
NorthflankIn stock
GBUK1 config1xcollected 2026-10-11
On-Demand from $2.74
From
$2.74 / GPU / hr
On-DemandVisit website →
Thunder ComputeIn stock
USUSA2 configs1xcollected 2026-10-11
On-Demand from $2.95
From
$2.95 / GPU / hr
On-DemandVisit website →
CivoIn stock
GBUK2 configs1x–8xcollected 2026-10-11
On-Demand from $2.99
From
$2.99 / GPU / hr
On-DemandVisit website →
OVHcloudIn stock
FRFrance4 configs1x–4xcollected 2026-10-11
On-Demand from $2.99
From
$2.99 / GPU / hr
On-DemandVisit website →
Paperspace (DigitalOcean)In stock
USUSA2 configs1xcollected 2026-10-11
On-Demand from $3.09
From
$3.09 / GPU / hr
On-DemandVisit website →
RuncrateIn stock
1 config1xcollected 2026-10-11
On-Demand from $3.25
From
$3.25 / GPU / hr
On-DemandVisit website →
CerebriumIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $3.40
From
$3.40 / GPU / hr
On-DemandVisit website →
GPU.aiIn stock
AEUAE2 configs1xcollected 2026-10-11
On-Demand from $3.46
From
$3.46 / GPU / hr
On-DemandVisit website →
JarvislabsIn stock
INIndia1 config1xcollected 2026-10-11
On-Demand from $3.49
From
$3.49 / GPU / hr
On-DemandVisit website →
BeamIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $3.50
From
$3.50 / GPU / hr
On-DemandVisit website →
Cyfuture AIIn stock
INIndia1 config8xcollected 2026-10-11
On-Demand from $3.56
From
$3.56 / GPU / hr
On-DemandVisit website →
CrusoeIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $3.90
From
$3.90 / GPU / hr
On-DemandVisit website →
RunPod Secure CloudIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $3.99
From
$3.99 / GPU / hr
On-DemandVisit website →
LambdaIn stock
USUSA4 configs1x–8xcollected 2026-10-11
On-Demand from $3.99
From
$3.99 / GPU / hr
On-DemandVisit website →
Together AIIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $3.99Spot from $1.99Reserved from $3.69
From
$3.99 / GPU / hr
On-DemandVisit website →
DataCrunch (Verda)In stock
FIFinland2 configs1xcollected 2026-10-11
On-Demand from $4.01
From
$4.01 / GPU / hr
On-DemandVisit website →
DigitalOcean GPU DropletsIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $4.41
From
$4.41 / GPU / hr
On-DemandVisit website →
fal.aiIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $4.50
From
$4.50 / GPU / hr
On-DemandVisit website →
NebiusIn stock
NLNetherlands1 config1xcollected 2026-10-11
On-Demand from $4.50Spot from $0.79
From
$4.50 / GPU / hr
On-DemandVisit website →
Lightning AIIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $4.68
From
$4.68 / GPU / hr
On-DemandVisit website →
ReplicateIn stock
USUSA4 configs1x–8xcollected 2026-10-11
On-Demand from $5.49
From
$5.49 / GPU / hr
On-DemandVisit website →
CoreWeaveIn stock
USUSA1 config8xcollected 2026-10-11
On-Demand from $6.16
From
$6.16 / GPU / hr
On-DemandVisit website →
BasetenIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $6.50
From
$6.50 / GPU / hr
On-DemandVisit website →
Amazon Web ServicesIn stock
USUSA2 configs1x–8xcollected 2026-10-11
On-Demand from $6.88
From
$6.88 / GPU / hr
On-Demand · us-east-1Visit website →
Oracle CloudIn stock
USUSA1 config1xcollected 2026-10-11
On-Demand from $10.00
From
$10.00 / GPU / hr
On-Demand · us-ashburn-1Visit website →
Microsoft AzureIn stock
USUSA5 configs8xcollected 2026-10-11
On-Demand from $11.06Spot from $2.04
From
$11.06 / GPU / hr
On-Demand · eastusVisit website →Recent price changes
Every time a provider's median for the NVIDIA H100 SXM moved between two consecutive snapshots. A listing appearing or vanishing is not a price change and is not shown.
| When | Provider | From | To | Change |
|---|---|---|---|---|
| 2026-10-11 09:14 | Vast.ai | $5.73 | $6.15 | +7.3% |
| 2026-10-11 09:14 | io.net | $3.67 | $3.87 | +5.4% |
| 2026-10-11 09:14 | DataCrunch (Verda) | $4.13 | $4.21 | +2.1% |
| 2026-10-10 08:53 | Vast.ai | $2.14 | $5.73 | +168.4% |
| 2026-10-10 08:53 | $4.20 | $2.64 | -37.1% | |
| 2026-10-10 08:53 | Runcrate | $4.29 | $3.25 | -24.2% |
| 2026-10-10 08:53 | io.net | $4.22 | $3.67 | -12.9% |
| 2026-10-10 08:53 | GPU.ai | $3.99 | $3.70 | -7.4% |
| 2026-10-09 09:31 | Vast.ai | $6.43 | $2.14 | -66.8% |
| 2026-10-09 09:31 | io.net | $2.60 | $4.22 | +62.1% |
Spot, reserved and where it is cheapest
Spot median
$2.0442% off · 3 providers
Reserved median
$2.7621% off · 2 providers
Brazil providers
$1.68median of 1
China providers
$1.80median of 1
By provider country: Brazil $1.68 (1) · China $1.80 (1) · Italy $2.12 (1) · Canada $2.45 (1) · Germany $2.60 (1) · France $2.75 (2) · UK $2.87 (4) · India $3.49 (3) · UAE $3.73 (1) · USA $4.06 (24) · Finland $4.21 (1) · Netherlands $4.50 (1). Full breakdown →
What fits on a NVIDIA H100 SXM
Weights + KV cache at 8K context + runtime overhead, against 72 GB usable of the 80 GB on the card. Capacity follows total parameters, even for mixture-of-experts models — any expert may be needed next. Where one card is not enough, the table says how many are, and prices the set at today's median.
| Model | Params | 4-bit | 8-bit | 16-bit |
|---|---|---|---|---|
| 2.8T104B active | 22× GPU$77.00/hr | 42× GPU$147.00/hr | 78× GPU$273.00/hr | |
| 552B16B active | 5× GPU$17.50/hr | 9× GPU$31.50/hr | 16× GPU$56.00/hr | |
 Llama 4 Maverick | 400B17B active | 4× GPU$14.00/hr | 6× GPU$21.00/hr | 12× GPU$42.00/hr |
 gpt-oss-120b | 117B5.1B active | ✓ 67.9 GB~934 tok/s · $1.04/M tok | 2× GPU$7.00/hr | 4× GPU$14.00/hr |
| Llama 3.1 70B | 70B | ✓ 44.5 GB~68 tok/s · $14.3/M tok | 2× GPU$7.00/hr | 3× GPU$10.50/hr |
 Gemma 4 31B | 31B | ✓ 21.2 GB~154 tok/s · $6.31/M tok | ✓ 36.7 GB~81 tok/s · $12/M tok | ✓ 65.7 GB~43 tok/s · $22.61/M tok |
 Qwen3 Coder 30B-A3B | 30.5B3.3B active | ✓ 19 GB~1444 tok/s · $0.67/M tok | ✓ 34.3 GB~764 tok/s · $1.27/M tok | ✓ 62.9 GB~406 tok/s · $2.39/M tok |
| Qwen3.8 27B | 27B | ✓ 18.7 GB~176 tok/s · $5.52/M tok | ✓ 32.2 GB~93 tok/s · $10.45/M tok | ✓ 57.6 GB~50 tok/s · $19.44/M tok |
| gpt-oss-20b | 21B3.6B active | ✓ 13.7 GB~1323 tok/s · $0.73/M tok | ✓ 24.2 GB~701 tok/s · $1.39/M tok | ✓ 43.9 GB~372 tok/s · $2.61/M tok |
| Llama 3.1 8B | 8B | ✓ 6.9 GB~596 tok/s · $1.63/M tok | ✓ 10.9 GB~315 tok/s · $3.09/M tok | ✓ 18.4 GB~168 tok/s · $5.79/M tok |
tok/s is decode throughput from memory bandwidth, derated 20%, single stream — an estimate, not a benchmark. $/M tok is the hourly median divided by that rate: the one-user floor for a million generated tokens. Set cost uses today's median × GPUs required.
Buy or rent a H100 SXM?
Approx. list price
$25,000not tracked
Rent, per month
$2,520at median, 720 h
Break-even
7,143 h≈ 9.9 months
Rent for fewer than about 9.9 months of continuous use and renting wins on the card alone; past that, owning does — before the server, power, cooling and the person who keeps it running, which for a datacenter card are not small. The list price is a typical quoted figure and is not tracked by the index.
Specifications
Memory80 GB HBM3
Memory bandwidth3,350 GB/s
ArchitectureHopper
VendorNVIDIA
ClassDatacenter
Released2022-09
Bandwidth is listed because it governs generation speed: each token streams the active weights once, so tokens per second is bandwidth divided by bytes read. TFLOPs decide prompt processing and training, not how fast text appears.
Alternatives and comparisons
H100 SXM vs A100 80GBPrice, memory, what fits, cost per tokenH100 SXM vs H200Price, memory, what fits, cost per tokenH100 SXM vs B200Price, memory, what fits, cost per tokenH100 SXM vs H100 PCIePrice, memory, what fits, cost per tokenH100 SXM vs H100 NVLPrice, memory, what fits, cost per tokenH100 SXM vs MI300XPrice, memory, what fits, cost per token
NVIDIA A100 80GB80 GB · $1.79/hr median · 35 providersNVIDIA H100 PCIe80 GB · $2.29/hr median · 8 providersNVIDIA H100 NVL94 GB · $2.80/hr median · 6 providers
Questions
How much does it cost to rent a NVIDIA H100 SXM?
As of 2026-10-11, the median on-demand price across 43 providers is $3.50 per GPU-hour, about $2,520 a month at 720 hours. The cheapest we saw was $1.68 at Latitude.sh.
Why do prices for the same GPU vary so much?
Hyperscalers bundle CPU, RAM and network into an instance price and charge for the ecosystem around it. Neoclouds sell the GPU more directly. Marketplaces are independent hosts competing on price, with the trade-offs of shared, third-party hardware. The per-GPU figure is the instance price divided by GPU count, which is the only way to compare an 8-GPU node with a single-card listing.
Is the median the price I will pay?
No — it is the middle of the market. Each provider's own median is taken first so a provider with many instance sizes counts once, then the median across providers. Spot and reserved rates are excluded from it; they set the floor shown separately. Use it to judge whether a quote is high or low, then verify with the provider.
Which models can a NVIDIA H100 SXM run?
With 80 GB per GPU, the table above shows which reference models fit on one card at 4, 8 and 16-bit, using the same memory arithmetic as the rest of Runyard: weights plus KV cache plus runtime overhead, with capacity following total parameters even for mixture-of-experts models. Where a model needs more than one GPU it says how many and what that set costs at today's median.
Own the hardware instead? Work out what your card holds with the same arithmetic.
Check what fits →