RRunyard Index
Runyard / GPU Index / NVIDIA H200
NVIDIA
Rental price index

NVIDIA H200

Hopper with 141 GB of faster memory. Same compute as the H100, far more room for KV cache.

Prices collected 2026-10-11 · 31 providers, 51 configurations

Jump to:At a glancePricingChangesAI modelsBuy vs rentSpecsFAQAlternatives
On-demandReservedSpot
$0.00$1.25$2.50$3.75$5.00Oct 5Oct 7Oct 9Oct 11

Index median price per GPU per hour, by billing type. Nothing is interpolated.

At a glance

Median on-demand
$4.50/GPU/hr
Cheapest on-demand
$2.00io.net
Floor, any billing
$2.00incl. spot
Per month at 720h
$3,240

NVIDIA H200 pricing by provider

One card per provider, cheapest first. A configuration is one priced unit — an instance type, a SKU, a marketplace offer — and the per-GPU price is that unit's price divided by its GPU count. Open a card to see every configuration with its vCPU, RAM and region where the provider publishes them.

31 providers · 47 configurations
io.netIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $2.00
From
$2.00 / GPU / hr
On-DemandVisit website →
BeamIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $2.09
From
$2.09 / GPU / hr
On-DemandVisit website →
SeewebIn stock
Italy1 config1xcollected 2026-10-11
On-Demand from $2.91
From
$2.91 / GPU / hr
On-DemandVisit website →
KoyebIn stock
France4 configs1x–8xcollected 2026-10-11
On-Demand from $3.00
From
$3.00 / GPU / hr
On-DemandVisit website →
GMI CloudIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $3.20
From
$3.20 / GPU / hr
On-DemandVisit website →
CivoIn stock
UK2 configs1x–8xcollected 2026-10-11
On-Demand from $3.49
From
$3.49 / GPU / hr
On-DemandVisit website →
GPU.aiIn stock
UAE2 configs1xcollected 2026-10-11
On-Demand from $3.59
From
$3.59 / GPU / hr
On-DemandVisit website →
OblivusIn stock
UK1 config1xcollected 2026-10-11
On-Demand from $3.99
From
$3.99 / GPU / hr
On-DemandVisit website →
HyperstackIn stock
UK1 config1xcollected 2026-10-11
On-Demand from $3.99Reserved from $2.79
From
$3.99 / GPU / hr
On-DemandVisit website →
CerebriumIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $4.20
From
$4.20 / GPU / hr
On-DemandVisit website →
CrusoeIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $4.29
From
$4.29 / GPU / hr
On-DemandVisit website →
ModalIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $4.54
From
$4.54 / GPU / hr
On-DemandVisit website →
NeysaIn stock
India1 config1xcollected 2026-10-11
On-Demand from $4.72
From
$4.72 / GPU / hr
On-DemandVisit website →
Vast.aiIn stock
USA8 configs1x–8xcollected 2026-10-11
On-Demand from $5.00
From
$5.00 / GPU / hr
On-Demand · Germany, DEVisit website →
NebiusIn stock
Netherlands1 config1xcollected 2026-10-11
On-Demand from $5.40Spot from $4.50
From
$5.40 / GPU / hr
On-DemandVisit website →
ReplicateIn stock
USA3 configs2x–8xcollected 2026-10-11
On-Demand from $5.49
From
$5.49 / GPU / hr
On-DemandVisit website →
SpheronIn stock
1 config1xcollected 2026-10-11
On-Demand from $5.52
From
$5.52 / GPU / hr
On-DemandVisit website →
Together AIIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $5.99Spot from $2.99Reserved from $4.99
From
$5.99 / GPU / hr
On-DemandVisit website →
fal.aiIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $6.00
From
$6.00 / GPU / hr
On-DemandVisit website →
OVHcloudIn stock
France1 config8xcollected 2026-10-11
On-Demand from $6.20
From
$6.20 / GPU / hr
On-DemandVisit website →
CoreWeaveIn stock
USA1 config8xcollected 2026-10-11
On-Demand from $6.31
From
$6.31 / GPU / hr
On-DemandVisit website →
Oracle CloudIn stock
USA1 config1xcollected 2026-10-11
On-Demand from $10.00
From
$10.00 / GPU / hr
On-Demand · us-ashburn-1Visit website →

Recent price changes

Every time a provider's median for the NVIDIA H200 moved between two consecutive snapshots. A listing appearing or vanishing is not a price change and is not shown.

WhenProviderFromToChange
2026-10-11 09:14GPU.ai$5.15$4.44-13.7%
2026-10-11 09:14DataCrunch (Verda)$5.38$5.49+2%
2026-10-10 08:53Vast.ai$5.12$5.00-2.3%
2026-10-09 09:31io.net$3.79$2.00-47.2%
2026-10-09 09:31RunPod Secure Cloud$4.59$5.29+15.3%
2026-10-09 09:31GPU.ai$4.86$5.15+6%
2026-10-09 09:31DataCrunch (Verda)$5.28$5.38+2%
2026-10-08 09:24DataCrunch (Verda)$5.22$5.28+1.1%
2026-10-07 09:10GMI Cloud$2.60$3.20+23.1%
2026-10-07 09:10GPU.ai$4.09$4.86+18.8%

Spot, reserved and where it is cheapest

Spot median
$3.7517% off · 2 providers
Reserved median
$3.8914% off · 2 providers
Italy providers
$2.91median of 1
Germany providers
$3.10median of 1

By provider country: Italy $2.91 (1) · Germany $3.10 (1) · UK $3.99 (3) · UAE $4.44 (1) · USA $4.54 (17) · India $4.59 (3) · France $4.60 (2) · Netherlands $5.40 (1) · Finland $5.49 (1). Full breakdown →

What fits on a NVIDIA H200

Weights + KV cache at 8K context + runtime overhead, against 127 GB usable of the 141 GB on the card. Capacity follows total parameters, even for mixture-of-experts models — any expert may be needed next. Where one card is not enough, the table says how many are, and prices the set at today's median.

ModelParams4-bit8-bit16-bit
Kimi K32.8T104B active13× GPU$58.50/hr24× GPU$108.00/hr45× GPU$202.50/hr
DeepSeek V4.1-Flash552B16B active3× GPU$13.50/hr5× GPU$22.50/hr9× GPU$40.50/hr
Llama 4 Maverick400B17B active2× GPU$9.00/hr4× GPU$18.00/hr7× GPU$31.50/hr
gpt-oss-120b117B5.1B active✓ 67.9 GB~1339 tok/s · $0.93/M tok✓ 126.4 GB~709 tok/s · $1.76/M tok2× GPU$9.00/hr
Llama 3.1 70B70B✓ 44.5 GB~98 tok/s · $12.76/M tok✓ 79.5 GB~52 tok/s · $24.04/M tok2× GPU$9.00/hr
Gemma 4 31B31B✓ 21.2 GB~220 tok/s · $5.68/M tok✓ 36.7 GB~117 tok/s · $10.68/M tok✓ 65.7 GB~62 tok/s · $20.16/M tok
Qwen3 Coder 30B-A3B30.5B3.3B active✓ 19 GB~2069 tok/s · $0.6/M tok✓ 34.3 GB~1095 tok/s · $1.14/M tok✓ 62.9 GB~582 tok/s · $2.15/M tok
Qwen3.8 27B27B✓ 18.7 GB~253 tok/s · $4.94/M tok✓ 32.2 GB~134 tok/s · $9.33/M tok✓ 57.6 GB~71 tok/s · $17.61/M tok
gpt-oss-20b21B3.6B active✓ 13.7 GB~1896 tok/s · $0.66/M tok✓ 24.2 GB~1004 tok/s · $1.25/M tok✓ 43.9 GB~533 tok/s · $2.35/M tok
Llama 3.1 8B8B✓ 6.9 GB~853 tok/s · $1.47/M tok✓ 10.9 GB~452 tok/s · $2.77/M tok✓ 18.4 GB~240 tok/s · $5.21/M tok

tok/s is decode throughput from memory bandwidth, derated 20%, single stream — an estimate, not a benchmark. $/M tok is the hourly median divided by that rate: the one-user floor for a million generated tokens. Set cost uses today's median × GPUs required.

Buy or rent a H200?

Approx. list price
$32,000not tracked
Rent, per month
$3,240at median, 720 h
Break-even
7,111 h≈ 9.9 months

Rent for fewer than about 9.9 months of continuous use and renting wins on the card alone; past that, owning does — before the server, power, cooling and the person who keeps it running, which for a datacenter card are not small. The list price is a typical quoted figure and is not tracked by the index.

Specifications

Memory141 GB HBM3e
Memory bandwidth4,800 GB/s
ArchitectureHopper
VendorNVIDIA
ClassDatacenter
Released2023-11

Bandwidth is listed because it governs generation speed: each token streams the active weights once, so tokens per second is bandwidth divided by bytes read. TFLOPs decide prompt processing and training, not how fast text appears.

Alternatives and comparisons

H200 vs H100 SXMPrice, memory, what fits, cost per tokenH200 vs B200Price, memory, what fits, cost per tokenH200 vs MI300XPrice, memory, what fits, cost per tokenH200 vs MI325XPrice, memory, what fits, cost per tokenH200 vs GH200Price, memory, what fits, cost per token
NVIDIA H200 NVL141 GB · $3.79/hr median · 5 providersNVIDIA B200180 GB · $6.99/hr median · 25 providersNVIDIA GH20096 GB · $3.45/hr median · 4 providers

Questions

How much does it cost to rent a NVIDIA H200?

As of 2026-10-11, the median on-demand price across 31 providers is $4.50 per GPU-hour, about $3,240 a month at 720 hours. The cheapest we saw was $2.00 at io.net.

Why do prices for the same GPU vary so much?

Hyperscalers bundle CPU, RAM and network into an instance price and charge for the ecosystem around it. Neoclouds sell the GPU more directly. Marketplaces are independent hosts competing on price, with the trade-offs of shared, third-party hardware. The per-GPU figure is the instance price divided by GPU count, which is the only way to compare an 8-GPU node with a single-card listing.

Is the median the price I will pay?

No — it is the middle of the market. Each provider's own median is taken first so a provider with many instance sizes counts once, then the median across providers. Spot and reserved rates are excluded from it; they set the floor shown separately. Use it to judge whether a quote is high or low, then verify with the provider.

Which models can a NVIDIA H200 run?

With 141 GB per GPU, the table above shows which reference models fit on one card at 4, 8 and 16-bit, using the same memory arithmetic as the rest of Runyard: weights plus KV cache plus runtime overhead, with capacity following total parameters even for mixture-of-experts models. Where a model needs more than one GPU it says how many and what that set costs at today's median.

Own the hardware instead? Work out what your card holds with the same arithmetic.
Check what fits →