RRunyard Index
Runyard / GPU Index / NVIDIA B200
NVIDIA
Rental price index

NVIDIA B200

The Blackwell flagship for training and large-scale inference. Underlies the CME B200 rental index.

Prices collected 2026-09-12 · 15 providers, 36 configurations

Compare vs other GPUs →
On-demandOn-demand (archive, Lambda only)
$0.00$2.50$5.00$7.50$10.00Sep 11 08:15Sep 11 10:33Sep 12 04:39Sep 12 20:35

Index median price per GPU per hour, by billing type. Nothing is interpolated.

At a glance

Median on-demand
$6.39/GPU/hr
Cheapest on-demand
$3.75Packet.ai
Floor, any billing
$3.75incl. spot
Per month at 720h
$4,601

NVIDIA B200 pricing by provider

One card per provider, cheapest first. A configuration is one priced unit — an instance type, a SKU, a marketplace offer — and the per-GPU price is that unit's price divided by its GPU count. Open a card to see every configuration with its vCPU, RAM and region where the provider publishes them.

15 providers · 36 configurations
BeamIn stock
USA1 config1xcollected 2026-09-12
On-Demand from $4.11
From
$4.11 / GPU / hr
On-DemandVisit website →
Vast.aiIn stock
USA16 configs1x–8xcollected 2026-09-12
On-Demand from $5.31
From
$5.31 / GPU / hr
On-Demand · Oregon, USVisit website →
GPU.aiIn stock
UAE2 configs1xcollected 2026-09-12
On-Demand from $5.40
From
$5.40 / GPU / hr
On-DemandVisit website →
KoyebIn stock
France1 config1xcollected 2026-09-12
On-Demand from $5.50
From
$5.50 / GPU / hr
On-DemandVisit website →
fal.aiIn stock
USA1 config1xcollected 2026-09-12
On-Demand from $6.25
From
$6.25 / GPU / hr
On-DemandVisit website →
LyceumIn stock
Germany2 configs1xcollected 2026-09-12
On-Demand from $6.29
From
$6.29 / GPU / hr
On-DemandVisit website →
LambdaIn stock
USA4 configs1x–8xcollected 2026-09-12
On-Demand from $6.69
From
$6.69 / GPU / hr
On-DemandVisit website →
SpheronIn stock
1 config1xcollected 2026-09-12
On-Demand from $7.20
From
$7.20 / GPU / hr
On-DemandVisit website →
CoreWeaveIn stock
USA1 config8xcollected 2026-09-12
On-Demand from $8.60
From
$8.60 / GPU / hr
On-DemandVisit website →

What fits on a NVIDIA B200

Weights + KV cache at 8K context + runtime overhead, against 162 GB usable of the 180 GB on the card. Capacity follows total parameters, even for mixture-of-experts models — any expert may be needed next. Where one card is not enough, the table says how many are, and prices the set at today's median.

ModelParams4-bit8-bit16-bit
Kimi K32.8T104B active10× GPU$63.90/hr19× GPU$121.41/hr35× GPU$223.65/hr
DeepSeek V4.1-Flash552B16B active2× GPU$12.78/hr4× GPU$25.56/hr7× GPU$44.73/hr
Llama 4 Maverick400B17B active2× GPU$12.78/hr3× GPU$19.17/hr5× GPU$31.95/hr
gpt-oss-120b117B5.1B active✓ 67.9 GB~2231 tok/s✓ 126.4 GB~1181 tok/s2× GPU$12.78/hr
Llama 3.1 70B70B✓ 44.5 GB~163 tok/s✓ 79.5 GB~86 tok/s✓ 145.1 GB~46 tok/s
Gemma 4 31B31B✓ 21.2 GB~367 tok/s✓ 36.7 GB~194 tok/s✓ 65.7 GB~103 tok/s
Qwen3 Coder 30B-A3B30.5B3.3B active✓ 19 GB~3448 tok/s✓ 34.3 GB~1825 tok/s✓ 62.9 GB~970 tok/s
Qwen3.8 27B27B✓ 18.7 GB~421 tok/s✓ 32.2 GB~223 tok/s✓ 57.6 GB~119 tok/s
gpt-oss-20b21B3.6B active✓ 13.7 GB~3160 tok/s✓ 24.2 GB~1673 tok/s✓ 43.9 GB~889 tok/s
Llama 3.1 8B8B✓ 6.9 GB~1422 tok/s✓ 10.9 GB~753 tok/s✓ 18.4 GB~400 tok/s

tok/s is decode throughput from memory bandwidth, derated 20%, single stream — an estimate, not a benchmark. Set cost uses today's median × GPUs required.

Specifications

Memory180 GB HBM3e
Memory bandwidth8,000 GB/s
ArchitectureBlackwell
VendorNVIDIA
ClassDatacenter
Released2024-12

Bandwidth is listed because it governs generation speed: each token streams the active weights once, so tokens per second is bandwidth divided by bytes read. TFLOPs decide prompt processing and training, not how fast text appears.

Alternatives

Questions

How much does it cost to rent a NVIDIA B200?

As of 2026-09-12, the median on-demand price across 15 providers is $6.39 per GPU-hour, about $4,601 a month at 720 hours. The cheapest we saw was $3.75 at Packet.ai.

Why do prices for the same GPU vary so much?

Hyperscalers bundle CPU, RAM and network into an instance price and charge for the ecosystem around it. Neoclouds sell the GPU more directly. Marketplaces are independent hosts competing on price, with the trade-offs of shared, third-party hardware. The per-GPU figure is the instance price divided by GPU count, which is the only way to compare an 8-GPU node with a single-card listing.

Is the median the price I will pay?

No — it is the middle of the market. Each provider's own median is taken first so a provider with many instance sizes counts once, then the median across providers. Spot and reserved rates are excluded from it; they set the floor shown separately. Use it to judge whether a quote is high or low, then verify with the provider.

Which models can a NVIDIA B200 run?

With 180 GB per GPU, the table above shows which reference models fit on one card at 4, 8 and 16-bit, using the same memory arithmetic as the rest of Runyard: weights plus KV cache plus runtime overhead, with capacity following total parameters even for mixture-of-experts models. Where a model needs more than one GPU it says how many and what that set costs at today's median.

Own the hardware instead? Work out what your card holds with the same arithmetic.
Check what fits →