V100 32GB vs A100 40GB
The A100 40GB rents for 44% less per hour today — $1.48 against $2.66 — with 40 GB against 32 GB of memory.
Prices collected 2026-09-18 · 4 providers price both
Index median per GPU-hour, on-demand, per snapshot.
Side by side
| V100 32GB | A100 40GB | |
|---|---|---|
| Median rental, per GPU-hour | $2.66 | $1.48 |
| Cheapest listing | $1.57 | $0.79 |
| Per month at 720 h | $1,917 | $1,066 |
| Providers pricing it | 4 | 16 |
| Memory | 32 GB HBM2 | 40 GB HBM2 |
| Memory bandwidth | 900 GB/s | 1,555 GB/s |
| GB of memory per $/hr | 12.0 | 27.0 |
| Architecture | Volta | Ampere |
| Class | Datacenter | Datacenter |
| Released | 2018-03 | 2020-05 |
Same provider, both GPUs
The cleanest comparison: 4 providers price both cards, so the difference is the GPU and nothing else. The V100 32GB is cheaper at 1 of them.
| Provider | V100 32GB | A100 40GB | A100 40GB premium |
|---|---|---|---|
 io.net | $2.05 | $1.19 | -42% |
 Runcrate | $2.57 | $1.54 | -40% |
 Microsoft Azure | $2.75 | $3.40 | +23% |
 Amazon Web Services | $3.90 | $2.74 | -30% |
What each one runs, and what a million tokens costs
Weights + KV cache at 8K context + overhead against 90% of each card's memory. Where a model needs more than one card the cell says how many and prices the set at today's median. $/M tokens is the hourly median divided by estimated single-stream output, from memory bandwidth — an estimate for ranking, not a benchmark.
| Model | Bits | V100 32GB | A100 40GB |
|---|---|---|---|
| Kimi K3 | 4-bit | 55× GPU$146.41/hr | 44× GPU$65.12/hr |
| Kimi K3 | 16-bit | 195× GPU$519.09/hr | 156× GPU$230.88/hr |
| DeepSeek V4.1-Flash | 4-bit | 11× GPU$29.28/hr | 9× GPU$13.32/hr |
| DeepSeek V4.1-Flash | 16-bit | 39× GPU$103.82/hr | 31× GPU$45.88/hr |
| Llama 4 Maverick | 4-bit | 8× GPU$21.30/hr | 7× GPU$10.36/hr |
| Llama 4 Maverick | 16-bit | 28× GPU$74.54/hr | 23× GPU$34.04/hr |
| gpt-oss-120b | 4-bit | 3× GPU$7.99/hr | 2× GPU$2.96/hr |
| gpt-oss-120b | 16-bit | 9× GPU$23.96/hr | 7× GPU$10.36/hr |
| Llama 3.1 70B | 4-bit | 2× GPU$5.32/hr | 2× GPU$2.96/hr |
| Llama 3.1 70B | 16-bit | 6× GPU$15.97/hr | 5× GPU$7.40/hr |
| Gemma 4 31B | 4-bit | ✓ 21.2 GB~41 tok/s · $18.04/M | ✓ 21.2 GB~71 tok/s · $5.79/M |
| Gemma 4 31B | 16-bit | 3× GPU$7.99/hr | 2× GPU$2.96/hr |
| Qwen3 Coder 30B-A3B | 4-bit | ✓ 19 GB~388 tok/s · $1.91/M | ✓ 19 GB~670 tok/s · $0.61/M |
| Qwen3 Coder 30B-A3B | 16-bit | 3× GPU$7.99/hr | 2× GPU$2.96/hr |
| Qwen3.8 27B | 4-bit | ✓ 18.7 GB~47 tok/s · $15.73/M | ✓ 18.7 GB~82 tok/s · $5.01/M |
| Qwen3.8 27B | 16-bit | 2× GPU$5.32/hr | 2× GPU$2.96/hr |
| gpt-oss-20b | 4-bit | ✓ 13.7 GB~356 tok/s · $2.08/M | ✓ 13.7 GB~614 tok/s · $0.67/M |
| gpt-oss-20b | 16-bit | 2× GPU$5.32/hr | 2× GPU$2.96/hr |
| Llama 3.1 8B | 4-bit | ✓ 6.9 GB~160 tok/s · $4.62/M | ✓ 6.9 GB~276 tok/s · $1.49/M |
| Llama 3.1 8B | 16-bit | ✓ 18.4 GB~45 tok/s · $16.43/M | ✓ 18.4 GB~78 tok/s · $5.27/M |
Buy or rent?
Hours of renting at today's median that add up to the card's approximate list price. List prices are typical quoted figures, not tracked, and do not include the server, power or the person to run it — so the break-even is a floor, not a verdict.
Questions
Is the V100 32GB or the A100 40GB cheaper to rent?
On 2026-09-18 the V100 32GB has a market median of $2.66 per GPU-hour across 4 providers and the A100 40GB $1.48 across 16, so the A100 40GB is 44% cheaper per hour. Among the 4 providers that price both, the V100 32GB is cheaper at 1 and the A100 40GB at 3. Per hour is only half the answer — the table below prices a whole model on each.
Which should I rent for a 70B model?
At 4-bit, Llama 3.1 70B needs about 44.5 GB. On the V100 32GB that is 2 cards at $5.32/hr; on the A100 40GB 2 cards at $2.96/hr.
What is the real difference between them?
32 GB HBM2 at 900 GB/s (Volta) against 40 GB HBM2 at 1,555 GB/s (Ampere). Memory decides what fits; bandwidth decides how fast it generates, because each token streams the active weights once. Compute matters for prompt processing and training, not for how fast text appears.