data-receipts/109-gpu-pricing at main · datareceipts/data-receipts
Contribute to datareceipts/data-receipts development by creating an account on GitHub.
Contribute to datareceipts/data-receipts development by creating an account on GitHub.
On-demand GPU rental prices across AWS, Azure and the neoclouds, normalised to dollars per GPU per hour and grouped so only identical GPUs are compared.
| H100 SXM 80GB | $/GPU-hr | A month (730 h) |
|---|---|---|
| RunPod Community | $2.69 | $1,964 |
| RunPod Secure | $3.99 | $2,913 |
AWS p5.48xlarge |
$6.88 | $5,022 |
Azure ND96isr_H100_v5 |
$12.29 | $8,972 |
4.57× between cheapest and dearest, for the same chip. One GPU running continuously for a month is $1,964 or $8,972 depending only on where you rent it.
"An H100" is three different products. The SXM 80GB, the PCIe 80GB and the NVL 94GB all get marketed as H100s and they do not cost the same. Putting them in one chart manufactures a spread that isn't there, so every comparison here is within a single (model, memory) group.
The same applies within a vendor: Azure lists the same A100 PCIe 80GB at one, two and four GPUs per VM for $3.67, $4.78 and $4.78 per GPU-hour. The spread uses each vendor's cheapest route to a given GPU, so an Azure-vs-Azure gap never shows up as a market gap. RunPod Secure and Community are counted as one company.
It is not pure margin. Going from Azure's ND series to RunPod Community gives up:
If you are fine-tuning on one node, you are paying for an interconnect you will never use. If you are training across 64 nodes, the cheap row is not an option.
| File | What it is |
|---|---|
collect.py |
Pulls AWS Price List + Azure Retail Prices. No auth required. |
hyperscalers.json |
What those APIs returned. |
vendors.json |
Neocloud prices, transcribed, with source URL and date read. |
compute.py |
Grouping, per-vendor normalisation, spreads. |
compare.json |
Output. |
python3 collect.py # ~1 GB AWS index, slow python3 compute.py
us-east-1, Azure eastus).compare.json.Texto de github.com tal como lo publicó, leído de su página y mostrado aquí con el formato de El Autómata. El original, en github.com · Volver a la noticia de El Autómata