GPU prices

A100 price per hour

The 80GB SXM neocloud list index is $2.55 per GPU-hour as of Oct 10.

Neocloud list index

$2.55

Median of the providers’ list prices, linked over time so a changed provider mix causes no jump.

Unchanged since Oct 3

Hyperscaler list index
$4.05
Neocloud list index
$2.55
Price range
$2.30–$5.07

On-demand list prices. USD per GPU-hour. Updated daily.

Providers tracked6

AWS, Azure, Crusoe, GCP, Lambda, OCI.

Pricing questions4
What is a GPU-hour?
One GPU rented for one hour. Eight GPUs running for one hour count as eight GPU-hours.
What is a list index?
The median of the providers’ list prices for one GPU variant, linked over time so a provider joining or leaving causes no jump. It can differ slightly from the median of today’s prices.
Why do A100 prices vary?
Hardware configurations and included services differ. The range shows the lowest and highest listed rates tracked for 80GB SXM.
Does this include every cost?
Storage, networking and taxes may be extra. Check the provider’s terms and available capacity before booking.