NVIDIA · Ampere Architecture

Rent NVIDIA A100 SXM (80GB) in the Cloud

Previous-generation workhorse for AI training and inference. Still widely available at lower cost than H100.

VRAM 80 GB HBM2e
Bandwidth 2,039 GB/s
FP16 312.0 TFLOPS
FP32 19.5 TFLOPS
TDP 400W
Architecture Ampere
Cheapest On-Demand $1.10/hr
Average On-Demand $1.67/hr
Providers 6

Compare NVIDIA A100 SXM (80GB) Cloud Pricing — 6 Providers

On-Demand

NVIDIA A100 SXM (80GB) — On-Demand pricing
Provider Price / GPU / hr Availability Notes Action
Vast.ai United States $1.10/hr CHEAPEST Available Marketplace avg Visit Provider
Massed Compute United States $1.23/hr Available SXM4 Visit Provider
RunPod United States $1.49/hr Available Secure Cloud, SXM Visit Provider
Novita AI United States $1.60/hr Available SXM Visit Provider
Cherry Servers Lithuania $2.18/hr Available Bare metal Visit Provider
Vultr United States $2.40/hr Available PCIe Visit Provider

Spot / Preemptible

NVIDIA A100 SXM (80GB) — Spot / Preemptible pricing
Provider Price / GPU / hr Availability Notes Action
Novita AI United States $0.79/hr CHEAPEST Available Spot, 1hr guaranteed Visit Provider
RunPod United States $1.39/hr Available Community Cloud Visit Provider

Prices last verified: April 13, 2026

NVIDIA A100 SXM (80GB) Technical Specifications

Manufacturer NVIDIA
Architecture Ampere
VRAM 80 GB HBM2e
Memory Bandwidth 2,039 GB/s
FP16 (Tensor) 312.0 TFLOPS
FP32 19.5 TFLOPS
TDP 400W
Release Year 2020
Segment Data center
Memory Type HBM2e

Best For

AI training fine-tuning HPC inference

Frequently Asked Questions

Is NVIDIA A100 SXM (80GB) affordable for pre-training in the cloud?

Cloud NVIDIA A100 SXM (80GB) pricing in July 2026: on-demand starts at $1.10 per hour (cheapest at Vast.ai), spot at $0.79 per hour (cheapest at Novita AI), reserved ~up to 40% below on-demand.

For reference, 6 providers currently list NVIDIA A100 SXM (80GB) capacity. Differences in interconnect, regions, and SLA explain why rates span a wide band — the lowest-cost isn't always the right answer for multi-node training or regulated real-time serving.

Rent NVIDIA A100 SXM (80GB) today from Vast.ai, Massed Compute, or RunPod — compare live pricing and spin up in minutes.

NVIDIA A100 SXM (80GB) technical profile — everything ML teams need to know

NVIDIA A100 SXM (80GB) packs 80 GB of HBM2e with 2,039 GB/s of bandwidth, delivers 312 TFLOPS of FP16 compute, and operates at 400W. It's based on the Ampere architecture introduced in 2020.

For most AI use cases this matters in three ways: 1) how big a model you can load; 2) how fast attention runs (bandwidth-bound); 3) how fast MatMul-heavy ops run (compute-bound). NVIDIA A100 SXM (80GB) tends to sit in a balanced spot on all three — which is why it shows up repeatedly in cloud catalogues aimed at ML teams.

Ready to deploy? Vast.ai has NVIDIA A100 SXM (80GB) from $1.10/hr. Massed Compute and RunPod also carry it.

How does NVIDIA A100 SXM (80GB) perform on Stable Diffusion?

How fast is NVIDIA A100 SXM (80GB)? The raw numbers: 312 TFLOPS FP16, 19.5 TFLOPS FP32, 2,039 GB/s memory bandwidth. In mixed-precision AI jobs, that translates to sustained throughput comfortably above older generations.

For model training, expect wall-clock times that scale predictably from those TFLOPS figures at large batch sizes. For low-latency inference, real-world latency is dominated by memory bandwidth and by how much of your KV-cache fits on-chip — so the 2,039 GB/s and 80 GB capacity matter more than headline TFLOPS.

Launch a NVIDIA A100 SXM (80GB) instance on Vast.ai from $1.10/hr — or check Massed Compute and RunPod for alternative regions and availability.

Where is NVIDIA A100 SXM (80GB) cheapest in July 2026?

Cloud providers carrying NVIDIA A100 SXM (80GB) in July 2026: Cherry Servers, Massed Compute, Novita AI, RunPod, Vast.ai, Vultr (6 total). Vast.ai has the most affordable on-demand rate ($1.10 per hour); Novita AI has the most affordable spot rate ($0.79 per hour).

When evaluating, go beyond the per-hour rate: check typical queue times, whether instances are bare-metal or virtualised, what interconnect is available for multi-GPU model training, and what support channels you get. These factors often matter more than a 10-15% rate difference.

Rent NVIDIA A100 SXM (80GB) today from Vast.ai, Massed Compute, or RunPod — compare live pricing and spin up in minutes.

What AI projects suit NVIDIA A100 SXM (80GB)?

NVIDIA A100 SXM (80GB) shines for AI training, fine-tuning, HPC, inference. The card's 80 GB of VRAM and Ampere-generation tensor cores make it a strong match for AI AI workloads that push batch sizes hard and benefit from modern mixed-precision support.

It's overkill for toy experiments and under-sized for the largest frontier models, but covers the vast middle: fine-tuning open-source transformers, training diffusion models, running batch real-time serving pipelines, and supporting interactive workflows that need more VRAM than a consumer card offers.

Top cloud providers offering NVIDIA A100 SXM (80GB): Vast.ai (from $1.10/hr), Massed Compute, and RunPod. Start comparing live rates.

Compare with Other GPUs

See how NVIDIA A100 SXM (80GB) stacks up against other popular cloud GPUs in specs, pricing, and availability.