Best Cloud GPUs for Edge Inference — May 2026

Edge inference cards (NVIDIA A2 and similar) — low TDP, single-slot, dense racks.

Updated May 2026 Showing 1 GPU model Best for edge
NVIDIA 16 GB
A2
GDDR6 Ampere $0.22/hr
VRAM 16 GB