When was NVIDIA A10G released?

💡 Answer

NVIDIA A10G is a Ampere card with 24 GB of GDDR6 memory, 600 GB/s of bandwidth, and 70 TFLOPS of FP16 compute. It launched in 2021 and uses up to 300W of power.

On real workloads the memory subsystem is typically the most important factor: 600 GB/s of bandwidth is enough to sustain most transformer decoding tasks without starving the compute units, while 24 GB of VRAM supports a wide range of model sizes, especially once quantisation is applied.

Check the NVIDIA A10G page for complete specifications and related GPU matchups.