How does NVIDIA GeForce RTX 4080 SUPER benchmark against H100?

Antwoord

NVIDIA GeForce RTX 4080 SUPER performance specs: 52.4 FP16 TFLOPS / 26.2 FP32 TFLOPS / 736 GB/s / 16 GB.

Three workload classes, three different bottlenecks: fine-tuning stresses FP16/BF16 tensor cores (FLOPS-bound); serving on large language models stresses memory bandwidth (bandwidth-bound); HPC-style simulation stresses FP32 (also FLOPS-bound). NVIDIA GeForce RTX 4080 SUPER covers all three competently for its generation. If your workload mix leans toward one class, benchmark with that workload specifically rather than relying on synthetic peak numbers.

Review full specs and related comparisons on the NVIDIA GeForce RTX 4080 SUPER page.