How many images per second can NVIDIA B100 generate?

回答

Benchmarked performance on NVIDIA B100: 1,750 TFLOPS in FP16, 60 TFLOPS in FP32, 8,000 GB/s memory bandwidth, 192 GB VRAM.

For the workloads most engineers care about — model training transformer-family models, serving LLM low-latency inference, running diffusion and vision pipelines — those specs are enough to sustain batch sizes that keep tensor cores busy. Expect wall-clock gains versus previous-generation Blackwell cards to range from 1.5x to 3x depending on workload shape.

See the NVIDIA B100 page for the full spec sheet and comparisons to related GPUs.