Tensor core performance of NVIDIA Tesla P4

الإجابة

The short answer: NVIDIA Tesla P4 runs at FP16 TFLOPS with 192 GB/s of memory bandwidth. The longer answer depends on what you run.

For dense FP16 training with large batches, NVIDIA Tesla P4 saturates tensor cores and delivers throughput close to peak FLOPS. For memory-bound serving on long-context foundation models, bandwidth dominates — the 192 GB/s figure matters more than headline TFLOPS. For scientific computing, FP32 at 5.5 TFLOPS is the relevant number and puts NVIDIA Tesla P4 in line with the HPC expectations of its Pascal class.

Get NVIDIA Tesla P4 on Cherry Servers starting at $0.16/hr — live pricing and fast provisioning.