How fast is AMD Instinct MI350X for ML?
💡 Answer
AMD Instinct MI350X hits 1,800 TFLOPS of FP16 compute with 8,000 GB/s of memory bandwidth and 288 GB of VRAM. FP32 peaks at 72 TFLOPS.
Those figures place AMD Instinct MI350X in a useful performance band for generative AI work: strong enough to pre-training mid-to-large models in reasonable time, with enough bandwidth to keep real-time serving latency low. Actual tokens-per-second or images-per-second varies 2x depending on framework, quantisation, and model size — always benchmark with the exact stack you plan to ship.
See the AMD Instinct MI350X page for the full spec sheet and current provider list.
More FAQs about AMD Instinct MI350X
DigitalOcean GPU Provider Review & Key Facts (April 2026)
Snapshot of DigitalOcean: GPU models, pricing, billing granularity, infrastructure, developer tools, support channels, and compliance. Data verified April 2026.
|
DigitalOcean
Simple, scalable GPU cloud for AI/ML
|
|
|---|---|
| Overview | |
| Trustpilot Rating | 4.6 |
| Headquarters | United States |
| Provider Type | N/A |
| Best For | AI training inference fine-tuning LLM deployment LLM serving computer vision startups generative AI research |
| GPU Hardware | |
| GPU Models | RTX 4000 Ada RTX 6000 Ada L40S MI300X H100 SXM H200 |
| Max VRAM (GB) | 192 |
| Max GPUs/Instance | 8 |
| Interconnect | NVLink |
| Pricing | |
| Starting Price ($/hr) | $0.76/hr |
| Billing Granularity | Per-second |
| Spot/Preemptible | No |
| Reserved Discounts | N/A |
| Free Credits | $200 free credit for 60 days |
| Egress Fees | None (included in plan) |
| Storage | 500-720 GiB NVMe boot (included), 5 TiB NVMe scratch on larger configs, Volumes at $0.10/GiB/mo |
| Infrastructure | |
| Regions | New York (NYC2), Toronto (TOR1), Atlanta (ATL1), Richmond (RIC1), Amsterdam (AMS3) |
| Uptime SLA | 99% |
| Developer Experience | |
| Frameworks | PyTorch TensorFlow Jupyter Miniconda CUDA ROCm Hugging Face |
| Docker Support | Yes |
| SSH Access | Yes |
| Jupyter Notebooks | Yes |
| API / CLI | Yes |
| Setup Time | Minutes |
| Kubernetes Support | Yes |
| Business Terms | |
| Min Commitment | None |
| Compliance | SOC 2 Type II SOC 3 HIPAA (with BAA) CSA STAR Level 1 |
DigitalOcean