Does Vast.ai support scale-to-zero GPU deployments?
💡 Answer
Serverless availability at Vast.ai: Yes
With serverless GPU, you deploy a model container and the platform handles autoscaling, load balancing, and cold starts automatically. You pay only when your endpoint is processing requests — there are no charges during idle time. This can reduce costs by 80-95% compared to always-on dedicated instances for bursty inference workloads.
Vast.ai on-demand pricing starts from $0.06/hr (Per-second billing).
View serverless deployment options and cold-start benchmarks on Vast.ai official website.
More FAQs about Vast.ai
- What type of workloads is Vast.ai ideal for?
- What is Vast.ai Trustpilot rating and total review count?
- Can I use custom ML frameworks on Vast.ai?
- What developer tools are available at Vast.ai?
- What is Vast.ai uptime SLA guarantee?
- Can I run distributed training across multiple GPUs at Vast.ai?
- Are spot instances available at Vast.ai for cost savings?
- How much does Vast.ai charge for outbound data transfer?
- How can I get free GPU credits at Vast.ai?
- What is the maximum VRAM available on Vast.ai GPU instances?
- What are the pricing plans and billing options at Vast.ai?
Guides Where Vast.ai Is Featured
- Best Cloud GPU Providers with NVIDIA B300
- Best Cloud GPUs for Stable Diffusion & Image Generation
- Cheapest Cloud GPUs Under $0.50/hr
- Cloud GPU Providers with API & CLI Management
- Cloud GPU Providers with Docker & Custom Images
- Cloud GPU Providers with Free Credits
- Cloud GPU Providers with Jupyter Notebook Support
- Cloud GPU Providers with Kubernetes Support
- Cloud GPU Providers with Multi-Node GPU Clusters
- Cloud GPU Providers with NVLink or InfiniBand
- Cloud GPU Providers with Per-Second Billing
- Cloud GPU Providers with Persistent Storage
- Cloud GPU Providers with Serverless GPU Inference
- Cloud GPU Providers with Spot / Preemptible Instances
- Cloud GPU Providers with SSH Access
- Cloud GPU Providers with Zero Egress Fees
These guides include Vast.ai alongside other cloud GPU providers, grouped by hardware, pricing, features, and infrastructure.
Vast.ai GPU Provider Review & Key Facts (May 2026)
Snapshot of Vast.ai: GPU models, pricing, billing granularity, infrastructure, developer tools, support channels, and compliance. Data verified May 2026.
|
Vast.ai
Instant GPUs. Transparent Pricing.
|
|
|---|---|
| Overview | |
| Trustpilot Rating | 4.3 |
| Headquarters | United States |
| Provider Type | GPU Marketplace |
| Best For | AI training inference fine-tuning Stable Diffusion batch processing research LLM serving generative AI |
| GPU Hardware | |
| GPU Models | B200 H200 H100 SXM H100 NVL A100 SXM A100 PCIe RTX 5090 RTX 5080 RTX 5070 Ti RTX 6000 Pro RTX 6000 Ada RTX 4500 Ada RTX A6000 RTX A5000 RTX A4000 L40S L40 A40 A10 RTX 4090 RTX 4080 RTX 4070 Ti RTX 4070 RTX 4060 Ti RTX 4060 RTX 3090 Ti RTX 3090 RTX 3080 Ti RTX 3080 RTX 3070 Ti RTX 3070 Tesla V100 Tesla T4 A2 GTX 1080 |
| Max VRAM (GB) | 192 |
| Max GPUs/Instance | 8 |
| Interconnect | NVLink, InfiniBand |
| Pricing | |
| Starting Price ($/hr) | $0.06/hr |
| Billing Granularity | Per-second |
| Spot/Preemptible | Yes |
| Reserved Discounts | Up to 50% (1-6 month reserved) |
| Free Credits | Small test credit on signup |
| Egress Fees | Varies by host ($/TB) |
| Storage | Varies by host ($/GB/hr, charged while instance exists) |
| Infrastructure | |
| Regions | 500+ locations, 40+ data centers |
| Uptime SLA | No formal SLA (host reliability scores visible) |
| Developer Experience | |
| Frameworks | PyTorch TensorFlow CUDA vLLM ComfyUI |
| Docker Support | Yes |
| SSH Access | Yes |
| Jupyter Notebooks | Yes |
| API / CLI | Yes |
| Setup Time | Seconds |
| Kubernetes Support | No |
| Business Terms | |
| Min Commitment | None |
| Compliance | SOC 2 Type 2 HIPAA GDPR CCPA |
Vast.ai