NVIDIA RTX PRO 6000 MIG 24GB cloud GPU rental

The NVIDIA RTX PRO 6000 MIG 24GB is a datacenter Blackwell GPU with 24 GB of GDDR7 (MIG slice). On FastInfra it is a good fit for 7B–13B inference, LoRA fine-tuning, ComfyUI and Stable Diffusion. As a rule of thumb, one PRO 6000 MIG 24GB holds the weights of a model of about 9.5B parameters at 16-bit precision, or about 38B with 4-bit quantization, after leaving room for the KV cache.

The PRO 6000 MIG 24GB runs on the Secure tier in vetted datacenters at $0.746 per GPU-hour.

This is a Multi-Instance GPU (MIG) slice: a hardware-isolated partition of a larger card with its own 24 GB of memory and compute. It costs less than the full GPU and suits inference services, notebooks and CI jobs that do not need the whole card.

Best for

7B–13B inference, LoRA fine-tuning, ComfyUI and Stable Diffusion.

About the Blackwell architecture

RTX Blackwell cards pair fifth-generation Tensor Cores (with FP4 and FP8 support) with GDDR7 memory. They give much of the inference throughput of datacenter parts at a lower hourly price, and suit LLM serving with quantized weights, image and video generation, and fine-tuning of small and mid-size models. Use a CUDA 12.8+ image for full Blackwell support.

Only need inference?

If you want to call an open model such as Llama, Qwen, DeepSeek or GPT-OSS rather than manage a server, the pay-per-token inference API is often cheaper than keeping a GPU busy around the clock. It is OpenAI-compatible and uses the same account and wallet as your pods. Browse every model with live prices.

How much does it cost to rent an NVIDIA RTX PRO 6000 MIG 24GB per hour?

$0.746 per GPU-hour on demand. Billing is per minute while the pod exists, so 24/7 use for a 730-hour month costs about $545 per GPU at the lowest on-demand rate. Prices sync from live capacity and are shown before you deploy.

How much VRAM does the NVIDIA RTX PRO 6000 MIG 24GB have?

24 GB of GDDR7 (MIG slice). A pod with 32 GPUs gives 768 GB of combined VRAM for tensor- or pipeline-parallel workloads.

What size LLM can I run on an NVIDIA RTX PRO 6000 MIG 24GB?

Roughly 9.5B parameters at FP16 or BF16, 19B at 8-bit and 38B at 4-bit on a single GPU, reserving about 20% of VRAM for the KV cache and activations. Mixture-of-experts models need memory for all experts, not only the active ones. Long contexts and large batches need more headroom.

Is the NVIDIA RTX PRO 6000 MIG 24GB billed per hour or per minute?

Per minute. The hourly rate is divided by 60 and charged for every minute the pod exists. Attached volumes bill per GB-month and continue while a pod is stopped; delete the pod to stop all charges. There is no minimum term or reservation fee.

How do I rent an NVIDIA RTX PRO 6000 MIG 24GB on FastInfra?

Create an account, add prepaid credit, open the GPU configurator and choose the PRO 6000 MIG 24GB, the tier, the GPU count, a container template and storage. The configurator shows the hourly and monthly price, then deploys a pod you reach over SSH or JupyterLab within minutes.

Can I rent multiple PRO 6000 MIG 24GB GPUs in one pod?

Yes, up to 32 per pod. The price scales linearly: 8 GPUs cost $5.97 per hour on Secure.

Is there a cheaper GPU than the PRO 6000 MIG 24GB with the same VRAM?

Yes. The NVIDIA RTX A5000 has 24 GB and starts at $0.173 per hour. It differs in architecture (Ampere), memory bandwidth and multi-GPU interconnect, so compare throughput for your workload before switching.