NVIDIA A100 SXM 40GB cloud GPU rental

The NVIDIA A100 SXM 40GB is a datacenter Ampere GPU with 40 GB of HBM2 at 1.6 TB/s of memory bandwidth. On FastInfra it is a good fit for 13B–34B inference, LoRA and QLoRA fine-tuning, large diffusion batches. As a rule of thumb, one A100 SXM 40GB holds the weights of a model of about 16B parameters at 16-bit precision, or about 64B with 4-bit quantization, after leaving room for the KV cache.

The A100 SXM 40GB runs on the Value tier, lower-cost community hosts, at $1.08 per GPU-hour.

Best for

13B–34B inference, LoRA and QLoRA fine-tuning, large diffusion batches.

About the Ampere architecture

Ampere brought third-generation Tensor Cores with BF16 and TF32 support, which modern training code relies on, and the A100 added Multi-Instance GPU partitioning. Ampere cards remain a dependable, lower-cost option for fine-tuning, inference and research, though they lack the FP8 support of Ada, Hopper and Blackwell.

Only need inference?

If you want to call an open model such as Llama, Qwen, DeepSeek or GPT-OSS rather than manage a server, the pay-per-token inference API is often cheaper than keeping a GPU busy around the clock. It is OpenAI-compatible and uses the same account and wallet as your pods. Browse every model with live prices.

How much does it cost to rent an NVIDIA A100 SXM 40GB per hour?

$1.08 per GPU-hour on demand. Billing is per minute while the pod exists, so 24/7 use for a 730-hour month costs about $788 per GPU at the lowest on-demand rate. Prices sync from live capacity and are shown before you deploy.

How much VRAM does the NVIDIA A100 SXM 40GB have?

40 GB of HBM2 at 1.6 TB/s of memory bandwidth. The chip is rated at up to 400 W. A pod with 2 GPUs gives 80 GB of combined VRAM for tensor- or pipeline-parallel workloads.

What size LLM can I run on an NVIDIA A100 SXM 40GB?

Roughly 16B parameters at FP16 or BF16, 32B at 8-bit and 64B at 4-bit on a single GPU, reserving about 20% of VRAM for the KV cache and activations. Mixture-of-experts models need memory for all experts, not only the active ones. Long contexts and large batches need more headroom.

Is the NVIDIA A100 SXM 40GB billed per hour or per minute?

Per minute. The hourly rate is divided by 60 and charged for every minute the pod exists. Attached volumes bill per GB-month and continue while a pod is stopped; delete the pod to stop all charges. There is no minimum term or reservation fee.

How do I rent an NVIDIA A100 SXM 40GB on FastInfra?

Create an account, add prepaid credit, open the GPU configurator and choose the A100 SXM 40GB, the tier, the GPU count, a container template and storage. The configurator shows the hourly and monthly price, then deploys a pod you reach over SSH or JupyterLab within minutes.

Can I rent multiple A100 SXM 40GB GPUs in one pod?

Yes, up to 2 per pod. The price scales linearly: 2 GPUs cost $2.16 per hour on Value.

Is there a cheaper GPU than the A100 SXM 40GB with the same VRAM?

Yes. The NVIDIA RTX A6000 has 48 GB and starts at $0.357 per hour. It differs in architecture (Ampere), memory bandwidth and multi-GPU interconnect, so compare throughput for your workload before switching.