Llama 3.1 Nemotron 70B Instruct HF API
Run nvidia/Llama-3.1-Nemotron-70B-Instruct-HF through FastInfra's API.
Pay per token, no subscription, routed to the cheapest available provider.
Llama 3.1 Nemotron 70B Instruct HF pricing
Billed per token used. Prices sync automatically from wholesale providers.
| Direction | Price per 1M tokens |
|---|---|
| Input | $0.92 |
| Output | $0.92 |
Served by 1 provider
Requests route to Together AI by default (cheapest).
Pin a specific provider with the :provider suffix.
| Provider | Upstream model ID |
|---|---|
| together | nvidia/Llama-3.1-Nemotron-70B-Instruct-HF |
Call Llama 3.1 Nemotron 70B Instruct HF in 30 seconds
Works with any OpenAI SDK — change the base URL and API key only.
Python
from openai import OpenAI
client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")
response = client.chat.completions.create(
model="nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)curl
curl https://api.fastinfra.ai/v1/chat/completions \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
"messages": [{"role": "user", "content": "Hello!"}]
}'Llama 3.1 Nemotron 70B Instruct HF — common questions
How much does the nvidia/Llama-3.1-Nemotron-70B-Instruct-HF API cost?
On FastInfra, nvidia/Llama-3.1-Nemotron-70B-Instruct-HF costs $0.924/1M input, $0.924/1M output tokens. Billing is per token used, with no subscription.
Is nvidia/Llama-3.1-Nemotron-70B-Instruct-HF compatible with the OpenAI SDK?
Yes. FastInfra exposes nvidia/Llama-3.1-Nemotron-70B-Instruct-HF through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.
Which providers serve nvidia/Llama-3.1-Nemotron-70B-Instruct-HF?
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF is available from 1 provider(s): together. Requests route to Together AI by default (cheapest); append ":provider" to the model ID to pin one.
Related models
Compare side by side: Llama 3.1 Nemotron 70B Instruct HF vs Llama Nemotron Embed Vl 1b v2 · Llama 3.1 Nemotron 70B Instruct HF vs Nemotron 3 Nano 30b a3b · Llama 3.1 Nemotron 70B Instruct HF vs Nemotron 3.5 Lightning