OSAIM
Open Source AI Models

Llama 3.1 Nemotron 70B Instruct

NVIDIA's RLHF-tuned Llama 3.1 70B. Tops several Arena-style human-preference leaderboards and shipped with NVIDIA's reward-model research. Inherits the Llama 3 community licence.

Parameters
70B
Context length
128K
Modality
text
Released
2024-10-15

Memory & hardware

VRAM (fp16)
140 GB
VRAM (Q4)
42 GB
Recommended
1× H100 80GB or RTX 4090 (Q4)
Quantizations
fp16, fp8, q8_0, q5_k_m, q4_k_m

License: Llama 3 Community License

SPDX
Commercial use
Yes
Modification
Yes
Redistribution
Yes

Benchmarks

MMLU
85.0
HumanEval
84.0
MATH
67.4
Benchmarks last verified 2026-05-18.

Hosted inference pricing

No hosted pricing listed — this model is currently self-host-only on this site.

Run it yourself

Drop-in commands for the three most common open-source inference paths. The Ollama tag is a best-effort match against the registry; verify the size variant before pulling.

Run Llama 3.1 Nemotron 70B Instruct locally
Ollama (easiest)
ollama run llama3.1:70b
Single-line install + run; uses the official Ollama registry tag for this family.
vLLM (production)
vllm serve nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
High-throughput hosted inference; one command to expose an OpenAI-compatible HTTP server.
Transformers (Python)
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("nvidia/Llama-3.1-Nemotron-70B-Instruct-HF")
model = AutoModelForCausalLM.from_pretrained(
    "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF", device_map="auto", torch_dtype="auto"
)
Direct PyTorch usage. Pin a torch / cuda version that matches your GPU.
Hugging Face ID: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Related models

Same family or similar size — useful when shopping around.

Nemotron-4 340B Instruct
340B

NVIDIA's reward-modelling research vehicle. Trained primarily to be a synthetic-data-generation specialist rather than a chat-first model. Useful for teams building instruction-tuning datasets at scale.

Context
4K
License
llama-3
VRAM Q4
204 GB
DeepSeek R1 Distill Llama 70B
70B

R1 reasoning capabilities distilled into a Llama 3.3 70B base. The most accessible way to run R1-class reasoning locally — fits on a single H100 in fp16 or on a 4090 at Q4. Inherits Llama 3's community licence (commercial use under 700M MAU). Great pick for production reasoning workloads where the full R1 is too expensive to host but o1/R1-style quality is required.

Context
128K
License
llama-3
VRAM Q4
42 GB
Llama 3.3 70B Instruct
70B

Meta's December 2024 refresh of Llama 3 70B that closes most of the gap with Llama 3.1 405B for chat workloads while remaining tractable on a single H100. Strong instruction following, robust tool-use behaviour, and a 128K context window make it the default choice for production chat at 70B scale. The 3.3 release was trained on a refreshed instruction-tuning data mix and benefits from Meta's most recent alignment work. It outperforms the much larger 3.1 405B on several reasoning benchmarks at a fraction of inference cost. The licence is the Llama 3 Community License, which permits commercial use unless your service exceeds 700M monthly active users. Good pick for: production chat at scale, RAG over long documents, agentic workflows where tool use matters, and any 70B-tier replacement for closed proprietary models.

Context
128K
License
llama-3
VRAM Q4
42 GB
Qwen2.5 72B Instruct
72B

The flagship Qwen 2.5 release. Competes with Llama 3.1 405B on many benchmarks at one-fifth the parameter count. Note the 72B specifically uses the Qwen License (commercial use up to 100M MAU) — the smaller Qwen2.5 sizes are Apache 2.0.

Context
128K
License
qwen
VRAM Q4
43.2 GB
Llama 3.2 90B Vision
90B

Larger vision-language Llama variant, competitive with the proprietary multimodal frontier on standard image-understanding benchmarks. Drops in as a vision upgrade where 11B isn't sharp enough. Requires substantial GPU memory in fp16; most teams will run it quantized or on multi-GPU. A natural pairing with retrieval pipelines that fetch image-rich chunks alongside text.

Context
128K
License
llama-3
VRAM Q4
54 GB
Command R+
104B

Cohere's flagship 104B model. RAG-focused with native multilingual support across ~10 high-resource languages. CC-BY-NC weights; commercial use via Cohere's hosted API.

Context
128K
License
mrl
VRAM Q4
62.4 GB