OSAIM
Open Source AI Models

DeepSeek R1

Reasoning model trained with reinforcement learning on top of DeepSeek V3-Base. MIT licence — even the weights are unrestricted, making R1 the most permissively-licensed frontier reasoning model. Generates long internal chains-of-thought before answering, trading latency for accuracy on math, code, and reasoning benchmarks. Distilled variants (e.g. R1 Distill Llama 70B) recover most of the quality at much smaller scales.

Parameters
671B
Context length
128K
Modality
text
Released
2025-01-20

Memory & hardware

VRAM (fp16)
1342 GB
VRAM (Q4)
402.6 GB
Recommended
8× H100 80GB
Quantizations
fp8, fp16, q4_k_m

License: MIT

SPDX
MIT
Commercial use
Yes
Modification
Yes
Redistribution
Yes

Benchmarks

MATH
97.3
ArenaHard
92.3
MMLU
90.8
MMLU-Pro
84.0
IFEval
83.3
GPQA
71.5
SWE-bench Verified
49.2
Benchmarks last verified 2026-07-02.

Hosted inference pricing

USD per million tokens.

ProviderInputOutput
deepinfraCheapest$0.55$2.19
together$3.00$7.00
Pricing last verified 2026-05-18. Providers update rates frequently; confirm before integrating.

Run it yourself

Drop-in commands for the three most common open-source inference paths. The Ollama tag is a best-effort match against the registry; verify the size variant before pulling.

Run DeepSeek R1 locally
Ollama (easiest)
ollama run deepseek-r1:671b
Single-line install + run; uses the official Ollama registry tag for this family.
vLLM (production)
vllm serve deepseek-ai/DeepSeek-R1
High-throughput hosted inference; one command to expose an OpenAI-compatible HTTP server.
Transformers (Python)
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("deepseek-ai/DeepSeek-R1")
model = AutoModelForCausalLM.from_pretrained(
    "deepseek-ai/DeepSeek-R1", device_map="auto", torch_dtype="auto"
)
Direct PyTorch usage. Pin a torch / cuda version that matches your GPU.
Hugging Face ID: deepseek-ai/DeepSeek-R1

Related models

Same family or similar size — useful when shopping around.

DeepSeek V3
671B

671B-parameter MoE model with 37B active per token. Trained for roughly $5.6M of compute — a landmark in cost-efficient frontier training. Frontier-class quality at a fraction of the cost of the closed proprietary frontier. The DeepSeek licence permits commercial use with limited restrictions on military and unlawful applications. Running V3 yourself requires serious hardware (8× H100 at fp8); most teams will use it via the DeepSeek API or providers like Together.

Context
128K
License
deepseek
VRAM Q4
402.6 GB
DeepSeek Coder V2
236B

Coding-focused MoE model with 21B active parameters out of 236B total. Supports 338 programming languages with strong performance across mainstream stacks (Python, TypeScript, Go, Rust, Java, C++) and competent results on niche languages where most open models falter. The DeepSeek licence applies — commercial use permitted with some application restrictions.

Context
128K
License
deepseek
VRAM Q4
141.6 GB
DeepSeek R1 Distill Llama 70B
70B

R1 reasoning capabilities distilled into a Llama 3.3 70B base. The most accessible way to run R1-class reasoning locally — fits on a single H100 in fp16 or on a 4090 at Q4. Inherits Llama 3's community licence (commercial use under 700M MAU). Great pick for production reasoning workloads where the full R1 is too expensive to host but o1/R1-style quality is required.

Context
128K
License
llama-3
VRAM Q4
42 GB
Llama 3.1 405B Instruct
405B

Meta's July 2024 flagship — the first open-weights model at 405B parameters. Trained on 15T tokens with 128K context. Rivals GPT-4o on many academic benchmarks and set the ceiling for open-weights quality for most of 2024. Running it self-hosted requires serious hardware (8× H100 at fp8 or multi-node at fp16); most users will run it via a hosted provider (Together, Groq, Fireworks). Llama 3.3 70B closed most of the practical gap at a fraction of the cost, so 405B is now most useful when 70B specifically hits its ceiling.

Context
128K
License
llama-3
VRAM Q4
243 GB
Jamba 1.5 Large
398B

Hybrid Mamba-Transformer-MoE model with native 256K context (effective beyond 140K). 94B active parameters out of 398B total. The state-space-model layers give it linear-time scaling with sequence length, making it interesting for very long contexts. Licensed under AI21's open model licence, which permits most commercial use.

Context
256K
License
jamba-open
VRAM Q4
238.8 GB
Kimi K2 Instruct
1000B

Moonshot AI's 1-trillion-parameter mixture-of-experts (32B active per token). Trained on 15.5T tokens with a heavy emphasis on tool-use and agentic behaviour. Modified-MIT licence with an attribution clause for very-large deployments. Exceptional at long-horizon agent tasks; benchmarked well against Claude Sonnet on SWE-bench Verified.

Context
128K
License
kimi
VRAM Q4
600 GB