OSAIM
ModelsFamiliesBy TaskBy SizeLicensesLeaderboardsCompareGlossary
Open Source AI Models

Databricks

DBRX

Databricks' 132B mixture-of-experts (12 of 16 experts active per token) built on the MegaBlocks stack. Released under the Databricks Open Model Licence.

Visit homepage ↗

Flagship model

DBRX Instruct
132B

Databricks' 132B mixture-of-experts — 16 experts, 4 active per token (36B active params). Trained on 12T tokens on Mosaic infrastructure and released under the Databricks Open Model Licence. DBRX was best-in-class on release; now beaten by Llama 3.3 70B and Qwen 2.5 72B on most benchmarks, but retains value as a well-documented MoE reference.

Context
33K
License
dbrx-open
VRAM Q4
79.2 GB

1 model in this family

DBRX Instruct
132B

Databricks' 132B mixture-of-experts — 16 experts, 4 active per token (36B active params). Trained on 12T tokens on Mosaic infrastructure and released under the Databricks Open Model Licence. DBRX was best-in-class on release; now beaten by Llama 3.3 70B and Qwen 2.5 72B on most benchmarks, but retains value as a well-documented MoE reference.

Context
33K
License
dbrx-open
VRAM Q4
79.2 GB
Comparing DBRX against another family? Try the side-by-side comparator or browse all leaderboards.