# Mixtral

> Open models where each word goes to two of eight experts.

**Field:** Artificial Intelligence  
**Category:** Models & Providers  
**Also known as:** Mixtral 8x7B, Mixtral 8x22B

## Think of it like

It is like a team of eight cooks. For each dish, only the two best cooks for it do the work.

## Definition

Mixtral is a family of open-weight language models. Each one is built as a mixture of experts. Mixtral 8x7B came out in December 2023, with eight experts in each layer. A router sends each token to two of those eight. The model holds about 47 billion parameters, but each token uses only about 13 billion. So it runs at the speed of a much smaller model.

## Example

Lucy downloads Mixtral 8x7B from Mistral AI and runs it on her own server. Each word costs the work of about 13 billion weights, not 47.

## Why it matters

It was one of the first open models of this kind. It did as well as much bigger models, and cost less to run.

## Common mistake

Reading 8x7B as 56 billion parameters. The experts share some parts, so the total is about 47 billion. Only about 13 billion work on each token.

## Three principles

- **Eight experts.** In every layer of the model.
- **Two per token.** A router picks which two do the work.
- **Open weights.** Anyone can download and run it.

## Related terms

- [Mixture of Experts (MoE)](https://learn.benibix.com/term/ai/mixture-of-experts)
- [Gating Network](https://learn.benibix.com/term/ai/gating-network)
- [Mistral AI](https://learn.benibix.com/term/ai/mistral-ai)
- [Open-Weight Model](https://learn.benibix.com/term/ai/open-weight-model)
- [Model Parameter](https://learn.benibix.com/term/ai/model-parameter)

## Taught in

- [Transformer Architecture](https://learn.benibix.com/learn/ai-llms/transformer-architecture): LLMs, 5/15
- [AI Model Names and Sizes](https://learn.benibix.com/learn/ai-models-providers/ai-model-names-and-sizes): AI Models and Providers, 6/13

![A token goes into a router. The router sends it to two of eight experts, which are lit up. The other six are idle for this token.](https://learn.benibix.com/diagrams/llm-moe.svg)

---

Source: https://learn.benibix.com/term/ai/mixtral
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
