💻MLX
Also known as Apple MLX, MLX LM, mlx-lm
Apple's free tool kit. It runs AI models fast on Macs with Apple chips.
Think of it like
It is like a toolbox made for one brand of bike. Every tool fits just right.
Example
Jack has a Mac with 32 GB of shared memory. He runs a 4-bit model with MLX LM. The model can use most of that pool, not just a small graphics card.
Why it matters
A Mac's shared memory can hold bigger models than many graphics cards. MLX is built to use all of it.
Definition
Example code
bash
pip install mlx-lm
mlx_lm.generate --prompt "How tall is Mt Everest?"Common mistake
Key takeaways
- 1Made for Apple chips. It uses the shared memory pool.
- 2MLX LM. Language models in one command.
- 3Its own files. Not the same as GGUF.