Raspberry Pi

How to install the llama.cpp libraries on a Raspberry Pi.

yzma runs on a Raspberry Pi 4 and on a Raspberry Pi 5. You need the 64 bit version of the Raspberry Pi OS.

The Raspberry Pi OS uses its own library versions, so you must name the operating system with the --os flag.

Use this command for the latest version of the Raspberry Pi OS:

yzma install --lib /path/to/lib --processor cpu --os trixie

Use this command for an older version of the Raspberry Pi OS:

yzma install --lib /path/to/lib --processor cpu --os bookworm

The yzma install command prints instructions for your system when it finishes. Follow them to complete the installation.

Then set the YZMA_LIB environment variable:

export YZMA_LIB=/path/to/lib

A Raspberry Pi has a small amount of memory. Use a small model, such as SmolLM2-135M or gemma-3-1b-it. See Models.

Next steps