Raspberry Pi

Run models with the CPU of a Raspberry Pi.

The Raspberry Pi is a popular single board computer. yzma runs on a Raspberry Pi 4 and on a Raspberry Pi 5 with the 64 bit version of the Raspberry Pi OS.

yzma uses the CPU. With a small text model, a Raspberry Pi 4 can process about 35 tokens a second.

Raspberry Pi 5 board
Image by Raspberry Pi Ltd, CC BY-SA 4.0