Arduino UNO Q
Run models on the Arduino UNO Q.
The Arduino UNO Q is a unique board with two functions. It has both a Qualcomm QRB2210 arm64 processor running a full Debian based Linux, as well as a STM32U585 microcontroller.
yzma runs on the Linux side of the board and uses the CPU for inference. With a small text model, the board can process about 32 tokens a second.