macOS

How to install the llama.cpp libraries on macOS.

macOS on Apple silicon uses the Metal GPU. You do not need to install a driver.

Decide where you want to put the library files, then run this command:

yzma install --lib /path/to/lib

The yzma install command prints instructions for your system when it finishes. Follow them to complete the installation.

Then set the YZMA_LIB environment variable:

export YZMA_LIB=/path/to/lib

Next steps

Go to Download models.