Environment variables
The variables that yzma reads.
For your programs
YZMA_LIB
The directory that holds the llama.cpp shared library files. This is the only variable that a normal program needs.
export YZMA_LIB=/path/to/lib
set YZMA_LIB=C:\yzma\lib
The yzma install command and the yzma verify command also read it, so the --lib flag is not necessary when it is set.
A program does not have to use this variable. llama.Load takes any path:
llama.Load("/opt/myapp/lib")
YZMA_VERIFY
How to check the digest of each download.
| Value | What it does |
|---|---|
available |
Checks a digest when there is one. This is the default. |
require |
Fails when an asset has no digest. |
off |
Does no check. |
export YZMA_VERIFY=require
For the tests of yzma
These variables name the model files that the test suite uses. make test sets them.
| Variable | What it names |
|---|---|
YZMA_TEST_MODEL |
A text model. |
YZMA_TEST_MMMODEL |
A multimodal model. |
YZMA_TEST_MMPROJ |
The projector of that multimodal model. |
YZMA_TEST_QUANTIZE_MODEL |
A model for the quantization tests. |
YZMA_TEST_ENCODER_MODEL |
A model that has an encoder. |
YZMA_TEST_LORA_MODEL |
A model for the LoRA tests. |
YZMA_TEST_LORA_ADAPTER |
A LoRA adapter file. |
YZMA_TEST_SPLIT_MODELS |
A model that comes in splits. |
YZMA_TEST_VIDEO |
A video file for the mtmd video tests. |
YZMA_TEST_LLAMA_TAG |
The llama.cpp release tag to test against. |
For the benchmarks
| Variable | What it names |
|---|---|
YZMA_BENCHMARK_MODEL |
The text model for the benchmarks. |
YZMA_BENCHMARK_MMMODEL |
The multimodal model for the benchmarks. |
YZMA_BENCHMARK_MMPROJ |
The projector of that model. |
yzma model get -u https://huggingface.co/QuantFactory/SmolLM-135M-GGUF/resolve/main/SmolLM-135M.Q2_K.gguf
export YZMA_BENCHMARK_MODEL=~/models/SmolLM-135M.Q2_K.gguf
For the Makefile
| Variable | Default | What it does |
|---|---|---|
YZMA_LIB |
./lib |
Where the Makefile puts the libraries. |
MODELS_DIR |
$HOME/models |
Where the Makefile puts the models. |
WASM_DIR |
build/wasm |
Where the WebAssembly build goes. |