Download models
yzma uses models in the GGUF format that llama.cpp supports. There are more than 201,000 GGUF models on Hugging Face:
https://huggingface.co/models?library=gguf&sort=trending
Use the yzma command
The yzma command downloads a model for you:
yzma model get -u https://huggingface.co/QuantFactory/SmolLM2-135M-GGUF/resolve/main/SmolLM2-135M.Q4_K_M.gguf
The command puts the file in the default models directory. A Go program finds that directory with download.DefaultModelsDir().
Choose a model
A larger model gives better answers, but it needs more memory and more time. Start with a small model.
| Model | Size | What it does |
|---|---|---|
SmolLM2-135M |
Very small | Text. Good for a first test. |
qwen2.5-0.5b-instruct |
Small | Chat. |
gemma-3-1b-it |
Small | Chat. |
Qwen3-VL-2B-Instruct |
Medium | Images and text. |
See Models for the complete list with the command for each one.
Projector files
A Vision Language Model needs two files, the model file and the projector file. The projector file turns an image into tokens that the model reads. The name of a projector file starts with mmproj.
Download both files:
yzma model get -u https://huggingface.co/ggml-org/Qwen2.5-VL-3B-Instruct-GGUF/resolve/main/Qwen2.5-VL-3B-Instruct-Q8_0.gguf
yzma model get -u https://huggingface.co/ggml-org/Qwen2.5-VL-3B-Instruct-GGUF/resolve/main/mmproj-Qwen2.5-VL-3B-Instruct-Q8_0.gguf
Next steps
Now write your first program. Go to Your first program.