Try yzma in your browser
The model runs on your machine, in your browser. No install, no signup, and no server.
Click Load to start. The smallest model in the list is 220 MB, so the first download takes a moment, and then the browser keeps it for the next time. The line at the top right shows the backend.
On a computer with two GPUs, open the demo on its own page with ?gpu=high-performance to use the faster GPU, or with ?mode=cpu to compare it with the CPU.
The demo is a Go program that TinyGo compiles to WebAssembly. It uses the pkg/llamawasm package, which has the same calls as the native package.
- The demo code
- WebAssembly shows how the parts fit together.
- Run yzma in a browser shows how to build a page like this yourself.