NVIDIA Jetson Orin Nano
Use the GPU of the NVIDIA Jetson Orin Nano with CUDA or Vulkan.
The NVIDIA Jetson Orin Nano is a small computer for AI at the edge. It has an arm64 processor and an NVIDIA GPU on the same board.
yzma uses the GPU with CUDA or Vulkan. With a small text model and CUDA, the board can process about 190 tokens a second.
