Fully local AI agent using Gemma 4 on an Nvidia GPU with 24GB VRAM.
All these commands were tested on the latest rolling release of CachyOS on a 2025 ASUS ROG Zephyrus G16 with a 16-core Intel Ultra 9 285H, 64GB DDR5 RAM, and an Nvidia RTX 5090 Mobile. But this guide should work for any linux distro and an Nvidia GPU with 24GB VRAM like the A10 or RTX A5500.
Start by installing system packages we'll need. If you're using another package manager like apt or zypper, google around to find the equivalent packages.