Initial LXD Setup AMD GPU Passthrough Setup This section is AMD-specific. Install ROCm Mostly following https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/quick-start.html, within the ai container as user “josh” do: I also followed the “AMDGPU driver installation” section of instructions from that page but I’m not sure that was actually necessary in the container. I also installed rocm-core and rocminfo in
Continue Reading “Running a Local LLM with Ollama and Claude Code in an LXD Sandbox”