ai Qwen 3.6 on Local Hardware In this article, I'll explain the steps that I took to get the Qwen 3.6 35B A3B model running on my desktop.
series-localai Running AI Models Locally In the previous article, I mentioned how I used the Pi coding harness and connected it to a Qwen 3.6 35 billion parameter model that was running locally on my desktop. In this article, I'll go through my setup and how I got it running. Hardware The nice bit of the Qwen 3.6 35b model is that it can run on mid- and high-end consumer hardware. This is what my desktop configuration looks like: * Nvidia RTX 5080 graphics card * 16 GB VRAM (for the GPU) * AMD Ryzen 7 9800X3D processor * 64 G
