Running AI Models Locally
series-localai

Running AI Models Locally

In the previous article, I mentioned how I used the Pi coding harness and connected it to a Qwen 3.6 35 billion parameter model that was running locally on my desktop. In this article, I'll go through my setup and how I got it running. Hardware The nice bit of the Qwen 3.6 35b model is that it can run on mid- and high-end consumer hardware. This is what my desktop configuration looks like: * Nvidia RTX 5080 graphics card * 16 GB VRAM (for the GPU) * AMD Ryzen 7 9800X3D processor * 64 G
The Pi Coding Agent

The Pi Coding Agent

Last month I did a session at the local ChennaiPy meetup about "Pi and Py: Using the Pi agent for Python coding". Pi is a coding agent harness. If you've used Claude Code or Codex for coding, then Pi is similar to those tools. You can learn more about Pi below: Pi Coding AgentA terminal-based coding agent Open source Coding Harnesses One differentiator between Pi and Claude Code / Codex is that Pi is open source. Another tool in the open source agentic coding space is Opencode. There are tw
Python and AI in 2026

Python and AI in 2026

It's been a while since I sent out this newsletter. The last twelve months have probably been the most hectic that I've seen in the last decade. AI has taken off exponentially, and being an AI trainer it has kept me really busy (in a good way). And with AI taking off like this, its had a huge impact on the Python ecosystem as well. There has been a massive influx of new developers into the community, many who are not from a traditional developer background - which is great! I've also spoken at

Explore More Content

Load More