For the better part of a decade, Nvidia has dominated the artificial intelligence (AI) landscape, not just with high-performance graphics cards but by building an ecosystem that locked in developers and researchers. Anyone looking to engage in serious AI development was expected to pay the hefty “Nvidia tax.” I have written before about the NVIDIA…
I get asked all the time: “What are you actually using for your AI Lab?” To answer that, I wanted to provide an update on how I’m building, testing, and deploying. But first, a little background. I’m a technology consultant and services principal, and I’ve been developing custom software since I was 15. I’ve been deep…
How I Bypassed Ollama and LM studio Limitations on my Ryzen AI NPU to Hit 50+ TPS If you recently purchased a modern AI-PC, you bought into a promising vision: a dedicated, cutting-edge Neural Processing Unit (NPU) sitting right inside your silicon, designed to stream large language models (LLMs) smoothly without draining your battery or…
I have been using Agent Zero, but after watching the many reviews, I got curious about Hermes and decided to give it a try as a container on my Ryzen AI PC. Running autonomous agent architectures completely locally on consumer hardware is the absolute frontier of modern AI engineering. Moving from terminal-centric frameworks like Agent…
Nvidia’s dominance in the AI hardware market is not solely due to its high-performance GPUs. The company’s real strength lies in its comprehensive ecosystem, centered around its proprietary Compute Unified Device Architecture (CUDA). Over the past decade, CUDA has evolved from a programming framework into the foundation of modern AI development, creating a powerful network…
As enterprises scale their AI operations from experimental “playgrounds” to full-scale agentic workflows, a new bottleneck has emerged: Token Controlling and API Key Chaos. With teams of 6–10 developers or automated agents hitting multiple providers (OpenAI, Anthropic, Gemini) and local servers simultaneously, managing individual accounts is no longer viable. Enter the AI Gateway—the centralized “Token…
Back in 2024 I wrote a blog post: How Much Does It Cost to Operate AI ChatBots? As we move into the new era of the token economy, the conversations, about tokens costs and power are very much part of the story. A useful model must account for real model pricing, utilization, infrastructure, performance, and…
With 64GB of RAM and the latest Ryzen AI silicon, you are no longer a mere consumer of AI—you are a host. This setup leverages AMD’s XDNA architecture to run Gemma 4 and / or and Qwen 3.5 locally, ensuring your data never leaves your machine while providing a professional-grade automation suite via Docker. This…
For months, I’ve been refining my local AI lab. I had the hardware dialed in—my AMD Ryzen AI processor, 128GB of RAM, running Ollama and Open WebUI like a dream. But I kept hitting the “invisible wall.” Every time I asked my local agents for the morning’s technical headlines or a deep dive into a…
I started an experiment today… We’ve all seen the flashy trading bots promising “1000% returns,” but usually, those come with a hefty subscription fee and a black box where your data goes to die. If you’re already running a local agent (via Ollama, LM Studio, AgentZero or a custom build one), you’re sitting on untapped…
The buzz around Artificial Intelligence is everywhere, but the conversation is shifting. We are moving away from “chatbots in a browser” and toward Local AI Agents—personalized assistants that live on your device and work for your individual productivity. As we enter 2026, the winner in this space isn’t just the company with the smartest code;…
Apple’s Unified Memory has been a game-changer for Local AI and Everyone Else is Catching Up.. The buzz around Artificial Intelligence is everywhere, and one of the most exciting frontiers is “Local AI” – running powerful AI models directly on your device, without sending your data to the cloud. If you’ve been following the developments,…
As a follow up to my How to Host Multiple Public Websites on Your Windows PC a few months bac, I am writing this one If you want to move away from expensive AI subscriptions and bring your data back home, building a local AI home lab is the answer. Today, I’m documenting how I…
The future of AI isn’t just in the cloud; it’s right on your desktop. Running AI models locally offers unparalleled privacy, speed, and creative freedom. But with so many options from AMD, Intel, and Apple, how do you choose the best “Local AI PC” for you? Let’s break down the leading architectures and what they…
Ollama, Open WebUI and n8n on Windows Hosting your own AI models is no longer just for Linux gurus. With Docker Desktop on Windows, you can run a professional-grade automation and chat suite—n8n, Ollama, and Open WebUI—all on your own hardware. In this guide, we will set up a “Generic” configuration that makes it easy…
Watched some of the CES (Consumer Electronics Show) keynotes and updates from this week in Las Vegas… What a great start for 2025! Nvidia Keynote was simply amazing! The new RTX PCs the Super Computer in the palm of your hand, and the Agentic-AI piece (preconfigure and downloadable blueprints ) was specifically interesting, but that…
See 2025-01-13-UPDATE below I am so excited about this technology! I have been using local AI on my Dell Precision Laptop. It is SLOW but the capabilities and possibilities are incredible. The use of AI on my local machine will change the way I work,. Incredible.. Copilot+ PCs from Microsoft In May 2024, Microsoft has…
