{"id":519218,"date":"2024-12-18T10:44:14","date_gmt":"2024-12-18T17:44:14","guid":{"rendered":"https:\/\/jorgep.com\/blog\/?p=519218"},"modified":"2025-09-22T14:09:25","modified_gmt":"2025-09-22T21:09:25","slug":"the-power-of-local-ai-on-your-windows-pc","status":"publish","type":"post","link":"https:\/\/jorgep.com\/blog\/the-power-of-local-ai-on-your-windows-pc\/","title":{"rendered":"The Power of Local AI on Your Windows PC"},"content":{"rendered":"\n<div class=\"wp-block-columns has-theme-palette-7-background-color has-background is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p>Part of: <strong> <a href=\"https:\/\/jorgep.com\/blog\/series-ai-learnings\/\">AI Learning Series Here<\/a><\/strong><\/p>\n\n\n<style>.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col,.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col{flex-direction:column;}.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column395113_43ef2d-d5{position:relative;}@media all and (max-width: 1024px){.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column395113_43ef2d-d5 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column395113_43ef2d-d5\"><div class=\"kt-inside-inner-col\"><style>.wp-block-kadence-advancedheading.kt-adv-heading510545_6813a5-28, .wp-block-kadence-advancedheading.kt-adv-heading510545_6813a5-28[data-kb-block=\"kb-adv-heading510545_6813a5-28\"]{font-size:var(--global-kb-font-size-sm, 0.9rem);font-style:normal;}.wp-block-kadence-advancedheading.kt-adv-heading510545_6813a5-28 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading510545_6813a5-28[data-kb-block=\"kb-adv-heading510545_6813a5-28\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading510545_6813a5-28 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading510545_6813a5-28[data-kb-block=\"kb-adv-heading510545_6813a5-28\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<p class=\"kt-adv-heading510545_6813a5-28 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading510545_6813a5-28\">Quick Links:&nbsp;<a href=\"https:\/\/jorgep.com\/blog\/resources-for-learning-ai\/\">Resources for Learning AI<\/a> | <a href=\"https:\/\/jorgep.com\/blog\/keeping-up-with-ai\/\">Keep up with AI<\/a> | <a href=\"https:\/\/jorgep.com\/blog\/list-of-ai-tools\/\" data-type=\"post\" data-id=\"402818\">List of AI Tools<\/a><\/p>\n<\/div><\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><div class=\"wp-block-template-part\"><style>.wp-block-kadence-advancedheading.kt-adv-heading395113_c650df-47, .wp-block-kadence-advancedheading.kt-adv-heading395113_c650df-47[data-kb-block=\"kb-adv-heading395113_c650df-47\"]{text-align:center;font-size:var(--global-kb-font-size-md, 1.25rem);line-height:60px;font-style:normal;background-color:#f5a511;}.wp-block-kadence-advancedheading.kt-adv-heading395113_c650df-47 mark.kt-highlight, .wp-block-kadence-advancedheading.kt-adv-heading395113_c650df-47[data-kb-block=\"kb-adv-heading395113_c650df-47\"] mark.kt-highlight{font-style:normal;color:#f76a0c;-webkit-box-decoration-break:clone;box-decoration-break:clone;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;}.wp-block-kadence-advancedheading.kt-adv-heading395113_c650df-47 img.kb-inline-image, .wp-block-kadence-advancedheading.kt-adv-heading395113_c650df-47[data-kb-block=\"kb-adv-heading395113_c650df-47\"] img.kb-inline-image{width:150px;vertical-align:baseline;}<\/style>\n<p class=\"kt-adv-heading395113_c650df-47 wp-block-kadence-advancedheading\" data-kb-block=\"kb-adv-heading395113_c650df-47\">Subscribe to <a href=\"https:\/\/go.35s.be\/jtb\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>JorgeTechBits  newsletter<\/strong><\/a><\/p>\n<\/div><\/div>\n<\/div>\n\n\n\n<div style=\"font-family: Verdana, Geneva, sans-serif; font-size: 11px;\"><b>Disclaimer<\/b>: \u00a0I work for <a href=\"https:\/\/www.dell.com\/en-us\/work\/learn\/by-service-type-deployment\">Dell Technology Services<\/a> as a Workforce Transformation Solutions Principal.\u00a0 \u00a0 It is my passion to help guide organizations\u00a0through the current technology transition specifically as it relates to <a href=\"https:\/\/www.delltechnologies.com\/en-us\/what-we-do\/workforce-transformation.htm\">Workforce Transformation<\/a>.\u00a0 Visit <a href=\"https:\/\/www.delltechnologies.com\/en-us\/index.htm\">Dell Technologies<\/a>\u00a0site for more information.\u00a0 Opinions are my own and not the views of my employer.<\/div>\n<div><\/div><br>\n\n\n\n<p><em>You don&#8217;t need a supercomputer to run AI models, but the right software makes all the difference. Here are some options to get you started on your local AI journey.<\/em><\/p>\n\n\n\n<p>AI is no longer exclusive to data centers and cloud services. With the right software and a decent PC, you can run powerful AI models right from your desktop. This means you can create content, analyze data, and experiment with cutting-edge technology without an internet connection, subscription fees, or privacy concerns.<\/p>\n\n\n\n<p>This is a companion article to the more :  <a href=\"https:\/\/jorgep.com\/blog\/how-to-run-llms-on-your-computer\/\">How to Run LLMs on Your Computer <\/a><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>These are 3 of my favorite FREE TOOLS  I use to utilize Local AI <\/p>\n\n\n\n<h4 class=\"wp-block-heading\">1. Ollama + Open WebUI (The All-in-One Solution)<\/h4>\n\n\n\n<p>This combination offers a flexible and powerful way to run AI models. You have two excellent installation options depending on your preference: a simple Windows installer or a robust Docker container setup.<\/p>\n\n\n\n<p><strong>Ollama<\/strong> is a command-line tool that makes it incredibly easy to download and run large language models (LLMs). It handles all the complex setup in the background, so you can interact with models with simple commands.<\/p>\n\n\n\n<p><strong>Open WebUI<\/strong> is a beautiful, self-hosted user interface that gives you a ChatGPT-like experience right on your computer. It uses Ollama as its backend, providing the best of both worlds: a powerful engine and an intuitive interface.<\/p>\n\n\n\n<p><strong>How to get started (Windows Installer):<\/strong><\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Install Ollama:<\/strong> Download the Windows installer from the official Ollama website. Once installed, open your command prompt and run a model like this: <code>ollama run llama2<\/code>. Ollama will download the model and start a conversation right in your terminal.<\/li>\n\n\n\n<li><strong>Install Open WebUI:<\/strong> The easiest way to get the full web interface is to also install Docker Desktop for Windows. Once Docker is running, use a single command to download and run the Open WebUI container. This will provide you with a sleek, browser-based chat interface.<\/li>\n<\/ol>\n\n\n\n<p><strong>How to get started (Docker Containers):<\/strong><\/p>\n\n\n\n<p>This is the recommended method for those who want a robust and easy-to-manage setup. It provides a clean, isolated environment that bundles everything needed.<\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Install Docker Desktop:<\/strong> Download and install Docker Desktop for Windows from the official Docker website.<\/li>\n\n\n\n<li><strong>Run Ollama:<\/strong> Open your command prompt and run the Ollama container with a single command:\n<ul class=\"wp-block-list\">\n<li><code>docker run -d -p 11434:11434 --name ollama ollama\/ollama<\/code><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Run Open WebUI:<\/strong> In the same way, you can run the Open WebUI container. This command will link it to your running Ollama container:\n<ul class=\"wp-block-list\">\n<li><code>docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:\/app\/backend\/data --name open-webui --restart always ghcr.io\/open-webui\/open-webui:main<\/code><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Access the UI:<\/strong> Open your web browser and go to<strong> <code>http:\/\/localhost:3000<\/code><\/strong>. You can now sign up and start interacting with your local AI models.<\/li>\n<\/ol>\n\n\n\n<h4 class=\"wp-block-heading\">2. LM Studio (The User-Friendly Standalone)<\/h4>\n\n\n\n<p>If you&#8217;re looking for a simple, all-in-one solution that doesn&#8217;t require any command-line work, <strong>LM Studio<\/strong> is your best bet. It&#8217;s a desktop application that provides a full graphical user interface for downloading and running a wide range of LLMs.<\/p>\n\n\n\n<p><strong>Key features:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Model Browser:<\/strong> Browse and download models directly from the Hugging Face Hub, the largest repository of AI models.<\/li>\n\n\n\n<li><strong>Chat Interface:<\/strong> Chat with your downloaded models in a clean, straightforward interface.<\/li>\n\n\n\n<li><strong>Local Server:<\/strong> You can run a local server in the app to access your models via an API, allowing you to integrate them with other applications.<\/li>\n<\/ul>\n\n\n\n<p>LM Studio is perfect for beginners who want to explore different models and see them in action without any technical hassle.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">3. Anywhere LLM (For the Local AI Assistant)<\/h4>\n\n\n\n<p><strong>Anywhere LLM<\/strong> is an open-source tool that allows you to turn your local AI model into a powerful RAG (Retrieval-Augmented Generation) assistant. This means you can upload your own documents (PDFs, text files, web pages) and have the AI model use that information to answer your questions.<\/p>\n\n\n\n<p><strong>How it works:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Anywhere LLM acts as the &#8220;middleman&#8221; between your documents and your local AI model (which can be run with Ollama or LM Studio).<\/li>\n\n\n\n<li>It provides a user-friendly interface to upload data and ask questions, making it a great tool for researchers, writers, or anyone who wants an AI that&#8217;s an expert on their personal data.<\/li>\n<\/ul>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Docker: A Developer&#8217;s Secret Weapon for Local AI<\/h3>\n\n\n\n<p>While the blog post presents containerization as a great way to simplify AI model installation, there&#8217;s a deeper reason why professionals and hobbyists alike choose this method for their workflows. Using Docker (or others like it &#8211; Podman) for AI development isn&#8217;t just about convenience; it&#8217;s about control, consistency, and a more integrated, efficient workflow.<\/p>\n\n\n\n<p>Here\u2019s a look at the additional advantages of using Docker for your local AI setup:<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">1. Environmental Isolation and Cleanliness<\/h4>\n\n\n\n<p>This is perhaps the most significant benefit. When you install an application directly on your PC, it often creates files, registry entries, and dependencies that can conflict with other applications. For an AI project, this can mean a specific version of a library you need for one model might break another.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>No &#8220;Core&#8221; Changes:<\/strong> By running an application in a Docker container, you&#8217;re running it in an isolated sandbox. This means all the files, libraries, and configurations required for that AI model are contained within the container itself. You can experiment with different models, frameworks, and versions without worrying about them interfering with your Windows operating system or your other daily applications. When you&#8217;re done, you can simply remove the container, and your system is left in a pristine state.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">2. Reproducibility for Development and Sharing<\/h4>\n\n\n\n<p>The &#8220;it works on my machine&#8221; problem is a classic frustration in software development. Docker eliminates this. The container image acts as a self-contained blueprint for your entire AI environment.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Consistent Results:<\/strong> If you&#8217;re working on a project with a team or need to come back to a project months later, the Docker container ensures that the exact versions of the AI model, its dependencies, and the Python environment are all identical. This guarantees that you will get the same results and avoids the headache of troubleshooting obscure dependency conflicts.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">3. Seamless Integration with Other Local Tools<\/h4>\n\n\n\n<p>This is where your local setup truly becomes a powerful development machine. Containers are designed to communicate with each other and with your host system. This allows you to create a powerful local workflow by connecting different containerized applications.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Testing and Development with Workflow Tools:<\/strong> You mentioned using a tool like <strong>n8n<\/strong> (a workflow automation tool). You can run n8n in its own Docker container and have it communicate directly with your AI model running in its own container (like Ollama). For example, you could create a workflow where:\n<ol start=\"1\" class=\"wp-block-list\">\n<li>n8n monitors a specific email inbox.<\/li>\n\n\n\n<li>When a new email arrives, it triggers the workflow.<\/li>\n\n\n\n<li>n8n sends the email&#8217;s content to your local Ollama container via its API.<\/li>\n\n\n\n<li>The AI model summarizes the email and sends the summary back to n8n.<\/li>\n\n\n\n<li>n8n then sends the summary to you via a Slack or Discord message.<\/li>\n<\/ol>\n<\/li>\n<\/ul>\n\n\n\n<p>This type of integration allows you to build sophisticated, multi-step processes for testing and development, all within a self-contained and easily manageable local environment. It&#8217;s a professional-grade setup that leverages the best of containerization without the complexity of cloud deployments.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Final Thoughts<\/h3>\n\n\n\n<p>By using tools like Ollama, LM Studio, and Anywhere LLM, you can take control of your AI experience. You&#8217;ll gain privacy, reduce costs, and have the freedom to experiment without limitations.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>Using Docker on my computer, I can test and do many things on my day to day app.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Additional Resources<\/h3>\n\n\n\n<h2 class=\"wp-block-heading\">Ollama \/ OpenWebUI<\/h2>\n\n\n<style>.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap{align-content:start;}:where(.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap) > .wp-block-kadence-column{justify-content:start;}.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap{column-gap:var(--global-kb-gap-md, 2rem);row-gap:var(--global-kb-gap-md, 2rem);padding-top:var(--global-kb-spacing-sm, 1.5rem);padding-bottom:var(--global-kb-spacing-sm, 1.5rem);}.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap{grid-template-columns:repeat(3, minmax(0, 1fr));}.kb-row-layout-id519218_6a1a59-24 > .kt-row-layout-overlay{opacity:0.30;}@media all and (max-width: 1024px){.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}}@media all and (max-width: 1024px){.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap{grid-template-columns:repeat(3, minmax(0, 1fr));}}@media all and (max-width: 767px){.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}.kb-row-layout-id519218_6a1a59-24 > .kt-row-column-wrap{grid-template-columns:minmax(0, 1fr);}}<\/style><div class=\"kb-row-layout-wrap kb-row-layout-id519218_6a1a59-24 alignnone wp-block-kadence-rowlayout\"><div class=\"kt-row-column-wrap kt-has-3-columns kt-row-layout-equal kt-tab-layout-inherit kt-mobile-layout-row kt-row-valign-top\">\n<style>.kadence-column519218_3f4045-b8 > .kt-inside-inner-col,.kadence-column519218_3f4045-b8 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_3f4045-b8 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_3f4045-b8 > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_3f4045-b8 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_3f4045-b8 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_3f4045-b8{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_3f4045-b8 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_3f4045-b8 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_3f4045-b8\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Run AI Models Locally with Ollama: Fast &amp; Simple Deployment\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/uxE8FFiu_UQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n\n<style>.kadence-column519218_9ee221-6d > .kt-inside-inner-col,.kadence-column519218_9ee221-6d > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_9ee221-6d > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_9ee221-6d > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_9ee221-6d > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_9ee221-6d > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_9ee221-6d{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_9ee221-6d > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_9ee221-6d > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_9ee221-6d\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"How to Run Llama 3.1 Locally on your Computer with Ollama and n8n (Step-by-Step Tutorial)\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/2orxyu8c7Ek?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n\n<style>.kadence-column519218_5703eb-64 > .kt-inside-inner-col,.kadence-column519218_5703eb-64 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_5703eb-64 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_5703eb-64 > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_5703eb-64 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_5703eb-64 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_5703eb-64{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_5703eb-64 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_5703eb-64 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_5703eb-64\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Feed Your OWN Documents to a Local Large Language Model!\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/fFgyOucIFuk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n<\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\">LM Studio<\/h2>\n\n\n<style>.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap{align-content:start;}:where(.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap) > .wp-block-kadence-column{justify-content:start;}.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap{column-gap:var(--global-kb-gap-md, 2rem);row-gap:var(--global-kb-gap-md, 2rem);padding-top:var(--global-kb-spacing-sm, 1.5rem);padding-bottom:var(--global-kb-spacing-sm, 1.5rem);}.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap{grid-template-columns:repeat(3, minmax(0, 1fr));}.kb-row-layout-id519218_89cecc-13 > .kt-row-layout-overlay{opacity:0.30;}@media all and (max-width: 1024px){.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}}@media all and (max-width: 1024px){.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap{grid-template-columns:repeat(3, minmax(0, 1fr));}}@media all and (max-width: 767px){.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}.kb-row-layout-id519218_89cecc-13 > .kt-row-column-wrap{grid-template-columns:minmax(0, 1fr);}}<\/style><div class=\"kb-row-layout-wrap kb-row-layout-id519218_89cecc-13 alignnone wp-block-kadence-rowlayout\"><div class=\"kt-row-column-wrap kt-has-3-columns kt-row-layout-equal kt-tab-layout-inherit kt-mobile-layout-row kt-row-valign-top\">\n<style>.kadence-column519218_18a001-f2 > .kt-inside-inner-col,.kadence-column519218_18a001-f2 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_18a001-f2 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_18a001-f2 > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_18a001-f2 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_18a001-f2 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_18a001-f2{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_18a001-f2 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_18a001-f2 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_18a001-f2\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Private &amp; Uncensored Local LLMs in 5 minutes (DeepSeek and Dolphin)\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/A2CqSfd5I4I?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n\n<style>.kadence-column519218_690817-b5 > .kt-inside-inner-col,.kadence-column519218_690817-b5 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_690817-b5 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_690817-b5 > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_690817-b5 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_690817-b5 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_690817-b5{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_690817-b5 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_690817-b5 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_690817-b5\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"LM Studio Tutorial: Run Large Language Models (LLM) on Your Laptop\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/ygUEbCpOOLg?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n\n<style>.kadence-column519218_3ba932-bb > .kt-inside-inner-col,.kadence-column519218_3ba932-bb > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_3ba932-bb > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_3ba932-bb > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_3ba932-bb > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_3ba932-bb > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_3ba932-bb{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_3ba932-bb > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_3ba932-bb > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_3ba932-bb\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Getting started with LM Studio (100% private local AI)\" width=\"720\" height=\"540\" src=\"https:\/\/www.youtube.com\/embed\/fTUGVA2EKq0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n<\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\">AnythingLLM<\/h2>\n\n\n<style>.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap{align-content:start;}:where(.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap) > .wp-block-kadence-column{justify-content:start;}.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap{column-gap:var(--global-kb-gap-md, 2rem);row-gap:var(--global-kb-gap-md, 2rem);padding-top:var(--global-kb-spacing-sm, 1.5rem);padding-bottom:var(--global-kb-spacing-sm, 1.5rem);}.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap{grid-template-columns:repeat(3, minmax(0, 1fr));}.kb-row-layout-id519218_632401-01 > .kt-row-layout-overlay{opacity:0.30;}@media all and (max-width: 1024px){.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}}@media all and (max-width: 1024px){.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap{grid-template-columns:repeat(3, minmax(0, 1fr));}}@media all and (max-width: 767px){.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap > div:not(.added-for-specificity){grid-column:initial;}.kb-row-layout-id519218_632401-01 > .kt-row-column-wrap{grid-template-columns:minmax(0, 1fr);}}<\/style><div class=\"kb-row-layout-wrap kb-row-layout-id519218_632401-01 alignnone wp-block-kadence-rowlayout\"><div class=\"kt-row-column-wrap kt-has-3-columns kt-row-layout-equal kt-tab-layout-inherit kt-mobile-layout-row kt-row-valign-top\">\n<style>.kadence-column519218_b33991-1b > .kt-inside-inner-col,.kadence-column519218_b33991-1b > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_b33991-1b > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_b33991-1b > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_b33991-1b > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_b33991-1b > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_b33991-1b{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_b33991-1b > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_b33991-1b > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_b33991-1b\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Launch a Private AI Document Chatbot in 10 minutes! | Open Source\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/Hn5lzvo0-Q8?list=PLJwx0uYOFu7QWZarxOsEn1LCCNH0fIbfv\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n\n<style>.kadence-column519218_8b6920-94 > .kt-inside-inner-col,.kadence-column519218_8b6920-94 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_8b6920-94 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_8b6920-94 > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_8b6920-94 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_8b6920-94 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_8b6920-94{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_8b6920-94 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_8b6920-94 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_8b6920-94\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-4-3 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Do Anything with Local Agents with AnythingLLM\" width=\"720\" height=\"540\" src=\"https:\/\/www.youtube.com\/embed\/p82aMGJJLU8?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n\n<style>.kadence-column519218_b4d85a-98 > .kt-inside-inner-col,.kadence-column519218_b4d85a-98 > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column519218_b4d85a-98 > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column519218_b4d85a-98 > .kt-inside-inner-col{flex-direction:column;}.kadence-column519218_b4d85a-98 > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column519218_b4d85a-98 > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column519218_b4d85a-98{position:relative;}@media all and (max-width: 1024px){.kadence-column519218_b4d85a-98 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}@media all and (max-width: 767px){.kadence-column519218_b4d85a-98 > .kt-inside-inner-col{flex-direction:column;justify-content:center;}}<\/style>\n<div class=\"wp-block-kadence-column kadence-column519218_b4d85a-98\"><div class=\"kt-inside-inner-col\">\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"AnythingLLM: All-In-One AI Platform! Fully LOCAL Chat With Docs + Do Anything with Local Agents!\" width=\"720\" height=\"405\" src=\"https:\/\/www.youtube.com\/embed\/WsQLC1jOO1U?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n<\/div><\/div>\n\n<\/div><\/div>\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>You don&#8217;t need a supercomputer to run AI models, but the right software makes all the difference. Here are some options to get you started on your local AI journey. AI is no longer exclusive to data centers and cloud services. With the right software and a decent PC, you can run powerful AI models&#8230;<\/p>\n","protected":false},"author":2,"featured_media":427864,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_blocks_custom_css":"","_kad_blocks_head_custom_js":"","_kad_blocks_body_custom_js":"","_kad_blocks_footer_custom_js":"","ngg_post_thumbnail":0,"episode_type":"","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[441],"tags":[471,930,842,871,876,986],"class_list":["post-519218","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-talk","tag-ai","tag-ai-series","tag-chatgpt","tag-genai","tag-llm","tag-local-ai"],"taxonomy_info":{"category":[{"value":441,"label":"Tech Talk"}],"post_tag":[{"value":471,"label":"AI"},{"value":930,"label":"AI Series"},{"value":842,"label":"ChatGPT"},{"value":871,"label":"GenAi"},{"value":876,"label":"LLM"},{"value":986,"label":"Local AI"}]},"featured_image_src_large":["https:\/\/jorgep.com\/blog\/wp-content\/uploads\/Topic-ArtificialIntelligenceBanner-900x200-1.png",900,200,false],"author_info":{"display_name":"Jorge Pereira","author_link":"https:\/\/jorgep.com\/blog\/author\/jorge\/"},"comment_info":0,"category_info":[{"term_id":441,"name":"Tech Talk","slug":"tech-talk","term_group":0,"term_taxonomy_id":451,"taxonomy":"category","description":"","parent":0,"count":670,"filter":"raw","cat_ID":441,"category_count":670,"category_description":"","cat_name":"Tech Talk","category_nicename":"tech-talk","category_parent":0}],"tag_info":[{"term_id":471,"name":"AI","slug":"ai","term_group":0,"term_taxonomy_id":481,"taxonomy":"post_tag","description":"","parent":0,"count":141,"filter":"raw"},{"term_id":930,"name":"AI Series","slug":"ai-series","term_group":0,"term_taxonomy_id":940,"taxonomy":"post_tag","description":"","parent":0,"count":144,"filter":"raw"},{"term_id":842,"name":"ChatGPT","slug":"chatgpt","term_group":0,"term_taxonomy_id":852,"taxonomy":"post_tag","description":"","parent":0,"count":18,"filter":"raw"},{"term_id":871,"name":"GenAi","slug":"genai","term_group":0,"term_taxonomy_id":881,"taxonomy":"post_tag","description":"","parent":0,"count":78,"filter":"raw"},{"term_id":876,"name":"LLM","slug":"llm","term_group":0,"term_taxonomy_id":886,"taxonomy":"post_tag","description":"","parent":0,"count":14,"filter":"raw"},{"term_id":986,"name":"Local AI","slug":"local-ai","term_group":0,"term_taxonomy_id":996,"taxonomy":"post_tag","description":"","parent":0,"count":23,"filter":"raw"}],"_links":{"self":[{"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/posts\/519218","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/comments?post=519218"}],"version-history":[{"count":5,"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/posts\/519218\/revisions"}],"predecessor-version":[{"id":519415,"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/posts\/519218\/revisions\/519415"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/media\/427864"}],"wp:attachment":[{"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/media?parent=519218"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/categories?post=519218"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/jorgep.com\/blog\/wp-json\/wp\/v2\/tags?post=519218"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}