How to Run LLMs on Your Computer
Tech Talk

How to Run LLMs on Your Computer

Large Language Models (LLMs) have revolutionized the field of natural language processing and artificial intelligence. These powerful models enable applications like language translation, text summarization, and content generation. The world of Large Language Models (LLMs) can be intimidating, especially with the associated costs. However, there are plenty of free and low-cost options available for those…

What is LLM Quantization?
Tech Talk

What is LLM Quantization?

LLM quantization is the process of reducing the precision of numbers used to represent a model’s weights, typically converting from 32-bit floating point (FP32) to smaller formats like 8-bit integers (INT8) or 4-bit integers (INT4). Think of it like compressing a high-resolution image to a smaller file size while trying to maintain as much quality…

Welcome!

JPG

This is my personal site and blog. I post bits and pieces about myLife, myWork, myJourney. They are interesting to me but make them available in the hopes someone else will them interesting, useful and enjoyable!

NFT Learnings
doodlingjorge.com
modernEUC.com
DayScheduler.com
Subscribe!


Categories:
Tag Cloud