What It Takes to Run ChatGPT

Disclaimer: I create this content entirely on my own time, and the views expressed here are mine alone (not my employer’s). Because I love leveraging new tech, I use AI tools like Gemini, NotebookLM, Claude, Perplexity and others as a “digital team” to help research and polish these articles so I can share the best possible insights with you!

A few weeks back I wrote about how ChatGPT has reignited AI .

A few hours ago, Microsoft Mechanics released a very cool behind the scenes look at what technology Microsoft is using to run their AI services. Just to give you an idea:

GPT 3.0 used 175 billion parameters in their released Language model.
Microsoft Megatron-Turing model (already in production) has 530 billion parameters!

The technology behind the curtain is amazing. Very cool inside without too much technical details.

Thank to Microsoft Mechanics and Microsoft CTO Mark Russinovich for the video!

YouTube video at: