What It Takes to Run ChatGPT

A few weeks back I wrote about how ChatGPT has reignited AI .

A few hours ago, Microsoft Mechanics released a very cool behind the scenes look at what technology Microsoft is using to run their AI services. Just to give you an idea:

GPT 3.0 used 175 billion parameters in their released Language model.
Microsoft Megatron-Turing model (already in production) has 530 billion parameters!

The technology behind the curtain is amazing. Very cool inside without too much technical details.

Thank to Microsoft Mechanics and Microsoft CTO Mark Russinovich for the video!

YouTube video at:

Similar Posts