ainewsblitz.com

Breaking

Developer Runs Moonshot AI's 2.78-Trillion-Parameter Kimi K3 on a CPU With 8.24GB of RAM Using a 176KB C Engine

Developer Runs Moonshot AI's 2.78-Trillion-Parameter Kimi K3 on a CPU With 8.24GB of RAM Using a 176KB C Engine
  • Open Source
  • Foundation Models
  • Infra & Chips

A developer has released a 176KB inference engine written in pure C99 that can run Moonshot AI's 2.78-trillion-parameter Kimi K3 model on an ordinary CPU using as little as 8.24GB of RAM, sidestepping the roughly 1.56TB of memory a full load would normally demand.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.

$20
Read this article
$29/month
Unlimited — all 27,931 articles, the full archive, and comprehension quizzes
Save 72%
$98/year
≈ $8.17/month
Unlimited, billed once a year