ainewsblitz.com

Breaking

Kimi K3 Demo Runs a 2.78 Trillion-Parameter Model on One CPU With 8.24 GB of RAM

  • Foundation Models
  • Open Source
  • Software Dev & Coding

A public C99 inference project says it can run Moonshot AI's 2.78 trillion-parameter Kimi K3 model on a single CPU with a measured peak memory footprint of 8.24 GB, without a GPU, BLAS library or machine-learning framework. The result does not make a frontier-scale model fast on a laptop, but it reframes the hardware bottleneck: the checkpoint still occupies 1.56 TB on disk, while memory is treated as a speed dial rather than a hard requirement.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.

$20
Read this article
$29/month
Unlimited — all 27,234 articles, the full archive, and comprehension quizzes
Save 72%
$98/year
≈ $8.17/month
Unlimited, billed once a year