ainewsblitz.com

Breaking

Developer Runs a 28.9M-Parameter Language Model Fully Offline on an $8 ESP32-S3 Microcontroller

Developer Runs a 28.9M-Parameter Language Model Fully Offline on an $8 ESP32-S3 Microcontroller
  • Foundation Models
  • Open Source
  • Infra & Chips

A developer known as slvDev has squeezed a 28.9-million-parameter language model onto Espressif's ESP32-S3, an approximately $8 microcontroller, running the model entirely on-chip with no server connection and generating text at roughly 9.5 tokens per second. The demonstration, released as open source with firmware and training code on GitHub, pushes the boundary of what tiny, low-cost silicon can do without touching the cloud.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.

$20
Read this article
$29/month
Unlimited — all 27,934 articles, the full archive, and comprehension quizzes
Save 72%
$98/year
≈ $8.17/month
Unlimited, billed once a year