ainewsblitz.com

Breaking

Developer runs 28.9M-parameter language model fully on-device on an ESP32-S3 microcontroller

  • Foundation Models
  • Open Source

A 28.9 million-parameter language model now runs entirely on an ESP32-S3 microcontroller, generating text at 9.88 tokens per second with no network connection on a board that typically costs about $8.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.

$20
Read this article
$29/month
Unlimited — all 27,559 articles, the full archive, and comprehension quizzes
Save 72%
$98/year
≈ $8.17/month
Unlimited, billed once a year