ainewsblitz.com

Breaking

Cactus Releases Needle 3: A Quantized 8–29MB Model Matching DeepSeek on Embedded Devices

  • Foundation Models
  • AI Agents
  • Infra & Chips

Cactus Compute has released Needle 3, an automation foundation model compressed to just 8–29 MB that achieves performance parity with models orders of magnitude larger when fine-tuned for on-device task automation. The model, built as a Laddered Simple Attention Network with a novel Monarch Hadamard MLP architecture and CQ2 quantization (approximately 2.125 bits per weight), represents a significant step toward deploying capable AI agents on phones, wearables, smart home systems, and microcontrollers without cloud dependency.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.

$20
Read this article
$29/month
Unlimited — all 27,307 articles, the full archive, and comprehension quizzes
Save 72%
$98/year
≈ $8.17/month
Unlimited, billed once a year