PrismML, a Caltech-born AI startup, has introduced 1-bit Bonsai, which it calls the world's first commercially viable LLM family designed with native 1-bit weights across all layers. The flagship Bonsai 8B fits within a 1.15 GB memory footprint and is released as open source under Apache 2.0. The company's CEO, Caltech professor Babak Hassibi, projects that within a few years 95% of AI compute will run on device, with only the leading-edge 5% running in the cloud.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in✓ Signed in — this article isn’t included in your current plan.
Unlocking the full article...
Contact us
Questions, corrections, or ideas? Send us a message here. We aim to reply by email within 24 hours.
Thank you. Your message has been sent. We aim to reply by email within 24 hours.Please enter your email address and a message.We could not send your message. Please try again in a little while.