NVIDIA Research has released Spatial-IQ, a diagnostic benchmark that decomposes 3D object counting—including hidden objects—into nine perceptual and cognitive sub-tasks, revealing a stark gap between humans and today's best multimodal systems. On the headline task of counting objects in a stacked 3D structure, humans reach 82.1% accuracy, while the strongest off-the-shelf multimodal large language model manages just 17.7%.
Continue reading
The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.
Already purchased? Sign in✓ Signed in — this article isn’t included in your current plan.
Unlocking the full article...
Contact us
Questions, corrections, or ideas? Send us a message here. We aim to reply by email within 24 hours.
Thank you. Your message has been sent. We aim to reply by email within 24 hours.Please enter your email address and a message.We could not send your message. Please try again in a little while.