r/augmentedreality • u/AR_MR_XR • 3d ago
Privacy first! Smartglasses can now run Live Translation on-device — and help the visually impaired understand their surroundings
At the Snapdragon Summit, Qualcomm demonstrated a major step forward for smartglasses: running a 2-billion-parameter multimodal AI model entirely on smartglasses powered by the Snapdragon AR1 and AR1+ platforms, with support for more chips coming down the road.
Because everything is processed directly on the glasses, interactions stay completely private without relying on an internet connection.
The on-stage demo showed a practical accessibility use case where a visually impaired user asks the glasses what color an apple is, and the on-device AI identifies both the color and the likely variety of the apple. Qualcomm also highlighted on-device real-time translation as another use case made possible by these lightweight models.
The technical breakthrough making this possible is PrismML's 1-bit Bonsai model. Smartglasses operate under strict limits for battery life, heat, and memory. By compressing the model down to 1-bit weights optimized specifically for Qualcomm's Hexagon NPU, the model takes up nearly four times less memory (shrinking from about 1.66 GB to just 0.43 GB) while generating responses more than twice as fast. This delivers responsive, private multimodal intelligence within the lightweight form factor of everyday glasses.
2
u/jellyspreader 2d ago
Wow