Snapchat has unveiled a series of new Lenses, platform features, and tools aimed at enhancing augmented reality (AR) experiences for developers and users alike. The updates are part of the Snap OS v5.58 release, which introduces innovative capabilities for Spectacles, Snap’s AR-enabled smart glasses, along with expanded tools for developers to create and experiment with AR applications.
New Lenses: Piano Tutor and Ball Game
Snapchat’s new Lenses demonstrate the power of the Spectacles camera and SnapML, Snap’s machine learning technology.
- Piano Tutor Lens: Designed to bring a personal piano instructor to users, this Lens uses custom machine learning models to identify and track a variety of pianos. It overlays notes onto the keys in real-time, helping users familiarize themselves with the keyboard layout and practice coordination. The Lens also evaluates performance, providing real-time feedback for continuous improvement.