Multimodal AI capabilities on Meta smart spectacles

The Ray-Ban Meta Smart Glasses were originally launched with voice-activated controls. However, Meta has upgraded these functions with the latest update by incorporating multimodal AI features which will utilize the 12 MP camera in addition to the microphone to process commands and provide real-time information to users.

Ray-Ban Meta Smart Glasses
Meta activates multimodal AI features on Ray-Ban Meta Smart Glasses in the new update. You can ask for translation, recipes, what to wear, tell you about the subjects, and more. / © Meta

With Meta AI, users can perform queries such as asking the assistant to translate visible text, and they will be able to hear the translation through the spectacles’ speakers. Alternatively, they can make suggestions for recipes or let the AI scan what dish can be whipped up from the available ingredients.

Video calls and Apple Music on Ray-Ban Meta Smart Glasses

Apart from the multimodal AI features, Meta is also adding video call support that will support both Messenger and WhatsApp services. Users can ask Meta AI to start a video call and share their current view.

At the same time, there is also added streaming support for Apple Music with the Ray-Ban Meta Smart Glasses which enables hands-free voice control audio playback.

Ray-Ban Meta Smart Glasses
Meta launches new Ray-Ban Meta Smart Glasses in Scuderia Ferrari Limited Edition colorways / © Meta

Meta announced new frame styles and exclusive colorways for the Ray-Ban Meta Smart Glasses as well. These include the new classic Skyler frames with cat eye design and Headliner frames with lower bridge alignment. Additionally, the Ray-Ban Meta glasses are now available in limited edition Scuderia Ferrari finishes.

The software update is already rolling out in the USA and Canada. Meta didn’t confirm when this will arrive on Ray-Ban Meta Smart Glasses in other countries.

Do you have Ray-Ban Meta Smart Glasses now that they feature AI features? Share your thoughts with us in the comments.