Last year at Meta Connect, Meta introduced Meta AI—a powerful intelligent assistant powered by Meta Llama technology. The Ray-Ban Meta smart glasses were the first to feature Meta AI, and they have only gotten smarter with the introduction of Meta AI with Vision. This multimodal update allows the smart glasses to see what the user sees, enabling hands-free text translation, fashion advice, and more. Now, Meta Quest is set to join the innovation wave this summer.
As part of the Meta Horizon OS, Meta AI will elevate the hands-free experience. Users will soon be able to get answers to a wide range of questions with real-time information powered by Bing. Meta AI with Vision will be included in the update (initially available in Passthrough), allowing users to ask questions about their physical surroundings while wearing the headset. This update will start rolling out in the US and Canada in experimental mode next month, with ongoing improvements planned.
Imagine watching YouTube videos of breathtaking hikes in mixed reality while packing for a trip to Joshua Tree. Users can ask Meta AI for advice on dressing for summer weather, or hold up a pair of shorts and ask what kind of top would complete the outfit. They can get weather forecasts, and even local restaurant recommendations.
Or, picture being in-headset, listening to music while working on a school paper on a massive virtual monitor. Users can ask Meta AI for memorable quotes from Shakespeare’s Hamlet and explanations of significant soliloquies or scenes.
During a game of Assassin’s Creed® Nexus VR, curiosity might strike while parkouring across rooftops. Users can ask Meta AI about historical facts, like the presence of actual assassins in colonial Boston, and receive surprising answers.
More than a decade ago, Meta recognised AI and the metaverse as key technologies for the next computing platform and has since invested heavily in research. Breakthroughs in areas like computer vision have enabled standalone VR and the new generation of all-in-one mixed reality devices.
AI has driven Meta’s consumer hardware from the start, and recent innovations in generative AI have accelerated progress toward the vision of human-oriented computing. Large language models are creating powerful virtual assistants, becoming even more useful when integrated into wearable devices like Ray-Ban Meta smart glasses and soon, Meta Quest. As technology advances, regular software updates will continue to enhance the experience.
Millions have already experienced Meta AI via Facebook, Instagram, WhatsApp, Messenger, the web, and Ray-Ban Meta smart glasses. Now, Meta is excited for even more people to tap into the power, intelligence, and utility of Meta AI on Quest 3. It’s still early days, with more functionality to come. Meta looks forward to seeing how users engage with Meta AI in-headset and will share more updates soon.
*Ray-Ban Meta smart glasses voice features are available in English, Italian, and French. Select voice features are only available in English. Voice features and functionalities may vary by language.
**Meta AI on Meta Quest will be available only in experimental mode in the US and Canada in English.
***Meta AI with Vision is not available on Meta Quest 2. Only physical objects seen through Passthrough are recognised by this experimental version of Meta AI with Vision—virtual objects are not recognised at this time.
****The existing Voice Commands will be deprecated. Stay tuned for more details.