Your Route to Real News

Mark Zuckerberg’s AI camera glasses now tell you about what you’re looking at

395     0
There are some other upgrades too
There are some other upgrades too

META has upgraded its smart glasses with the ability to describe what you're seeing using a built-in camera.

You can simply ask the AI inside the glasses about what you're looking at – and it'll reply using the speaker inside the specs.

Mark Zuckerberg's smart specs have built-in artificial intelligence qeithiqdidzeprw
Mark Zuckerberg's smart specs have built-in artificial intelligenceCredit: Reuters

The Ray-Ban Meta Smart Glasses were launched by tech billionaire Mark Zuckerberg last year, giving you the ability to record videos and ask an AI questions simply using the eyewear.

Now the AI can assess what's in front of you and provide helpful responses.

For instance, it could describe a cat breed, translate a foreign-language sign, or tell you information about a famous landmark.

Fashion fans sent into a frenzy after seeing Ugg dupes in the Primark saleFashion fans sent into a frenzy after seeing Ugg dupes in the Primark sale

Meta calls this "multimodal", which simply means the AI can assess more than one type of input – so not just your voice, but images of the world around you too.

"We started testing a multimodal AI update in December, so you can ask your glasses about what you’re seeing, and they’ll give you smart, helpful answers or suggestions," Meta explains.

"That means you can do more with your glasses because now they can see what you see.

"Say you’re traveling and trying to read a menu in French.

"Your smart glasses can use their built-in camera and Meta AI to translate the text for you, giving you the info you need without having to pull out your phone or stare at a screen."

However, you can't ask just anything: for instance, it Meta won't be able to tell you about a person you've spotted in the street, for privacy reasons.

The feature is now rolling out to all Ray-Ban Meta smart glasses across the U.S. and Canada as a beta test.

Just make sure you've updated your glasses to the latest software, and then simply say "Hey Meta" and ask a question.

META VISION

That's not all: the Meta glasses now let you share your view while making a video call.

If you're video-calling via WhatsApp and Facebook Messenger and you're wearing the glasses, you can show the other callers what you're seeing.

Mrs Hinch fan transforms kitchen for £70 using vinyl wrap and Facebook freebieMrs Hinch fan transforms kitchen for £70 using vinyl wrap and Facebook freebie
The trendy Ray-Ban glasses use microphones and speakers to provide an Amazon Alexa-style chat feature
The trendy Ray-Ban glasses use microphones and speakers to provide an Amazon Alexa-style chat featureCredit: Meta

Meta says: "At the grocery store and not sure which brand of kombucha to buy? Can’t tell if that pineapple is ripe?

"Now you can hop on a video call with your mom and get her advice based on what you see."

The video-calling feature is rolling out gradually according to Meta, so you might not see the update right away.

Meta has also added new frame options, which are now available in 15 countries, including the U.S., Canada, and Australia.

Sean Keach

Print page

Comments:

comments powered by Disqus