Apple’s Live Text lets you interact with text in your photos

Apple has introduced a new feature to its camera system that automatically recognizes and transcribes text in your photos, from a phone number on a business card to a whiteboard full of notes. Live Text, as the feature is called, doesn’t need any prompting or special work from the user — just tap the icon and you’re good to go.

Announced by Craig Federighi on the virtual stage of WWDC, Live Text will be arriving on iPhones with iOS 15. He demonstrated it with a couple pictures, one of a whiteboard after a meeting, and a couple snapshots that included restaurant signs in the background.

Tapping the Live Text button in the lower right gave detected text a slight underline, and then a swipe allowed it to be selected and copied. In the case of the whiteboard, it collected several sentences of notes including bullet points, and with one of the restaurant signs it grabbed the phone number, which could be called or saved.

Screenshot of a phone selecting text in an image.

The feature is reminiscent of many found in Google’s long-developed Lens app, and the Pixel 4 added more robust scanning capability in 2019. The difference is that the text is captured more or less passively in every photo taken by an iPhone running the new system — you don’t have to enter scanner mode or launch a separate app.

This is a nice thing for anyone to have, but it could be especially helpful for people with visual impairments. A snapshot or two makes any text, otherwise difficult to read, able to be dictated or saved.

The process seems to take place entirely on the phone, so don’t worry that this info is being sent to a datacenter somewhere. That also means it’s fairly quick, though until we test it for ourselves we can’t say whether it’s instantaneous or, like some other machine learning features, something that happens over the next few seconds or minutes after you take a shot.

read more about Apple's WWDC 2021 on TechCrunch

Credit belongs to : www.techcrunch.com

You May Also Like

Vietnamese financial services app MFast gets $1.5M pre-Series A led by Do Ventures

MFast, a mobile app that lets Vietnamese users in remote areas access financial services, announced today it has raised a $1.5 million pre-Series A. The round was led by Do Ventures, with participation from JAFCO Asia.  Launched in 2019 by fintech company Digipay, MFast says it has been used by 600,000 people to date. It […]

GrowSari, a B2B platform for small stores in the Philippines, adds investors like Temasek’s Pavilion Capital and Tencent

Sari-sari stores are neighborhood stores in the Philippines that usually sell daily necessities and sometimes serve as community hubs, too. Today GrowSari, a startup that is digitizing sari-sari stores with features like pricing tools, inventory management and working capital loans, announced it has raised a Series B from several notable investors that brings its total […]
error: Content is protected !!