Microsoft Released Seeing AI, Talking Camera App for iOS to help Visually Impaired

Microsoft launched Seeing AI, free smartphone app for iOS device in the U.S., Canada, India, Hong Kong, New Zealand, Singapore and coming soon to more countries. Seeing AI designed for the blind, low vision and visually impaired community, to describe nearby people, objects and scenes using neural network based AI that runs locally on their phone.

Seeing AI app uses artificial intelligence, camera on iPhone and optimized for use with VoiceOver to perform a number of useful functions:

  • Short Text – Speaks text as soon as it appears in front of the camera.
  • Documents – Provides audio guidance to capture a printed page, and recognizes the text, along with its original formatting.
  • Products – Scans barcodes, using audio beeps to guide you; hear the name, and package information when available.
  • People – Saves people’s faces so you can recognize them, and get an estimate of their age, gender, and emotions.
  • Scenes (early preview) – Hear an overall description of the scene captured.
  • Images in other apps – Just tap “Share” and “Recognize with Seeing AI” to describe images from Mail, Photos, Twitter, and more.

Read more on Mashable: Microsoft’s ‘talking camera’ app for the blind isn’t as magical as it sounds

One of the things we wanted to do was face recognition on device, and we’ve done that so within a few milliseconds you’ll hear the result. It’s all about the speed, and we try to do as much as we can on the device.

Saqib Shaikh, the tech lead on Seeing AI, said.

Download Seeing AI App for iOS
Languages supported – English.
Supported on iPhone 5C, 5S and later; best performance with iPhone 6S and later models.

An experimental feature called Scenes Channel is available to describe the scene around you, allowing Seeing AI App to analyze what’s going on in a photograph. As Seeing AI is an ongoing research product, so it may not accurately describe every image.

Microsoft Accessibility Blog: Seeing AI App is Now Available in the iOS app store
Microsoft News Centre UK: Microsoft reinforces AI vision at London event

Leave a Reply

Your email address will not be published.