Microsoft Seeing AI app

Posted on: Thursday 23 November 2017

Microsoft’s Seeing AI app, which helps blind and partially sighted people by narrating the world around them, has been released in the UK.

The free program uses artificial intelligence to recognise objects, people and text via a phone or tablet’s camera and describes them to the user.
Seeing AI, an ongoing research project from Microsoft, is designed to help people with visual impairments complete everyday tasks.

Saqib Shaikh, who is himself visually impaired and led the development of Seeing AI from Microsoft’s offices in UK, said he was excited at the possibilities the technology can offer people.

“Since launching Seeing AI, it’s been amazing to see how people with visual impairments have been using the app to increase their independence, and we are excited to bring the app to the UK – my home country. At Microsoft, we aim to empower every person and every organization on the planet to achieve more, and Seeing AI achieves this in a very real sense. As someone who is visually impaired, this has become a key tool in my daily life, and I look forward to others in the UK benefitting from it, too.”

The program lets users recognise:

Text – speaks text as soon as it appears in front of the camera

Documents – provides audio guidance to capture a printed page, and recognizes the text, along with its original formatting

Products – scans barcodes, using audio beeps to guide you; hear the name, and package information when available

People – allows users to saves friends’ faces in their contact list so they can be recognized later

Scenes (early preview) – hear an overall description of the scene captured

Images in other apps – just tap “Share” and “Recognize with Seeing AI” to describe images from emails, photos, Twitter and more.

The app is now available for iOS devices in the UK, Ireland and Australia, after being released in the United States, Canada, India, Hong Kong, New Zealand and Singapore earlier this year.