• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechFortune 500

Microsoft’s New iPhone App Helps Blind People ‘See’ What’s Around Them

By
Lisa Eadicicco
Lisa Eadicicco
and
TIME
TIME
Down Arrow Button Icon
By
Lisa Eadicicco
Lisa Eadicicco
and
TIME
TIME
Down Arrow Button Icon
July 13, 2017, 8:24 PM ET

Microsoft has used its artificial intelligence chops to automatically add captions to your selfies and guess your age. Now, the company is applying similar tech to a more practical purpose: making everyday life easier for the visually impaired.

The company’s new Seeing AI app, which is now available for the iPhone, uses the smartphone’s camera to detect and describe nearby people, text, and objects.

The app not only recognizes a person based on his or her face, but can also relay mood based on facial expressions, estimate a person’s proximity to the user, and describe physical characteristics. In a demo video, Seeing AI provided a description of a woman smiling by saying: “28 year old female wearing glasses looking happy.”

Get Data Sheet, Fortune’s technology newsletter.

Microsoft says Seeing AI can also identify products based on their barcode, a feature aimed at making shopping easier. The app emits a series of beeps to indicate how close the viewfinder is to the barcode, helping users align the camera properly. Similarly, when reading documents to users, Seeing AI will provide spoken hints to ensure that all corners of the paper are properly captured.

For more about Microsoft, watch:

Facebook has made similar efforts in the past when it comes to leveraging its image recognition technology to benefit the visually impaired. Earlier this year, the company enhanced its automatic alt text feature to be more accurate in describing Facebook photos. The technology can now piece together what’s occurring in a scene rather than just stating the subjects of a photo.

Microsoft’s new app is available in six countries, including the United States, Canada, India, Hong Kong, New Zealand, and Singapore. The company has not yet said whether it plans to develop an Android version.

This article was originally published at Time.com

About the Authors
By Lisa Eadicicco
See full bioRight Arrow Button Icon
By TIME
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Taylor Swift poses.
AICelebrities
Taylor Swift files to trademark her voice and image to save from potential AI misuse
By Maria Sherman and The Associated PressApril 28, 2026
3 hours ago
Janet Yellen on her legacy as the first woman to lead the Fed, Trump’s central bank clash, and Kevin Warsh’s tightrope
EconomyMost Powerful Women
Janet Yellen on her legacy as the first woman to lead the Fed, Trump’s central bank clash, and Kevin Warsh’s tightrope
By Emma HinchliffeApril 28, 2026
3 hours ago
Ferguson points
CybersecurityScams
Americans lost $2.1 billion to social media scams last year, 8 times more than in 2020. Facebook alone cost users more than texts and emails combined
By Jacqueline MunisApril 28, 2026
3 hours ago
Photo of Vinod Khosla
Startups & VentureVenture Capital
‘He wanted to be CEO’: Early OpenAI VC Vinod Khosla says Elon Musk’s bid for control led to the Sam Altman feud and his major investment
By Nick LichtenbergApril 28, 2026
3 hours ago
Dex founder and CEO Paddy Lambros (left) sits on a stool on a stage with two other panelists while holding a microphone and gesturing.
Startups & VentureVenture Capital
Exclusive: AI-powered recruiting startup Dex raises $5.3 million seed round
By Jeremy KahnApril 28, 2026
4 hours ago
Customers Bank CEO Sam Sidhu
SuccessJobs
CEO of a $25.9 billion bank had his AI clone lead the company’s earnings call—as Mark Zuckerberg builds his own digital twin
By Emma BurleighApril 28, 2026
4 hours ago

Most Popular

Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
Success
Apple cofounder Ronald Wayne—whose stake would be worth up to $400 billion had he not sold it in 1976—says that at 91, he has no regrets
By Preston ForeApril 27, 2026
1 day ago
‘The cost of compute is far beyond the costs of the employees’: Nvidia executive says right now AI is more expensive than paying human workers
AI
‘The cost of compute is far beyond the costs of the employees’: Nvidia executive says right now AI is more expensive than paying human workers
By Sasha RogelbergApril 28, 2026
12 hours ago
Current price of silver as of Monday, April 27, 2026
Personal Finance
Current price of silver as of Monday, April 27, 2026
By Joseph HostetlerApril 27, 2026
1 day ago
Current price of oil as of April 27, 2026
Personal Finance
Current price of oil as of April 27, 2026
By Joseph HostetlerApril 27, 2026
1 day ago
Current price of gold as of April 27, 2026
Personal Finance
Current price of gold as of April 27, 2026
By Danny BakstApril 27, 2026
1 day ago
The U.S. military may have already used up half of its most expensive missiles, and it could take up to 4 years to rebuild its stockpiles
Politics
The U.S. military may have already used up half of its most expensive missiles, and it could take up to 4 years to rebuild its stockpiles
By Sasha RogelbergApril 24, 2026
4 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.