• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI

2

Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living

3

The stock market is about to suffer a 'snapback' and will lose much of this year's gains as 'speculation is hitting extreme levels,' BofA warns

1

Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI

2

Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living

3

The stock market is about to suffer a 'snapback' and will lose much of this year's gains as 'speculation is hitting extreme levels,' BofA warns

This Startup Wants to Bring ‘Common Sense’ to Self-Driving Cars

By
Renae Reints
Renae Reints
Down Arrow Button Icon
By
Renae Reints
Renae Reints
Down Arrow Button Icon
November 5, 2018, 1:45 PM ET
Add Fortune on Google for similar content.

A little-known name in the world of autonomous driving is paving the way for a new type of self-driving car—one that can use “common sense,” as the company calls it, to navigate an uncontrolled environment.

While most companies developing self-driving cars are focused on improving sensors, perception, and control, iSee CEO Yibiao Zhao says his company is the first to work on creating a robot that can really understand what’s going on.

Zhao founded iSee just about a year ago along with Chris Baker, his lab partner at the Massachusetts Institute of Technology, and Debbie Yu, who has a history with tech startups. The three are supported by MIT’s venture capital firm, The Engine, in Cambridge, Mass.

“We know that seeing is not equivalent to understanding,” Zhao told Fortune in a phone call last week. “Currently cars can see, but they cannot really understand what’s really going on and what other people are thinking, and what are the other people’s intentions.”

With iSee, the cars’ programming has a special algorithm allowing it to collaborate with humans in an open environment. The system has two components: deep learning and the common sense engine.

Deep learning is something other companies like Waymo and Uber have already established; it’s the notion that if you practice something enough, you’ll be able to do it unconsciously. In humans, it’s the fast, subconscious thinking that allows you to multitask while driving. In self-driving cars, it’s the type of learning that lets a car remain within a lane.

When you get to an obstacle, however, you’ll need reasoning, or conscious thinking. When you merge on the highway, change lanes, or come to an intersection, you need to predict the actions of other cars, negotiate with them, and consider different possibilities in order to make a safe decision.

As a human driver, “we’ll consciously think about those types of possible parallel futures,” says Zhao. “That is enabled by our common sense engine in our mind, and that gives us the ability to handle some new scenario that we never encountered before.”

In a self-driving car, the common sense engine allows it to navigate new situations based on a handful of past experiences and general knowledge.

This component, unique to iSee, helps the car to “truly understand what is going on, and to predict what they might do in the next two seconds,” says Zhao. This lets the robot “make safe and strategic decisions when they need to interact or even negotiate with the other drivers in the environment,” he says.

Once Zhao, Baker, and Yu had this algorithm established and passed through a simulator about a year ago, they figured “why not” try it on a real car, says Zhao. Yu generously agreed to let her car, a hybrid SUV, serve as guinea pig.

“We spent just two weeks, and we made the car driving,” says Zhao, laughing as he recalls how cold it was working in the garage in the winter of 2017. “It was a very fun experience.”

Since the success of that first experiment, iSee has gone through multiple variations of programming. The team tests their system with both a simulation engine and manned cars driving in multiple states.

This kind of technology, allowing robots to work fluidly with humans, has potential outside the industry of autonomous cars, but Zhao says iSee is focused on self-driving cars for now.

“We believe the self-driving car is the emerging market. Everyone is working so hard towards it, and the market is ready, the customer is ready,” he says. “What is lacking is this enabling technology, so we want to make this killer application work first. In the future, we can extend it to other applications.”

With the success of the common sense engine, iSee hopes to become widely accepted—without the controversies that have surrounded industry leaders like Waymo, which is reportedly hated by its human neighbors in Arizona due to the cars’ overly-conservative driving.

“I think that’s the open challenge in the field,” says Zhao. “There’s one single piece—that is this core part of the common sense understanding—and I think even Waymo and Uber, those companies, haven’t figured it out yet. We are laser focusing on that and I think that can be the enabling technology to make it really work well in a real-world scenario.”

How soon will that be? “It’s already happening,” says Zhao. “It’s not the future. It’s now.”

About the Author
By Renae Reints
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in

Medical workers wear protecting coverings that are white and yellow.
PoliticsDOGE
‘The risks are growing and the resources are shrinking’: Experts blame DOGE cuts for intensifying the Ebola outbreak, which has killed more than 500
By Sasha RogelbergJuly 6, 2026
3 hours ago
White man glasses gray hair smiling.
PoliticsBernie Sanders
The man who ran Bernie’s campaign says Democrats are still making the same mistakes with Democratic Socialists, and they should laud Mamdani’s win
By Catherina GioinoJuly 6, 2026
3 hours ago
t
CommentaryParenting
Babylist CEO: The Trump Accounts gold rush is overlooking moms
By Natalie GordonJuly 6, 2026
5 hours ago
SoFi vs. Sallie Mae student loans
Personal Financestudent loans and debt
SoFi vs. Sallie Mae student loans
By Joseph HostetlerJuly 6, 2026
6 hours ago
Trump rings opening bell for Trump Accounts as Treasury commits $1.4 billion in seed money
Personal FinanceDonald Trump
Trump rings opening bell for Trump Accounts as Treasury commits $1.4 billion in seed money
By Catherina GioinoJuly 6, 2026
6 hours ago
e
CommentaryCorporate Governance
SpaceX’s supervoting shares put a decades-old governance debate back in play
By Jeffrey Sonnenfeld and Steven TianJuly 6, 2026
7 hours ago

Most Popular

Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
AI
Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
By Marco Quiroz-GutierrezJuly 5, 2026
1 day ago
Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
Success
Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
By Preston ForeJuly 4, 2026
3 days ago
The stock market is about to suffer a 'snapback' and will lose much of this year's gains as 'speculation is hitting extreme levels,' BofA warns
Investing
The stock market is about to suffer a 'snapback' and will lose much of this year's gains as 'speculation is hitting extreme levels,' BofA warns
By Jason MaJuly 5, 2026
1 day ago
Egg companies made $1.22 billion in profit off a $6 carton — now they’re buying their way out of a price-fixing case with 53 million donated eggs
Law
Egg companies made $1.22 billion in profit off a $6 carton — now they’re buying their way out of a price-fixing case with 53 million donated eggs
By Wyatte Grantham-Philips and The Associated PressJuly 2, 2026
4 days ago
Gen Z was 'jaded about employment before we ever entered the workforce'—now psychologists say the stare has hardened into something worse
Economy
Gen Z was 'jaded about employment before we ever entered the workforce'—now psychologists say the stare has hardened into something worse
By Nick LichtenbergJuly 6, 2026
17 hours ago
Meet the Zillennials: The luckiest micro-generation in the workforce, born between 1993 and 1998
AI
Meet the Zillennials: The luckiest micro-generation in the workforce, born between 1993 and 1998
By Nick LichtenbergJuly 3, 2026
4 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.