• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'

2

Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal

3

'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down

1

The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'

2

Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal

3

'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down

This Startup Wants to Bring ‘Common Sense’ to Self-Driving Cars

By
Renae Reints
Renae Reints
Down Arrow Button Icon
By
Renae Reints
Renae Reints
Down Arrow Button Icon
November 5, 2018, 1:45 PM ET
Add Fortune on Google for similar content.

A little-known name in the world of autonomous driving is paving the way for a new type of self-driving car—one that can use “common sense,” as the company calls it, to navigate an uncontrolled environment.

While most companies developing self-driving cars are focused on improving sensors, perception, and control, iSee CEO Yibiao Zhao says his company is the first to work on creating a robot that can really understand what’s going on.

Zhao founded iSee just about a year ago along with Chris Baker, his lab partner at the Massachusetts Institute of Technology, and Debbie Yu, who has a history with tech startups. The three are supported by MIT’s venture capital firm, The Engine, in Cambridge, Mass.

“We know that seeing is not equivalent to understanding,” Zhao told Fortune in a phone call last week. “Currently cars can see, but they cannot really understand what’s really going on and what other people are thinking, and what are the other people’s intentions.”

With iSee, the cars’ programming has a special algorithm allowing it to collaborate with humans in an open environment. The system has two components: deep learning and the common sense engine.

Deep learning is something other companies like Waymo and Uber have already established; it’s the notion that if you practice something enough, you’ll be able to do it unconsciously. In humans, it’s the fast, subconscious thinking that allows you to multitask while driving. In self-driving cars, it’s the type of learning that lets a car remain within a lane.

When you get to an obstacle, however, you’ll need reasoning, or conscious thinking. When you merge on the highway, change lanes, or come to an intersection, you need to predict the actions of other cars, negotiate with them, and consider different possibilities in order to make a safe decision.

As a human driver, “we’ll consciously think about those types of possible parallel futures,” says Zhao. “That is enabled by our common sense engine in our mind, and that gives us the ability to handle some new scenario that we never encountered before.”

In a self-driving car, the common sense engine allows it to navigate new situations based on a handful of past experiences and general knowledge.

This component, unique to iSee, helps the car to “truly understand what is going on, and to predict what they might do in the next two seconds,” says Zhao. This lets the robot “make safe and strategic decisions when they need to interact or even negotiate with the other drivers in the environment,” he says.

Once Zhao, Baker, and Yu had this algorithm established and passed through a simulator about a year ago, they figured “why not” try it on a real car, says Zhao. Yu generously agreed to let her car, a hybrid SUV, serve as guinea pig.

“We spent just two weeks, and we made the car driving,” says Zhao, laughing as he recalls how cold it was working in the garage in the winter of 2017. “It was a very fun experience.”

Since the success of that first experiment, iSee has gone through multiple variations of programming. The team tests their system with both a simulation engine and manned cars driving in multiple states.

This kind of technology, allowing robots to work fluidly with humans, has potential outside the industry of autonomous cars, but Zhao says iSee is focused on self-driving cars for now.

“We believe the self-driving car is the emerging market. Everyone is working so hard towards it, and the market is ready, the customer is ready,” he says. “What is lacking is this enabling technology, so we want to make this killer application work first. In the future, we can extend it to other applications.”

With the success of the common sense engine, iSee hopes to become widely accepted—without the controversies that have surrounded industry leaders like Waymo, which is reportedly hated by its human neighbors in Arizona due to the cars’ overly-conservative driving.

“I think that’s the open challenge in the field,” says Zhao. “There’s one single piece—that is this core part of the common sense understanding—and I think even Waymo and Uber, those companies, haven’t figured it out yet. We are laser focusing on that and I think that can be the enabling technology to make it really work well in a real-world scenario.”

How soon will that be? “It’s already happening,” says Zhao. “It’s not the future. It’s now.”

About the Author
By Renae Reints
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

Latest in

Booted from Malaysia, tech guru Balaji Srinivasan finds a new patron for his ‘nomad’ commune: Kazakhstan
AsiaMalaysia
Booted from Malaysia, tech guru Balaji Srinivasan finds a new patron for his ‘nomad’ commune: Kazakhstan
By Nicholas GordonJuly 26, 2026
2 hours ago
France deploys giant military cargo plane to dump tons of flame retardants as European wildfires displace more than 250,000
Environmentwildfires
France deploys giant military cargo plane to dump tons of flame retardants as European wildfires displace more than 250,000
By Mark Carlson, Emma Da Silva, John Leicester and The Associated PressJuly 25, 2026
8 hours ago
Intern arrested in Belgium on suspicion of spying inside NATO military headquarters and ‘being a member of a criminal organization’
CybersecurityNATO
Intern arrested in Belgium on suspicion of spying inside NATO military headquarters and ‘being a member of a criminal organization’
By Sam McNeil and The Associated PressJuly 25, 2026
8 hours ago
Let’s get ready to rumble: The next Fed meeting will be a ‘family feud’ — and that’s exactly what Chairman Kevin Warsh wants
EconomyFederal Reserve
Let’s get ready to rumble: The next Fed meeting will be a ‘family feud’ — and that’s exactly what Chairman Kevin Warsh wants
By Jason MaJuly 25, 2026
8 hours ago
The ‘Trump Trade’ is turning into a loser in the stock market
InvestingStock
The ‘Trump Trade’ is turning into a loser in the stock market
By Geoffrey Morgan, Joel Leon and BloombergJuly 25, 2026
10 hours ago
Samsung wins $200 billion order to supply chips to Broadcom
AIChips
Samsung wins $200 billion order to supply chips to Broadcom
By Hooyeon Kim and BloombergJuly 25, 2026
10 hours ago

Most Popular

The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'
Real Estate
The millennial generation is split in 2: an older crowd with boomer-style comfort, a younger set going 'back to the early 1900s'
By Nick LichtenbergJuly 25, 2026
19 hours ago
Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal
Middle East
Trump pulls back after Iran crosses his red line as U.S. military breaks two-week streak of airstrikes amid talks for potential Hormuz deal
By Jason MaJuly 25, 2026
11 hours ago
'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down
Economy
'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down
By Eleanor PringleJuly 24, 2026
2 days ago
An 11-year-old is cleaning his neighbors' trash cans for $10 each—he now has 100K followers as teens face the worst summer job market since 1948
Success
An 11-year-old is cleaning his neighbors' trash cans for $10 each—he now has 100K followers as teens face the worst summer job market since 1948
By Orianna Rosa RoyleJuly 25, 2026
21 hours ago
Jensen Huang made his $172 billion fortune on AI chips. His family's $75 million gift to Vanderbilt argues art decides what technology is for
Big Tech
Jensen Huang made his $172 billion fortune on AI chips. His family's $75 million gift to Vanderbilt argues art decides what technology is for
By Sydney LakeJuly 23, 2026
3 days ago
A Hims cofounder fired his entire marketing team for AI. Now his 24/7 online vet service is growing 20% a month
Success
A Hims cofounder fired his entire marketing team for AI. Now his 24/7 online vet service is growing 20% a month
By Sydney LakeJuly 25, 2026
17 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.