• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

3

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

3

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
TechAdvertising

Now Advertisers Can Watch You Watch TV

By
Hilary Brueck
Hilary Brueck
Down Arrow Button Icon
By
Hilary Brueck
Hilary Brueck
Down Arrow Button Icon
February 13, 2016, 2:30 PM ET
87301848
Photograph by Getty Images/Image Source

Last fall, as people around the world stared into their computer screens, the British Broadcasting Corporation was staring right back.

The company was checking out the expressions on people’s faces as they read advertisements online. Using webcams, the company scanned 5,153 study participants’ for happiness, sadness, fear, surprise, puzzlement, and rejection of online ads.

Why bother to get the cameras involved? Marketers want to get a more accurate picture for how advertising really makes people feel. Instead of just asking focus groups how they feel, or what they think, they’re going straight to the subconscious source, and watching faces react in real time.

Of course, our human emotions are more complicated than a few smiles and frowns. Andrew Tenzer, senior research manager at BBC Global News says he knows that. A face of “puzzlement” could mean something is intriguing, or it might just be an indication that a person is deep in thought. But Tenzer also says unlike traditional survey and questionnaire results, “our face never lies.”

Using the six basic emotions to track expressions on people’s faces, the BBC marketing team found a few key ways to make text-based online ads more successful. The new research, published online in January, found, not surprisingly, that people don’t like to be tricked into reading ads that look like a news article, for example. But participant faces registered much less “rejection” when those same ads were clearly labeled.

In the past, the BBC has used its facial recognition technology, built by in-house startup CrowdEmotion, to track 4,500 faces as people watched show trailers to see what kinds of emotions the commercials produced. They’ve also looked at how hundreds of study participants react to programs like Top Gear and Sherlock.

Get Data Sheet, Fortune’s technology newsletter.

“Using CrowdEmotion’s emotional intelligence platform, broadcasters can find out exactly what an audience thought about a programme instead of being fed skewed data by respondents trying to give the right answer,” CrowdEmotion wrote in a release.

Facial recognition software like CrowdEmotion’s has gained traction in recent years, and is often used for identifying people in photos. Facebook uses “DeepFace” to pin point who’s who in images so it can predict who you might want to tag. The State Department uses the tech to catalogue faces of people registering for visas and passports into searchable databases. Scientists will soon use their own version of facial recognition to help save whales by more quickly identifying them when they’re tangled up in fishing gear.

Now a few U.S. companies are starting to experiment with using facial recognition to track reactions of American TV viewers to commercials and TV shows. TVision, a company that measures “eyes-on-screen” is in about 600 households in the Boston area. Last weekend, the startup awarded the “most smiled at” ad of Super Bowl 50 to the Amazon Echo commercial. It’s the one in which Alec Baldwin parties with Dan Marino and Missy Elliott, while ordering his Echo voice assistant, Alexa, to do things around the house like turn on the lights and answer questions about Marino’s failed Super Bowl record.

Tim Cook tears into personal data-based advertising:

TV ratings giant Nielsen is also buying up facial recognition technology. Last year, it acquired Innerscope Research, a “neuromarketing” company that tracks emotions using skin sweat, eye movements, and other biometrics to find out exactly where audiences are looking on screen and how they feel. But so far Nielsen hasn’t used the new approaches in any of its industry-standard TV ratings.

There is a certain creep factor that goes along with monitoring what happens right in your living room. Samsung learned that the hard way last year when it warned users of its Smart TVs to watch what they say in conversation around their sets. That could be part of the reason why there are no prizes for the “most feared” or “happiest” show on television. At least not yet.

About the Author
By Hilary Brueck
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Current price of Ethereum for June 10, 2026
Personal FinanceEthereum
Current price of Ethereum for June 10, 2026
By Joseph HostetlerJune 10, 2026
22 minutes ago
goldman
Investingprivate equity
‘The circulatory system isn’t working.’ Goldman on what’s really wrong with private markets
By Nick LichtenbergJune 10, 2026
2 hours ago
Exclusive: Mastercard launches protocol to let AI agents pay each other, send micropayments
BankingMastercard
Exclusive: Mastercard launches protocol to let AI agents pay each other, send micropayments
By Ben WeissJune 10, 2026
2 hours ago
Geoffrey von Maltzahn and Kimberly Powell on stage at Fortune Brainstorm Tech
AITerm Sheet
AI drug discovery leaders warn U.S. health funding cuts risk falling behind global rivals
By Lily Mae LazarusJune 10, 2026
3 hours ago
Kevin O'Leary wears a silver and black suit with a chain of basketball cards around his neck.
AIData centers
From the Trump administration to Kevin O’Leary, there’s a new narrative that China is to blame for plummeting data center popularity
By Sasha RogelbergJune 10, 2026
5 hours ago
JB Straubel, co-founder of Tesla and founder and CEO of Redwood Materials, speaking at Fortune Brainstorm Tech 2026 in Aspen, Colorado. (Photo: Michael Faas/Fortune)
NewslettersFortune Tech
Why China is outpacing the U.S. power grid
By Andrew NuscaJune 10, 2026
5 hours ago

Most Popular

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
Asia
Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
By Kate O'Keeffe and BloombergJune 8, 2026
2 days ago
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
Economy
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
By Nick LichtenbergJune 9, 2026
21 hours ago
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
Success
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
By Preston ForeJune 8, 2026
2 days ago
Current price of oil as of June 9, 2026
Personal Finance
Current price of oil as of June 9, 2026
By Joseph HostetlerJune 9, 2026
1 day ago
Current price of silver as of Tuesday, June 9, 2026
Personal Finance
Current price of silver as of Tuesday, June 9, 2026
By Joseph HostetlerJune 9, 2026
1 day ago
Trump, who has repeatedly called climate change fake, is now threatening Brazil with tariffs over the deforestation of the Amazon
Environment
Trump, who has repeatedly called climate change fake, is now threatening Brazil with tariffs over the deforestation of the Amazon
By Sasha RogelbergJune 8, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.