• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics

3

The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises

1

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 

2

Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics

3

The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
Tech

Here’s Why Facebook’s Repeated Measurement Mistakes Matter

By
Mathew Ingram
Mathew Ingram
Down Arrow Button Icon
By
Mathew Ingram
Mathew Ingram
Down Arrow Button Icon
December 9, 2016, 2:52 PM ET
INDIA-INTERNET-FACEBOOK
The 'Facebook' logo is reflected in a young Indian woman's sunglasses as she browses on a tablet in Bangalore on May 15, 2012. World's popular and leading social networking company Facebook Inc., founded in a Harvard dorm room by Mark Zuckerberg whose current value exceeds 100 billion USD, will be making an initial public offering (IPO) which is slated to be Silicon Valley's biggest-ever. AFP PHOTO/Manjunath KIRAN Photograph by Manjunath Kiran—AFP/Getty Images

In what has become a depressingly routine announcement from Facebook—at least for advertisers and media companies who rely on the social network—the company said Friday it has uncovered more errors in the way it measures engagement with live videos and also links to external sites.

This is the third such admission since September. While some may be encouraged by the transparency around how it measures engagement, other publishers are likely to wonder if they are actually getting the kind of value out of their investments that the social network promised them.

In the latest announcement, Facebook (FB) said that it had identified an anomaly in how it measures the total amount of likes, shares, and comments an external link gets—a mistake that came to light when the site Marketing Land looked into a BuzzFeed report about fake news stories getting more engagement on Facebook than legitimate news stories.

It appears that in some cases, the total number of shares and comments reported by doing a search on Facebook can be larger than the number of shares, comments, and likes reported by the site’s Graph API feature, which shouldn’t be the case. The latter number should always be larger.

What that means is that many publishers may have been misled into thinking their links were getting a lot more engagement than they actually did, depending on how they measured it.

Get Data Sheet, Fortune’s technology newsletter.

In addition to that error, which Facebook says it is investigating, the site admitted that publishers and brands were getting inaccurate counts of how many people reacted to their live video streams. If a user reacted more than once, their subsequent reactions were identified as reactions to shared versions of the video rather than the live stream.

These mistakes may seem minor, but taken together they suggest that many of the tools brands and media companies have been using to judge their performance on Facebook have been faulty. And that’s significant because so many companies are relying on the social network for reach and revenue.

Facebook has also been trying to persuade more publishers to invest in Facebook Live video streaming and in its Instant Articles mobile-friendly page feature. But the flaws in its metrics may have some questioning whether doing so is worth it or not.

The first error the site admitted to was a fairly major one: The company said in September that it had been misstating the amount of time users watched videos for more than two years, a key metric that many advertisers and media brands rely on to prove their videos have value.

As a result of what the company’s head of advertising called a mathematical error, Facebook had been taking the total amount of time spent watching videos and dividing by the number of views, rather than dividing by the number of users who watched them.

What that produced was an inflated number for the “average duration of video viewed” metric that publishers and page owners were getting. Facebook’s vice president of advertising David Fischer promised at the time that the mistake would not have an impact on how Facebook partners were billed for their content or how their videos were promoted and distributed by the network.

Facebook’s fake news problem is worse than it looks:

Nevertheless, the Association of National Advertisers slammed the company for having “not yet achieved the level of measurement transparency that marketers need and require,” and pointed out that it expected better of a site that handles more than $6 billion in advertising a year.

The second announcement came last month when Facebook said that it had misstated a number of metrics, including the “organic reach” measurement that showed how many people were seeing a user or brand’s page. A bug caused weekly and monthly totals to be over-stated by as much as 55%, the company said.

The site also admitted that it was measuring the number of videos that played to completion inaccurately. And it said it had been overstating the amount of time people were spending with Instant Articles, the mobile-friendly posts that it has been trying to convince media companies to use instead of generating their own mobile pages.

At the same time, Facebook said it was creating a Measurement Council, which would be staffed in part by executives from large advertising firms and analytics companies. And it said it was expanding its integration with third-party video measurement firms such as Moat.

Whether all of these steps are enough to satisfy everyone who has doubts about the social network’s ability to measure its performance remains to be seen. But it’s likely that Facebook’s sheer size and dominance in the ad market will keep many brands and publishers coming back regardless.

About the Author
By Mathew Ingram
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Samuel Corum/Getty Images
Big TechSpaceX
Elon Musk’s proposed pay package in SpaceX’s IPO filing reveals what the company actually is: a $1 trillion monster built to colonize Mars
By Eva RoytburgMay 20, 2026
57 minutes ago
elon
SuccessIPOs
SpaceX IPO targets $28.5 trillion total addressable market, mission to ‘make life multiplanetary’ and understand ‘true nature of the universe’
By Nick LichtenbergMay 20, 2026
3 hours ago
Jensen Huang, chief executive officer of Nvidia
AINvidia
Nvidia tells skeptical investors that AI is ready to go mainstream
By Ian King and BloombergMay 20, 2026
3 hours ago
SpaceX finally files IPO prospectus, reveals revenue is up–but losses are too
Big TechSpaceX
SpaceX finally files IPO prospectus, reveals revenue is up–but losses are too
By Allie Garfinkle and Alexei OreskovicMay 20, 2026
4 hours ago
Elon Musk sits with his fists together, looking up.
Commentaryspace
SpaceX will be worth trillions, but the space station that made it possible is worth even more — if we don’t squander it
By Tejpaul BhatiaMay 20, 2026
4 hours ago
Antler CEO Magnus Grimeland says Silicon Valley doesn’t have a monopoly on tech: ‘People can innovate from almost anywhere’
AsiaAsia Agenda
Antler CEO Magnus Grimeland says Silicon Valley doesn’t have a monopoly on tech: ‘People can innovate from almost anywhere’
By Angelica AngMay 20, 2026
4 hours ago

Most Popular

Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
Workplace Culture
Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
By Preston ForeMay 19, 2026
1 day ago
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
Future of Work
Meet a 21-year-old community college student who's going to China as the first American woman welder in the trades Olympics
By Mike Householder and The Associated PressMay 17, 2026
3 days ago
The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
Politics
The Bezos family just donated $100 million to help achieve one of Mayor Zohran Mamdani’s top campaign promises
By Jake AngeloMay 12, 2026
8 days ago
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
Success
Despite a $500 million net worth, Shaq just finished his fourth degree. He warns graduates: 'Your character will take you further than your resume'
By Preston ForeMay 20, 2026
10 hours ago
Spirit Airlines apologizes to all the Americans who can't afford any summer vacation flights as it shuts down
Travel & Leisure
Spirit Airlines apologizes to all the Americans who can't afford any summer vacation flights as it shuts down
By Rio Yamat and The Associated PressMay 18, 2026
2 days ago
Current price of oil as of May 19, 2026
Personal Finance
Current price of oil as of May 19, 2026
By Joseph HostetlerMay 19, 2026
1 day ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.