• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year

2

Indeed chief economist says we’re entering an era of ‘great mismatch’ thanks to a generational imbalance of workers

3

Apple’s Steve Wozniak says he cofounded the tech giant after 5 rejections from HP—not to ‘make money.’ For years, his paycheck was just $50

1

Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year

2

Indeed chief economist says we’re entering an era of ‘great mismatch’ thanks to a generational imbalance of workers

3

Apple’s Steve Wozniak says he cofounded the tech giant after 5 rejections from HP—not to ‘make money.’ For years, his paycheck was just $50
AI

This Researcher Programmed the Perfect Poker-Playing Computer

By
Lisa Eadicicco
Lisa Eadicicco
and
TIME
TIME
Down Arrow Button Icon
By
Lisa Eadicicco
Lisa Eadicicco
and
TIME
TIME
Down Arrow Button Icon
February 1, 2017, 12:48 PM ET
King of hearts
Hands of card player holding king of heartsGetty Images/iStockphoto

When Tuomas Sandholm began studying poker to research artificial intelligence 12 years ago, he never imagined that a computer would be able to defeat the best human players. “At least not in my lifetime,” he says.

But Sandholm, a computer science professor at Carnegie Mellon University, along with doctorate student Noam Brown, developed AI software capable of doing just that. The program, called Libratus, successfully defeated four professional poker players in a 20-day competition that ended on Jan. 30. After playing 120,000 hands of heads-up, no-limit Texas Hold’em, Libratus was ahead of its human challengers by more than $1.7 million in chips.

“I didn’t expect that we would win by this much,” says Sandholm. “I thought we had a 50-50 chance.”

Games have long served as tools for training artificial intelligence and measuring new breakthroughs. Google’s Deepmind AlphaGo (GOOGL) software made headlines last year after it defeated legendary player Lee Sedol in the ancient and highly complex Chinese game of Go. IBM’s Watson (IBM), which is now being used for everything from diagnosing diseases to aiding in online shopping, is still best known for beating Jeopardy! champs Ken Jennings and Brad Rutter in 2011. And who could forget when IBM’s Deep Blue defeated then-world chess champion Garry Kasparov in 1996?

What makes poker different than a game of chess or Go is the level of uncertainty involved. Unlike those aforementioned games, poker players don’t have access to all of the elements in the game. Whereas chess and Go players can view the entire board, including their opponent’s pieces, there’s no way to tell which cards an adversary might be holding, other than players’ “tells.” Conquering games like poker, known as “imperfect information” situations, opens up new possibilities for computers in the future, says Sandholm.

Get Data Sheet, Fortune’s technology newsletter

Sandholm spoke with TIME about how he developed Libratus and the factors that contributed to its victory. What follows is a transcript of our conversation that has been edited for length and clarity.

You’ve been developing artificial intelligence systems specifically for playing poker over the past 12 years. What were the breakthroughs that enabled Libratus to be so successful this time?

Sandholm: There are really three pieces of the architecture, and each one has really important advancements over the prior corresponding modules. One is the strategy computation ahead of the time, so the algorithms that are game-independent, meaning they’re not about poker. The second module is the endgame solving. During the game, the computer will think about how to refine its strategy.

The third piece is the continual improvement of its own strategy in the background. So, based on what holes the opponent found in our strategy, the AI will automatically see which of those holes have been the biggest and the most frequently exploited. And then overnight on a supercomputer, it will compute patches to those pieces of the strategy, and they’re automatically glued into the main strategy.

AI has become incredibly advanced, but it still can’t communicate as well as humans. Given that, how did you teach Libratus to bluff?

Bluffing is not really programmed in. The algorithm for solving these games just comes up with the strategy, and the strategy includes bluffing. Given the input rules of the game, the algorithm will already output a strategy, and that strategy does involve bluffing. And it also involves understanding the opponent’s bluffing.

How does this differ from the algorithms you’ve used in the past? Your previous AI, Claudico, wasn’t able to win as many chips as human poker professionals when it competed in 2015.

It’s a combination of these three modules we talked about. Each one has new algorithms. Using the new algorithm in any two of them, but with old algorithms in any one of the modules, would not have done the trick. So all of the new algorithms in all three modules were necessary.

Can you go into more detail about how these new algorithms work?

The main benefit [of the first module] is that it can solve the game faster, meaning we can solve larger abstractions. In the second module, we were doing what’s called “nested endgame solving.” Instead of just solving the endgame once, we are solving it every time the opponent makes a move in the endgame. So we can actually take the opponent’s bet sizes into account. And we do what we call safe endgame solving, [which is] taking into account the opponent’s mistakes so far.

And in the last module, unlike learning to exploit opponents as other people’s learning systems have done, including ours in the past, we are actually letting opponents’ actions tell us where our biggest holes are. And then we are automatically algorithmically fixing those holes in our own strategy. So instead of trying to learn to exploit the opponent, we are learning to patch our own strategy to become less exploitable.

We’ve seen AI defeat renowned human players in games like Go, chess, Jeopardy!, and now Texas Hold’em. What’s an example of a game that’s still too complex for a computer to master?

Well, heads up, no-limit Texas Hold’em was really the last frontier of the games on which AI research has been done seriously. And by seriously I mean for many decades. So, Othello, checkers, chess, and heads up Texas Hold’em, those are really games where the best AI had already surpassed the best human. It had remained elusive for years and now we have actually achieved superhuman performance on that game. That said, of course there are a lot of games where AI is not as good as humans because it has not been studied yet.

[fortune-brightcove videoid=4842438119001]

Tell me about how this type of technology can be used outside of board games.

I’ve been working on poker for 12 years and have been doing research in automated negotiation for 27 years. So I don’t view poker as an application; poker has emerged as the benchmark in the AI community for testing these types of algorithms for solving imperfect information games. These algorithms work for any imperfect information game.

And by game, I don’t mean recreational. I mean these games can be very high stakes, like business-to-business negotiations, military strategy planning, cybersecurity, finance, medical treatment planning of certain kinds. These are really for a host of applications, really any situation that can be modeled theoretically as a game. Now that we’ve shown that the best AI’s ability to do strategic reasoning in an imperfect information setting has surpassed that of the best humans, there’s really a strong reason for companies to start using this kind of AI support in their interactions.

This article originally appeared on Time.com.

About the Authors
By Lisa Eadicicco
See full bioRight Arrow Button Icon
By TIME
See full bioRight Arrow Button Icon

Latest in

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in

Russia’s economy is much worse than it seems, and ‘elites are increasingly alarmed’ as alternate GDP gauge shows huge contraction
EconomyRussia
Russia’s economy is much worse than it seems, and ‘elites are increasingly alarmed’ as alternate GDP gauge shows huge contraction
By Jason MaMay 24, 2026
3 minutes ago
Alaska’s oil revival sparks a new energy rush Into the Arctic
EnergyOil
Alaska’s oil revival sparks a new energy rush Into the Arctic
By Jennifer A. Dlouhy and BloombergMay 24, 2026
2 hours ago
Trump says ‘don’t listen to the losers’ after fellow Republicans warn he’s about to make a disastrous mistake with Iran ceasefire deal
PoliticsIran
Trump says ‘don’t listen to the losers’ after fellow Republicans warn he’s about to make a disastrous mistake with Iran ceasefire deal
By Darlene Superville, Matthew Daly and The Associated PressMay 24, 2026
2 hours ago
SpaceX stock is about to join this growing constellation of public companies building a space-based economy
Investingspace
SpaceX stock is about to join this growing constellation of public companies building a space-based economy
By Jason MaMay 24, 2026
3 hours ago
The more generous U.S. ceasefire terms are, the more suspicious Iran becomes they’re a ruse for another attack, expert says
PoliticsIran
The more generous U.S. ceasefire terms are, the more suspicious Iran becomes they’re a ruse for another attack, expert says
By Jason MaMay 24, 2026
5 hours ago
f
Energyfraud
Nonprofit fraud isn’t surging. Enforcement is
By Sarah Webber and The ConversationMay 24, 2026
7 hours ago

Most Popular

Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year
Success
Jeff Bezos wants the bottom half of earners to pay zero income tax—he says nurses making just $75K should save $12K a year
By Preston ForeMay 21, 2026
3 days ago
Indeed chief economist says we’re entering an era of ‘great mismatch’ thanks to a generational imbalance of workers
Success
Indeed chief economist says we’re entering an era of ‘great mismatch’ thanks to a generational imbalance of workers
By Emma BurleighMay 22, 2026
2 days ago
Apple’s Steve Wozniak says he cofounded the tech giant after 5 rejections from HP—not to ‘make money.’ For years, his paycheck was just $50
Success
Apple’s Steve Wozniak says he cofounded the tech giant after 5 rejections from HP—not to ‘make money.’ For years, his paycheck was just $50
By Preston ForeMay 22, 2026
2 days ago
Uber CEO says rideshare 'freed up' his son from having to get a driver’s license—and he's one of many Gen Zers who aren’t willing to drive
Lifestyle
Uber CEO says rideshare 'freed up' his son from having to get a driver’s license—and he's one of many Gen Zers who aren’t willing to drive
By Sasha RogelbergMay 24, 2026
11 hours ago
Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
Workplace Culture
Bolt CEO says he let go of his entire HR team for creating problems that didn’t exist: ‘Those problems disappeared when I let them go’ 
By Preston ForeMay 19, 2026
5 days ago
Inside the 'stealth wealth' playbook: How Silicon Valley's elite buy multimillion-dollar mansions without leaving a paper trail
Real Estate
Inside the 'stealth wealth' playbook: How Silicon Valley's elite buy multimillion-dollar mansions without leaving a paper trail
By Sydney LakeMay 24, 2026
12 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.