Researchers have developed a computer program they say can beat any human on the planet at a particular variant of Texas Hold'em poker.
The scientists aren't planning to clean up with their powerful poker bot. Instead, they hope it can help computers become better decision-makers in the face of uncertainty. The work is published Thursday in the journal Science.
Poker players know the game is a mixture of luck, statistics and psychology. You need to know your odds and know whether your opponent is bluffing. In the words of Kenny Rogers, "You've got to know when to hold 'em, know when to fold 'em."
The variety of strategies one can use to play poker is truly immense, according to Michael Bowling, a computer scientist at the University of Alberta in Canada who invented the new program.
"There are ... 10 trillion different decision points in the game," Bowling says. "So the actual number of ways of playing is an astronomically large number."
But in the case of Heads-up Limit Texas Hold'em (a variant in which there are only two players and the betting is capped) one of these trillions of strategies can beat all the others.
It doesn't matter if the human opponent is a master bluffer, or a blundering amateur, Bowling says — a computer using that single best strategy can eventually win.
It took Bowling years to find that winning approach. His team had to crunch the strategies with supercomputers. The final push for the ultimate strategy was crunched by a computing cluster made of nearly 5,000 CPUs, according to Michael Johanson, a graduate student on the project. It took the cluster more than two months to find the answer, Johanson says. "Almost a thousand years of computation went into this."
But at the end of all that, they had the perfect strategy, the scientists say. Well, almost perfect.
"It's just a tiny bit off," Bowling says. "And that tiny bit is so small that even if you played a lifetime — 12 hours a day, 200 hands an hour for 70 years — you still wouldn't be able to tell it apart from having played a perfect game."
The strategy confirms several long-held beliefs among poker players. For example, the program will always raise the stakes if it has a reasonable hand and is the first to bet.
But the computer program also showed some surprises. It often bets even when it holds a pair of low-ranked cards like fours and threes, according to Bowling. Many professional players would fold, or at least call, with such a weak hand.
Bowling says the program isn't much of a threat to online gamblers. Heads-up Limit Hold'em is not the variety of poker most people play. But he does believe that "poker bots" are trying to win in online game rooms. "My guess is there are probably quite strong poker bots out there," he says. "But you're not going to hear a lot of talk about them."
He hopes the program he's developed can help make computers generally better at making decisions, when faced with uncertainty.
Oren Etzioni, the head of Seattle's Allen Institute for Artificial Intelligence, says the new program is breakthrough. Etzioni notes that computers now have beaten humans at chess, checkers, backgammon and even Jeopardy!
But he says humans still have an edge: Each game-winning computer involves "very, very different computer software," he says. In other words, they're highly specialized tricks for winning at particular games.
"The human," Etzioni says, "is still eons ahead of these computer programs in general intelligence."
Copyright 2021 NPR. To see more, visit https://www.npr.org. 9(MDAxNzg0MDExMDEyMTYyMjc1MDE3NGVmMw004))
