255 Views

Two new poker programs beat the pro’s

20 years on from the momentous event in Artificial Intelligence when a computer program, “Deep Blue”, beat chess grandmaster Garry Kasparov over an extended number of games, two new poker computer programs have beaten a selection of human players with statistical significance. This follows impresive advances in AI over the last two decades on other table games such as checkers, and in late December 2016, Go by  Google Deep Mind project AI, AlphaGo.

Previous generations, including the Chess Grand Master beating “DeepBlue”, have typically been able to beat humans by selecting the best move from millions of possible chains of moves and predicting future moves based on millions of probabilities. This extraordinary number of statistics is too large for humans to think about “manually”but is required to beat the human “intuition” we use naturally when deciding which moves to make in table games.

Libratus, one of the two new poker programs, largely follows in this direction, requiring a super computer to run and store the immense amount of data needed to beat humans with this approach. Innovating on DeepBlues strategies, Libratus adaptively changes itself during the course of each game based on moves and possible mistakes made by it’s human opponents. Libratus switches modes as the game possibilities become less open resulting in more accuracy and making the best use of the processing power it has available.

This extraordinary number of statistics …is required to beat the human “intuition” we use naturally when deciding which moves to make in table games.

The other program, DeepStack AI, takes a more interesting approach, similar to the “deep learning” approach of Googles AI, AlphaGo. For humans, deep learning would be equivalent to looking at an image and picking out that it is blue, has some white objects, and a section of green at the bottom from a picture of the sky and a grassy horizon

DeepStack identifies and connects these “features” to each other by looking through moves identified with good or bad outcomes. From these, often hundreds of features, DeepStack can adjust a network created from this input towards an output of “moves to make”.  Each time DeepStack gets it wrong, it adapts that network and how it detects features until it is finding features so optimally that it’s predictions can outwit humans.

One advantage of Deepstack over Libratus is that it can run on a laptop as it does not store reams and reams of potential configurations and probabilities. Rather DeepStack merely stores a configuration for “Deep Learning” features and a configuration for a “Neural Network” which lists potential moves and makes a final choice based on that.

These two successful cases are also noteworthy because poker involves a vast amount of “hidden data”, especially when betting amounts are unlimited. Known as an “imperfect-information” area of games, this represents better our world than perfect games (such as chess).

Perhaps one day we won’t be analysed by a doctor that asks for our diet, but an Artifical Intelligence that derives from when we tell them about our diet, how much we are lying, how that correlates with our weight and how many previous similar cases to ourselves have been confirmed as diabetic patients. It seems AI is rapidly gaining the upper hand on us humans.

IMAGE: Wikimedia Commons

Get the best viral stories straight into your inbox!

Don't worry, we don't spam

Leave a Reply

Join the Badger Team

Apply today!

Latest Posts

Union obliterates the debate – unwritten requirement used to shut down free speech debate
Campus News
535 views1
Campus News
535 views1

Union obliterates the debate – unwritten requirement used to shut down free speech debate

Jordan Wright - April 27, 2018

Student society Liberate the Debate’s most recent event was cancelled over a lack of compliance with the Students' Union's (USSU) requirement for a neutral chair - a…

Verve Couture – Musicality, kitsch & ignition: the beginning of a series
Arts
73 views
Arts
73 views

Verve Couture – Musicality, kitsch & ignition: the beginning of a series

Ricardo Reverón Blanco - June 17, 2018

Pictured: Zac Black At Proud Cabaret audiences were spellbound as if at night at the circus, yet this was not like Angela Carter’s magical realist novel; Verve…

Fleabag on stage at The Old Market – review
Arts
107 views
Arts
107 views

Fleabag on stage at The Old Market – review

Florence Dutton - June 11, 2018

[caption id="attachment_35513" align="alignnone" width="2400"] Fleabag at Soho Theatre[/caption] Last Monday at 8pm at Brighton’s The Old Market, I sat myself down in my theatre seat eagerly awaiting…

Fleabag preview
Arts
107 views
Arts
107 views

Fleabag preview

Florence Dutton - June 2, 2018

[caption id="attachment_35513" align="alignnone" width="2400"] Fleabag at Soho Theatre[/caption] Following the mass success of the Bafta award-winning BBC Series, DryWrite and Soho Theatre are about to hit the…

Brighton Festival: Ezra Furman at the Dome
Arts
131 views
Arts
131 views

Brighton Festival: Ezra Furman at the Dome

Georgia Grace - June 1, 2018

Having completed my final semester of university with modules on punk history and queer arts, it was fitting that I rounded off my end-of-assessment celebrations by attending…

Arts
147 views

The Tempest review

Georgia Grace - May 30, 2018

As the sun begins to set over Hove Green, tinnies of Red Stripe are cracked open, tartan blankets are strewn, and families tuck into their picnic hampers.…

A Glass Half Empty review
Arts
158 views
Arts
158 views

A Glass Half Empty review

Georgia Grace - May 27, 2018

For those of us coming to the end of another year of university study, the prospect of careers, marriages and babies may seem a long way off.…

DollyWould at The Old Market review
Arts
149 views
Arts
149 views

DollyWould at The Old Market review

Alex Hutson - May 27, 2018

Sh!t Theatre’s DollyWould is a hilarious, thoughtful and experimental performance piece. The award winning show has the Sh!t Theatre duo integrating comedy, storytelling, personal experience and music.…

UCU Launch Petition to End the ‘Hostile Environment’ at Sussex
Campus News
244 views
Campus News
244 views

UCU Launch Petition to End the ‘Hostile Environment’ at Sussex

Billie-Jean Johnson - May 26, 2018

The Sussex branch of the University and College Union (UCU) has launched a petition calling for Vice-Chancellor Adam Tickell to end the 'hostile environment' at Sussex. The…

Arts
116 views

Shakespeare in the sun – The Tempest preview

Georgia Grace - May 24, 2018

In a world of dystopian King Lears and female Hamlets, Shakespeare’s classics are constantly being reimagined for the modern day. There’s something oddly refreshing then about the…

Review: Nick Cave Double Bill at The Old Market (TOM’s Film Club)
Arts
229 views
Arts
229 views

Review: Nick Cave Double Bill at The Old Market (TOM’s Film Club)

Sophie Coppenhall - May 23, 2018

What a phenomenal contrast these two films present when watched side-by-side. In essence, together they are capable of tracing inner and outer metamorphoses of their subjects. The…

Dollywould at The Old Market preview
Arts
149 views
Arts
149 views

Dollywould at The Old Market preview

Alex Hutson - May 22, 2018

From the 22nd May - 25th May 2018 DollyWould will be showing at The Old Market. An exciting new show, presented by Sh!t Theatre, who won the…

Exhibition: Io-sono Fedilouu
Artist Focus
221 views
Artist Focus
221 views

Exhibition: Io-sono Fedilouu

Ricardo Reverón Blanco - May 16, 2018

Last week artist Fedilou made her debut exhibition in the downstairs space of Morelli Zorelli, a quaint vegan Italian restaurant in Hove, featuring a collection of intimate…

Interview with Philosophy faculty and COGS director Ron Chrisley
Interview
156 views
Interview
156 views

Interview with Philosophy faculty and COGS director Ron Chrisley

Nikolaos Manesis - May 15, 2018

Ron Chrisley is a Reader in Philosophy, on the faculty of the Sackler Centre for Consciousness Science, and is the director of COGS (Centre for Cognitive Science).…

Adam review
Arts
222 views
Arts
222 views

Adam review

Ketan Jha - May 13, 2018

If you have been a stranger to the stage this spring and decide to see one contemporary show, let it be Adam. This reviewer went in entirely…

Brighton Fringe Preview: Nick Cave Double Bill at The Old Market (TOM’s Film Club)
Arts
249 views
Arts
249 views

Brighton Fringe Preview: Nick Cave Double Bill at The Old Market (TOM’s Film Club)

Sophie Coppenhall - May 13, 2018

In celebration of iconic Brighton local, legendary alt-rock musician (and episodic actor) Nick Cave, TOM’s Film Club are hosting a double-bill screening of his films at The…

Whimsical fairy-tale meets class war – Standard: Elite review
Arts
287 views
Arts
287 views

Whimsical fairy-tale meets class war – Standard: Elite review

Georgia Grace - May 11, 2018

Meta-theatricality and interactivity are becoming all the more vogue in contemporary theatre, and in a world where the arts are becoming increasingly open and democratised, I find…

A Year of Art Society: The Best Picks
Artist Focus
199 views
Artist Focus
199 views

A Year of Art Society: The Best Picks

Alex Leissle - May 9, 2018

  [gallery type="slideshow" ids="35385,35386,35387,35388,35389,35390,35391,35392,35393,35394,35395,35396,35397,35398,35399,35400,35401,35402,35403,35404,35405,35406,35407,35408,35409,35410,35411"]

More Brit(ish) than ever: A review of Afua Hirsch at Brighton Festival
Books
213 views
Books
213 views

More Brit(ish) than ever: A review of Afua Hirsch at Brighton Festival

William Singh - May 9, 2018

Afua Hirsch’s 2018 book - part memoir, part polemic - provokes mixed feelings. So too did her discussion of the topic at this year’s Brighton Festival. Don’t…

Ethnic-bioweapons: between conspiracy and reality
Science
266 views
Science
266 views

Ethnic-bioweapons: between conspiracy and reality

Luke Richards - May 8, 2018

Bioweapons exist, while ethnic-bioweapons are whispered conspiracies. Pandemics can fairly hazardous to human life, the 1918 Flu Pandemic killed 20-50 million people. A man made pandemic could…

Breaking: Spring referenda results announced
News
273 views
News
273 views

Breaking: Spring referenda results announced

Jessica Hubbard - May 4, 2018

Students have voted to support the BDS (Boycott, Divestment and Sanctions) movement, reject Prevent and adopt new Gender Equality policies. Results for the Students' Union referenda were…