Did A Chatbot Really Pass The Turing Test? #SaturdayMorningCartoons


A Chatbot won a Turning Test contest after 10 out of 30 people thought it was human. By Maki Naro. via Popsci.com

By now you’ve all been swept up in the cult of personality of Eugene Goostman, the chatbot that made news when it convinced 10 out 30 judges at the University of Reading’s 2014 Turing Test that it was human, thus winning the contest. With the announcement, every news source with two hundred words to spare was quick to crown Eugene Goostman as king of bots. But we should know better by now.

In 1950, British mathematician and cryptanalyst Alan Turing introduced the idea of a test to see if a machine could be indistinguishable from a human. Promptly dubbed the Turing Test, a passing grade is the holy grail of artificial intelligence. Think of the Voight-Kampff test in Blade Runner. Except at the end, you don’t shoot a replicant. Yet. In its current incarnation, the human judge sits down at a computer and begins texting with an unseen partner. Being unable to see who they are talking to, the judge must rely on conversation cues to decide whether their partner is human or machine. Turing famously predicted that by the year 2000, a computer program would be able to convince 30% of people that it was human. The event organizers used this prediction—taken somewhat out of context, as Turing never set any specific guidelines for what a Turing Test should be—to set the win conditions of the Turing Test.

I did get a chance to talk to Goostman, before the droves of people wanting to do the same crashed the servers. Despite Oz’s harsh critique (he tends to go a bit overboard), I have to truthfully report that he’s good. Far from perfect, but not bad. Goostman makes all the mistakes the chatbots before him have made: he dodges questions, he changes the subject, he makes vague answers, he repeats things back to you in ways that no normal human does in a cute attempt to show that he’s listening, and of course he says really stupid stuff that doesn’t make any sense. Goostman’s creators explain his quirks away by giving him a fictional back story. See, Eugene is a 13-year-old Ukranian kid. He has favorite foods and a pet guinea pig, and he feels okay derailing important interrogations to tell you these things. I would have shot him as a replicant ages ago.

I don’t buy any of this, by the way. One, it’s insulting to 13-year-olds, plenty of whom can hold a conversation without resorting to non sequitur. It’s also insulting to people who speak English as a second language, for the same reasons. Goostman’s background is a crutch, but it’s not the first time a bit of social engineering was used to make up for a bot’s inadequacies. The notorious MGONZ program had some poor fellow going for 90 minutes. Its trick? MGONZ was combative, vulgar, and insulting. Any alarms going off in your head when testing MGONZ would be attributed to the mannerisms of an asshole, rather than a computer. Bypassing your brain’s psychopath detector is a neat trick, and much more entertaining than the foreign teenager shtick.

Eugene Goostman did not pass the Turing Test. He won the University of Reading contest. He met Turing’s benchmark within 14 years of the predicted date. But he’s not a perfect AI at all, and we have a long way to go, and a lot to learn in the process. I don’t actually think the judges were morons. But I hope they felt silly afterwards.

Read more

Each Saturday Morning here at Adafruit is Saturday Morning Cartoons! Be sure to check our cartoon and animated posts both nostalgic and new that inspire makers of all ages! You’ll find how-tos for young makers, approaches to learning about science and engineering, and all sorts of comic strip and animated Saturday Morning fun! Be sure to check out our Adafruit products featuring comic book art while you’re at it!

Adafruit publishes a wide range of writing and video content, including interviews and reporting on the maker market and the wider technology world. Our standards page is intended as a guide to best practices that Adafruit uses, as well as an outline of the ethical standards Adafruit aspires to. While Adafruit is not an independent journalistic institution, Adafruit strives to be a fair, informative, and positive voice within the community – check it out here: adafruit.com/editorialstandards

Join Adafruit on Mastodon

Adafruit is on Mastodon, join in! adafruit.com/mastodon

Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and hardware together, TinyGO, or even use the Arduino IDE. Circuit Playground Express is the newest and best Circuit Playground board, with support for CircuitPython, MakeCode, and Arduino. It has a powerful processor, 10 NeoPixels, mini speaker, InfraRed receive and transmit, two buttons, a switch, 14 alligator clip pads, and lots of sensors: capacitive touch, IR proximity, temperature, light, motion and sound. A whole wide world of electronics and coding is waiting for you, and it fits in the palm of your hand.

Have an amazing project to share? The Electronics Show and Tell is every Wednesday at 7pm ET! To join, head over to YouTube and check out the show’s live chat – we’ll post the link there.

Join us every Wednesday night at 8pm ET for Ask an Engineer!

Join over 36,000+ makers on Adafruit’s Discord channels and be part of the community! http://adafru.it/discord

CircuitPython – The easiest way to program microcontrollers – CircuitPython.org

Maker Business — “Packaging” chips in the US

Wearables — Enclosures help fight body humidity in costumes

Electronics — Transformers: More than meets the eye!

Python for Microcontrollers — Python on Microcontrollers Newsletter: Silicon Labs introduces CircuitPython support, and more! #CircuitPython #Python #micropython @ThePSF @Raspberry_Pi

Adafruit IoT Monthly — Guardian Robot, Weather-wise Umbrella Stand, and more!

Microsoft MakeCode — MakeCode Thank You!

EYE on NPI — Maxim’s Himalaya uSLIC Step-Down Power Module #EyeOnNPI @maximintegrated @digikey

New Products – Adafruit Industries – Makers, hackers, artists, designers and engineers! — #NewProds 7/19/23 Feat. Adafruit Matrix Portal S3 CircuitPython Powered Internet Display!

Get the only spam-free daily newsletter about wearables, running a "maker business", electronic tips and more! Subscribe at AdafruitDaily.com !

No Comments

No comments yet.

Sorry, the comment form is closed at this time.