The Cochlear Implant Musical Experience #MusicMonday

NewImage

NPR recently published this article, giving readers a basic understanding of the cochlear implant and explaining the next step in cochlear implant improvements. Be sure to check out the full article to learn more and to hear simulations of different sounds through cochlear implants with and without pitch restoring software.

Lots Of Beat, Not Much Tune

A cochlear implant is designed to do one thing really well — allow users to understand speech.

“Where it is somewhat lacking is more in relating information about pitch and timbre,” says Phillips-Silver. Current implants simply leave out much of the information needed to tell the difference between notes that are close together on a keyboard or instruments that sound similar, she says.

To show how this affects listening to music, Phillips-Silver did an experiment that involved people with cochlear implants listening to Suavamente, a merengue song with a strong dance beat. “There is a lot going on,” she says. “A lot of different instrument sounds, there’s a vocal line, there’s a great range of frequencies. It’s fairly intricate music.”

Even so, people with cochlear implants had no trouble moving in time with the music, Phillips-Silver says. They also kept the beat when they heard a version of the song that consisted entirely of drum tones.

But when they heard a version played on a solo piano, participants had no success keeping the beat, Phillips-Silver says, because they couldn’t rely on the bass or drums.

Better Implants For Music

It should be possible to make cochlear implants more music-friendly, says Les Atlas, a professor of electrical engineering at the University of Washington. But there’s a reason current models are so limited, he says.

“There is no easy way to encode pitch as an electrical stimulation pattern,” Atlas says. Also, it takes a lot of computing power to encode something like pitch information in real time.

As a result, even the newest cochlear implants provide very little information about pitch, Atlas says. To make his point, he plays a recording of a few piano notes, followed by a simulation of how those notes might sound through a cochlear implant. The simulated version sounds like the same note being played again and again.

So Atlas and other researchers are working on software that allows an implant to convey more information about pitch and timbre. “It explicitly looks for the tonality in the music and uses it in how things are encoded,” he says.

When he plays a simulation of the piano music as encoded by his software, changes in pitch are much more obvious. The result may not replicate music exactly, Atlas says, but it offers implant users a lot more information about musical sounds.

Read more


Adafruit publishes a wide range of writing and video content, including interviews and reporting on the maker market and the wider technology world. Our standards page is intended as a guide to best practices that Adafruit uses, as well as an outline of the ethical standards Adafruit aspires to. While Adafruit is not an independent journalistic institution, Adafruit strives to be a fair, informative, and positive voice within the community – check it out here: adafruit.com/editorialstandards

Join Adafruit on Mastodon

Adafruit is on Mastodon, join in! adafruit.com/mastodon

Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and hardware together, TinyGO, or even use the Arduino IDE. Circuit Playground Express is the newest and best Circuit Playground board, with support for CircuitPython, MakeCode, and Arduino. It has a powerful processor, 10 NeoPixels, mini speaker, InfraRed receive and transmit, two buttons, a switch, 14 alligator clip pads, and lots of sensors: capacitive touch, IR proximity, temperature, light, motion and sound. A whole wide world of electronics and coding is waiting for you, and it fits in the palm of your hand.

Have an amazing project to share? The Electronics Show and Tell is every Wednesday at 7pm ET! To join, head over to YouTube and check out the show’s live chat – we’ll post the link there.

Join us every Wednesday night at 8pm ET for Ask an Engineer!

Join over 36,000+ makers on Adafruit’s Discord channels and be part of the community! http://adafru.it/discord

CircuitPython – The easiest way to program microcontrollers – CircuitPython.org


Maker Business — “Packaging” chips in the US

Wearables — Enclosures help fight body humidity in costumes

Electronics — Transformers: More than meets the eye!

Python for Microcontrollers — Python on Microcontrollers Newsletter: Silicon Labs introduces CircuitPython support, and more! #CircuitPython #Python #micropython @ThePSF @Raspberry_Pi

Adafruit IoT Monthly — Guardian Robot, Weather-wise Umbrella Stand, and more!

Microsoft MakeCode — MakeCode Thank You!

EYE on NPI — Maxim’s Himalaya uSLIC Step-Down Power Module #EyeOnNPI @maximintegrated @digikey

New Products – Adafruit Industries – Makers, hackers, artists, designers and engineers! — #NewProds 7/19/23 Feat. Adafruit Matrix Portal S3 CircuitPython Powered Internet Display!

Get the only spam-free daily newsletter about wearables, running a "maker business", electronic tips and more! Subscribe at AdafruitDaily.com !



No Comments

No comments yet.

Sorry, the comment form is closed at this time.