The Cochlear Implant Musical Experience #MusicMonday


NPR recently published this article, giving readers a basic understanding of the cochlear implant and explaining the next step in cochlear implant improvements. Be sure to check out the full article to learn more and to hear simulations of different sounds through cochlear implants with and without pitch restoring software.

Lots Of Beat, Not Much Tune

A cochlear implant is designed to do one thing really well — allow users to understand speech.

“Where it is somewhat lacking is more in relating information about pitch and timbre,” says Phillips-Silver. Current implants simply leave out much of the information needed to tell the difference between notes that are close together on a keyboard or instruments that sound similar, she says.

To show how this affects listening to music, Phillips-Silver did an experiment that involved people with cochlear implants listening to Suavamente, a merengue song with a strong dance beat. “There is a lot going on,” she says. “A lot of different instrument sounds, there’s a vocal line, there’s a great range of frequencies. It’s fairly intricate music.”

Even so, people with cochlear implants had no trouble moving in time with the music, Phillips-Silver says. They also kept the beat when they heard a version of the song that consisted entirely of drum tones.

But when they heard a version played on a solo piano, participants had no success keeping the beat, Phillips-Silver says, because they couldn’t rely on the bass or drums.

Better Implants For Music

It should be possible to make cochlear implants more music-friendly, says Les Atlas, a professor of electrical engineering at the University of Washington. But there’s a reason current models are so limited, he says.

“There is no easy way to encode pitch as an electrical stimulation pattern,” Atlas says. Also, it takes a lot of computing power to encode something like pitch information in real time.

As a result, even the newest cochlear implants provide very little information about pitch, Atlas says. To make his point, he plays a recording of a few piano notes, followed by a simulation of how those notes might sound through a cochlear implant. The simulated version sounds like the same note being played again and again.

So Atlas and other researchers are working on software that allows an implant to convey more information about pitch and timbre. “It explicitly looks for the tonality in the music and uses it in how things are encoded,” he says.

When he plays a simulation of the piano music as encoded by his software, changes in pitch are much more obvious. The result may not replicate music exactly, Atlas says, but it offers implant users a lot more information about musical sounds.

Read more

Make a robot friend with Adafruit’s CRICKIT – A Creative Robotics & Interactive Construction Kit. It’s an add-on to our popular Circuit Playground Express, FEATHER and other platforms to make and program robots with CircuitPython, MakeCode, and Arduino. Start controlling motors, servos, solenoids. You also get signal pins, capacitive touch sensors, a NeoPixel driver and amplified speaker output. It complements & extends your boards so you can still use all the goodies on the microcontroller, now you have a robotics playground as well.

Join 7,500+ makers on Adafruit’s Discord channels and be part of the community! http://adafru.it/discord

CircuitPython in 2018 – Python on Microcontrollers is here!

Have an amazing project to share? Join the SHOW-AND-TELL every Wednesday night at 7:30pm ET on Google+ Hangouts.

Join us every Wednesday night at 8pm ET for Ask an Engineer!

Follow Adafruit on Instagram for top secret new products, behinds the scenes and more https://www.instagram.com/adafruit/

Maker Business — Fewer startups, and other collateral damage from the 2018 tariffs

Wearables — Light as a Worbla feather

Electronics — How to make your own magnetic field probe!

Biohacking — The State of DNA Analysis in Three Mindmaps

Python for Microcontrollers — One year of CircuitPython weeklies!

Get the only spam-free daily newsletter about wearables, running a "maker business", electronic tips and more! Subscribe at AdafruitDaily.com !

No Comments

No comments yet.

Sorry, the comment form is closed at this time.