The Cochlear Implant Musical Experience #MusicMonday
NPR recently published this article, giving readers a basic understanding of the cochlear implant and explaining the next step in cochlear implant improvements. Be sure to check out the full article to learn more and to hear simulations of different sounds through cochlear implants with and without pitch restoring software.
Lots Of Beat, Not Much Tune
A cochlear implant is designed to do one thing really well — allow users to understand speech.
“Where it is somewhat lacking is more in relating information about pitch and timbre,” says Phillips-Silver. Current implants simply leave out much of the information needed to tell the difference between notes that are close together on a keyboard or instruments that sound similar, she says.
To show how this affects listening to music, Phillips-Silver did an experiment that involved people with cochlear implants listening to Suavamente, a merengue song with a strong dance beat. “There is a lot going on,” she says. “A lot of different instrument sounds, there’s a vocal line, there’s a great range of frequencies. It’s fairly intricate music.”
Even so, people with cochlear implants had no trouble moving in time with the music, Phillips-Silver says. They also kept the beat when they heard a version of the song that consisted entirely of drum tones.
But when they heard a version played on a solo piano, participants had no success keeping the beat, Phillips-Silver says, because they couldn’t rely on the bass or drums.
Better Implants For Music
It should be possible to make cochlear implants more music-friendly, says Les Atlas, a professor of electrical engineering at the University of Washington. But there’s a reason current models are so limited, he says.
“There is no easy way to encode pitch as an electrical stimulation pattern,” Atlas says. Also, it takes a lot of computing power to encode something like pitch information in real time.
As a result, even the newest cochlear implants provide very little information about pitch, Atlas says. To make his point, he plays a recording of a few piano notes, followed by a simulation of how those notes might sound through a cochlear implant. The simulated version sounds like the same note being played again and again.
So Atlas and other researchers are working on software that allows an implant to convey more information about pitch and timbre. “It explicitly looks for the tonality in the music and uses it in how things are encoded,” he says.
When he plays a simulation of the piano music as encoded by his software, changes in pitch are much more obvious. The result may not replicate music exactly, Atlas says, but it offers implant users a lot more information about musical sounds.
We are angry, frustrated, and in pain because of the violence and murder of Black people by the police because of racism. We are in the fight AGAINST RACISM. George Floyd was murdered, his life stolen. The Adafruit teams have specific actions we’ve done, are doing, and will do together as a company and culture. We are asking the Adafruit community to get involved and share what you are doing. The Adafruit teams will not settle for a hash tag, a Tweet, or an icon change. We will work on real change, and that requires real action and real work together. That is what we will do each day, each month, each year – we will hold ourselves accountable and publish our collective efforts, partnerships, activism, donations, openly and publicly. Our blog and social media platforms will be utilized in actionable ways. Join us and the anti-racist efforts working to end police brutality, reform the criminal justice system, and dismantle the many other forms of systemic racism at work in this country, read more @ adafruit.com/blacklivesmatter
Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and hardware together, TinyGO, or even use the Arduino IDE. Circuit Playground Express is the newest and best Circuit Playground board, with support for CircuitPython, MakeCode, and Arduino. It has a powerful processor, 10 NeoPixels, mini speaker, InfraRed receive and transmit, two buttons, a switch, 14 alligator clip pads, and lots of sensors: capacitive touch, IR proximity, temperature, light, motion and sound. A whole wide world of electronics and coding is waiting for you, and it fits in the palm of your hand.