0

Nintendo audio played by player piano and robotic percussion

This system allows for Nintendo gameplay audio to be played through an acoustic player piano and robotically controlled percussive instruments. The piano and percussion play live during actual gameplay, mirroring the sounds that would normally be created electronically. All audio, including music and sound effects, is translated in realtime so that it is produced by the instrument most closely resembling the characteristics of the original electronic sound.


Make a robot friend with Adafruit’s CRICKIT – A Creative Robotics & Interactive Construction Kit. It’s an add-on to our popular Circuit Playground Express, FEATHER and other platforms to make and program robots with CircuitPython, MakeCode, and Arduino. Start controlling motors, servos, solenoids. You also get signal pins, capacitive touch sensors, a NeoPixel driver and amplified speaker output. It complements & extends your boards so you can still use all the goodies on the microcontroller, now you have a robotics playground as well.

Join 7,500+ makers on Adafruit’s Discord channels and be part of the community! http://adafru.it/discord

CircuitPython in 2018 – Python on Microcontrollers is here!

Have an amazing project to share? Join the SHOW-AND-TELL every Wednesday night at 7:30pm ET on Google+ Hangouts.

Join us every Wednesday night at 8pm ET for Ask an Engineer!

Follow Adafruit on Instagram for top secret new products, behinds the scenes and more https://www.instagram.com/adafruit/


Maker Business — Fewer startups, and other collateral damage from the 2018 tariffs

Wearables — Light as a Worbla feather

Electronics — How to make your own magnetic field probe!

Biohacking — The State of DNA Analysis in Three Mindmaps

Python for Microcontrollers — One year of CircuitPython weeklies!

Get the only spam-free daily newsletter about wearables, running a "maker business", electronic tips and more! Subscribe at AdafruitDaily.com !



4 Comments

  1. Does anyone know how the musical data is extracted? I have some automatic instruments and I’m dying to try this out myself.

  2. The UnDisbeliever

    @kx
    They would have used a custom NES emulator with a modified Audio Processing Unit.

    The emulated APU convert every APU register write into MIDI output. After reading the video description I’m guessing it stores the APU state in a buffer in order to simplify the MIDI output and handle the return rate of the real instruments.

    There aren’t many NES emulators that can handle MIDI output.

    The only one I know of is BasicNES and uses MIDI ouput so the author didn’t need to create an audio engine. Annoyingly it is written in Visual Basic and doesn’t supports external devices in Win7/8. See http://code.google.com/p/basicnes/, and its fork http://sourceforge.net/projects/yoshines/

    Sample: http://youtu.be/T1wlaj7RyKI

    Let us know if you manage to do anything with it.

  3. The UnDisbeliever

    My mistake, I meant https://www.youtube.com/watch?v=k1AFvtN0Teg (as a sample of BasicNES’s MIDI output)

  4. Thanks a lot for all that info The UnDisbeliever!

    Because of that I was able to get it going with yoshiNES on Windows XP and am now playing Super Mario Brothers with an accompaniment of automatic instruments.

Sorry, the comment form is closed at this time.