1. How did the idea for the SND and what was your R+D process like?
Our initial plan was to develop a musical interface that was inviting and intuitive for users of all abilities and age levels. We also wanted to give the user the fine-grained level of control, such as one would find in a modular analog synthesizer. Very early on in our development, we decided that sand would be a great medium for control due to people’s familiarity with it as well as its tactile nature.
The original plan for user control was to track gestures and shapes in the sand as well as measure its topography. Our initial implementations and user testing lead us to the conclusion that directly linking the physical configuration of the sand to the instrument’s various sonic parameters results in an underwhelming experience. In order for users to get a satisfying sense of control, we had to exaggerate the sonic changes to a level we all felt was unmusical. By giving too much control to the user we ended up with a system that was neither inviting nor intuitive.
Our next iteration included tracking the location of colored objects in the sand. This gave the users an easy to understand the one-to-one relationship between their physical actions and the sound in a manner similar to a common X/Y pad. While this approach allowed for more intuitive interactions, it wasn’t an engaging enough experience to capture most of our testers’ interest.
Our current design is an attempt to replace direct control with a more indirect system. Instead of providing a sand-based musical controller, we instead decided to design a generative system and provide the user with a way to control its functionality. We used the same color-tracking and topographical mapping approaches as before but instead created a much more autonomous system. We also added a visual feedback component as well as revamping the style of the various physical components. At this stage we feel that we are providing the user with just the correct amount of control for them to find the experience engaging but not so much that they will get frustrated…
The Sand Noise Device (SND) is both a complex generative music system as well as a novel and intuitive interface for influencing and interacting with this system. The interface consists of a table height box filled with sand, a Microsoft Kinect (which provides an RGB camera and depth sensing capabilities), an overhead projector, and several internally lit tangible objects. The Kinect is used to track object position, object color, and sand topography. The projector is used to provide visual feedback. Sound is provided by a multi-channel loudspeaker system arranged around the box.
The various parameters that determine the functionality of the SND’s generative music system are influenced by the user’s interactions with the sandscape and provided tangible objects. By manipulating the sand and objects the user is able to influence various aspects of the generative music system.
We are angry, frustrated, and in pain because of the violence and murder of Black people by the police because of racism. We are in the fight AGAINST RACISM. George Floyd was murdered, his life stolen. The Adafruit teams have specific actions we’ve done, are doing, and will do together as a company and culture. We are asking the Adafruit community to get involved and share what you are doing. The Adafruit teams will not settle for a hash tag, a Tweet, or an icon change. We will work on real change, and that requires real action and real work together. That is what we will do each day, each month, each year – we will hold ourselves accountable and publish our collective efforts, partnerships, activism, donations, openly and publicly. Our blog and social media platforms will be utilized in actionable ways. Join us and the anti-racist efforts working to end police brutality, reform the criminal justice system, and dismantle the many other forms of systemic racism at work in this country, read more @ adafruit.com/blacklivesmatter
Stop breadboarding and soldering – start making immediately! Adafruit’s Circuit Playground is jam-packed with LEDs, sensors, buttons, alligator clip pads and more. Build projects with Circuit Playground in a few minutes with the drag-and-drop MakeCode programming site, learn computer science using the CS Discoveries class on code.org, jump into CircuitPython to learn Python and hardware together, TinyGO, or even use the Arduino IDE. Circuit Playground Express is the newest and best Circuit Playground board, with support for CircuitPython, MakeCode, and Arduino. It has a powerful processor, 10 NeoPixels, mini speaker, InfraRed receive and transmit, two buttons, a switch, 14 alligator clip pads, and lots of sensors: capacitive touch, IR proximity, temperature, light, motion and sound. A whole wide world of electronics and coding is waiting for you, and it fits in the palm of your hand.