OUR STORY

C-Note is a one-of-a-kind educational application that uses augmented reality (AR) technology to help music students enter the complex world of sound design. Designed with kids in mind, C-Note features a series of physical puzzle pieces that are used in conjunction with the AR app to create an immersive and interactive sound design learning experience.

With C-Note, students can explore the intricate process of sound design by manipulating a variety of virtual sound objects (notes + effects). From selecting the sound waveform to chaining effects like distortion, reverb, and chorus together, C-Note provides an engaging and hands-on approach to learning about sound.

One of the unique features of C-Note is its focus on the physical manipulation of puzzle pieces, which allows kids to learn about sound design in a tactile and intuitive way. As they explore the various puzzle pieces and experiment with different sound combinations, students are encouraged to think critically about the various elements that make up the sounds we hear every day.

Overall, C-Note is an innovative and exciting way to introduce music students and kids to the fascinating world of sound design. By combining AR technology with physical puzzle pieces, this app provides a fun and interactive learning experience that is sure to inspire the next generation of sound designers.

Problem & Solution

Sound design (the process of creating auditory media) occurs all around us, but few people have a baseline understanding of how it works. This can be attributed to the price tag of physical hardware, with entry-level synthesizers costing $100s of dollars. How can we create an immersive sound design learning experience that's accessible to those who can't afford to purchase such equipment?

C-Note is an augmented reality application (AR) aimed at middle-schoolers to learn more about sound design. By using a series of physical puzzle pieces, kids can learn more about what goes into making the sounds around them.

Our solution provides the following benefits:

Cheaper. By using the audio hardware already built within a smartphone. There is no need for expensive manufacturing!
More intuitive. Instead of staring at a wall of complicated knobs, interactive puzzle pieces simplify the learning experience.
Transportable. C-Note can be taken anywhere (as long as you bring the right puzzle pieces with you)!

What is an example puzzle chain?

Every physical puzzle piece modifies the sound in a direct way and chains are processed left-to-right. This can be denoted by the tabs (outward facing part on the piece) always facing to the right. In the example to the left:

A low-pass filter (LFO) is applied to a pure sine wave.
Chorus is applied to the step 1 sound.
Reverb is applied to the step 2 sound.

The phones speaker then renders the final waveform and outputs the audio.

How is audio generated?

C-Note utilizes the FMOD Core API for all digital signal processing (DSP) needs. By utilizing this software, C-Note can create complex audio chains on the fly. Furthermore, FMOD allows DSP code to be translated into native mobile code for fast run-times when deployed.