One Minute Wwise | Controlling Wwise with Sensors
Learn how to control an RTPC in Wwise, based on touching a capacitive sensor connected to an Arduino. No commercials, no lengthy introductions - get "Wwiser" in about a minute.
Let's say that we are making an interactive surface, that plays an ambience in Wwise on Touch. To do so...
1. We'll start by making a capacitive sensor.
2. Hook it up to an Arduino.
3. And then send the value as MIDI to Wwise.
Let's talk briefly about the setup. On this wooden surface we've got some conductive aluminium foil. When I touch it, my body will affect the signal, received in the Arduino. Now what's even better, is that this also works on the other side of the wooden surface. So that you can hide it in the wall. So once you've connected the Capacitive sensor, with a Resistor like this, and receive the sensor values in Arduino, adjust the value so it lies within the range of 0 to 127. Next, since all the code runs on the Arduino, we need to receive the USB signal from it, and convert it into MIDI. For that, we'll include MIDI in the sketch and use Hairless MIDI to pass the signal from the Arduino into this virtual MIDI bus. Back in Wwise, you can now influence an RTPC with that MIDI control change, like controlling the volume of some Ambience. That's it!
Resources:
* Connecting a Control Surface: https://hubs.ly/H0rFx3N0
* Using Control Surfaces: https://hubs.ly/H0rFwbX0
* Modifying an RTPC with MIDI Controllers: https://hubs.ly/H0rFwb-0
* Using a MIDI controller: https://hubs.ly/H0rLJdY0
* Arduino Capacitive Sensor Library: https://playground.arduino.cc/Main/CapacitiveSensor/
* Arduino MIDI Library: https://playground.arduino.cc/Main/MIDILibrary/
* Hairless MIDI: https://projectgus.github.io/hairless-midiserial/
* Virtual MIDI (Windows): https://www.tobias-erichsen.de/software/loopmidi.html
* Virtual MIDI (Mac): https://support.apple.com/guide/audio-midi-setup/transfer-midi-information-between-apps-ams1013/mac
* DIY light theremin with Arduino: https://www.youtube.com/watch?v=pWc8XVmGXkE
Other ideas to use with Wwise? Try combining a Ultrasound sensor with a capacitive sensor to get position on surface along with when pressed.