Earthworms Trigger Audio Using Wwise : 'We - The Common Body'

상호작용 오디오 / 위치 기반 엔터테인먼트 (LBE) / 사운드 디자인 / VR 체험

Inspired by space, human's relationship with nature, and nature's relationship with technology, the interactive installation 'We - The Common Body' triggers a VR experience from combining the worlds of nature and technology.

The Installation 

The work consists of three pieces.

Interactive installation using Wwise

Installation overview video 

Part A : 'This view has potential'

Object A resembles a defensive structure, which can symbolize the relationship between humans and nature. It is a ball-incubator populated by thousands of earthworms.  The biohumus produced by them travels to the sensor grid, then, the signals are sent to computers and controllers, which also read the temperature in the incubator, all in the real-time.

Interactive installation using Wwise

Interactive installation using Wwise

Part B : 'Vanitasity'

Object B was inspired by the construction of the James Webb space telescope, which emphasizes the exploratory nature of the work. It is a group of thirteen transparent domes illuminated by LED lights that are controlled by the drivers referred to in Part A.

 Interactive installation using Wwise  

Part C : 'Virtual phenotype'

Object C is inspired by the death penalty chair as a post-human era representation. It is a publicly accessible chair with a VR helmet mounted, in which you can observe the interpretation of the signals referred to in part A in real-time.

Interactive installation using Wwise

While earthworms in part A of the installation, unconsciously control the LED lights in part B of the installation, the VR world and viewers sitting in the chair also unconsciously activate the audio layer in the room where the work is located.

 

The Experience

Experience is primarily explorative - we can observe the life of earthworms in Part A, and the accompanying flashes of light from Part B, which represent an unconscious expression. Our intention was to present humans as a small part of a larger universe, and our goal was to demonstrate how humans are observers, only partaking in the creation of reality. While watching the work, we are accompanied by disturbing sounds, a consistent ambient-drone in the background suppressed with typical earthworm sounds; slick, watery, and growing. The audio provokes some kind of discomfort for the viewer. Moving from Part B to Part C increases anxiety, because the chair, which resembles a typical death penalty chair is supposed to move us to the final Part or element of the installation - Virtual Reality.

The VR world represents an exploratory journey. There, we meet various stages of migration (difficulties and overcoming difficulties). Our existence within a large universe where we are observers and not more than contributors, is enhanced by the appearance of Object C, the death penalty chair, and the symbolic 'closing' of the viewer, within the VR helmet.

 Interactive installation using Wwise

 

 Virtual Phenotype - VR experience 

After setting up the VR goggles, we experience a sharp forward movement as we glide just above a black frozen ice sheet, which lights up with the temperature rising in the middle of the habitat inhabited by earthworms (Object A). Our trip is accompanied by falling lights from the sky, triggered by the increase of humidity under object A. On the horizon, there is a shape that we cannot determine at first. Our virtual journey is divided into four stages of migration: the journey to the destination, the goal and the discovery of the next one, the struggle and difficulties, and the ultimate goal which is that all stages have their own disturbing character. 

Interactive installation using Wwise

Interactive installation using Wwise

Interactive installation using Wwise

The Audio 

Audio plays an important role immediately upon observing the installation, as well as within the VR experience.

The sounds of the installation (outside of the VR experience) are not pleasant, yet dreamy. They introduce and influence the viewer into a monotonous mood, suppressed by anxiety and alienation. A 2X stereo configuration allows one to observe the outlines of the VR sound space, by projecting the audio from the virtual world. The audio within the VR world serves as an 'extraction', immersing the viewer into 360 degrees of observation and characterization of individual elements inside this world. 

The sounds of this experience are from elements recorded from the installation and its environment, where the work was built and exhibited. Followed by postproduction, elements are slowed down spectrally and go through a special set of effects, like echo and distortion. The interactive audio piece is inspired by NASA's research on how electromagnetic waves are converted into acoustic waves.

We used Wwise to spatialize the audio field of work. It allowed us to connect sounds with individual 3D elements, each of which would acquire a particular characteristic. In our virtual world, there are falling flares, and using Wwise we were able to attach each of the flares to the sound which accompanied it in space, wherever it would appear. This allowed us to ensure that we impel the viewer to look around the space. Wwise and its spatial audio features and capacities, empowered us to give our world and VR experience naturalness, with all its abstractness. 

 

INFER Project

INFER Project

The INFER is an abstract audio-visual project that explores the relationships between culture, nature, and technology. The development of science has led to a reality in which we are becoming more dependent to technology. Modern tools are a practical extension of our natural abilities, and a gradual expansion of our perception, wherein tools that we use are becoming a direct extension of our senses. Via a combination of biology and technology, the INFER project is designed to exhibit how these two worlds schematically penetrate one another through an audiovisual performance that allows the visualize what human perception is not able to capture. The viewer is placed in an exclusive but also catharsis-like situation, co-creating a concert with the artist and the surrounding reality – which is "prime matter”.

댓글

댓글 달기

이메일 주소는 공개되지 않습니다.


다른 글

소규모 게임 프로젝트가 Wwise로부터 혜택을 받을 수 있는 5가지 이유

여러분이 게임 오디오 분야에 종사하고 있으며 이전에 소규모 게임 프로젝트를 수행한 적이 있는 경우. 다음과 같은 대화를 나눈 적이 있을 수 있습니다. "근데, 와이즈와 같은...

7.7.2020 - 작성자: 알렉스 메이 (ALEX MAY)

합성 만으로 빗소리 만들기

몇 년 전 저는 원하는 모든 사운드를 합성할 수 있을까 하는 궁금증이 생겼습니다. 바람, 새의 노랫소리, 곤충 소리 등 다양한 자연 소리를 합성하기 시작했죠. 이런 작업에서는...

3.9.2020 - 작성자: 알렉산더 킬코(ALEKSANDR KHILKO)

가상 음향을 통해 소리 풍경 가청화하기

이 시리즈에서는 과거, 현재, 그리고 새로운 잔향 기술을 집중적으로 살펴보고 몰입적 공간적 관점에서 이 기술을 검토해봅니다. 이전 글에서는 가상 현실에서 몰입적인 잔향을 제작하는...

16.3.2021 - 작성자: 브누아 알라리 (BENOIT ALARY)

텔 미 와이(Tell Me Why) | 오디오 다이어리 제 3부: 사운드 디자인

텔 미 와이(Tell Me Why)의 오디오 팀에게는 독특하면서도 인상 깊은 서사적 시퀀스를 향상시킬 수 있는 기회가 많았습니다. 저희 시네마틱 및 크리에이티브 디렉터는 영상에 꼭...

19.7.2022 - 작성자: 매튜 피오렌티니 (Mathieu Fiorentini)

Strata, Wwise, Unreal을 결합해 몰입형 게임 환경 만들기

이 블로그에서는 Wwise가 통합된 Unreal Engine 5 프로젝트의 멀티트랙 컬렉션 중 하나를 사용하여 Strata를 이용한 상호작용 디자인 과정을 살펴보겠습니다.이...

16.5.2023 - 작성자: 체이스 스틸(Chase Steele)

Wwise로 게임 마스터링하기 | 제 1부: 게임 오디오 마스터링 접근 방법

게임은 다양한 구성에서 뛰어난 청각적 경험을 제공해야 합니다. 이것은 헤드폰의 3D Audio가 될 수도 있고, 스테레오 TV 스피커 혹은 광대한 7.1.4 Atmos 시스템이 될...

19.3.2025 - 작성자: 로익 쿠티에(Loïc Couthier) & 단제리 스켐브리(Danjeli Schembri)

다른 글

소규모 게임 프로젝트가 Wwise로부터 혜택을 받을 수 있는 5가지 이유

여러분이 게임 오디오 분야에 종사하고 있으며 이전에 소규모 게임 프로젝트를 수행한 적이 있는 경우. 다음과 같은 대화를 나눈 적이 있을 수 있습니다. "근데, 와이즈와 같은...

합성 만으로 빗소리 만들기

몇 년 전 저는 원하는 모든 사운드를 합성할 수 있을까 하는 궁금증이 생겼습니다. 바람, 새의 노랫소리, 곤충 소리 등 다양한 자연 소리를 합성하기 시작했죠. 이런 작업에서는...

가상 음향을 통해 소리 풍경 가청화하기

이 시리즈에서는 과거, 현재, 그리고 새로운 잔향 기술을 집중적으로 살펴보고 몰입적 공간적 관점에서 이 기술을 검토해봅니다. 이전 글에서는 가상 현실에서 몰입적인 잔향을 제작하는...