2016

Pulse.Breath.Water

An Improvised Live Performance

Pulse Breath Water, an interactive art piece that brings together three components: an immersive virtual environment (via Oculus Rift), embodied interaction (via breathing), and a reactive musical agent to generate unique experiences of the virtual world unified with the AI generated sonic environment.

The frequency of the user’s breathing provokes and challenges the interaction between the user and the environment. The reactive musical agent (AI) generates the sonic environment using a sound memory with affective computing. Musical agent accompanies the moody atmospheres of impermanent and ever changing virtual environment.

Credits


Directors: Kıvanç Tatar and Mirjana Prpa
Generative Music and Signal Processing: Kıvanç Tatar
Virtual Reality: Mirjana Prpa
AI system design advisor: Philippe Pasquier
VR advisor: Bernhard Riecke

Publications

Prpa, M., Tatar, K., Riecke, B. E., & Pasquier, P. (2017). The Pulse Breath Water System: Exploring Breathing as an Embodied Interaction for Enhancing the Affective Potential of Virtual Reality. In the 19th International Conference on Human-Computer Interaction, Vancouver, BC, Canada. Paper

Exhibitions

Mutek-IMG 2016, Montreal, Canada

Latent space scatter plot

Scores and Traces, 2016, New York, USA

Interpolated latent space scatter plot

Acknowledgements

This work has been supported by the Canada Council of the Arts, the Natural Sciences and Engineering Research Council of Canada, and Social Sciences and Humanities Research Council of Canada.

Ce travail est supporté par le Conseil national des sciences et de l’ingénieurie du Canada, et le Conseil national des sciences humaines et sociales du Canada.