Live Volumetric Capture
This project explores the creation of an affordable, accessible solution for live volumetric capture, enabling performers to be streamed in real time to VR headsets anywhere in the world. It also facilitates the recording and preservation of performances, with immense potential for cultural preservation, education, and immersive storytelling.
It can also be used as an art installation and therapy tool that offer a new perspectives on embodiment. The technology allows performers to see themselves in VR as a dynamic point cloud, manipulated in real time either by themselves or others. This unlocks new artistic possibilities for embodiment, movement, and interactive storytelling.
Existing volumetric solutions often face challenges, they’re either tied to fixed devices that limit movement range or require large, expensive camera arrays. My approach involves designing a system where cameras can track and rotate with the performer, allowing for a full range of motion in real time. This solution makes volumetric capture more flexible, affordable, and easier to set up, removing barriers for artists and educators.
I see immense value in democratizing tools that can archive performances while providing new ways to experience them. Whether it’s enabling dancers to view their movements from new perspectives in VR and manipulate it or sharing rare cultural performances globally, live volumetric capture holds transformative potential.
Future Goals:
I aim to further develop this system, refining its accessibility and ease of use. By eliminating the limitations of existing setups, I hope to empower artists, educators, and cultural practitioners to preserve, share, and innovate in ways that were previously impossible.
This demos represents a long-term exploration of live motion capture, digital puppetry, and volumetric capture, pushing the boundaries of storytelling through technology and the human body. By experimenting with emerging tools, I sought to create real-time, immersive performance environments that respond dynamically to performers’ movements.
At the heart of this experimentation is a fascination with the human body as a medium of expression, reimagined through digital tools. These projects integrates volumetric video capture, motion-tracking technology, and interactive real-time softwares like unreal engine, notch, touchdesigner to enable performers to manipulate their virtual avatars live on stage. These explorations celebrate the blend of physical and digital storytelling, creating experiences that are both personal and universal.
This expermints excites me because it merges my deep love for movement, dance, and technology. Seeing performers interact with digital visuals in real time brings a sense of freedom and magic to the stage
This project excites me because it merges my deep love for movement, dance, and technology. Seeing performers interact with digital visuals in real time brings a sense of freedom and magic to the stage