CAPTURE is an ongoing research project investigating the integration of the biological body with virtual technologies. Using a Metahuman and a BCI, I am developing a system where an individual’s movement and appearance in VR are driven by mental commands and emotional performance metrics such as arousal, valence and frustration. This system will later be extended to support a wide variety of physiological sensors, each capturing biological data from a network of different bodies. I plan to combine these data streams, positioning the virtual as a collaborative zone, activated by the interplay of a crowd of external agents. Capture can also be paired with EXIT SUIT, becoming a useful tool for VR. The system can be combined with the motion capture workflow I have developed, allowing us to record facial animation even when the user is wearing a VR headset.

In CAPTURE, I experimented with various types of motion capture to create virtual domains which challenged the convention of a disembodied cyberspace. In one experiment, I built an array of motion trackers to record the movement of my torso whilst breathing (see top & bottom left). Likewise, I also tested a Rokoko suit (see top right), and an AI-based system called poseAI (see bottom right). Using the knowledge from these experiments, my plan is to connect the immersant’s brain data with the movement of their entire virtual body.