Capturekit & Streamingkit

The Capturekit & Streamingkit workshop, led by Fang Tsai, provided participants with an immersive introduction to the creative potential of motion-capture technology for live performance.

Designed for the Performance Class in the Fine Arts program under Prof. Mathilde Ter Heijne, the workshop explored how bodily movement can function as a dynamic interface for audiovisual expression, enabling gestures and physical presence to be transformed into interactive video streams.

Participants engaged with the Azure Kinect motion-capture system and learned to integrate it with visual programming software such as TouchDesigner. Through guided exercises, they experimented with real-time tracking of skeletal and positional data, mapping body movement to visual and auditory effects.

This approach allowed the body itself to become a central tool in performance design, offering new ways to shape live experiences and challenge conventional stage presentation.

The workshop emphasized experimentation and collaborative learning. Students were introduced to foundational software and hardware tools before working in small groups to develop short live performances. These exercises combined motion capture with interactive video and audio elements, demonstrating how technology can extend the expressive range of performance while maintaining a direct connection to the performer’s gestures.

The workshop highlighted the interplay between physical movement and digital signal processing, showing how visual effects can amplify and transform live performance. It also laid the groundwork for further experimentation, inspiring students to integrate motion-tracking technologies into their own artistic practices, creating interactive, immersive, and visually dynamic performances that bridge body, technology, and creative expression.

Photo Credit | Suet Wa