Gaze and Graze," an eye-tracking interactive installation supported by the Taiwan Ministry of Science and Technology Council project, was showcased at NYCU Arts Center (June 2023) and is set to feature in an upcoming exhibition at the Taiwan Kaohsiung Museum of Fine Arts (Dec 2023 to Mar 2024).
This innovative work deconstructs traditional Taiwanese Hand Puppetry, leveraging eye-tracking technology to redefine audience engagement. Spectators seated in front of the stage control puppets through eye movements while others on the ground observe this unique fusion of technology and culture. The installation transforms the audience into both viewers and participants, immersing them in the rich context of hand puppetry.
Utilizing the Stage of the Seden Society Puppet Theater provided by the National Taiwan Museum, “Gaze and Graze" addresses challenges facing traditional puppetry. Despite its cultural significance, the art form struggles with declining interest and a widening talent gap. Traditional puppet details, often overlooked, hinder a deeper appreciation of their artistic intricacies. This installation seeks to bridge this gap by integrating eye-tracking technology, enriching the audience’s understanding and experience of Taiwanese Hand Puppets.
While contemporary adaptations, such as 3D animation, aim to broaden puppetry’s appeal, live performances and audience interactions require enhancement. “Gaze and Graze" fills this gap by offering a unique interactive experience. Through eye-tracking, audiences can closely examine puppet details—costumes, patterns, and embroidery—gaining a profound understanding of their cultural and artistic significance. This fusion of traditional art and modern technology aims to enrich cultural experiences, preserve Taiwan’s heritage, and drive the continual innovation of cultural arts.
Interactive instructions: Controlling the puppet’s entrance and exit through eye movement, the audience sits in chairs in front of the stage and uses their eyes to observe the “entrance" or “exit" of the hand puppet in the performance.
Team members: I-Ping Chen, Tsuei-Ju Hsieh, Yun-Ju Chen, Chung-Yu Hsu
Special thanks: Chun-Cheng Hsu Lab, TOBII Co., Ltd, The Seidan Glove Puppetry Foundation
