MediGesture

MediGesture Prototype

Ziyuan Zhu. Juried Artist

Artist Statement

How might we make the meditation experience more customized and personalized?

MediGesture is a multimodal application that enables users to utilize voice and gesture to control the meditation process and customize their own experience. It is, also, an educational tool that introduces mudras to the one who wants to experience more origin and a fun meditation with the mudras. The interface is created using , and voice control, with which users can control the meditation interface with natural language to switch to different modes of meditation. The hand detection function with a webcam, which enables users to pose mudras, triggers customized chime sounds that aim for a customized meditation experience.

About the artists

Ziyuan Zhu is a creative technologist working at the intersection of design and emerging technology. At IDEO, a global design company committed to fostering social impact with human-centric design, she helps teams tangibly explore the future of product experience with emerging technologies, including generative AI, data visualization, and XR. Ziyuan is also an affiliate researcher at MIT, where she leads research on integrating technology into climate education. Ziyuan holds a dual master’s degree in design study and computer science from MIT.

Ziyuan Zhu is a creative technologist working at the intersection of design and emerging technology. At IDEO, a global design company committed to fostering social impact with human-centric design, she helps teams tangibly explore the future of product experience with emerging technologies, including generative AI, data visualization, and XR. Ziyuan is also an affiliate researcher at MIT, where she leads research on integrating technology into climate education. Ziyuan holds a dual master’s degree in design study and computer science from MIT.

Credits: Ziyuan Zhu, Kat Labrou

URL: https://iam-zy.com/

ISEA2024 acknowledges the Turrbal and Yugara as the First Nations owners of the lands where the symposium will be held. We pay our respects to their elders, lores, customs and creation spirits. We also acknowledge and pay respects to all First Nations peoples across the continent and beyond Australian shores.