The whole picture of this project

Chinese Traditional Opera (Xiqu) is a form of art (intangible cultural heritage in UNESCO) which requires high level of visual effect. Xiqu makeup is a tedious process for the beginners. Based on our research, we found that eye makeup was the most difficult part to apply, while existing text & video tutorial are usually hard to understand and time-consuming, so we did a AR-based tutorial for opera eye makeup.

The system overview:

System Overview

The procedure of the system:


For technical part, we use facemesh to detect the facial feature points and customize AR components in 2D picture to align with the real-time AR effect in 3D.

Technical Details

Zeyu Xiong
Zeyu Xiong
Incoming PhD Student

My research interests include Human-Computer Interaction, Human-AI Collaboration, Accessibility, Ubiquitous Computing and Computer Music.