OperARtistry

Chinese Traditional Opera (Xiqu) is a form of art (intangible cultural heritage in UNESCO) which requires high level of visual effect. Xiqu makeup is a tedious process for the beginners. Based on our research, we found that eye makeup was the most difficult part to apply, while existing text & video tutorial are usually hard to understand and time-consuming, so we did a AR-based tutorial for opera eye makeup.

The system overview:

The procedure of the system:

For technical part, we use facemesh to detect the facial feature points and customize AR components in 2D picture to align with the real-time AR effect in 3D.