Multimodal Emotional Intelligence System
Project Team
Project Supervisor
Lujia WANG
Academic Supervisor
Yutao YUE, Dengbo HE
Team members
Zihe ZHAO, Boyu JIN, Xiao YANG
Project Overview
Emotion is not a decoration—it is the foundational protocol that underlies human decision-making and collaboration. To accelerate the industrial adoption of AI in healthcare, education, and human-computer interaction, we have engineered a comprehensive multimodal affective intelligence system. Our solution integrates a specialized hardware suite capable of simultaneous non-contact physiological monitoring, facial Action Unit detection, and audio acquisition. By leveraging a cloud-based Multimodal Large Language Model (MLLM) for sophisticated data analysis and dynamic interaction, we are evolving AI from static brains into adaptive minds. This establishes “understanding humans” as a standard capability for the next generation of intelligent systems, paving the way for more empathetic and effective technology.
Honor and achievements
The Emotional Intelligence System was awarded the Gold Medal at the International Exhibition of Inventions Geneva in March 2026
Student Research Areas
Zihe ZHAO
Multimodal Large Language Model
Boyu JIN
Emotional Intelligence System, Intelligent Hardware Integration
Xiao YANG
Non-contact Physiological Signal Processing




