Multimodal Emotional Intelligence System 

Project Team

Project Supervisor

Lujia WANG

Academic Supervisor

Yutao YUE, Dengbo HE

Team members

Zihe ZHAO, Boyu JIN, Xiao YANG

Project Overview

Emotion is not a decoration—it is the foundational protocol that underlies human decision-making and collaboration. To accelerate the industrial adoption of AI in healthcare, education, and human-computer interaction, we have engineered a comprehensive multimodal affective intelligence system. Our solution integrates a specialized hardware suite capable of simultaneous non-contact physiological monitoring, facial Action Unit detection, and audio acquisition. By leveraging a cloud-based Multimodal Large Language Model (MLLM) for sophisticated data analysis and dynamic interaction, we are evolving AI from static brains into adaptive minds. This establishes “understanding humans” as a standard capability for the next generation of intelligent systems, paving the way for more empathetic and effective technology. 

Honor and achievements

The Emotional Intelligence System was awarded the Gold Medal at the International Exhibition of Inventions Geneva in March 2026 

Student Research Areas

Zihe ZHAO

Multimodal Large Language Model 

Boyu JIN

Emotional Intelligence System, Intelligent Hardware Integration 

Xiao YANG

Non-contact Physiological Signal Processing