Assist Prof Dr. Haoyu Chen | Human Behavior Modeling | Young Scientist Award

Assist Prof Dr. Haoyu Chen at University of Oulu, Finland

👨‍🎓Professional Profile

• Google Scholar Profile

👨‍🏫 Summary

Assist Prof Dr. Haoyu Chen at the CMVS unit of the University of Oulu, where I also completed my Ph.D. and Master’s in Computer Science. My research focuses on the intersection of emotion AI, computer vision, and machine learning. I am particularly interested in building AI systems that can understand and perceive complex human emotions. My work integrates human cognitive modeling, adversarial learning, and multimodal learning to push the boundaries of how AI can interact with humans in more intuitive and empathetic ways.

🎓 Education

I hold a Ph.D. in Computer Science and Engineering from the University of Oulu, Finland (2022), with distinction (GPA: 4.5). Prior to that, I completed my Master’s degree in Computer Science and Engineering at the same institution in 2017, graduating with excellent marks (GPA: 4.2).

💼 Professional Experience

As an Assistant Professor (03/2022–Present) at the University of Oulu’s CMVS unit, I focus on human emotional and cognitive modeling in AI. I also serve as a Postdoctoral Researcher (03/2022–Present) on Emotion AI and Adversarial Learning projects under the guidance of Prof. Guoying Zhao. In addition, I was a Visiting Researcher at Delft University of Technology in the Learning Science group, where I collaborated with Prof. Marcus Specht (03/2023–06/2023). I also contributed to Computer-Supported Collaborative Learning (CSCL) projects as a technical consultant for NTU Singapore (09/2019–09/2022).

📚 Academic Citations

My research has been featured in top-tier conferences like AAAI, ICCV, BMVC, CVPR, and IJCV, with publications in major journals like TIP, TMM, and TNNLS. My work primarily focuses on emotion recognition, gesture analysis, multimodal learning, and adversarial attacks in AI systems.

💻 Technical Skills

I am proficient in Python, C++, and major deep learning frameworks like TensorFlow and PyTorch. My expertise includes computer vision techniques such as object detection and action recognition, as well as emotion recognition and gesture analysis. I also specialize in machine learning methodologies, including supervised and unsupervised learning and the development of secure AI systems resistant to adversarial attacks.

📚 Teaching Experience

I have served as a Lecturer for courses like Affective Computing (2024 Spring) and Computer Graphics (2024 & 2023 Spring) at the University of Oulu. Additionally, I have been a Teaching Assistant for courses in Affective Computing and Computer Graphics over the years. Beyond the classroom, I organize workshops and challenges such as the MiGA Workshop on micro-gesture analysis (IJCAI 2023 & 2024) and the VIPriors Challenges (ECCV 2020). I also serve as a peer reviewer for conferences and journals like CVPR, AAAI, ECCV, and TMM.

🔬 Research Interests

My research interests lie at the intersection of Emotion AI, Human-AI Interaction, and Adversarial Learning. I explore how AI can recognize and interpret human emotions through gestural analysis and cognitive modeling, aiming to build systems that enhance emotional and cognitive understanding. I am also interested in developing AI models that are both secure and reliable, particularly in defending against adversarial attacks.