VALSE Webinar 20220119-03 总第268期 特邀报告：智能情绪感知与情感接口 ... ...

特邀报告嘉宾：赵国英 (芬兰Oulu大学)

报告题目：Emotional Interfaces with Face Analysis (基于脸部分析的情感接口)

*欢迎大家在下方留言提出主题相关问题，主持人和panel嘉宾会从中选择若干热度高的问题加入panel议题！

特邀报告嘉宾：赵国英 (芬兰Oulu大学)

报告时间：2022年01月19日 (星期三)晚上20:00 (北京时间)

报告题目：Emotional Interfaces with Face Analysis (基于脸部分析的情感接口)

报告人简介：

赵国英博士、IEEE Fellow 和IAPR Fellow，于2005年在中国科学院获得博士学位。芬兰科学院教授和芬兰Oulu大学的终身正教授。赵国英教授在国际期刊和会议上发表了超过270篇文章，谷歌学术引用超17700次，H-index 64. 她是ICMI2021的共同程序主席、FG18的共同出版主席，受邀担任PR, TCSVT，IVC等国际知名期刊的编委。她当前的研究兴趣包括图像和视频描述、人脸表情与微表情识别，情绪的姿态分析，情感计算和生物识别。她的研究成果被芬兰国家电视台，报纸和MIT技术综述等媒体专文报道。

ZHAO Guoying received the Ph.D. degree in computer science from the Chinese Academy of Sciences, Beijing, China, in 2005. She is currently an Academy Professor and full Professor (tenured in 2017) with University of Oulu. She is IEEE Fellow and IAPR Fellow. She has authored or co-authored more than 270 papers in journals and conferences with 17700+ citations in Google Scholar and h-index 64. She is co-program chair for ACM International Conference on Multimodal Interaction (ICMI 2021), was co-publicity chair for FG2018, and has served as area chairs for several conferences and is associate editor for Pattern Recognition, IEEE Transactions on Circuits and Systems for Video Technology, and Image and Vision Computing Journals. Her current research interests include image and video descriptors, facial-expression and micro-expression recognition, emotional gesture analysis, affective computing, and biometrics. Her research has been reported by Finnish TV programs, newspapers and MIT Technology Review.

个人主页：

https://gyzhao-nm.github.io/Guoying/

报告摘要：

情绪在人与人之间的互动中发挥着关键作用，并成为未来人工智能的一个关键焦点。人工智能技术的发展越来越需要开发情感智能界面，使之可以能够读取用户的情绪并相应地调整他们的操作。基于计算机视觉的人脸分析毫无疑问将在此类界面的研发中发挥关键作用。本次报告将介绍情感界面，并概述我们研究组在相关研究中的进展。涵盖的研究主题包括面部表情识别、微表情分析、情绪手势、视频远程心率测量和潜在应用。最后将对未来的挑战进行展望。

Emotions play a key role in human-human interactions and become one key focus in future Artificial Intelligence. There is a growing need to develop emotionally intelligent interfaces, which are able to read the emotions of the users and adapt their operations accordingly. Among the areas of application are human-robot interaction, emotional chatpots, health and medicine, on-line learning, user or customer analysis, and security and safety. Face analysis based on computer vision will play a key role in developing such interfaces. This talk will introduce the emotional interfaces, and overview our progress in related research. The research topics to be covered include facial expression recognition, analysis of micro-expressions, emotional gestures, remote heart rate measurement from videos and potential applications. Finally, some future challenges are outlined.

参考文献：

[1] Zitong Yu, Jun Wan, Yunxiao Qin, Xiaobai Li, Stan Z. Li and Guoying Zhao. NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofing. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 43(9): 3005 - 3023, 2021.

[2] Ruijing Yang,  Ziyu Guan, Zitong Yu, Xiaoyi Feng,  Jinye Peng, Guoying Zhao. Non-contact Pain Recognition from Video Sequences with Remote Physiological Measurements Prediction. International Joint Conference on Artificial Intelligence (IJCAI) 2021

[3] Xin Liu, Henglin Shi, Haoyu Chen, Zitong Yu, Xiaobai Li, Guoying Zhao. iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysis. CVPR, 2021.

[4] Zitong Yu, Xiaobai Li, and Guoying Zhao. Facial Video-based Physiological Signal Measurement: Recent Advances and Affective Applications. IEEE Signal Processing Magazine, 38 (6): 50-58, 2021.

[5] Yante Li, Xiaohua Huang, Guoying Zhao. Joint Local and Global Information Learning with Single Apex Frame Detection for Micro-expression Recognition. IEEE Trans. on Image Processing, 30: 249 - 263, 2020.

[6] Zitong Yu, Wei Peng, Xiaobai Li, Xiaopeng Hong, Guoying Zhao. Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancement. ICCV 2019.

[7] Yuan Zong, Wenming Zheng, Xiaohua Huang, Jingang Shi, Zhen Cui, Guoying Zhao. Domain regeneration for cross-database micro-expression recognition. IEEE Transactions on Image Processing, 27(5): 2484-2498, 2018.

[8] Xiaobai Li, Xiaopeng Hong, Antti Moilanen, Xiaohua Huang, Tomas Pfister, Guoying Zhao, and Matti Pietikäinen. Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-expression Spotting and Recognition Methods. IEEE Transactions on Affective Computing, 9(4): 563-577, 2018.

[9] Yimo Guo, Guoying Zhao and Matti Pietikäinen. Dynamic Facial Expression Recognition with Atlas Construction and Sparse Representation. IEEE Transactions on Image Processing, 25(5): 1977-1992, 2016.

[10] Guoying Zhao and Matti Pietikäinen. Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence journal (TPAMI), 2007, 29(6): 915-928.

主持人：洪晓鹏 (哈尔滨工业大学)

主持人简介：

洪晓鹏，哈尔滨工业大学教授，博导。历任芬兰Oulu大学博士后研究员、Docent (芬兰副高、博士生导师)和西安交通大学特聘研究员，澳洲国立大学访问学者和美国马里兰大学帕克校区访问教授。在视频监控、深度连续学习、脸部微小运动分析等方面开展了多年研究。曾先后主持国家重点研发计划课题、面上基金、芬兰信息技术学会博士后基金等项目。在IEEE会刊和CCF A类会议上发表论文50余篇。在面部微小运动分析方面的相关工作见诸美国《麻省理工技术评论》等国际权威媒体专文报道并获IEEE芬兰区最佳学生会议论文奖。图象图形学学会情感计算与理解专业委员会副秘书长，视觉与学习青年学者研讨会 (VALSE)执行领域主席。受邀担任PRL和SIVP等期刊的客座编委和主流国际会议ACM MM、IJCAI、AAAI和ICME的领域主席或资深程序委员。

个人主页：

http://homepage.hit.edu.cn/hongxiaopeng

特别鸣谢本次Webinar主要组织者：

主办AC：洪晓鹏 (哈尔滨工业大学)

赵国英 [slide]