VALSE 论文速览 第171期：基于骨架的带有遮挡的人体动作识别

论文题目：

Occluded Skeleton-Based Human Action Recognition with Dual Inhibition Training

作者列表：

陈振洁 (东南大学)，王洪松 (东南大学)，桂杰 (东南大学)

B站观看网址：

https://www.bilibili.com/video/BV1WJ4m1j7vF/

论文摘要：

Recently, skeleton-based human action recognition has received widespread attention in computer vision and multimedia communities. However, most existing research focuses on improving the recognition accuracy on complete skeleton data, while ignoring the performance on the incomplete skeleton data with occlusion or noise. This paper addresses occluded and noise-robust skeleton-based action recognition and presents a novel Dual Inhibition Training strategy. Specifically, we propose Part-aware and Dual-inhibition Graph Convolutional Network (PDGCN), which comprises of three parts: Input Skeleton Inhibition (ISI), Part-Aware Representation Learning (PARL) and Predicted Score Inhibition (PSI). The ISI and PSI are plug and play modules which could encourage the model to learn discriminative features from diversified body joints by effectively simulating key body part occlusions and random occlusions. The PARL module learns both the global and local representations from the whole body and body parts, respectively, and progressively fuses them during representation learning to enhance the model robustness under occlusions. Finally, we design different settings for occluded skeleton-based human action recognition to deep study this problem and better evaluate different approaches. Our approach considerably outperforms previous state-of-the-art methods and particularly exceeds the baselines with an average improvement of 10% on the Toyota Smarthome dataset.

论文链接：

[https://dl.acm.org/doi/10.1145/3581783.3612170]

视频讲者简介：

陈振洁，东南大学硕士研究生在读。第三作者简介：桂杰博士，东南大学青年首席教授、博士生导师，国家青年高层次人才（国家级四青人才），目前主要从事模式识别、机器学习、图像处理、计算机视觉及人工智能安全等方面的研究，是CCF杰出会员、IEEE高级会员、 ACM高级会员、中国人工智能学会高级会员和中国图象图形学学会高级会员。荣获2021年度江苏省计算机学会“青年科技奖”。担任JCR一区期刊IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), Artificial Intelligence Review, Neural Networks和Neurocomputing的编委(Associate editor, AE)，是多个国际SCI期刊TPAMI,TNNLS, TCYB, TIP, TIFS等的审稿人。近年来，在国际学术期刊和会议上发表学术论文七十多篇，有多篇SCI高被引论文。 

个人主页：

https://guijiejie.github.io/index.html

特别鸣谢本次论文速览主要组织者：

月度轮值AC：张瑞茂 (香港中文大学 (深圳))