VALSE 论文速览 第87期： 双视角一致的在线增量学习

论文题目：Not Just Selection, but Exploration: 双视角一致的在线增量学习

作者列表：顾亚男 (西安电子科技大学)，杨旭 (西安电子科技大学)，魏坤 (西安电子科技大学)，邓成 (西安电子科技大学)

B站观看网址：

https://www.bilibili.com/video/BV1rZ4y1Y7dv/

论文摘要：

Online class-incremental continual learning aims to learn new classes continually from a never-ending and single-pass data stream, while not forgetting the learned knowledge of old classes. Existing replay-based methods have shown promising performance by storing a subset of old class data. Unfortunately, these methods only focus on selecting samples from the memory bank for replay and ignore the adequate exploration of semantic information in the single-pass data stream, leading to poor classification accuracy. In this paper, we propose a novel yet effective framework for online class-incremental continual learning, which considers not only the selection of stored samples, but also the full exploration of the data stream. Specifically, we propose a gradient-based sample selection strategy, which selects the stored samples whose gradients generated in the network are most interfered by the new incoming samples. We believe such samples are beneficial for updating the neural network based on back gradient propagation. More importantly, we seek to explore the semantic information between two different views of training images by maximizing their mutual information, which is conducive to the improvement of classification accuracy. Extensive experimental results demonstrate that our method achieves state-of-the-art performance on a variety of benchmark datasets.

论文信息：

[1] Yanan Gu, Xu Yang, Kun Wei, Cheng Deng. Not Just Selection, but Exploration: Online Class-Incremental Continual Learning via Dual View Consistency. CVPR 2022.

论文链接：

[https://openaccess.thecvf.com/content/CVPR2022/papers/Gu_Not_Just_Selection_but_Exploration_Online_Class-Incremental_Continual_Learning_via_CVPR_2022_paper.pdf]

代码链接：

[https://github.com/YananGu/DVC]

视频讲者简介：

顾亚男，西安电子科技大学电子工程学院博士生，师从邓成教授，主要研究方向是计算机视觉和深度增量学习，在CVPR、AAAI等国际会议发表论文多篇。

特别鸣谢本次论文速览主要组织者：

月度轮值AC：王智慧 (大连理工大学)、杨旭 (西安电子科技大学)

季度责任AC：魏秀参 (南京理工大学)