VALSE 论文速览 第99期：学习不变性视觉表示的零样本组合学习 ...

论文题目：Learning Invariant Visual Representations for Compositional Zero-Shot Learning

作者列表：张甜 (北京邮电大学)、梁孔明 (北京邮电大学)、杜若一 (北京邮电大学)、孙显 (中国科学院航空航天信息研究所)、马占宇 (北京邮电大学)、郭军 (北京邮电大学)

B站观看网址：

https://www.bilibili.com/video/BV1aG411g7x9/

论文摘要：

Compositional Zero-Shot Learning (CZSL)aims to recognize novel compositions using knowledge learned from seen attribute-object compositions in the training set. Previous works mainly project an image and a composition into a common embedding space to measure their compatibility score. However, both attributes and objects share the visual representations learned above, leading the model to exploit spurious correlations and bias towards seen pairs. Instead, we reconsider CZSL as an out-of-distribution generalization problem. If an object is treated as a domain, we can learn object-invariant features to recognize the attributes attached to any object reliably. Similarly, attribute-invariant features can also be learned when recognizing the objects with attributes as domains. Specifically, we propose an invariant feature learning framework to align different domains at the representation and gradient levels to capture the intrinsic characteristics associated with the tasks. Experiments on three CZSL benchmarks demonstrate that the proposed method significantly outperforms the previous state-of-the-art.

论文信息：

[1] Tian Zhang, Kongming Liang, Ruoyi Du, Xian Sun, Zhanyu Ma, and Jun Guo. Learning Invariant Visual Representations for Compositional Zero-Shot Learning. ECCV 2022.

论文链接：

[https://arxiv.org/pdf/2206.00415.pdf]

代码链接：

[https://github.com/PRIS-CV/IVR]

视频讲者简介：

张甜，北京邮电大学人工智能学院博士生，师从马占宇教授。主要研究方向为零样本组合学习，域泛化等。

特别鸣谢本次论文速览主要组织者：

月度轮值AC：王立君 (大连理工大学)、眭亚楠 (清华大学)

季度责任AC：张姗姗 (南京理工大学)