Details

Autor(en) / Beteiligte

• Duan, Yu
• He, Junzhi
• Zhang, Runxin
• Wang, Rong
• Li, Xuelong
• Nie, Feiping

Titel

Prediction consistency regularization for Generalized Category Discovery

Ist Teil von

• Information fusion, 2024-12, Vol.112, p.102547, Article 102547

Ort / Verlag

Elsevier B.V

Erscheinungsjahr

2024

Quelle

Alma/SFX Local Collection

Beschreibungen/Notizen

• Generalized Category Discovery (GCD) is a recently proposed open-world problem that aims to automatically discover and cluster based on partially labeled data. The mainstream GCD methods typically involve two steps: representation learning and classification assignment. Some methods focus on representation and design effective contrastive learning strategies and subsequently utilize clustering methods to obtain the final results. In contrast, some methods attempt to jointly optimize the linear classifier and the model, directly obtaining the predictions. However, the linear classifier is strongly influenced by supervised information, which limits its ability to discover novel categories. In this work, to address the aforementioned issues, we propose the Prediction Consistency Regularization (PCR), which combines the advantages of the aforementioned methods and achieves prediction consistency at both the representation-level and label-level. We employ the Expectation–Maximization (EM) framework to iteratively optimize the model with theoretical guarantees. On one hand, PCR overcomes the limitation of standalone clustering methods that fail to capture fine-grained information within features. On the other hand, it avoids an excessive reliance on supervised information, which can result in the linear classifier getting trapped in local optima. Finally, we comprehensively evaluate our proposed PCR on five benchmark datasets through extensive experiments, and the results demonstrate its superiority over the previous state-of-the-art methods. Our code is available at https://github.com/DuannYu/PCR. •PCR combines the advantages of representation learning and a linear classifier.•PCR ensure consistent predictions in the label space and representation space.•We employ the EM framework to optimize the model with theoretical guarantees.•The experimental results demonstrate the superiority and efficiency of PCR.