More Like this

1. Contrastive quant: quantization makes stronger contrastive learning

   https://doi.org/10.1145/3489517.3530419  

   Fu, Yonggan; Yu, Qixuan; Li, Meng; Ouyang, Xu; Chandra, Vikas; Lin, Yingyan (July 2022, DAC '22: Proceedings of the 59th ACM/IEEE Design Automation Conference)

   Contrastive learning learns visual representations by enforcing feature consistency under different augmented views. In this work, we explore contrastive learning from a new perspective. Interestingly, we find that quantization, when properly engineered, can enhance the effectiveness of contrastive learning. To this end, we propose a novel contrastive learning framework, dubbed Contrastive Quant, to encourage feature consistency under both differently augmented inputs via various data transformations and differently augmented weights/activations via various quantization levels. Extensive experiments, built on top of two state-of-the-art contrastive learning methods SimCLR and BYOL, show that Contrastive Quant consistently improves the learned visual representation. 

   more » « less
2. Contrastive Attraction and Contrastive Repulsion for Representation Learning

   Zheng, Huangjie; Chen, Xu; Yao, Jiangchao; Yang, Hongxia; Li, Chunyuan; Zhang, Ya; Zhang, Hao; Tsang, Ivor; Zhou, Jingren; Zhou, Mingyuan (July 2023, Transactions on Machine Learning Research)
3. Contrastive Unlearning: A Contrastive Approach to Machine Unlearning

   https://doi.org/10.24963/ijcai.2025/830  

   Lee, Hong kyu; Zhang, Qiuchen; Yang, Carl; Lou, Jian; Xiong, Li (September 2025, International Joint Conferences on Artificial Intelligence Organization)

   Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model performance is challenging. Existing works mainly exploit input and output space and classification loss, which can result in ineffective unlearning or performance loss. In addition, they utilize unlearning or remaining samples ineffectively, sacrificing either unlearning efficacy or efficiency. Our main insight is that the direct optimization on the representation space utilizing both unlearning and remaining samples can effectively remove influence of unlearning samples while maintaining representations learned from remaining samples. We propose a contrastive unlearning framework, leveraging the concept of representation learning for more effective unlearning. It removes the influence of unlearning samples by contrasting their embeddings against the remaining samples' embeddings so that their embeddings are closer to the embeddings of unseen samples. Experiments on a variety of datasets and models on both class unlearning and sample unlearning showed that contrastive unlearning achieves the best unlearning effects and efficiency with the lowest performance loss compared with the state-of-the-art algorithms. In addition, it is generalizable to different contrastive frameworks and other models such as vision-language models. Our main code is available on github.com/Emory-AIMS/Contrastive-Unlearning 

   more » « less
4. Contrastive Dual Gating: Learning Sparse Features With Contrastive Learning

   Jian Meng; Li Yang; Jinwoo Shin; Deliang Fan; Jae-sun Seo (June 2022, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR))
5. Debiased Contrastive Learning

   Chuang, Ching-Yao; Robinson, Joshua; Yen-Chen, Lin; Torralba, Antonio; Jegelka, Stefanie (January 2020, 34th Conference on Neural Information Processing Systems (NeurIPS 2020))