Reasoning-Aware Cross-Modal Association Unlearning in Multimodal Large Reasoning Models
Multimodal large reasoning models (MLRMs) integrate visual inputs with textual and parametric knowledge, allowing sensitive information to be accessed through cross-modal associations during reasoning. This raises privacy concerns when a visual input should no longer provide access to such information. Machine unlearning can remove this influence without retraining the model from scratch. However, multimodal unlearning methods mainly target samples, concepts, or knowledge content, without separating the knowledge from the cross-modal association through which it is accessed. In reasoning models, target information may disappear from the final answer while remaining in intermediate reasoning, or be replaced by incorrect substitute knowledge. We therefore study cross-modal association unlearning, where the forget target is a designated visual-to-knowledge association: the model should suppress target-bearing behavior under the designated visual context while preserving access to the same knowledge in permitted contexts. We propose Visual-Keyed Counterfactual Rebinding (VKCR), a parameter-efficient framework for cross-modal association editing. VKCR first localizes the edit to a…
Cross-modal association unlearning for privacy in multimodal reasoning models.
- arXiv
- 2611.06168
- Authors
- Xinghao Li, Chenchen Tan, Youyang Qu, Shujie Cui, Xingliang Yuan and 3 more
- Categories
- cs.CV · cs.AI