Towards comprehensive interactive change understanding in remote sensing: A large-scale dataset and dual-granularity enhanced VLM

Xue, Junxiao, Deng, Quan, Wu, Xuecheng, Yao, Kelu, Yin, Xinyi, Yu, Fei, Zhou, Wei, Zhong, Yanfei, Liu, Yang and Yang, Dingkang 2026. Towards comprehensive interactive change understanding in remote sensing: A large-scale dataset and dual-granularity enhanced VLM. IEEE Transactions on Geoscience and Remote Sensing 10.1109/tgrs.2025.3650151

Full text not available from this repository.

Abstract

Remote sensing change understanding (RSCU) is essential for analyzing remote sensing images and understanding how human activities affect the environment. However, existing datasets lack deep understanding and interactions in the diverse change captioning, counting, and localization tasks. To tackle these gaps, we construct ChangeIMTI, a new large-scale interactive multi-task instruction dataset that encompasses four complementary tasks including change captioning, binary change classification, change counting, and change localization. Building upon this new dataset, we further design a novel vision-guided vision-language model (ChangeVG) with dual-granularity awareness for bi-temporal remote sensing images (i.e., two remote sensing images of the same area at different times). The introduced visionguided module is a dual-branch architecture that synergistically combines fine-grained spatial feature extraction with high-level semantic summarization. These enriched representations further serve as the auxiliary prompts to guide large vision-language models (VLMs) (e.g., Qwen2.5-VL-7B) during instruction tuning, thereby facilitating the hierarchical cross-modal learning. We extensively conduct experiments across four tasks to demonstrate the superiority of our approach. Remarkably, on the change captioning task, our method outperforms the strongest method Semantic-CC by 1.39 points on the comprehensive S∗m metric, which integrates the semantic similarity and descriptive accuracy to provide an overall evaluation of change caption. Moreover, we also perform a series of ablation studies to examine the critical components of our method. The source code and associated data for this work are publicly available at Github.

Item Type:	Article
Date Type:	Published Online
Status:	In Press
Schools:	Schools > Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers (IEEE)
ISSN:	0196-2892
Last Modified:	07 Jan 2026 13:45
URI:	https://orca.cardiff.ac.uk/id/eprint/183671

Actions (repository staff only)

Edit Item