COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations
Researchers have introduced COMBINER, a network for composed image retrieval guided by attribute-based neighbor relations, and ZeroSight, a new benchmark for Zero-Shot Composed Image Retrieval (ZS-CIR)[1][2].
COMBINER tackles three core issues in composed image retrieval: entanglement in attribute-level semantics, inconsistency across modalities, and supervised signal missing. It uses an Adaptive Semantic Disentanglement module to disentangle attribute features, a Unified Prototype-based Composition module to construct cross-modal unified prototypes, and a Dual Relations Modeling module to mine pairwise and neighbor relations based on attribute similarity[1]. The introduction of COMBINER comes alongside the release of ZeroSight, a new benchmark for ZS-CIR. Existing ZS-CIR datasets often suffer from complete irrelevance between reference and target images, but ZeroSight includes a dataset with consistent reference-target pairs sourced from videos published as early as 2022 and specifically on March 31[2]. A training-free method, SC4CIR, is proposed to identify hard negative targets through symmetric consistency checks. Current ZS-CIR datasets and evaluation metrics have been shown to result in inflated retrieval performance, exaggerating the capabilities of CIR methods[2].
research-paperbenchmarktool-release
Background sources we checked (4)
- arxiv.org ↗ Composed Image Retrieval (CIR) represents a challenging retrieval task that targets locating specific images through multimodal inputs. Despite recent progress in CIR techniques, prior approaches often overlook cases where images appear visually alike yet differ in attributes, po…
- en.wikipedia.org ↗ Artificial intelligence (AI) is the capability of computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. It is a field of research in engineering, mathematics and computer…
- en.wikipedia.org ↗ This glossary of artificial intelligence is a list of definitions of terms and concepts relevant to the study of artificial intelligence (AI), its subdisciplines, and related fields. Related glossaries include Glossary of computer science, Glossary of robotics, Glossary of machin…
- en.wikipedia.org ↗ The Ming treasure voyages were maritime expeditions undertaken by Ming China's treasure fleet between 1405 and 1433. The Yongle Emperor ordered the construction of the fleet in 1403. The grand project resulted in seven far-reaching ocean voyages to the coastal territories and isl…