Probing Perceptual Constancy in Large Vision-Language Models
Haoran Sun ⋅ Bingyang Wang ⋅ Suyang Yu ⋅ Yijiang Li ⋅ Qingying Gao ⋅ Haiyun Lyu ⋅ Lianyu Huang ⋅ Zelong Hong ⋅ Jiahui Ge ⋅ Qianli Ma ⋅ Hang He ⋅ Yifan Zhou ⋅ Lingzi Guo ⋅ Lantao Mei ⋅ Maijunxian Wang ⋅ Dezhi Luo ⋅ Hokin Deng
Abstract
Perceptual constancy is the ability to maintain stable perceptions of objects despite changes in sensory input, such as variations in distance, angle, or lighting. This ability is crucial for visual understanding in a dynamic world. Here, we explored such ability in current Vision Language Models (VLMs). In this study, we evaluated 155 VLMs using 236 experiments across three domains: color, size, and shape constancy. The experiments included single-image and video adaptations of classic cognitive tasks, along with novel tasks in in-the-wild conditions. We found significant variability in VLM performance across these domains, with model performance in shape constancy clearly dissociated from that of color and size constancy.
Chat is not available.
Successful Page Load