Journal article · 2026 · Open access
SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models
International Journal of Computer Vision, 134(12) · Published 13 November 2026 · DOI 10.1007/s11263-026-03112-7
In brief
“SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models” is a 2026 journal article by Turhan Can Kargin and 4 co-authors, published in International Journal of Computer Vision. OpenAlex counts 2 citations as of 18 November 2026, which puts it in the top 6% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at International Journal of Computer Vision.
- Citations
- 2
- Most cited in
- 2026 (2)
- Field-weighted impact
- 2.29
- References
- 62
- Authors
- 5
Abstract
Visual Foundation Models (VFMs), such as DINO and CLIP, excel in semantic understanding of images but exhibit limited spatial reasoning capabilities, which limits their applicability to embodied systems. As a result, recent work has incorporated some 3D tasks (such as depth estimation) into VFM training. However, VFM performance remains inconsistent across other spatial tasks, raising the question of whether these models truly possess spatial awareness or overfit to specific 3D objectives. To address this question, we introduce the Spatial Relation Recognition Task (SpaRRTa) benchmark, which evaluates the ability of VFMs to identify static directional relations between visible objects. Unlike traditional 3D objectives that focus on precise metric prediction (e.g., surface normal estimation), SpaRRTa probes a fundamental capability underpinning more advanced forms of human-like spatial understanding. SpaRRTa generates an arbitrary number of photorealistic images with diverse scenes and fully controllable object arrangements, along with freely accessible spatial annotations. Evaluating a range of state-of-the-art VFMs, we reveal significant disparities in their ability to encode directional spatial relations. Through our analysis, we provide insights into the mechanisms that support or hinder this form of spatial awareness in modern VFMs. We hope that SpaRRTa will serve as a useful tool for guiding the development of future spatially aware visual models. Our project page can be found at https://sparrta.gmum.net/ .
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Kargin, T. C., Jasiński, W., Pardyl, A., Zieliński, B., & Przewięźlikowski, M. (2026). SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models. International Journal of Computer Vision, 134(12). https://doi.org/10.1007/s11263-026-03112-7
MLA 9
Kargin, Turhan Can, et al. “SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models.” International Journal of Computer Vision, vol. 134, no. 12, 2026. https://doi.org/10.1007/s11263-026-03112-7.
Chicago
Kargin, Turhan Can, Wojciech Jasiński, Adam Pardyl, Bartosz Zieliński, and Marcin Przewięźlikowski. 2026. “SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models.” International Journal of Computer Vision 134 (12). https://doi.org/10.1007/s11263-026-03112-7.
Harvard
Kargin, T. C. et al. (2026) ‘SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models’, International Journal of Computer Vision, 134(12). doi:10.1007/s11263-026-03112-7.
IEEE
T. C. Kargin, W. Jasiński, A. Pardyl, B. Zieliński, and M. Przewięźlikowski, “SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models,” International Journal of Computer Vision, vol. 134, no. 12, 2026, doi: 10.1007/s11263-026-03112-7.
BibTeX
@article{kargin2026sparrta,
title = {{SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models}},
author = {Kargin, Turhan Can and Jasiński, Wojciech and Pardyl, Adam and Zieliński, Bartosz and Przewięźlikowski, Marcin},
journal = {International Journal of Computer Vision},
year = {2026},
volume = {134},
number = {12},
doi = {10.1007/s11263-026-03112-7},
url = {https://doi.org/10.1007/s11263-026-03112-7}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- vision foundation models
- spatial reasoning
- benchmark
- synthetic image generation
- spatial awareness
- embodied AI
- DINO
- CLIP
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Kargin, T. C., Jasiński, W., Pardyl, A., Zieliński, B., & Przewięźlikowski, M. (2026). SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models. International Journal of Computer Vision, 134(12). https://doi.org/10.1007/s11263-026-03112-7
How many times has this paper been cited?
2 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at International Journal of Computer Vision: sign in and open the PDF from this page.
Who wrote this paper?
Turhan Can Kargin, Wojciech Jasiński, Adam Pardyl, Bartosz Zieliński, Marcin Przewięźlikowski.
What is the DOI of this paper?
10.1007/s11263-026-03112-7, permanently at https://doi.org/10.1007/s11263-026-03112-7. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.