Journal article · 2025 · Open access
VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models
IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(3), 3268–3285 · Published 17 November 2025 · DOI 10.1109/tpami.2025.3633890
In brief
“VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models” is a 2025 journal article by Ziqi Huang and 16 co-authors, published in IEEE Transactions on Pattern Analysis and Machine Intelligence. OpenAlex counts 221 citations as of 16 November 2026, which puts it in the top 7% of works published in 2025 by citations. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 221
- Most cited in
- 2026 (137)
- Field-weighted impact
- 51.71
- References
- 148
- Authors
- 17
Abstract
Video generation has witnessed significant advancements, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align with human perceptions; 2) An ideal evaluation system should provide insights to inform future developments of video generation. To this end, we present VBench++, a comprehensive benchmark suite that dissects "video generation quality" into specific, hierarchical, and disentangled dimensions, each with tailored prompts and evaluation methods. VBench++ has several appealing properties: 1) Comprehensive Dimensions: VBench++ comprises 16 dimensions in text-to-video generation (e.g., subject identity inconsistency, motion smoothness, temporal flickering, and spatial relationship, etc). The evaluation metrics with fine-grained levels reveal individual models' strengths and weaknesses. 2) Human Alignment: We also provide a dataset of human preference annotations to validate our benchmarks' alignment with human perception, for each evaluation dimension respectively. 3) Valuable Insights: We look into current models' ability across various evaluation dimensions, and various content types. We also investigate the gaps between video and image generation models. 4) Versatile Benchmarking: VBench++ is designed to evaluate a wide range of video generation tasks, including text-to-video and image-to-video. We introduce a high-quality Image Suite with an adaptive aspect ratio to enable fair evaluations across different image-to-video generation settings. Beyond assessing technical quality, VBench++ evaluates the trustworthiness of video generative models, providing a more holistic view of model performance. 5) Full Open-Sourcing: We fully open-source VBench++, including all prompts, the Image Suite, evaluation methods, generated videos, and human preference annotations.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Huang, Z., Zhang, F., Xu, X., He, Y., Yu, J., Dong, Z., Ma, Q., Chanpaisit, N., Si, C., Jiang, Y., Wang, Y., Chen, X., Chen, Y.-C., Wang, L., Lin, D., Qiao, Y., & Liu, Z. (2025). VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(3), 3268–3285. https://doi.org/10.1109/tpami.2025.3633890
MLA 9
Huang, Ziqi, et al. “VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models.” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 48, no. 3, 2025, pp. 3268–3285. https://doi.org/10.1109/tpami.2025.3633890.
Chicago
Huang, Ziqi, Fan Zhang, Xiaojie Xu, Yinan He, Jiashuo Yu, Ziyue Dong, Qianli Ma, et al. 2025. “VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models.” IEEE Transactions on Pattern Analysis and Machine Intelligence 48 (3): 3268–3285. https://doi.org/10.1109/tpami.2025.3633890.
Harvard
Huang, Z. et al. (2025) ‘VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models’, IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(3), pp. 3268–3285. doi:10.1109/tpami.2025.3633890.
IEEE
Z. Huang et al., “VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 48, no. 3, pp. 3268–3285, 2025, doi: 10.1109/tpami.2025.3633890.
BibTeX
@article{huang2025vbench,
title = {{VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models}},
author = {Huang, Ziqi and Zhang, Fan and Xu, Xiaojie and He, Yinan and Yu, Jiashuo and Dong, Ziyue and Ma, Qianli and Chanpaisit, Nattapol and Si, Chenyang and Jiang, Yuming and Wang, Yaohui and Chen, Xinyuan and Chen, Ying-Cong and Wang, Limin and Lin, Dahua and Qiao, Yu and Liu, Ziwei},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {48},
number = {3},
pages = {3268--3285},
doi = {10.1109/tpami.2025.3633890},
url = {https://doi.org/10.1109/tpami.2025.3633890}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 2 | |
| 2025 | 82 | |
| 2026 | 137 |
Its field-weighted citation impact is 51.71: it has been cited 51.71 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- video generation
- benchmark suite
- text-to-video generation
- image-to-video generation
- video quality assessment
- movement smoothness
- spatial relations
- open-source benchmark
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Huang, Z., Zhang, F., Xu, X., He, Y., Yu, J., Dong, Z., Ma, Q., Chanpaisit, N., Si, C., Jiang, Y., Wang, Y., Chen, X., Chen, Y.-C., Wang, L., Lin, D., Qiao, Y., & Liu, Z. (2025). VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(3), 3268–3285. https://doi.org/10.1109/tpami.2025.3633890
How many times has this paper been cited?
221 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Ziqi Huang, Fan Zhang, Xiaojie Xu, Yinan He, Jiashuo Yu, Ziyue Dong, Qianli Ma, Nattapol Chanpaisit, Chenyang Si, Yuming Jiang, Yaohui Wang, Xinyuan Chen and 5 more.
What is the DOI of this paper?
10.1109/tpami.2025.3633890, permanently at https://doi.org/10.1109/tpami.2025.3633890. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.