Preprint · 2025 · Open access
CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale
arXiv (Cornell University) · Published 23 February 2025 · DOI 10.48550/arxiv.2502.16645
In brief
“CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale” is a 2025 preprint by Chenlong Wang and 8 co-authors, published in arXiv (Cornell University). OpenAlex counts 13 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 13
- Most cited in
- 2026 (12)
- References
- 68
- Authors
- 9
Abstract
Large Language Models (LLMs) have exhibited exceptional performance in software engineering yet face challenges in adapting to continually evolving code knowledge, particularly regarding the frequent updates of third-party library APIs. This limitation, stemming from static pre-training datasets, often results in non-executable code or implementations with suboptimal safety and efficiency. To this end, this paper introduces CODESYNC, a data engine for identifying outdated code patterns and collecting real-time code knowledge updates from Python third-party libraries. Building upon CODESYNC, we develop CODESYNCBENCH, a comprehensive benchmark for assessing LLMs' ability to stay synchronized with code evolution, which covers real-world updates for 220 APIs from six Python libraries. Our benchmark offers 3,300 test cases across three evaluation tasks and an update-aware instruction tuning dataset consisting of 2,200 training samples. Extensive experiments on 14 state-of-the-art LLMs reveal that they struggle with dynamic code evolution, even with the support of advanced knowledge updating methods (e.g., DPO, ORPO, and SimPO). We believe that our benchmark can offer a strong foundation for the development of more effective methods for real-time code knowledge updating in the future. The experimental code and dataset are publicly available at: https://github.com/Lucky-voyage/Code-Sync.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wang, C., Chu, Z., Zhengxiang, C., Xuyi, Y., Kaiyue, Q., Wan, Y., Zhao, Z., Shi, X., & Dongping, C. (2025). CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.16645
MLA 9
Wang, Chenlong, et al. “CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale.” arXiv (Cornell University), 2025. https://doi.org/10.48550/arxiv.2502.16645.
Chicago
Wang, Chenlong, Zhaoyang Chu, Cheng, Zhengxiang, Yang, Xuyi, Qiu, Kaiyue, Yao Wan, Zhou Zhao, Xuanhua Shi, and Chen, Dongping. 2025. “CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.16645.
Harvard
Wang, C. et al. (2025) ‘CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale’, arXiv (Cornell University). doi:10.48550/arxiv.2502.16645.
IEEE
C. Wang et al., “CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale,” arXiv (Cornell University), 2025, doi: 10.48550/arxiv.2502.16645.
BibTeX
@misc{wang2025codesync,
title = {{CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale}},
author = {Wang, Chenlong and Chu, Zhaoyang and Zhengxiang, Cheng, and Xuyi, Yang, and Kaiyue, Qiu, and Wan, Yao and Zhao, Zhou and Shi, Xuanhua and Dongping, Chen,},
howpublished = {arXiv (Cornell University)},
year = {2025},
doi = {10.48550/arxiv.2502.16645},
url = {https://doi.org/10.48550/arxiv.2502.16645}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- large language models
- code evolution
- third-party libraries
- Python library
- knowledge updating
- instruction tuning
- benchmark
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wang, C., Chu, Z., Zhengxiang, C., Xuyi, Y., Kaiyue, Q., Wan, Y., Zhao, Z., Shi, X., & Dongping, C. (2025). CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2502.16645
How many times has this paper been cited?
13 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Chenlong Wang, Zhaoyang Chu, Cheng, Zhengxiang, Yang, Xuyi, Qiu, Kaiyue, Yao Wan, Zhou Zhao, Xuanhua Shi, Chen, Dongping.
What is the DOI of this paper?
10.48550/arxiv.2502.16645, permanently at https://doi.org/10.48550/arxiv.2502.16645. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.