Dissertation · 2025 · Open access
Evaluation of code generation capabilities in Large Language Models
Hispana · Published 1 August 2025
In brief
“Evaluation of code generation capabilities in Large Language Models” is a 2025 dissertation by Eduardo Mena Caballero, published in Hispana. OpenAlex counts 0 citations as of 19 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at Hispana.
- Citations
- 0
- Authors
- 1
Abstract
Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation, yet their e ectiveness varies depending on multiple factors, including correctness, e ciency, and maintainability. This study presents a comprehensive evaluation framework for assessing LLM-generated code based on a diverse set of metrics. These include correctness, execution time, cyclomatic complexity, maintainability, style compliance, redundancy, and code similarity, among others. Additionally, generated unit tests are analyzed for coverage and e ectiveness. To enable a exible assessment, a benchmarking system is developed, allowing users to assign di erent weights to each metric based on the desired attributes of the generated code. Furthermore, the generated code is compared against reference implementations to determine whether LLMs can improve upon existing solutions. A functional analysis is performed using unit tests generated by the models. The results of this study provide valuable insights into the strengths and limitations of LLMs in software development, guiding future improvements and practical applications.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Caballero, E. M. (2025). Evaluation of code generation capabilities in Large Language Models. Hispana. https://oa.upm.es/91269/
MLA 9
Caballero, Eduardo Mena. “Evaluation of code generation capabilities in Large Language Models.” Hispana, 2025. https://oa.upm.es/91269/.
Chicago
Caballero, Eduardo Mena. 2025. “Evaluation of code generation capabilities in Large Language Models.” Hispana. https://oa.upm.es/91269/.
Harvard
Caballero, E. M. (2025) ‘Evaluation of code generation capabilities in Large Language Models’, Hispana. Available at: https://oa.upm.es/91269/.
IEEE
E. M. Caballero, “Evaluation of code generation capabilities in Large Language Models,” Hispana, 2025.
BibTeX
@phdthesis{caballero2025evaluation,
title = {{Evaluation of code generation capabilities in Large Language Models}},
author = {Caballero, Eduardo Mena},
year = {2025},
url = {https://oa.upm.es/91269/}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- large language models
- code generation
- program correctness
- software maintainability
- cyclomatic complexity
- code redundancy
- code similarity
- benchmarking framework
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Caballero, E. M. (2025). Evaluation of code generation capabilities in Large Language Models. Hispana. https://oa.upm.es/91269/
How many times has this paper been cited?
0 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Hispana: sign in and open the full text from this page.
Who wrote this paper?
Eduardo Mena Caballero.
Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.