Journal article · 2026 · Open access

A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator

Elahe Delavari, Feeza Khan Khanzada, Jaerock Kwon

IEEE Access, 14, 132298–132330 · Published 1 January 2026 · DOI 10.1109/access.2026.3724381

Open full textCite this paper

In brief

“A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator” is a 2026 journal article by Elahe Delavari and 2 co-authors, published in IEEE Access. OpenAlex counts 18 citations as of 17 November 2026, which puts it in the top 4% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at IEEE Access.

Citations
18
Most cited in
2026 (14)
Field-weighted impact
18.23
References
137
Authors
3

Abstract

Autonomous-driving research has recently embraced deep Reinforcement Learning (RL) as a promising framework for data-driven decision making, yet a clear picture of how these algorithms are currently employed, benchmarked and evaluated is still missing. This survey fills that gap by systematically analysing around 100 peer-reviewed papers that train, test or validate RL policies inside the open-source CARLA simulator. We first categorize the literature by algorithmic family model-free, model-based, hierarchical, and hybrid and quantify their prevalence, highlighting that more than 80% of existing studies still rely on model-free methods such as DQN, PPO and SAC. Next, we explain the diverse state, action and reward formulations adopted across works, illustrating how choices of sensor modality (RGB, LiDAR, BEV, semantic maps, and carla kinematics states), control abstraction (discrete vs. continuous) and reward shaping are used across various literature. We also consolidate the evaluation landscape by listing the most common metrics (success rate, collision rate, lane deviation, driving score) and the towns, scenarios and traffic configurations used in CARLA benchmarks. Persistent challenges including sparse rewards, sim-to-real transfer, safety guarantees and limited behaviour diversity are distilled into a set of open research questions, and promising directions such as model-based RL, meta-learning and richer multi-agent simulations are outlined. By providing a unified taxonomy, quantitative statistics and a critical discussion of limitations, this review aims to serve both as a reference for newcomers and as a roadmap for advancing RL-based autonomous driving toward real-world deployment.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Delavari, E., Khanzada, F. K., & Kwon, J. (2026). A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator. IEEE Access, 14, 132298–132330. https://doi.org/10.1109/access.2026.3724381

MLA 9

Delavari, Elahe, et al. “A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator.” IEEE Access, vol. 14, 2026, pp. 132298–132330. https://doi.org/10.1109/access.2026.3724381.

Chicago

Delavari, Elahe, Feeza Khan Khanzada, and Jaerock Kwon. 2026. “A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator.” IEEE Access 14: 132298–132330. https://doi.org/10.1109/access.2026.3724381.

Harvard

Delavari, E., Khanzada, F. K. and Kwon, J. (2026) ‘A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator’, IEEE Access, 14, pp. 132298–132330. doi:10.1109/access.2026.3724381.

IEEE

E. Delavari, F. K. Khanzada, and J. Kwon, “A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator,” IEEE Access, vol. 14, pp. 132298–132330, 2026, doi: 10.1109/access.2026.3724381.

BibTeX

@article{delavari2026comprehensive,
  title     = {{A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator}},
  author    = {Delavari, Elahe and Khanzada, Feeza Khan and Kwon, Jaerock},
  journal   = {IEEE Access},
  year      = {2026},
  volume    = {14},
  pages     = {132298--132330},
  doi       = {10.1109/access.2026.3724381},
  url       = {https://doi.org/10.1109/access.2026.3724381}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics

  • deep reinforcement learning
  • autonomous driving
  • CARLA simulator
  • model-free reinforcement learning
  • model-based reinforcement learning
  • hierarchical reinforcement learning
  • hybrid reinforcement learning
  • reward shaping

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Delavari, E., Khanzada, F. K., & Kwon, J. (2026). A Comprehensive Review of Reinforcement Learning for Autonomous Driving in the CARLA Simulator. IEEE Access, 14, 132298–132330. https://doi.org/10.1109/access.2026.3724381

How many times has this paper been cited?

18 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at IEEE Access: sign in and open the full text from this page.

Who wrote this paper?

Elahe Delavari, Feeza Khan Khanzada, Jaerock Kwon.

What is the DOI of this paper?

10.1109/access.2026.3724381, permanently at https://doi.org/10.1109/access.2026.3724381. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.