Preprint · 2023 · Open access
Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA
arXiv (Cornell University) · Published 23 October 2023 · DOI 10.48550/arxiv.2311.10735
In brief
“Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA” is a 2023 preprint by G.H. Nehme and Tejas Y. Deo, published in arXiv (Cornell University). OpenAlex counts 15 citations as of 22 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 15
- Most cited in
- 2025 (10)
- References
- 8
- Authors
- 2
Abstract
Autonomous vehicles have the potential to revolutionize transportation, but they must be able to navigate safely in traffic before they can be deployed on public roads. The goal of this project is to train autonomous vehicles to make decisions to navigate in uncertain environments using deep reinforcement learning techniques using the CARLA simulator. The simulator provides a realistic and urban environment for training and testing self-driving models. Deep Q-Networks (DQN) are used to predict driving actions. The study involves the integration of collision sensors, segmentation, and depth camera for better object detection and distance estimation. The model is tested on 4 different trajectories in presence of different types of 4-wheeled vehicles and pedestrians. The segmentation and depth cameras were utilized to ensure accurate localization of objects and distance measurement. Our proposed method successfully navigated the self-driving vehicle to its final destination with a high success rate without colliding with other vehicles, pedestrians, or going on the sidewalk. To ensure the optimal performance of our reinforcement learning (RL) models in navigating complex traffic scenarios, we implemented a pre-processing step to reduce the state space. This involved processing the images and sensor output before feeding them into the model. Despite significantly decreasing the state space, our approach yielded robust models that successfully navigated through traffic with high levels of safety and accuracy.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Nehme, G., & Deo, T. Y. (2023). Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2311.10735
MLA 9
Nehme, G.H., and Tejas Y. Deo. “Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA.” arXiv (Cornell University), 2023. https://doi.org/10.48550/arxiv.2311.10735.
Chicago
Nehme, G.H. and Tejas Y. Deo. 2023. “Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2311.10735.
Harvard
Nehme, G. and Deo, T. Y. (2023) ‘Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA’, arXiv (Cornell University). doi:10.48550/arxiv.2311.10735.
IEEE
G. Nehme and T. Y. Deo, “Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA,” arXiv (Cornell University), 2023, doi: 10.48550/arxiv.2311.10735.
BibTeX
@misc{nehme2023safe,
title = {{Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA}},
author = {Nehme, G.H. and Deo, Tejas Y.},
howpublished = {arXiv (Cornell University)},
year = {2023},
doi = {10.48550/arxiv.2311.10735},
url = {https://doi.org/10.48550/arxiv.2311.10735}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 1 | |
| 2025 | 10 | |
| 2026 | 4 |
Topic and keywords
Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- autonomous vehicles
- autonomous driving
- deep reinforcement learning
- CARLA simulator
- deep Q-network
- collision avoidance
- object detection
- semantic segmentation
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
Nehme, G., & Deo, T. Y. (2023). Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2311.10735
How many times has this paper been cited?
15 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
G.H. Nehme, Tejas Y. Deo.
What is the DOI of this paper?
10.48550/arxiv.2311.10735, permanently at https://doi.org/10.48550/arxiv.2311.10735. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.