Preprint · 2023 · Open access

Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA

G.H. Nehme, Tejas Y. Deo

arXiv (Cornell University) · Published 23 October 2023 · DOI 10.48550/arxiv.2311.10735

Open PDFView at the publisherCite this paper

In brief

“Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA” is a 2023 preprint by G.H. Nehme and Tejas Y. Deo, published in arXiv (Cornell University). OpenAlex counts 15 citations as of 22 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at arXiv (Cornell University).

Citations
15
Most cited in
2025 (10)
References
8
Authors
2

Abstract

Autonomous vehicles have the potential to revolutionize transportation, but they must be able to navigate safely in traffic before they can be deployed on public roads. The goal of this project is to train autonomous vehicles to make decisions to navigate in uncertain environments using deep reinforcement learning techniques using the CARLA simulator. The simulator provides a realistic and urban environment for training and testing self-driving models. Deep Q-Networks (DQN) are used to predict driving actions. The study involves the integration of collision sensors, segmentation, and depth camera for better object detection and distance estimation. The model is tested on 4 different trajectories in presence of different types of 4-wheeled vehicles and pedestrians. The segmentation and depth cameras were utilized to ensure accurate localization of objects and distance measurement. Our proposed method successfully navigated the self-driving vehicle to its final destination with a high success rate without colliding with other vehicles, pedestrians, or going on the sidewalk. To ensure the optimal performance of our reinforcement learning (RL) models in navigating complex traffic scenarios, we implemented a pre-processing step to reduce the state space. This involved processing the images and sensor output before feeding them into the model. Despite significantly decreasing the state space, our approach yielded robust models that successfully navigated through traffic with high levels of safety and accuracy.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Nehme, G., & Deo, T. Y. (2023). Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2311.10735

MLA 9

Nehme, G.H., and Tejas Y. Deo. “Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA.” arXiv (Cornell University), 2023. https://doi.org/10.48550/arxiv.2311.10735.

Chicago

Nehme, G.H. and Tejas Y. Deo. 2023. “Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2311.10735.

Harvard

Nehme, G. and Deo, T. Y. (2023) ‘Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA’, arXiv (Cornell University). doi:10.48550/arxiv.2311.10735.

IEEE

G. Nehme and T. Y. Deo, “Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA,” arXiv (Cornell University), 2023, doi: 10.48550/arxiv.2311.10735.

BibTeX

@misc{nehme2023safe,
  title     = {{Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA}},
  author    = {Nehme, G.H. and Deo, Tejas Y.},
  howpublished = {arXiv (Cornell University)},
  year      = {2023},
  doi       = {10.48550/arxiv.2311.10735},
  url       = {https://doi.org/10.48550/arxiv.2311.10735}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202411
20251010
202644

Topic and keywords

Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety

  • autonomous vehicles
  • autonomous driving
  • deep reinforcement learning
  • CARLA simulator
  • deep Q-network
  • collision avoidance
  • object detection
  • semantic segmentation

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Nehme, G., & Deo, T. Y. (2023). Safe Navigation: Training Autonomous Vehicles using Deep Reinforcement Learning in CARLA. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2311.10735

How many times has this paper been cited?

15 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

G.H. Nehme, Tejas Y. Deo.

What is the DOI of this paper?

10.48550/arxiv.2311.10735, permanently at https://doi.org/10.48550/arxiv.2311.10735. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.