Journal article · 2024 · Open access

Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making

Fei Gao, Xiaodong Wang, Yuze Fan, Zhenhai Gao, Rui Zhao

IEEE Access, 12, 128007–128023 · Published 1 January 2024 · DOI 10.1109/access.2024.3454249

Open full textCite this paper

In brief

“Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making” is a 2024 journal article by Fei Gao and 4 co-authors, published in IEEE Access. OpenAlex counts 36 citations as of 22 November 2026, which puts it in the top 3% of works published in 2024 by citations. It is open access under a CC BY-NC-ND licence: the full text is free to read at IEEE Access.

Citations
36
Most cited in
2026 (30)
Field-weighted impact
2.88
References
30
Authors
5

Abstract

Although reinforcement learning (RL) methodologies exhibit potential in addressing decision-making and planning problems in autonomous driving, ensuring the safety of the vehicle under all circumstances remains a formidable challenge in practical applications. Current RL methods are predominantly driven by singular reward mechanisms, frequently encountering difficulties in balancing multiple sub-rewards such as safety, comfort, and efficiency. To address these limitations, this paper introduces a constraint-driven safety RL method, applied to decision-making and planning policy in highway scenarios. This method ensures decisions maximize performance rewards within the bounds of safety constraints, exhibiting exceptional robustness. Initially, the framework reformulates the autonomous driving decision-making problem as a Constrained Markov Decision Process (CMDP) within the safety RL framework. It then introduces a Multi-Level Safety-Constrained Policy Optimization (MLSCPO) method, incorporating a cost function to address safety constraints. Ultimately, simulated tests conducted within the CARLA environment demonstrate that the proposed method MLSCPO outperforms the current advanced safe reinforcement learning policy, Proximal Policy Optimization with Lagrangian (PPO-Lag) and the traditional stable longitudinal and lateral autonomous driving model, Intelligent Driver Model with Minimization of Overall Braking Induced by Lane Changes (IDM+MOBIL). Compared to the classic IDM+MOBIL method, the proposed approach not only achieves efficient driving but also offers a better driving experience. In comparison with the reinforcement learning method PPO-Lag, it significantly enhances safety while ensuring driving efficiency, achieving a zero-collision rate. In the future, we will integrate the aforementioned potential expansion plans to enhance the usability and generalization capabilities of the method in real-world applications.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Gao, F., Wang, X., Fan, Y., Gao, Z., & Zhao, R. (2024). Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making. IEEE Access, 12, 128007–128023. https://doi.org/10.1109/access.2024.3454249

MLA 9

Gao, Fei, et al. “Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making.” IEEE Access, vol. 12, 2024, pp. 128007–128023. https://doi.org/10.1109/access.2024.3454249.

Chicago

Gao, Fei, Xiaodong Wang, Yuze Fan, Zhenhai Gao, and Rui Zhao. 2024. “Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making.” IEEE Access 12: 128007–128023. https://doi.org/10.1109/access.2024.3454249.

Harvard

Gao, F. et al. (2024) ‘Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making’, IEEE Access, 12, pp. 128007–128023. doi:10.1109/access.2024.3454249.

IEEE

F. Gao, X. Wang, Y. Fan, Z. Gao, and R. Zhao, “Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making,” IEEE Access, vol. 12, pp. 128007–128023, 2024, doi: 10.1109/access.2024.3454249.

BibTeX

@article{gao2024constraints,
  title     = {{Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making}},
  author    = {Gao, Fei and Wang, Xiaodong and Fan, Yuze and Gao, Zhenhai and Zhao, Rui},
  journal   = {IEEE Access},
  year      = {2024},
  volume    = {12},
  pages     = {128007--128023},
  doi       = {10.1109/access.2024.3454249},
  url       = {https://doi.org/10.1109/access.2024.3454249}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics

  • safe reinforcement learning
  • autonomous driving decision-making
  • constrained Markov decision process
  • safety constraints
  • highway driving
  • longitudinal and lateral control
  • Intelligent Driver Model
  • collision avoidance

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Gao, F., Wang, X., Fan, Y., Gao, Z., & Zhao, R. (2024). Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making. IEEE Access, 12, 128007–128023. https://doi.org/10.1109/access.2024.3454249

How many times has this paper been cited?

36 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at IEEE Access: sign in and open the full text from this page.

Who wrote this paper?

Fei Gao, Xiaodong Wang, Yuze Fan, Zhenhai Gao, Rui Zhao.

What is the DOI of this paper?

10.1109/access.2024.3454249, permanently at https://doi.org/10.1109/access.2024.3454249. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.