Conference paper · 2022 · Open access

A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning

Danial Kamran, Thiago D. Simão, Qisong Yang, Canmanie Teresa Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, Martin Lauer

IEEE International Conference on Intelligent Transportation Systems (ITSC), 4017–4023 · Published 8 October 2022 · DOI 10.1109/itsc55140.2022.9921907

Open PDFView at the publisherCite this paper

In brief

“A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning” is a 2022 conference paper by Danial Kamran and 6 co-authors, published in IEEE International Conference on Intelligent Transportation Systems (ITSC). OpenAlex counts 26 citations as of 22 November 2026. It is open access: the full text is free to read at Research Repository (Delft University of Technology).

Citations
26
Most cited in
2025 (11)
Field-weighted impact
3.59
References
33
Authors
7

Abstract

The use of reinforcement learning (RL) in real-world domains often requires extensive effort to ensure safe behavior. While this compromises the autonomy of the system, it might still be too risky to allow a learning agent to freely explore its environment. These strict impositions come at the cost of flexibility and applying them often relies on complex parameters and hard-coded knowledge modelled by the reward function. Autonomous driving is one such domain that could greatly benefit from more efficient and verifiable methods for safe automation. We propose to approach the automated driving problem using constrained RL, a method that automates the trade off between risk and utility, thereby significantly reducing the burden on the designer. We first show that an engineered reward function for ensuring safety and utility in one specific environment might not result in the optimal behavior when traffic dynamics changes in the exact environment. Next we show how algorithms based on constrained RL which are more robust to the environmental disturbances can address this challenge. These algorithms use a simple and easy to interpret reward and cost function, and are able to maintain both, efficiency and safety without requiring reward parameter tuning. We demonstrate our approach in the automated merging scenario with different traffic configurations such as low or high chance of cooperative drivers and different cooperative driving strategies.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Kamran, D., Simão, T. D., Yang, Q., Ponnambalam, C. T., Fischer, J., Spaan, M. T. J., & Lauer, M. (2022). A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning. IEEE International Conference on Intelligent Transportation Systems (ITSC), 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907

MLA 9

Kamran, Danial, et al. “A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning.” IEEE International Conference on Intelligent Transportation Systems (ITSC), 2022, pp. 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907.

Chicago

Kamran, Danial, Thiago D. Simão, Qisong Yang, Canmanie Teresa Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, and Martin Lauer. 2022. “A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning.” IEEE International Conference on Intelligent Transportation Systems (ITSC): 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907.

Harvard

Kamran, D. et al. (2022) ‘A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning’, IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 4017–4023. doi:10.1109/itsc55140.2022.9921907.

IEEE

D. Kamran et al., “A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning,” IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 4017–4023, 2022, doi: 10.1109/itsc55140.2022.9921907.

BibTeX

@inproceedings{kamran2022modern,
  title     = {{A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning}},
  author    = {Kamran, Danial and Simão, Thiago D. and Yang, Qisong and Ponnambalam, Canmanie Teresa and Fischer, Johannes and Spaan, Matthijs T. J. and Lauer, Martin},
  booktitle = {IEEE International Conference on Intelligent Transportation Systems (ITSC)},
  year      = {2022},
  pages     = {4017--4023},
  doi       = {10.1109/itsc55140.2022.9921907},
  url       = {https://doi.org/10.1109/itsc55140.2022.9921907}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
202355
202433
20251111
202666

Its field-weighted citation impact is 3.59: it has been cited 3.59 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety

  • constrained reinforcement learning
  • traffic dynamics
  • reward function design
  • cooperative driving
  • autonomous vehicles

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Kamran, D., Simão, T. D., Yang, Q., Ponnambalam, C. T., Fischer, J., Spaan, M. T. J., & Lauer, M. (2022). A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning. IEEE International Conference on Intelligent Transportation Systems (ITSC), 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907

How many times has this paper been cited?

26 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Research Repository (Delft University of Technology): sign in and open the PDF from this page.

Who wrote this paper?

Danial Kamran, Thiago D. Simão, Qisong Yang, Canmanie Teresa Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, Martin Lauer.

What is the DOI of this paper?

10.1109/itsc55140.2022.9921907, permanently at https://doi.org/10.1109/itsc55140.2022.9921907. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.