Conference paper · 2022 · Open access
A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning
IEEE International Conference on Intelligent Transportation Systems (ITSC), 4017–4023 · Published 8 October 2022 · DOI 10.1109/itsc55140.2022.9921907
In brief
“A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning” is a 2022 conference paper by Danial Kamran and 6 co-authors, published in IEEE International Conference on Intelligent Transportation Systems (ITSC). OpenAlex counts 26 citations as of 22 November 2026. It is open access: the full text is free to read at Research Repository (Delft University of Technology).
- Citations
- 26
- Most cited in
- 2025 (11)
- Field-weighted impact
- 3.59
- References
- 33
- Authors
- 7
Abstract
The use of reinforcement learning (RL) in real-world domains often requires extensive effort to ensure safe behavior. While this compromises the autonomy of the system, it might still be too risky to allow a learning agent to freely explore its environment. These strict impositions come at the cost of flexibility and applying them often relies on complex parameters and hard-coded knowledge modelled by the reward function. Autonomous driving is one such domain that could greatly benefit from more efficient and verifiable methods for safe automation. We propose to approach the automated driving problem using constrained RL, a method that automates the trade off between risk and utility, thereby significantly reducing the burden on the designer. We first show that an engineered reward function for ensuring safety and utility in one specific environment might not result in the optimal behavior when traffic dynamics changes in the exact environment. Next we show how algorithms based on constrained RL which are more robust to the environmental disturbances can address this challenge. These algorithms use a simple and easy to interpret reward and cost function, and are able to maintain both, efficiency and safety without requiring reward parameter tuning. We demonstrate our approach in the automated merging scenario with different traffic configurations such as low or high chance of cooperative drivers and different cooperative driving strategies.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Kamran, D., Simão, T. D., Yang, Q., Ponnambalam, C. T., Fischer, J., Spaan, M. T. J., & Lauer, M. (2022). A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning. IEEE International Conference on Intelligent Transportation Systems (ITSC), 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907
MLA 9
Kamran, Danial, et al. “A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning.” IEEE International Conference on Intelligent Transportation Systems (ITSC), 2022, pp. 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907.
Chicago
Kamran, Danial, Thiago D. Simão, Qisong Yang, Canmanie Teresa Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, and Martin Lauer. 2022. “A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning.” IEEE International Conference on Intelligent Transportation Systems (ITSC): 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907.
Harvard
Kamran, D. et al. (2022) ‘A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning’, IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 4017–4023. doi:10.1109/itsc55140.2022.9921907.
IEEE
D. Kamran et al., “A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning,” IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 4017–4023, 2022, doi: 10.1109/itsc55140.2022.9921907.
BibTeX
@inproceedings{kamran2022modern,
title = {{A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning}},
author = {Kamran, Danial and Simão, Thiago D. and Yang, Qisong and Ponnambalam, Canmanie Teresa and Fischer, Johannes and Spaan, Matthijs T. J. and Lauer, Martin},
booktitle = {IEEE International Conference on Intelligent Transportation Systems (ITSC)},
year = {2022},
pages = {4017--4023},
doi = {10.1109/itsc55140.2022.9921907},
url = {https://doi.org/10.1109/itsc55140.2022.9921907}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2023 | 5 | |
| 2024 | 3 | |
| 2025 | 11 | |
| 2026 | 6 |
Its field-weighted citation impact is 3.59: it has been cited 3.59 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- constrained reinforcement learning
- traffic dynamics
- reward function design
- cooperative driving
- autonomous vehicles
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
Kamran, D., Simão, T. D., Yang, Q., Ponnambalam, C. T., Fischer, J., Spaan, M. T. J., & Lauer, M. (2022). A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning. IEEE International Conference on Intelligent Transportation Systems (ITSC), 4017–4023. https://doi.org/10.1109/itsc55140.2022.9921907
How many times has this paper been cited?
26 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Research Repository (Delft University of Technology): sign in and open the PDF from this page.
Who wrote this paper?
Danial Kamran, Thiago D. Simão, Qisong Yang, Canmanie Teresa Ponnambalam, Johannes Fischer, Matthijs T. J. Spaan, Martin Lauer.
What is the DOI of this paper?
10.1109/itsc55140.2022.9921907, permanently at https://doi.org/10.1109/itsc55140.2022.9921907. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.