Conference paper · 2020 · Open access
Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization
IEEE International Conference on Intelligent Transportation Systems (ITSC), 1–7 · Published 20 September 2020 · DOI 10.1109/itsc45102.2020.9294262
In brief
“Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization” is a 2020 conference paper by Lu Wen and 4 co-authors, published in IEEE International Conference on Intelligent Transportation Systems (ITSC). OpenAlex counts 114 citations as of 22 November 2026, which puts it in the top 7% of works published in 2020 by citations. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 114
- Most cited in
- 2025 (28)
- Field-weighted impact
- 3.20
- References
- 27
- Authors
- 5
Abstract
Reinforcement learning (RL) is attracting increasing interests in autonomous driving due to its potential to solve complex classification and control problems. However, existing RL algorithms are rarely applied to real vehicles for two predominant problems: behaviors are unexplainable, and they cannot guarantee safety under new scenarios. This paper presents a safe RL algorithm, called Parallel Constrained Policy Optimization (PCPO), for two autonomous driving tasks. PCPO extends today’s common actor-critic architecture to a three-component learning framework, in which three neural networks are used to approximate the policy function, value function and a newly added risk function, respectively. Meanwhile, a trust region constraint is added to allow large update steps without breaking the monotonic improvement condition. To ensure the feasibility of safety constrained problems, synchronized parallel learners are employed to explore different state spaces, which accelerates learning and policy-update. The simulations of two scenarios for autonomous vehicles confirm we can ensure safety while achieving fast learning.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Wen, L., Duan, J., Li, S. E., Xu, S., & Peng, H. (2020). Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization. IEEE International Conference on Intelligent Transportation Systems (ITSC), 1–7. https://doi.org/10.1109/itsc45102.2020.9294262
MLA 9
Wen, Lu, et al. “Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization.” IEEE International Conference on Intelligent Transportation Systems (ITSC), 2020, pp. 1–7. https://doi.org/10.1109/itsc45102.2020.9294262.
Chicago
Wen, Lu, Jingliang Duan, Shengbo Eben Li, Shaobing Xu, and Huei Peng. 2020. “Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization.” IEEE International Conference on Intelligent Transportation Systems (ITSC): 1–7. https://doi.org/10.1109/itsc45102.2020.9294262.
Harvard
Wen, L. et al. (2020) ‘Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization’, IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 1–7. doi:10.1109/itsc45102.2020.9294262.
IEEE
L. Wen, J. Duan, S. E. Li, S. Xu, and H. Peng, “Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization,” IEEE International Conference on Intelligent Transportation Systems (ITSC), pp. 1–7, 2020, doi: 10.1109/itsc45102.2020.9294262.
BibTeX
@inproceedings{wen2020safe,
title = {{Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization}},
author = {Wen, Lu and Duan, Jingliang and Li, Shengbo Eben and Xu, Shaobing and Peng, Huei},
booktitle = {IEEE International Conference on Intelligent Transportation Systems (ITSC)},
year = {2020},
pages = {1--7},
doi = {10.1109/itsc45102.2020.9294262},
url = {https://doi.org/10.1109/itsc45102.2020.9294262}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 2 | |
| 2021 | 13 | |
| 2022 | 15 | |
| 2023 | 18 | |
| 2024 | 23 | |
| 2025 | 28 | |
| 2026 | 15 |
Its field-weighted citation impact is 3.20: it has been cited 3.20 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- safe reinforcement learning
- autonomous driving
- risk function
- actor-critic architecture
- autonomous vehicle control
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Wen, L., Duan, J., Li, S. E., Xu, S., & Peng, H. (2020). Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization. IEEE International Conference on Intelligent Transportation Systems (ITSC), 1–7. https://doi.org/10.1109/itsc45102.2020.9294262
How many times has this paper been cited?
114 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Lu Wen, Jingliang Duan, Shengbo Eben Li, Shaobing Xu, Huei Peng.
What is the DOI of this paper?
10.1109/itsc45102.2020.9294262, permanently at https://doi.org/10.1109/itsc45102.2020.9294262. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.