Conference paper · 2025 · Open access
Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios
IEEE Intelligent Vehicles Symposium, 1964–1970 · Published 22 June 2025 · DOI 10.1109/iv64158.2025.11097749
In brief
“Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios” is a 2025 conference paper by Feihong Zhang and 5 co-authors, published in IEEE Intelligent Vehicles Symposium. OpenAlex counts 0 citations as of 22 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 0
- References
- 20
- Authors
- 6
Abstract
Reinforcement learning (RL), known for its self-evolution capability, offers a promising approach to training high-level autonomous driving systems. However, handling constraints remains a significant challenge for existing RL algorithms, particularly in real-world applications. In this paper, we propose a new safety-oriented training technique called harmonic policy iteration (HPI). At each RL iteration, it first calculates two policy gradients associated with efficient driving and safety constraints, respectively. Then, a harmonic gradient is derived for policy updating, minimizing conflicts between the two gradients and consequently enabling a more balanced and stable training process. Furthermore, we adopt the state-of-the-art DSAC algorithm as the backbone and integrate it with our HPI to develop a new safe RL algorithm, DSAC-H. Extensive simulations in multi-lane scenarios demonstrate that DSAC-H achieves efficient driving performance with near-zero safety constraint violations.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zhang, F., Zhan, G., Shuai, B., Zhang, T., Duan, J., & Li, S. E. (2025). Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios. IEEE Intelligent Vehicles Symposium, 1964–1970. https://doi.org/10.1109/iv64158.2025.11097749
MLA 9
Zhang, Feihong, et al. “Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios.” IEEE Intelligent Vehicles Symposium, 2025, pp. 1964–1970. https://doi.org/10.1109/iv64158.2025.11097749.
Chicago
Zhang, Feihong, Guojian Zhan, Bin Shuai, Tianyi Zhang, Jingliang Duan, and Shengbo Eben Li. 2025. “Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios.” IEEE Intelligent Vehicles Symposium: 1964–1970. https://doi.org/10.1109/iv64158.2025.11097749.
Harvard
Zhang, F. et al. (2025) ‘Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios’, IEEE Intelligent Vehicles Symposium, pp. 1964–1970. doi:10.1109/iv64158.2025.11097749.
IEEE
F. Zhang, G. Zhan, B. Shuai, T. Zhang, J. Duan, and S. E. Li, “Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios,” IEEE Intelligent Vehicles Symposium, pp. 1964–1970, 2025, doi: 10.1109/iv64158.2025.11097749.
BibTeX
@inproceedings{zhang2025distributional,
title = {{Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios}},
author = {Zhang, Feihong and Zhan, Guojian and Shuai, Bin and Zhang, Tianyi and Duan, Jingliang and Li, Shengbo Eben},
booktitle = {IEEE Intelligent Vehicles Symposium},
year = {2025},
pages = {1964--1970},
doi = {10.1109/iv64158.2025.11097749},
url = {https://doi.org/10.1109/iv64158.2025.11097749}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- autonomous driving
- safety constraints
- policy gradient
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Zhang, F., Zhan, G., Shuai, B., Zhang, T., Duan, J., & Li, S. E. (2025). Distributional Soft Actor-Critic with Harmonic Gradient for Safe and Efficient Autonomous Driving in Multi-Lane Scenarios. IEEE Intelligent Vehicles Symposium, 1964–1970. https://doi.org/10.1109/iv64158.2025.11097749
How many times has this paper been cited?
0 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Feihong Zhang, Guojian Zhan, Bin Shuai, Tianyi Zhang, Jingliang Duan, Shengbo Eben Li.
What is the DOI of this paper?
10.1109/iv64158.2025.11097749, permanently at https://doi.org/10.1109/iv64158.2025.11097749. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.