Journal article · 2022 · Open access
Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach
IEEE Transactions on Intelligent Transportation Systems, 24(4), 4103–4113 · Published 20 December 2022 · DOI 10.1109/tits.2022.3229518
In brief
“Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach” is a 2022 journal article by Xiangkun He and 3 co-authors, published in IEEE Transactions on Intelligent Transportation Systems. OpenAlex counts 135 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read.
- Citations
- 135
- Most cited in
- 2025 (44)
- Field-weighted impact
- 6.61
- References
- 49
- Authors
- 4
Abstract
Reinforcement learning has demonstrated its potential in a series of challenging domains. However, many real-world decision making tasks involve unpredictable environmental changes or unavoidable perception errors that are often enough to mislead an agent into making suboptimal decisions and even cause catastrophic failures. In light of these potential risks, reinforcement learning with application in safety-critical autonomous driving domain remains tricky without ensuring robustness against environmental uncertainties (e.g., road adhesion changes or measurement noises). Therefore, this paper proposes a novel constrained adversarial reinforcement learning approach for robust decision making of autonomous vehicles at highway on-ramps. Environmental disturbance is modelled as an adversarial agent that can learn an optimal adversarial policy to thwart the autonomous driving agent. Meanwhile, observation perturbation is approximated to maximize the variation of the perturbed policy through a white-box adversarial attack technique. Furthermore, a constrained adversarial actor-critic algorithm is presented to optimize an on-ramp merging policy while keeping the variations of the attacked driving policy and action-value function within bounds. Finally, the proposed robust highway on-ramp merging decision making method of autonomous vehicles is evaluated in three stochastic mixed traffic flows with different densities, and its effectiveness is demonstrated in comparison with the competitive baselines.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
He, X., Lou, B., Yang, H., & Lv, C. (2022). Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4103–4113. https://doi.org/10.1109/tits.2022.3229518
MLA 9
He, Xiangkun, et al. “Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach.” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 4, 2022, pp. 4103–4113. https://doi.org/10.1109/tits.2022.3229518.
Chicago
He, Xiangkun, Baichuan Lou, Haohan Yang, and Chen Lv. 2022. “Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach.” IEEE Transactions on Intelligent Transportation Systems 24 (4): 4103–4113. https://doi.org/10.1109/tits.2022.3229518.
Harvard
He, X. et al. (2022) ‘Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach’, IEEE Transactions on Intelligent Transportation Systems, 24(4), pp. 4103–4113. doi:10.1109/tits.2022.3229518.
IEEE
X. He, B. Lou, H. Yang, and C. Lv, “Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 4, pp. 4103–4113, 2022, doi: 10.1109/tits.2022.3229518.
BibTeX
@article{he2022robust,
title = {{Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach}},
author = {He, Xiangkun and Lou, Baichuan and Yang, Haohan and Lv, Chen},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2022},
volume = {24},
number = {4},
pages = {4103--4113},
doi = {10.1109/tits.2022.3229518},
url = {https://doi.org/10.1109/tits.2022.3229518}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 1 | |
| 2023 | 22 | |
| 2024 | 33 | |
| 2025 | 44 | |
| 2026 | 35 |
Its field-weighted citation impact is 6.61: it has been cited 6.61 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- autonomous vehicles
- on-ramp merging
- robust decision making
- adversarial reinforcement learning
- environmental uncertainty
- mixed traffic
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
He, X., Lou, B., Yang, H., & Lv, C. (2022). Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4103–4113. https://doi.org/10.1109/tits.2022.3229518
How many times has this paper been cited?
135 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: sign in and open the PDF from this page.
Who wrote this paper?
Xiangkun He, Baichuan Lou, Haohan Yang, Chen Lv.
What is the DOI of this paper?
10.1109/tits.2022.3229518, permanently at https://doi.org/10.1109/tits.2022.3229518. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.