Journal article · 2022 · Open access

Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach

Xiangkun He, Baichuan Lou, Haohan Yang, Chen Lv

IEEE Transactions on Intelligent Transportation Systems, 24(4), 4103–4113 · Published 20 December 2022 · DOI 10.1109/tits.2022.3229518

Open PDFView at the publisherCite this paper

In brief

“Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach” is a 2022 journal article by Xiangkun He and 3 co-authors, published in IEEE Transactions on Intelligent Transportation Systems. OpenAlex counts 135 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read.

Citations
135
Most cited in
2025 (44)
Field-weighted impact
6.61
References
49
Authors
4

Abstract

Reinforcement learning has demonstrated its potential in a series of challenging domains. However, many real-world decision making tasks involve unpredictable environmental changes or unavoidable perception errors that are often enough to mislead an agent into making suboptimal decisions and even cause catastrophic failures. In light of these potential risks, reinforcement learning with application in safety-critical autonomous driving domain remains tricky without ensuring robustness against environmental uncertainties (e.g., road adhesion changes or measurement noises). Therefore, this paper proposes a novel constrained adversarial reinforcement learning approach for robust decision making of autonomous vehicles at highway on-ramps. Environmental disturbance is modelled as an adversarial agent that can learn an optimal adversarial policy to thwart the autonomous driving agent. Meanwhile, observation perturbation is approximated to maximize the variation of the perturbed policy through a white-box adversarial attack technique. Furthermore, a constrained adversarial actor-critic algorithm is presented to optimize an on-ramp merging policy while keeping the variations of the attacked driving policy and action-value function within bounds. Finally, the proposed robust highway on-ramp merging decision making method of autonomous vehicles is evaluated in three stochastic mixed traffic flows with different densities, and its effectiveness is demonstrated in comparison with the competitive baselines.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

He, X., Lou, B., Yang, H., & Lv, C. (2022). Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4103–4113. https://doi.org/10.1109/tits.2022.3229518

MLA 9

He, Xiangkun, et al. “Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach.” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 4, 2022, pp. 4103–4113. https://doi.org/10.1109/tits.2022.3229518.

Chicago

He, Xiangkun, Baichuan Lou, Haohan Yang, and Chen Lv. 2022. “Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach.” IEEE Transactions on Intelligent Transportation Systems 24 (4): 4103–4113. https://doi.org/10.1109/tits.2022.3229518.

Harvard

He, X. et al. (2022) ‘Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach’, IEEE Transactions on Intelligent Transportation Systems, 24(4), pp. 4103–4113. doi:10.1109/tits.2022.3229518.

IEEE

X. He, B. Lou, H. Yang, and C. Lv, “Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 4, pp. 4103–4113, 2022, doi: 10.1109/tits.2022.3229518.

BibTeX

@article{he2022robust,
  title     = {{Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach}},
  author    = {He, Xiangkun and Lou, Baichuan and Yang, Haohan and Lv, Chen},
  journal   = {IEEE Transactions on Intelligent Transportation Systems},
  year      = {2022},
  volume    = {24},
  number    = {4},
  pages     = {4103--4113},
  doi       = {10.1109/tits.2022.3229518},
  url       = {https://doi.org/10.1109/tits.2022.3229518}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
20232222
20243333
20254444
20263535

Its field-weighted citation impact is 6.61: it has been cited 6.61 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety

  • autonomous vehicles
  • on-ramp merging
  • robust decision making
  • adversarial reinforcement learning
  • environmental uncertainty
  • mixed traffic

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

He, X., Lou, B., Yang, H., & Lv, C. (2022). Robust Decision Making for Autonomous Vehicles at Highway On-Ramps: A Constrained Adversarial Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4103–4113. https://doi.org/10.1109/tits.2022.3229518

How many times has this paper been cited?

135 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: sign in and open the PDF from this page.

Who wrote this paper?

Xiangkun He, Baichuan Lou, Haohan Yang, Chen Lv.

What is the DOI of this paper?

10.1109/tits.2022.3229518, permanently at https://doi.org/10.1109/tits.2022.3229518. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.