Journal article · 2024 · Open access

Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors

Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun

IEEE Transactions on Intelligent Transportation Systems, 26(1), 443–456 · Published 3 December 2024 · DOI 10.1109/tits.2024.3503092

Open PDFView at the publisherCite this paper

In brief

“Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors” is a 2024 journal article by Jiaqi Liu and 4 co-authors, published in IEEE Transactions on Intelligent Transportation Systems. OpenAlex counts 86 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read.

Citations
86
Most cited in
2026 (52)
Field-weighted impact
7.22
References
50
Authors
5

Abstract

The development of autonomous vehicles has shown great potential to enhance the efficiency and safety of transportation systems. However, the decision-making issue in complex human-machine mixed traffic scenarios, such as unsignalized intersections, remains a challenge for autonomous vehicles. While reinforcement learning (RL) has been used to solve complex decision-making problems, existing RL methods still have limitations in dealing with cooperative decision-making of multiple connected autonomous vehicles (CAVs), ensuring safety during exploration, and simulating realistic human driver behaviors. In this paper, a novel and efficient algorithm, Multi-Agent Game-prior Attention Deep Deterministic Policy Gradient (MA-GA-DDPG), is proposed to address these limitations. Our proposed algorithm formulates the decision-making problem of CAVs at unsignalized intersections as a decentralized multi-agent reinforcement learning problem and incorporates an attention mechanism to capture interaction dependencies between ego CAV and other agents. The attention weights between the ego vehicle and other agents are then used to screen interaction objects and obtain prior hierarchical game relations, based on which a safety inspector module is designed to improve the traffic safety. Furthermore, both simulation and hardware-in-the-loop experiments were conducted, demonstrating that our method outperforms other baseline approaches in terms of driving safety, efficiency, and comfort.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Liu, J., Hang, P., Na, X., Huang, C., & Sun, J. (2024). Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors. IEEE Transactions on Intelligent Transportation Systems, 26(1), 443–456. https://doi.org/10.1109/tits.2024.3503092

MLA 9

Liu, Jiaqi, et al. “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors.” IEEE Transactions on Intelligent Transportation Systems, vol. 26, no. 1, 2024, pp. 443–456. https://doi.org/10.1109/tits.2024.3503092.

Chicago

Liu, Jiaqi, Peng Hang, Xiaoxiang Na, Chao Huang, and Jian Sun. 2024. “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors.” IEEE Transactions on Intelligent Transportation Systems 26 (1): 443–456. https://doi.org/10.1109/tits.2024.3503092.

Harvard

Liu, J. et al. (2024) ‘Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors’, IEEE Transactions on Intelligent Transportation Systems, 26(1), pp. 443–456. doi:10.1109/tits.2024.3503092.

IEEE

J. Liu, P. Hang, X. Na, C. Huang, and J. Sun, “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors,” IEEE Transactions on Intelligent Transportation Systems, vol. 26, no. 1, pp. 443–456, 2024, doi: 10.1109/tits.2024.3503092.

BibTeX

@article{liu2024cooperative,
  title     = {{Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors}},
  author    = {Liu, Jiaqi and Hang, Peng and Na, Xiaoxiang and Huang, Chao and Sun, Jian},
  journal   = {IEEE Transactions on Intelligent Transportation Systems},
  year      = {2024},
  volume    = {26},
  number    = {1},
  pages     = {443--456},
  doi       = {10.1109/tits.2024.3503092},
  url       = {https://doi.org/10.1109/tits.2024.3503092}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202311
202455
20252828
20265252

Its field-weighted citation impact is 7.22: it has been cited 7.22 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety

  • connected and autonomous vehicles
  • unsignalized intersections
  • cooperative decision-making
  • multi-agent reinforcement learning
  • attention mechanism
  • deep deterministic policy gradient
  • road safety

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Liu, J., Hang, P., Na, X., Huang, C., & Sun, J. (2024). Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors. IEEE Transactions on Intelligent Transportation Systems, 26(1), 443–456. https://doi.org/10.1109/tits.2024.3503092

How many times has this paper been cited?

86 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: sign in and open the PDF from this page.

Who wrote this paper?

Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun.

What is the DOI of this paper?

10.1109/tits.2024.3503092, permanently at https://doi.org/10.1109/tits.2024.3503092. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.