Journal article · 2024 · Open access
Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors
IEEE Transactions on Intelligent Transportation Systems, 26(1), 443–456 · Published 3 December 2024 · DOI 10.1109/tits.2024.3503092
In brief
“Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors” is a 2024 journal article by Jiaqi Liu and 4 co-authors, published in IEEE Transactions on Intelligent Transportation Systems. OpenAlex counts 86 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read.
- Citations
- 86
- Most cited in
- 2026 (52)
- Field-weighted impact
- 7.22
- References
- 50
- Authors
- 5
Abstract
The development of autonomous vehicles has shown great potential to enhance the efficiency and safety of transportation systems. However, the decision-making issue in complex human-machine mixed traffic scenarios, such as unsignalized intersections, remains a challenge for autonomous vehicles. While reinforcement learning (RL) has been used to solve complex decision-making problems, existing RL methods still have limitations in dealing with cooperative decision-making of multiple connected autonomous vehicles (CAVs), ensuring safety during exploration, and simulating realistic human driver behaviors. In this paper, a novel and efficient algorithm, Multi-Agent Game-prior Attention Deep Deterministic Policy Gradient (MA-GA-DDPG), is proposed to address these limitations. Our proposed algorithm formulates the decision-making problem of CAVs at unsignalized intersections as a decentralized multi-agent reinforcement learning problem and incorporates an attention mechanism to capture interaction dependencies between ego CAV and other agents. The attention weights between the ego vehicle and other agents are then used to screen interaction objects and obtain prior hierarchical game relations, based on which a safety inspector module is designed to improve the traffic safety. Furthermore, both simulation and hardware-in-the-loop experiments were conducted, demonstrating that our method outperforms other baseline approaches in terms of driving safety, efficiency, and comfort.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Liu, J., Hang, P., Na, X., Huang, C., & Sun, J. (2024). Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors. IEEE Transactions on Intelligent Transportation Systems, 26(1), 443–456. https://doi.org/10.1109/tits.2024.3503092
MLA 9
Liu, Jiaqi, et al. “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors.” IEEE Transactions on Intelligent Transportation Systems, vol. 26, no. 1, 2024, pp. 443–456. https://doi.org/10.1109/tits.2024.3503092.
Chicago
Liu, Jiaqi, Peng Hang, Xiaoxiang Na, Chao Huang, and Jian Sun. 2024. “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors.” IEEE Transactions on Intelligent Transportation Systems 26 (1): 443–456. https://doi.org/10.1109/tits.2024.3503092.
Harvard
Liu, J. et al. (2024) ‘Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors’, IEEE Transactions on Intelligent Transportation Systems, 26(1), pp. 443–456. doi:10.1109/tits.2024.3503092.
IEEE
J. Liu, P. Hang, X. Na, C. Huang, and J. Sun, “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors,” IEEE Transactions on Intelligent Transportation Systems, vol. 26, no. 1, pp. 443–456, 2024, doi: 10.1109/tits.2024.3503092.
BibTeX
@article{liu2024cooperative,
title = {{Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors}},
author = {Liu, Jiaqi and Hang, Peng and Na, Xiaoxiang and Huang, Chao and Sun, Jian},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2024},
volume = {26},
number = {1},
pages = {443--456},
doi = {10.1109/tits.2024.3503092},
url = {https://doi.org/10.1109/tits.2024.3503092}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2023 | 1 | |
| 2024 | 5 | |
| 2025 | 28 | |
| 2026 | 52 |
Its field-weighted citation impact is 7.22: it has been cited 7.22 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- connected and autonomous vehicles
- unsignalized intersections
- cooperative decision-making
- multi-agent reinforcement learning
- attention mechanism
- deep deterministic policy gradient
- road safety
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
Liu, J., Hang, P., Na, X., Huang, C., & Sun, J. (2024). Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach With Attention and Hierarchical Game Priors. IEEE Transactions on Intelligent Transportation Systems, 26(1), 443–456. https://doi.org/10.1109/tits.2024.3503092
How many times has this paper been cited?
86 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: sign in and open the PDF from this page.
Who wrote this paper?
Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun.
What is the DOI of this paper?
10.1109/tits.2024.3503092, permanently at https://doi.org/10.1109/tits.2024.3503092. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.