Preprint · 2023 · Open access

Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors

Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun

TechRxiv · Published 17 May 2023 · DOI 10.36227/techrxiv.22817417

Open PDFView at the publisherCite this paper

In brief

“Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors” is a 2023 preprint by Jiaqi Liu and 4 co-authors, published in TechRxiv. OpenAlex counts 11 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read.

Citations
11
Most cited in
2025 (6)
References
41
Authors
5

Abstract

The development of autonomous vehicles has shown great potential to enhance the efficiency and safety of transportation systems. However, the decision-making issue in complex human-machine mixed traffic scenarios, such as unsignalized intersections, remains a challenge for autonomous vehicles. While reinforcement learning (RL) has been used to solve complex decision-making problems, existing RL methods still have limitations in dealing with cooperative decision-making of multiple connected autonomous vehicles (CAVs), ensuring safety during exploration, and simulating realistic human driver behaviors. In this paper, a novel and efficient algorithm, Multi-Agent Game-prior Attention Deep Deterministic Policy Gradient (MA-GA-DDPG), is proposed to address these limitations. Our proposed algorithm formulates the decision-making problem of CAVs at unsignalized intersections as a decentralized multi-agent reinforcement learning problem and incorporates an attention mechanism to capture interaction dependencies between ego CAV and other agents. The attention weights between the ego vehicle and other agents are then used to screen interaction objects and obtain prior hierarchical game relations, based on which a safety inspector module is designed to improve the traffic safety. Moreover, we consider the heterogeneity of human drivers in traffic environments and conduct a series of comprehensive experiments. The proposed approach shows better performance in terms of driving safety, efficiency and comfort than conventional RL algorithms.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Liu, J., Hang, P., Na, X., Huang, C., & Sun, J. (2023). Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors. TechRxiv. https://doi.org/10.36227/techrxiv.22817417

MLA 9

Liu, Jiaqi, et al. “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors.” TechRxiv, 2023. https://doi.org/10.36227/techrxiv.22817417.

Chicago

Liu, Jiaqi, Peng Hang, Xiaoxiang Na, Chao Huang, and Jian Sun. 2023. “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors.” TechRxiv. https://doi.org/10.36227/techrxiv.22817417.

Harvard

Liu, J. et al. (2023) ‘Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors’, TechRxiv. doi:10.36227/techrxiv.22817417.

IEEE

J. Liu, P. Hang, X. Na, C. Huang, and J. Sun, “Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors,” TechRxiv, 2023, doi: 10.36227/techrxiv.22817417.

BibTeX

@misc{liu2023cooperative,
  title     = {{Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors}},
  author    = {Liu, Jiaqi and Hang, Peng and Na, Xiaoxiang and Huang, Chao and Sun, Jian},
  howpublished = {TechRxiv},
  year      = {2023},
  doi       = {10.36227/techrxiv.22817417},
  url       = {https://doi.org/10.36227/techrxiv.22817417}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202444
202566
202611

Topic and keywords

Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety

  • connected and autonomous vehicles
  • unsignalized intersections
  • cooperative decision-making
  • multi-agent reinforcement learning
  • attention mechanism
  • deep deterministic policy gradient
  • road safety

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Liu, J., Hang, P., Na, X., Huang, C., & Sun, J. (2023). Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priors. TechRxiv. https://doi.org/10.36227/techrxiv.22817417

How many times has this paper been cited?

11 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: sign in and open the PDF from this page.

Who wrote this paper?

Jiaqi Liu, Peng Hang, Xiaoxiang Na, Chao Huang, Jian Sun.

What is the DOI of this paper?

10.36227/techrxiv.22817417, permanently at https://doi.org/10.36227/techrxiv.22817417. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.