Journal article · 2024 · Open access

An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle

Liping Zhao, Feng Li, Dongye Sun, Zihan Zhao

International Journal of Computers Communications & Control, 19(3) · Published 4 May 2024 · DOI 10.15837/ijccc.2024.3.5382

Open PDFView at the publisherCite this paper

In brief

“An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle” is a 2024 journal article by Liping Zhao and 3 co-authors, published in International Journal of Computers Communications & Control. OpenAlex counts 23 citations as of 22 November 2026. It is open access under a CC BY-NC licence: the full text is free to read at International Journal of Computers Communications & Control.

Citations
23
Most cited in
2025 (13)
Field-weighted impact
2.51
References
30
Authors
4

Abstract

In view of the problems existing in the path planning algorithms of unmanned vehicles, such as low search efficiency, slow convergence speed and easy to fall into the local optimal. Based on the characteristics of route planning for unmanned vehicles, this paper introduces Q-Learning into the traditional ant colony algorithm to enhance the learning ability of the algorithm in dynamic environment, so as to improve the overall efficiency of route search. By mapping pheromones into Q values in Q-learning, rapid search in complex environments is realized, and a collection-free path satisfying constraints is quickly found. The results of case analysis show that compared with the traditional ant colony algorithm and the improved ant colony algorithm considering reward and punishment factors, the improved ant colony algorithm based on Q-Learning can effectively reduce the number of iterations, shorten the path optimization time and path length and other performance indicators, and has many advantages in jumping out of the local optimal, improving the global search ability and improving the convergence speed, and has good adaptability and robustness in complex environments. It ensures the safety and stability of unmanned vehicles in complex environments.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zhao, L., Li, F., Sun, D., & Zhao, Z. (2024). An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle. International Journal of Computers Communications & Control, 19(3). https://doi.org/10.15837/ijccc.2024.3.5382

MLA 9

Zhao, Liping, et al. “An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle.” International Journal of Computers Communications & Control, vol. 19, no. 3, 2024. https://doi.org/10.15837/ijccc.2024.3.5382.

Chicago

Zhao, Liping, Feng Li, Dongye Sun, and Zihan Zhao. 2024. “An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle.” International Journal of Computers Communications & Control 19 (3). https://doi.org/10.15837/ijccc.2024.3.5382.

Harvard

Zhao, L. et al. (2024) ‘An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle’, International Journal of Computers Communications & Control, 19(3). doi:10.15837/ijccc.2024.3.5382.

IEEE

L. Zhao, F. Li, D. Sun, and Z. Zhao, “An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle,” International Journal of Computers Communications & Control, vol. 19, no. 3, 2024, doi: 10.15837/ijccc.2024.3.5382.

BibTeX

@article{zhao2024improved,
  title     = {{An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle}},
  author    = {Zhao, Liping and Li, Feng and Sun, Dongye and Zhao, Zihan},
  journal   = {International Journal of Computers Communications \& Control},
  year      = {2024},
  volume    = {19},
  number    = {3},
  doi       = {10.15837/ijccc.2024.3.5382},
  url       = {https://doi.org/10.15837/ijccc.2024.3.5382}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202411
20251313
202699

Its field-weighted citation impact is 2.51: it has been cited 2.51 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms

  • ant colony optimization
  • Q-learning
  • route planning
  • autonomous vehicles
  • unmanned vehicles
  • path planning
  • local optima avoidance
  • convergence rate

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Zhao, L., Li, F., Sun, D., & Zhao, Z. (2024). An improved ant colony algorithm based on Q-Learning for route planning of autonomous vehicle. International Journal of Computers Communications & Control, 19(3). https://doi.org/10.15837/ijccc.2024.3.5382

How many times has this paper been cited?

23 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at International Journal of Computers Communications & Control: sign in and open the PDF from this page.

Who wrote this paper?

Liping Zhao, Feng Li, Dongye Sun, Zihan Zhao.

What is the DOI of this paper?

10.15837/ijccc.2024.3.5382, permanently at https://doi.org/10.15837/ijccc.2024.3.5382. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.