Conference paper · 2020

Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning

George P. Kontoudis, Zirui Xu, Kyriakos G. Vamvoudakis

Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 3873–3878 · Published 1 July 2020 · DOI 10.23919/acc45564.2020.9148047

View at the publisherCite this paper

In brief

“Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning” is a 2020 conference paper by George P. Kontoudis and 2 co-authors, published in Proceedings of the ... American Control Conference/Proceedings of the American Control Conference. OpenAlex counts 9 citations as of 22 November 2026, which puts it in the top 8% of works published in 2020 by citations. The publisher's version is not open access, and OpenAlex records no free legal copy.

Citations
9
Most cited in
2021 (4)
Field-weighted impact
2.11
References
23
Authors
3

Abstract

This paper presents an online kinodynamic motion planning scheme for dynamically evolving environments, by employing Q-learning. The methodology addresses the finite horizon continuous-time optimal control problem with completely unknown system dynamics. An actor-critic structure is employed along with a buffer of previous experiences, to approximate the optimal policy and alleviate the learning signal requirements. The… Read the full abstract at the publisher.

Excerpt. This paper is not open access.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Kontoudis, G. P., Xu, Z., & Vamvoudakis, K. G. (2020). Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning. Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047

MLA 9

Kontoudis, George P., et al. “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning.” Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 2020, pp. 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047.

Chicago

Kontoudis, George P., Zirui Xu, and Kyriakos G. Vamvoudakis. 2020. “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning.” Proceedings of the ... American Control Conference/Proceedings of the American Control Conference: 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047.

Harvard

Kontoudis, G. P., Xu, Z. and Vamvoudakis, K. G. (2020) ‘Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning’, Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, pp. 3873–3878. doi:10.23919/acc45564.2020.9148047.

IEEE

G. P. Kontoudis, Z. Xu, and K. G. Vamvoudakis, “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning,” Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, pp. 3873–3878, 2020, doi: 10.23919/acc45564.2020.9148047.

BibTeX

@inproceedings{kontoudis2020online,
  title     = {{Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning}},
  author    = {Kontoudis, George P. and Xu, Zirui and Vamvoudakis, Kyriakos G.},
  booktitle = {Proceedings of the ... American Control Conference/Proceedings of the American Control Conference},
  year      = {2020},
  pages     = {3873--3878},
  doi       = {10.23919/acc45564.2020.9148047},
  url       = {https://doi.org/10.23919/acc45564.2020.9148047}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202144
202333
202422

Its field-weighted citation impact is 2.11: it has been cited 2.11 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control

  • kinodynamic motion planning
  • online motion planning
  • dynamic environments
  • Q-learning
  • continuous-time optimal control
  • model-free reinforcement learning
  • actor-critic
  • finite horizon control

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Kontoudis, G. P., Xu, Z., & Vamvoudakis, K. G. (2020). Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning. Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047

How many times has this paper been cited?

9 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

OpenAlex records no free legal copy. Check your library's access, the authors' pages or a repository, or ask the corresponding author for a copy.

Who wrote this paper?

George P. Kontoudis, Zirui Xu, Kyriakos G. Vamvoudakis.

What is the DOI of this paper?

10.23919/acc45564.2020.9148047, permanently at https://doi.org/10.23919/acc45564.2020.9148047. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.