Conference paper · 2020
Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning
Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 3873–3878 · Published 1 July 2020 · DOI 10.23919/acc45564.2020.9148047
In brief
“Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning” is a 2020 conference paper by George P. Kontoudis and 2 co-authors, published in Proceedings of the ... American Control Conference/Proceedings of the American Control Conference. OpenAlex counts 9 citations as of 22 November 2026, which puts it in the top 8% of works published in 2020 by citations. The publisher's version is not open access, and OpenAlex records no free legal copy.
- Citations
- 9
- Most cited in
- 2021 (4)
- Field-weighted impact
- 2.11
- References
- 23
- Authors
- 3
Abstract
This paper presents an online kinodynamic motion planning scheme for dynamically evolving environments, by employing Q-learning. The methodology addresses the finite horizon continuous-time optimal control problem with completely unknown system dynamics. An actor-critic structure is employed along with a buffer of previous experiences, to approximate the optimal policy and alleviate the learning signal requirements. The… Read the full abstract at the publisher.
Excerpt. This paper is not open access.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Kontoudis, G. P., Xu, Z., & Vamvoudakis, K. G. (2020). Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning. Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047
MLA 9
Kontoudis, George P., et al. “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning.” Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 2020, pp. 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047.
Chicago
Kontoudis, George P., Zirui Xu, and Kyriakos G. Vamvoudakis. 2020. “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning.” Proceedings of the ... American Control Conference/Proceedings of the American Control Conference: 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047.
Harvard
Kontoudis, G. P., Xu, Z. and Vamvoudakis, K. G. (2020) ‘Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning’, Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, pp. 3873–3878. doi:10.23919/acc45564.2020.9148047.
IEEE
G. P. Kontoudis, Z. Xu, and K. G. Vamvoudakis, “Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning,” Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, pp. 3873–3878, 2020, doi: 10.23919/acc45564.2020.9148047.
BibTeX
@inproceedings{kontoudis2020online,
title = {{Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning}},
author = {Kontoudis, George P. and Xu, Zirui and Vamvoudakis, Kyriakos G.},
booktitle = {Proceedings of the ... American Control Conference/Proceedings of the American Control Conference},
year = {2020},
pages = {3873--3878},
doi = {10.23919/acc45564.2020.9148047},
url = {https://doi.org/10.23919/acc45564.2020.9148047}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2021 | 4 | |
| 2023 | 3 | |
| 2024 | 2 |
Its field-weighted citation impact is 2.11: it has been cited 2.11 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Engineering › Control and Systems Engineering › Adaptive Dynamic Programming Control
- kinodynamic motion planning
- online motion planning
- dynamic environments
- Q-learning
- continuous-time optimal control
- model-free reinforcement learning
- actor-critic
- finite horizon control
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
Kontoudis, G. P., Xu, Z., & Vamvoudakis, K. G. (2020). Online, Model-Free Motion Planning in Dynamic Environments: An Intermittent, Finite Horizon Approach with Continuous-Time Q-Learning. Proceedings of the ... American Control Conference/Proceedings of the American Control Conference, 3873–3878. https://doi.org/10.23919/acc45564.2020.9148047
How many times has this paper been cited?
9 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
OpenAlex records no free legal copy. Check your library's access, the authors' pages or a repository, or ask the corresponding author for a copy.
Who wrote this paper?
George P. Kontoudis, Zirui Xu, Kyriakos G. Vamvoudakis.
What is the DOI of this paper?
10.23919/acc45564.2020.9148047, permanently at https://doi.org/10.23919/acc45564.2020.9148047. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.