Journal article · 2019
Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework
IEEE Transactions on Neural Networks and Learning Systems, 30(12), 3803–3817 · Published 29 March 2019 · DOI 10.1109/tnnls.2019.2899311
In brief
“Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework” is a 2019 journal article by George P. Kontoudis and Kyriakos G. Vamvoudakis, published in IEEE Transactions on Neural Networks and Learning Systems. OpenAlex counts 90 citations as of 22 November 2026. The publisher's version is not open access, and OpenAlex records no free legal copy.
- Citations
- 90
- Most cited in
- 2023 (24)
- Field-weighted impact
- 3.20
- References
- 48
- Authors
- 2
Abstract
This paper presents an online kinodynamic motion planning algorithmic framework using asymptotically optimal rapidly-exploring random tree (RRT*) and continuous-time Q-learning, which we term as RRT-Q*. We formulate a model-free Q-based advantage function and we utilize integral reinforcement learning to develop tuning laws for the online approximation of the optimal cost and the optimal policy of… Read the full abstract at the publisher.
Excerpt. This paper is not open access.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Kontoudis, G. P., & Vamvoudakis, K. G. (2019). Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework. IEEE Transactions on Neural Networks and Learning Systems, 30(12), 3803–3817. https://doi.org/10.1109/tnnls.2019.2899311
MLA 9
Kontoudis, George P., and Kyriakos G. Vamvoudakis. “Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework.” IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 12, 2019, pp. 3803–3817. https://doi.org/10.1109/tnnls.2019.2899311.
Chicago
Kontoudis, George P. and Kyriakos G. Vamvoudakis. 2019. “Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework.” IEEE Transactions on Neural Networks and Learning Systems 30 (12): 3803–3817. https://doi.org/10.1109/tnnls.2019.2899311.
Harvard
Kontoudis, G. P. and Vamvoudakis, K. G. (2019) ‘Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework’, IEEE Transactions on Neural Networks and Learning Systems, 30(12), pp. 3803–3817. doi:10.1109/tnnls.2019.2899311.
IEEE
G. P. Kontoudis and K. G. Vamvoudakis, “Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework,” IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 12, pp. 3803–3817, 2019, doi: 10.1109/tnnls.2019.2899311.
BibTeX
@article{kontoudis2019kinodynamic,
title = {{Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework}},
author = {Kontoudis, George P. and Vamvoudakis, Kyriakos G.},
journal = {IEEE Transactions on Neural Networks and Learning Systems},
year = {2019},
volume = {30},
number = {12},
pages = {3803--3817},
doi = {10.1109/tnnls.2019.2899311},
url = {https://doi.org/10.1109/tnnls.2019.2899311}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2019 | 1 | |
| 2020 | 6 | |
| 2021 | 15 | |
| 2022 | 14 | |
| 2023 | 24 | |
| 2024 | 12 | |
| 2025 | 10 | |
| 2026 | 8 |
Its field-weighted citation impact is 3.20: it has been cited 3.20 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- kinodynamic motion planning
- RRT*
- integral reinforcement learning
- model-free reinforcement learning
- Lyapunov stability
- collision-free navigation
- topological connectivity
- asymptotic convergence
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Kontoudis, G. P., & Vamvoudakis, K. G. (2019). Kinodynamic Motion Planning With Continuous-Time Q-Learning: An Online, Model-Free, and Safe Navigation Framework. IEEE Transactions on Neural Networks and Learning Systems, 30(12), 3803–3817. https://doi.org/10.1109/tnnls.2019.2899311
How many times has this paper been cited?
90 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
OpenAlex records no free legal copy. Check your library's access, the authors' pages or a repository, or ask the corresponding author for a copy.
Who wrote this paper?
George P. Kontoudis, Kyriakos G. Vamvoudakis.
What is the DOI of this paper?
10.1109/tnnls.2019.2899311, permanently at https://doi.org/10.1109/tnnls.2019.2899311. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.