Preprint · 2026 · Open access

Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation

Pinhao Song, Zhongxi Li, Ze Fu, Federico Ulloa Rios, Renaud J. Detry

arXiv (Cornell University) · Published 10 July 2026 · DOI 10.48550/arxiv.2607.09315

Open PDFView at the publisherCite this paper

In brief

“Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation” is a 2026 preprint by Pinhao Song and 4 co-authors, published in arXiv (Cornell University). OpenAlex counts 0 citations as of 22 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
0
References
47
Authors
5

Abstract

We aim to address the challenge of teleoperating robotic arms for high-degree-of-freedom (high-DoF) manipulation tasks, which is cognitively demanding and error-prone, particularly when relying on low-bandwidth interfaces. We propose Robot Trajectron V3 (RT-V3), a probabilistic shared control framework designed for $SE(3)$ grasping tasks. RT-V3 formulates shared control as Bayesian inference by learning a prior over user intent and combining it with real-time user commands to estimate the posterior intent distribution. The prior models user intent as a distribution over future trajectories conditioned on past robot dynamics and visual scene context. The intent prior is parameterized by a transformer-based conditional generative model that reasons over point clouds and candidate grasp poses, together with a factorized translation-rotation representation that improves learning efficiency in high-dimensional action spaces. During execution, RT-V3 continuously estimates the posterior distribution over future trajectories by combining the learned intent prior with a user-command likelihood derived from the observed control input, enabling continuous intent refinement and shared assistance. Comprehensive experiments demonstrate that RT-V3 achieves high accuracy in trajectory prediction and competitive performance in reactive planning. Furthermore, real-world user studies indicate that RT-V3 significantly outperforms baseline methods in terms of success rate and efficiency, while substantially reducing the user's physical and mental workload.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Song, P., Li, Z., Fu, Z., Rios, F. U., & Detry, R. J. (2026). Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2607.09315

MLA 9

Song, Pinhao, et al. “Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation.” arXiv (Cornell University), 2026. https://doi.org/10.48550/arxiv.2607.09315.

Chicago

Song, Pinhao, Zhongxi Li, Ze Fu, Federico Ulloa Rios, and Renaud J. Detry. 2026. “Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2607.09315.

Harvard

Song, P. et al. (2026) ‘Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation’, arXiv (Cornell University). doi:10.48550/arxiv.2607.09315.

IEEE

P. Song, Z. Li, Z. Fu, F. U. Rios, and R. J. Detry, “Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation,” arXiv (Cornell University), 2026, doi: 10.48550/arxiv.2607.09315.

BibTeX

@misc{song2026robot,
  title     = {{Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation}},
  author    = {Song, Pinhao and Li, Zhongxi and Fu, Ze and Rios, Federico Ulloa and Detry, Renaud J.},
  howpublished = {arXiv (Cornell University)},
  year      = {2026},
  doi       = {10.48550/arxiv.2607.09315},
  url       = {https://doi.org/10.48550/arxiv.2607.09315}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning

  • shared control
  • teleoperation
  • robotic arm manipulation
  • trajectory prediction
  • conditional generative models
  • user workload reduction
  • reactive planning

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Song, P., Li, Z., Fu, Z., Rios, F. U., & Detry, R. J. (2026). Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2607.09315

How many times has this paper been cited?

0 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Pinhao Song, Zhongxi Li, Ze Fu, Federico Ulloa Rios, Renaud J. Detry.

What is the DOI of this paper?

10.48550/arxiv.2607.09315, permanently at https://doi.org/10.48550/arxiv.2607.09315. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.