Journal article · 2020 · Open access

Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing

Ruoyu Wang, Shiheng Wang, Songyu Du, Erdong Xiao, Wenzhen Yuan, Chen Feng

IEEE Robotics and Automation Letters, 5(2), 3382–3389 · Published 21 February 2020 · DOI 10.1109/lra.2020.2975709

Open PDFView at the publisherCite this paper

In brief

“Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing” is a 2020 journal article by Ruoyu Wang and 5 co-authors, published in IEEE Robotics and Automation Letters. OpenAlex counts 63 citations as of 22 November 2026, which puts it in the top 8% of works published in 2020 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
63
Most cited in
2025 (12)
Field-weighted impact
2.32
References
34
Authors
6

Abstract

Soft bodies made from flexible and deformable materials are popular in many robotics applications, but their proprioceptive sensing has been a long-standing challenge. In other words, there has hardly been a method to measure and model the high-dimensional 3D shapes of soft bodies with internal sensors. We propose a framework to measure the high-resolution 3D shapes of soft bodies in real-time with embedded cameras. The cameras capture visual patterns inside a soft body, and a convolutional neural network (CNN) produces a latent code representing the deformation state, which can then be used to reconstruct the body's 3D shape using another neural network. We test the framework on various soft bodies, such as a Baymax-shaped toy, a latex balloon, and some soft robot fingers, and achieve real-time computation (≤2.5 ms/frame) for robust shape estimation with high precision (≤1% relative error) and high resolution. We believe the method could be applied to soft robotics and human-robot interaction for proprioceptive shape sensing. Our code is available at: https: //ai4ce.github.io/DeepSoRo/.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wang, R., Wang, S., Du, S., Xiao, E., Yuan, W., & Feng, C. (2020). Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing. IEEE Robotics and Automation Letters, 5(2), 3382–3389. https://doi.org/10.1109/lra.2020.2975709

MLA 9

Wang, Ruoyu, et al. “Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing.” IEEE Robotics and Automation Letters, vol. 5, no. 2, 2020, pp. 3382–3389. https://doi.org/10.1109/lra.2020.2975709.

Chicago

Wang, Ruoyu, Shiheng Wang, Songyu Du, Erdong Xiao, Wenzhen Yuan, and Chen Feng. 2020. “Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing.” IEEE Robotics and Automation Letters 5 (2): 3382–3389. https://doi.org/10.1109/lra.2020.2975709.

Harvard

Wang, R. et al. (2020) ‘Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing’, IEEE Robotics and Automation Letters, 5(2), pp. 3382–3389. doi:10.1109/lra.2020.2975709.

IEEE

R. Wang, S. Wang, S. Du, E. Xiao, W. Yuan, and C. Feng, “Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing,” IEEE Robotics and Automation Letters, vol. 5, no. 2, pp. 3382–3389, 2020, doi: 10.1109/lra.2020.2975709.

BibTeX

@article{wang2020real,
  title     = {{Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing}},
  author    = {Wang, Ruoyu and Wang, Shiheng and Du, Songyu and Xiao, Erdong and Yuan, Wenzhen and Feng, Chen},
  journal   = {IEEE Robotics and Automation Letters},
  year      = {2020},
  volume    = {5},
  number    = {2},
  pages     = {3382--3389},
  doi       = {10.1109/lra.2020.2975709},
  url       = {https://doi.org/10.1109/lra.2020.2975709}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201922
202099
202188
202299
202399
20241010
20251212
202644

Its field-weighted citation impact is 2.32: it has been cited 2.32 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Biomedical Engineering › Soft Robotics and Applications

  • 3D shape estimation
  • deformable materials
  • embedded camera
  • convolutional neural networks
  • shape recovery
  • soft robotics
  • real-time sensing

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Wang, R., Wang, S., Du, S., Xiao, E., Yuan, W., & Feng, C. (2020). Real-Time Soft Body 3D Proprioception via Deep Vision-Based Sensing. IEEE Robotics and Automation Letters, 5(2), 3382–3389. https://doi.org/10.1109/lra.2020.2975709

How many times has this paper been cited?

63 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Ruoyu Wang, Shiheng Wang, Songyu Du, Erdong Xiao, Wenzhen Yuan, Chen Feng.

What is the DOI of this paper?

10.1109/lra.2020.2975709, permanently at https://doi.org/10.1109/lra.2020.2975709. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.