Journal article · 2025 · Open access

A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation

Muhammad Usman Khalid, Mininder Sethi, Nirmal Kumar Ravikumar, Halar Haleem, Alessandro Seitone, Mattia Frascio, Perla Maiolino, Matteo Zoppi

IEEE Access, 13, 68492–68508 · Published 1 January 2025 · DOI 10.1109/access.2025.3561582

Open full textCite this paper

In brief

“A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation” is a 2025 journal article by Muhammad Usman Khalid and 7 co-authors, published in IEEE Access. OpenAlex counts 1 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at IEEE Access.

Citations
1
Most cited in
2026 (1)
Field-weighted impact
0.23
References
42
Authors
8

Abstract

This work introduces a novel vision-based sensing approach for self-adaptable soft fingers using an embedded camera, demonstrating proprioceptive and exteroceptive capabilities. The system achieves normal force estimation, Z-displacement estimation, slip detection, and force application position classification by integrating the Pi Camera V3 sensor into the structure of an additively manufactured self-adaptable soft finger. Our approach avoids the deformation disambiguation required in elastomer-based sensors by enabling direct deformation sensing without additional sensing layers like a silicon pad that alters the finger’s compliant characteristics. The system also overcomes the occlusion limitations inherent in external camera-based methods by observing structural changes through strategically placed dot patterns within the finger’s internal geometry, which are visible to the embedded camera. The camera mounting position was verified using Finite Element Analysis (FEA) while ensuring finger compliance and as much deformation as possible without touching the camera. We combined two algorithms: an optical flow-based method for reliably detecting slip events and a Convolutional Neural Network (CNN) for force, displacement estimation, and position classification. The slip detection algorithm uses a dual-threshold approach that combines the Median Absolute Deviation (MAD) and standard deviation. Customized rigs integrated with a Universal Testing Machine (UTM) were used for sensor characterization, dataset acquisition, and slip detection parameter optimization. Furthermore, the system was validated through integration with an industrial gripper in an experimental sequence on different object types to mimic real-world manipulation, where both algorithms were integrated and deployed on Raspberry Pi 5 to achieve proprioceptive and exteroceptive sensing. Reliable performance was achieved with slip detection operating at 28.5 Hz and CNN update rate of 8 Hz. The experimental results demonstrate the effectiveness of the proposed system for both sensing modalities. This study presents a compact, integrated solution that maintains the inherent compliant characteristics of the self-adaptable finger while providing feedback for real-world manipulation tasks.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Khalid, M. U., Sethi, M., Ravikumar, N. K., Haleem, H., Seitone, A., Frascio, M., Maiolino, P., & Zoppi, M. (2025). A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation. IEEE Access, 13, 68492–68508. https://doi.org/10.1109/access.2025.3561582

MLA 9

Khalid, Muhammad Usman, et al. “A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation.” IEEE Access, vol. 13, 2025, pp. 68492–68508. https://doi.org/10.1109/access.2025.3561582.

Chicago

Khalid, Muhammad Usman, Mininder Sethi, Nirmal Kumar Ravikumar, Halar Haleem, Alessandro Seitone, Mattia Frascio, Perla Maiolino, and Matteo Zoppi. 2025. “A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation.” IEEE Access 13: 68492–68508. https://doi.org/10.1109/access.2025.3561582.

Harvard

Khalid, M. U. et al. (2025) ‘A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation’, IEEE Access, 13, pp. 68492–68508. doi:10.1109/access.2025.3561582.

IEEE

M. U. Khalid et al., “A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation,” IEEE Access, vol. 13, pp. 68492–68508, 2025, doi: 10.1109/access.2025.3561582.

BibTeX

@article{khalid2025camera,
  title     = {{A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation}},
  author    = {Khalid, Muhammad Usman and Sethi, Mininder and Ravikumar, Nirmal Kumar and Haleem, Halar and Seitone, Alessandro and Frascio, Mattia and Maiolino, Perla and Zoppi, Matteo},
  journal   = {IEEE Access},
  year      = {2025},
  volume    = {13},
  pages     = {68492--68508},
  doi       = {10.1109/access.2025.3561582},
  url       = {https://doi.org/10.1109/access.2025.3561582}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning

  • slip detection
  • optical flow
  • convolutional neural networks
  • proprioception
  • exteroception
  • displacement estimation
  • robotic manipulation
  • Raspberry Pi

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Khalid, M. U., Sethi, M., Ravikumar, N. K., Haleem, H., Seitone, A., Frascio, M., Maiolino, P., & Zoppi, M. (2025). A Camera-Embedded Self-Adaptable Finger With Multi-Modal Sensing Capabilities for Robotic Manipulation. IEEE Access, 13, 68492–68508. https://doi.org/10.1109/access.2025.3561582

How many times has this paper been cited?

1 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at IEEE Access: sign in and open the full text from this page.

Who wrote this paper?

Muhammad Usman Khalid, Mininder Sethi, Nirmal Kumar Ravikumar, Halar Haleem, Alessandro Seitone, Mattia Frascio, Perla Maiolino, Matteo Zoppi.

What is the DOI of this paper?

10.1109/access.2025.3561582, permanently at https://doi.org/10.1109/access.2025.3561582. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.