Conference paper · 2019 · Open access

Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping

Ali Shafti, Pavel A. Orlov, A. Aldo Faisal

Proceedings - IEEE International Conference on Robotics and Automation/Proceedings, 2019, 863–869 · Published 1 May 2019 · DOI 10.1109/icra.2019.8793804

Open PDFView at the publisherCite this paper

In brief

“Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping” is a 2019 conference paper by Ali Shafti and 2 co-authors, published in Proceedings - IEEE International Conference on Robotics and Automation/Proceedings. OpenAlex counts 98 citations as of 22 November 2026, which puts it in the top 5% of works published in 2019 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
98
Most cited in
2025 (23)
Field-weighted impact
4.81
References
33
Authors
3

Abstract

Assistive robotic systems endeavour to support those with movement disabilities, enabling them to move again and regain functionality. Main issue with these systems is the complexity of their low-level control, and how to translate this to simpler, higher level commands that are easy and intuitive for a human user to interact with. We have created a multi-modal system, consisting of different sensing, decision making and actuating modalities, leading to intuitive, human-in-the-loop assistive robotics. The system takes its cue from the user's gaze, to decode their intentions and implement low-level motion actions to achieve high-level tasks. This results in the user simply having to look at the objects of interest, for the robotic system to assist them in reaching for those objects, grasping them, and using them to interact with other objects. We present our method for 3D gaze estimation, and grammars-based implementation of sequences of action with the robotic system. The 3D gaze estimation is evaluated with 8 subjects, showing an overall accuracy of 4.68\pm 0.14cm. The full system is tested with 5 subjects, showing successful implementation of 100% of reach to gaze point actions and full implementation of pick and place tasks in 96%, and pick and pour tasks in 76% of cases. Finally we present a discussion on our results and what future work is needed to improve the system.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Shafti, A., Orlov, P. A., & Faisal, A. A. (2019). Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping. Proceedings - IEEE International Conference on Robotics and Automation/Proceedings, 2019, 863–869. https://doi.org/10.1109/icra.2019.8793804

MLA 9

Shafti, Ali, et al. “Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping.” Proceedings - IEEE International Conference on Robotics and Automation/Proceedings, vol. 2019, 2019, pp. 863–869. https://doi.org/10.1109/icra.2019.8793804.

Chicago

Shafti, Ali, Pavel A. Orlov, and A. Aldo Faisal. 2019. “Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping.” Proceedings - IEEE International Conference on Robotics and Automation/Proceedings 2019: 863–869. https://doi.org/10.1109/icra.2019.8793804.

Harvard

Shafti, A., Orlov, P. A. and Faisal, A. A. (2019) ‘Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping’, Proceedings - IEEE International Conference on Robotics and Automation/Proceedings, 2019, pp. 863–869. doi:10.1109/icra.2019.8793804.

IEEE

A. Shafti, P. A. Orlov, and A. A. Faisal, “Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping,” Proceedings - IEEE International Conference on Robotics and Automation/Proceedings, vol. 2019, pp. 863–869, 2019, doi: 10.1109/icra.2019.8793804.

BibTeX

@inproceedings{shafti2019gaze,
  title     = {{Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping}},
  author    = {Shafti, Ali and Orlov, Pavel A. and Faisal, A. Aldo},
  booktitle = {Proceedings - IEEE International Conference on Robotics and Automation/Proceedings},
  year      = {2019},
  volume    = {2019},
  pages     = {863--869},
  doi       = {10.1109/icra.2019.8793804},
  url       = {https://doi.org/10.1109/icra.2019.8793804}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201944
202066
20211111
202288
20231616
20241414
20252323
20261616

Its field-weighted citation impact is 4.81: it has been cited 4.81 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology

  • gaze-based interaction
  • assistive robotics
  • reach-to-grasp
  • 3D gaze estimation
  • human-in-the-loop control
  • pick-and-place
  • mobility impairment
  • multimodal sensing

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Shafti, A., Orlov, P. A., & Faisal, A. A. (2019). Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping. Proceedings - IEEE International Conference on Robotics and Automation/Proceedings, 2019, 863–869. https://doi.org/10.1109/icra.2019.8793804

How many times has this paper been cited?

98 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Ali Shafti, Pavel A. Orlov, A. Aldo Faisal.

What is the DOI of this paper?

10.1109/icra.2019.8793804, permanently at https://doi.org/10.1109/icra.2019.8793804. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.