Performance evaluation of 3D vision-based semi-autonomous control method for assistive robotic manipulator

Abstract

We developed a 3D vision-based semi-autonomous control interface for assistive robotic manipulators. It was implemented based on one of the most popular commercially available assistive robotic manipulator combined with a low-cost depth-sensing camera mounted on the robot base. To perform a manipulation task with the 3D vision-based semi-autonomous control interface, a user starts operating with a manual control method available to him/her. When detecting objects within a set range, the control interface automatically stops the robot, and provides the user with possible manipulation options through audible text output, based on the detected object characteristics. Then, the system waits until the user states a voice command. Once the user command is given, the control interface drives the robot autonomously until the given command is completed. In the empirical evaluations conducted with human subjects from two different groups, it was shown that the semi-autonomous control can be used as an alternative control method to enable individuals with impaired motor control to more efficiently operate the robot arms by facilitating their fine motion control. The advantage of semi-autonomous control was not so obvious for the simple tasks. But, for the relatively complex real-life tasks, the 3D vision-based semi-autonomous control showed significantly faster performance.

Implications for Rehabilitation

• A 3D vision-based semi-autonomous control interface will improve clinical practice by providing an alternative control method that is less demanding physically as well cognitively.

• A 3D vision-based semi-autonomous control provides the user with task specific intelligent semiautonomous manipulation assistances.

• A 3D vision-based semi-autonomous control gives the user the feeling that he or she is still in control at any moment.

• A 3D vision-based semi-autonomous control is compatible with different types of new and existing manual control methods for ARMs.

Keywords:

• Assistive robotic manipulator
• semi-autonomous control
• physical disability
• rehabilitation robotics

Acknowledgements

This material does not represent the views of the Department of Veterans Affairs or the United States Government.

Disclosure statement

The authors report no conflicts of interest. The authors alone are responsible for the content and writing of this article.

Additional information

Funding

This work is supported by Craig H. Neilsen Foundation and with resources and use of facilities at the Human Engineering Research Laboratories (HERL), VA Pittsburgh Healthcare System.