Human-robot mobile co-manipulation of flexible objects by fusing wrench and skeleton tracking data

ABSTRACT

Over the past decades, robots have been extensively deployed in multiple industries. More recently, industrial robots have been taken out of their cages, being more present in dynamic environments, interacting in the close vicinity of human operators. Traditionally, robots have been mainly developed to perform pre-programmed tasks. However, some tasks are too complex or expensive to be performed by a robotic system alone. Examples are the handling of large sheet-like objects in the composite part production or plastic film wrapping industry. This work presents a hybrid wrench and vision reactive control approach towards the handling of large (non-)rigid materials. The presented approach fuses force-torque data and skeleton tracking to control a mobile manipulator in an intuitive manner, by using the intelligence of the operator as much as possible. Using this approach, tools such as path planning, or object modelling are not essential to obtain the results. The hybrid controller is subject to stability experiments where the controller responses are monitored when the mobile manipulator is subject to a step and sinusoidal function as input. Lastly, the overall approach is illustrated with a proof-of-concept task in which a flexible sheet is handled by a mobile manipulator and human operator together.

KEYWORDS:

• Mobile manipulation
• reactive robot control
• force control
• human-robot collaboration
• skeleton tracking
• non-rigid materials

Acknowledgments

The authors gratefully thank KU Leuven, Diepenbeek Campus, for granting a FLOF mandate, facilitating this research. The authors would also like to thank the researchers of KU Leuven research group ACRO for their contributions to the construction of and the experiments conducted with the mobile platform. We would also like to express our enormous gratitude for our former colleague ing. Bart Moyaers for his major contribution in this research project.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Notes

1. Footage of all the conductive experiments can be viewed on the ACRO’s YouTube channel through following link: https://youtu.be/tOXUz4Fo-qM.