Human-robot mobile co-manipulation of flexible objects by fusing wrench and skeleton tracking data

References

• Aertbeliën, E., and J. De Schutter. 2014. “eTaSL/eTC: A constraint-based Task Specification Language and Robot Controller Using Expression Graphs.” In 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, September, Chicago, IL, United States, 1540–1546.
   Google Scholar
• Andronas, D., E. Kampourakis, K. Bakopoulou, C. Gkournelos, P. Angelakis, and S. Makris. 2021. “Model-Based Robot Control for Human-Robot Flexible Material Co-Manipulation.” In 2021 26th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), 1–8. Vasteras, Sweden: IEEE.
   Google Scholar
• Bersch, C., B. Pitzer, and S. Kammel. 2011. “Bimanual Robotic Cloth Manipulation for Laundry Folding.” In IEEE International Conference on Intelligent Robots and Systems, San Francisco, CA, USA, 1413–1419.
   Google Scholar
• Bieller, S. 2021. “Top 5 Robot Trends 2021 – Smart Robots for Flexible Production and Resilient Supply Chains.” Accessed February 25 2021. https://ifr.org/post/top-5-robot-trends-2021
   Google Scholar
• Bodenhagen, L., A. R. Fugl, A. Jordt, M. Willatzen, K. A. Andersen, M. M. Olsen, R. Koch, H. G. Petersen, and N. Kruger. 2014. “An Adaptable Robot Vision System Performing Manipulation Actions With Flexible Objects.” IEEE Transactions on Automation Science and Engineering 11 (3): 749–765. doi:10.1109/TASE.2014.2320157.
   Web of Science ®Google Scholar
• Bruyninckx, H. 2001. Open Robot Control Software: The OROCOS Project. In: Proceedings of the IEEE International Conference on Robotics and Automation, (2523–2528). Presented at the IEEE International Conference on Robotics and Automation, Seoul, Korea, 21 May 2001-26 May 2001.
   Google Scholar
• Cao, Z., T. Simon, S.-E. Wei, and Y. Sheikh, “Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2017, pp. 1302–1310.
   Google Scholar
• Chiaverini, S., G. Oriolo, and A. A. Maciejewski. 2016. Redundant Robots, 221–242. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-32552-1_10
   Google Scholar
• De Schutter, J., D. L. Tinne, R. Johan, D. Wilm, S. Ruben, A. Erwin, C. Kasper, and B. Herman. 2007. “Constraint-based Task Specification and Estimation for Sensor-Based Robot Systems in the Presence of Geometric Uncertainty.” The International Journal of Robotics Research 26 (5): 433–455. doi:10.1177/027836490707809107.
   Web of Science ®Google Scholar
• Dynamic Controls. 2019. https://www.dynamiccontrols.com/
   Google Scholar
• Gao, Y., H. J. Chang, and Y. Demiris. 2016. “Iterative Path Optimisation for Personalised Dressing Assistance Using Vision and Force Information.” In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, October, 4398–4403.
   Google Scholar
• Hou, Y. C., K. S. M. Sahari, and D. N. T. How. 2019. “A Review on Modeling of Flexible Deformable Object for Dexterous Robotic Manipulation.” International Journal of Advanced Robotic Systems 16 (3): 1729881419848894. doi:10.1177/1729881419848894.
   Web of Science ®Google Scholar
• Huang, S., E. Aertbelien, H. Van Brussel, and H. Bruyninckx. 2010. “A Behavior-based Approach for Task Learning on Mobile Manipulators.” In ISR 2010 (41st International Symposium on Robotics) and ROBOTIK 2010 (6th German Conference on Robotics), München, Germany, 1–6.
   Google Scholar
• Hvilshøj, M., S. Bøgh, O. Skov Nielsen, and O. Madsen. 2012. “Autonomous Industrial Mobile Manipulation (AIMM): Past, Present and Future.“ Industrial Robot 39 (2): 120–135. https://sfx.aub.aau.dk/sfxaub?sid=pureportal
   Web of Science ®Google Scholar
• Ibarguren, A., P. Daelman, and M. Prada. 2020. “Control Strategies for Dual Arm Co-Manipulation of Flexible Objects in Industrial Environments.” In 2020 IEEE Conference on Industrial Cyberphysical Systems (ICPS), Vol. 1, 514–519. Tampere, Finland: IEEE.
   Google Scholar
• International Federation of Robotics. 2020a. How Connected Robots are Transforming Manufacturing. Frankfurt, Germany: International Federation of Robotics. https://ifr.org/papers/how-connected-robots-are-transforming-manufacturing
   Google Scholar
• International Federation of Robotics. 2020b. “IFR Presents World Robotics Report 2020.” Accessed 24 September 2020. https://ifr.org/ifr-press-releases/news/record-2.7-million-robots-work-in-factories-around-the-globe
   Google Scholar
• Kindle, J., F. Furrer, T. Novkovic, J. J. Chung, R. Siegwart, and J. I. Nieto. 2020. “Whole-Body Control of a Mobile Manipulator Using End-to-End Reinforcement Learning.” CoRR abs/2003.02637. https://arxiv.org/abs/2003.02637
   Google Scholar
• Kruse, D., R. J. Radke, and J. T. Wen. 2015. “Collaborative human-robot Manipulation of Highly Deformable Materials.” In 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA, May, 3782–3787.
   Google Scholar
• Kruse, D., R. J. Radke, and J. T. Wen. 2017. “Human-robot Collaborative Handling of Highly Deformable Materials.” In 2017 American Control Conference (ACC), Seattle, WA, USA, May, 1511–1516.
   Google Scholar
• Kuhn, S., T. Gecks, and D. Henrich. 2006. “Velocity Control for Safe Robot Guidance Based on Fused Vision and force/torque Data.” In 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Heidelberg, Germany, 485–492. IEEE.
   Google Scholar
• Langsfeld, J. D., A. M. Kabir, K. N. Kaipa, and S. K. Gupta. 2018. “Integration of Planning and Deformation Model Estimation for Robotic Cleaning of Elastically Deformable Objects.” IEEE Robotics and Automation Letters 3 (1): 352–359. doi:10.1109/LRA.2017.2749280.
   Web of Science ®Google Scholar
• Lee, A., A. Gupta, L. Henry, S. Levine, and P. Abbeel. 2015. “Learning from Multiple Demonstrations Using Trajectory-Aware Non-Rigid Registration with Applications to Deformable Object Manipulation.” In Proceedings of the 28th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Heidelberg, Germany.
   Google Scholar
• Lynch, K. M., and F. C. Park. 2017. Modern Robotics: Mechanics, Planning, and Control. 1st ed. USA: Cambridge University Press.
   Google Scholar
• Maitin-Shepard, J., M. Cusumano-Towner, J. Lei, and P. Abbeel. 2010. “Cloth Grasp Point Detection Based on multiple-view Geometric Cues with Application to Robotic Towel Folding.” In 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA, 2308–2315.
   Google Scholar
• Makris, S. 2020. Cooperating Robots for Flexible Manufacturing. Cham: Springer International Publishing AG.
   Google Scholar
• Mashali, M., W. Lei, R. Alqasemi, and R. Dubey. 2018. “Controlling a Non-Holonomic Mobile Manipulator in a Constrained Floor Space.” In 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia, 725–731.
   Google Scholar
• Miller, S., J. van den Berg, M. Fritz, T. Darrell, K. Goldberg, and P. Abbeel. 2012. “A Geometric Approach to Robotic Laundry Folding.” The International Journal of Robotics Research 31 (2): 249–267. doi:10.1177/0278364911430417.
   Web of Science ®Google Scholar
• Murakami, K., S. Huang, H. Sumi, M. Ishikawa, and Y. Yamakawa. 2018. “Towel-Like Object Alignment with Human-Robot Cooperation and High-Speed Robotic Manipulation.” In 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO), Kuala Lumpur, Malaysia, December, 772–777.
   Google Scholar
• Quigley, M., K. Conley, B. P. Gerkey, J. Faust, T. Foote, J. Leibs, R. Wheeler, and A. Y. Ng. 2009. “ROS: An open-source Robot Operating System.” In ICRA Workshop on Open Source Software, Kobe, Japan.
   Google Scholar
• Rizzi, C., M. Bordegoni, and G. Frugoli. 2000. Simulation of Non-Rigid Materials Handling. In: Robot Manipulation of Deformable Objects. Advanced Manufacturing, edited by Henrich, D., Wörn, H. London: Springer.
   Google Scholar
• Schulman, J., A. Lee, J. Ho, and P. Abbeel. 2013. “Tracking Deformable Objects with Point Clouds.” In 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany, 1130–1137.
   Google Scholar
• Simon, T., H. Joo, I. Matthews, and Y. Sheikh. 2017. “Hand Keypoint Detection in Single Images Using Multiview Bootstrapping.” In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition (pp. 1145–1153).
   Google Scholar
• Smits, R. n.d. “KDL: Kinematics and Dynamics Library.” http://www.orocos.org/kdl
   Google Scholar
• Vanthienen, D., T. De Laet, H. Bruyninckx, W. Decré, and J. De Schutter. 2012. “Force-Sensorless and Bimanual Human-Robot Comanipulation Implementation Using iTaSC.” IFAC Proceedings Volumes. 10th IFAC Symposium on Robot Control 45 22: 759–766. doi:10.3182/20120905-3-HR-2030.00127.
   Google Scholar
• Vicci, L. 2001. “Quaternions and Rotations in 3-Space: The Algebra and Its Geometric Interpretation.“ Technical Report. University of North Carolina at Chapel Hill, USA.
   Google Scholar
• Wang, P. C., S. Miller, M. Fritz, T. Darrell, and P. Abbeel. 2011. “Perception for the Manipulation of Socks.” In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA, USA, 4877–4884.
   Google Scholar
• Zhang, F., A. Cully, and Y. Demiris. 2017. “Personalized robot-assisted Dressing Using User Modeling in Latent Spaces.” In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, 3603–3610.
   Google Scholar