Web-based simulation and motion planning for human-robot and multi-robot applications

References

• Aivaliotis, S., K. Lotsaris, C. Gkournelos, N. Fourtakas, S. Koukas, N. Kousi, and S. Makris. 2023. “An Augmented Reality Software Suite Enabling Seamless Human Robot Interaction.” International Journal of Computer Integrated Manufacturing 36 (1): 3–29. https://doi.org/10.1080/0951192X.2022.2104459.
   Web of Science ®Google Scholar
• Bakker, S., L. Knoedler, M. Spahn, W. Böhmer, and J. Alonso-Mora. 2023. “Multi-Robot Local Motion Planning Using Dynamic Optimization Fabrics.” arXiv preprint arXiv:2310.12816. https://info.arxiv.org/help/faq/references.html.
   Google Scholar
• Beck, M. 2021. “Glumb Robot Simualtoir.” Acccessed 15 10 2021. https://github.com/glumb.
   Google Scholar
• Bravo, F. A., A. M. González, and E. González. 2017. “A Review of Intuitive Robot Programming Environments for Educational Purposes.” In 2017 IEEE 3rd Colombian Conference on Automatic Control, Cartagena, Columbia, 1–6. IEEE.
   Google Scholar
• Catmull, E., and R. Rom. 1974. “A Class of Local Interpolating Splines.” In Computer Aided Geometric Design, edited by R. E. Barnhill and R. F. Reisenfeld, 317–326. New York: Academic Press.
   Google Scholar
• Chen, W., H. Fang, Y. Yang, and W.He 2017 July, 21–23. “Optimal Trajectory Planning for Delta Robot Based on Three-Parameter Lamé Curve.” In Proceedings of the 2nd International Conference on Cybernetics, Robotics and Control (CRC), Chengdu, China, 39–44.
   Google Scholar
• Cimurs, R., J. H. Lee, and I. H. Suh. 2020. “Goal-Oriented Obstacle Avoidance with Deep Reinforcement Learning in Continuous Action Space.” Electronics 9 (3): 411. https://doi.org/10.3390/electronics9030411.
   Web of Science ®Google Scholar
• De Schepper, D., G. Schouterden, K. Kellens, and E. Demeester. 2023. “Human-Robot Mobile Co-Manipulation of Flexible Objects by Fusing Wrench and Skeleton Tracking Data.” International Journal of Computer Integrated Manufacturing 36 (1): 30–50.
   Web of Science ®Google Scholar
• drag and bot GmbH. 2020. “Flexible Produktionsplanung dank einfacher Roboterprogrammierung.” JOT Journal für Oberflächentechnik 60 (5–6): 32–33. https://doi.org/10.1007/s35144-020-0550-2.
   Google Scholar
• Elhoseny, M., A. Tharwat, and A. E. Hassanien. 2018. “Bezier Curve Based Path Planning in a Dynamic Field Using Modified Genetic Algorithm.” Journal of Computational Science 25:339–350. https://doi.org/10.1016/j.jocs.2017.08.004.
   Web of Science ®Google Scholar
• Franka Emika. 2021. “Franka Emika Desk.” Accessed October 15, 2021. https://www.franka.de/.
   Google Scholar
• Ge, J., F. Sun, and C. Liu RRT-GD: An Efficient Rapidly-Exploring Random Tree Approach with Goal Directionality for Redundant Manipulator Path Planning. In Proceedings of the IEEE International Conference on Robotics and Biomimetics, Qingdao, China, 3–7 December 2017, 1983–1988.
   Google Scholar
• Halt, L., F. Nagele, P. Tenbrock, and A. Pott, 2018. “Intuitive Constraint-Based Robot Programming for Robotic Assembly Tasks* the Research Leading to These Results Has Received Funding from the European Unions Seventh Framework Programme FP7/2013-2017 Under Grant Agreement N 608604 (LIAA: Lean Intelligent Assembly Automation) and Horizon 2020 Research and Innovation Programme Under Grant Agreement N 688642 (RAMPup).” In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA). Presented at the 2018 IEEE International Conference on Robotics and Automation (ICRA), 520–526. https://doi.org/10.1109/ICRA.2018.8462882
   Google Scholar
• Han, L., H. Yashiro, H. T. N. Nejad, Q. H. Do, and S. Mita.2010 June, 21–.14 “Bézier Curve Based Path Planning for Autonomous Vehicle in Urban Environment.” In Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, San Diego, CA, USA, 1036–1042.
   Google Scholar
• Hornung, A., M. Neubauer, and L. Müller. 2022. U.S. Patent No. 11,512,940. Washington, DC: U.S. Patent and Trademark Office.
   Google Scholar
• Huang, Y., J. Silvério, L. Rozo, and D. G. Caldwell. 2018. “Generalized task-parameterized skill learning.” In Proceedings of the 2018 IEEE international conference on robotics and automation (ICRA), Brisbane, Australia, 5667–5474. IEEE.
   Google Scholar
• Ionescu and Fröhlich. 2022. “Computer-Implemented Method for Correcting at Least One Model Output of a First Trained Machine Learning Model.” International Patent Application WO2023131444A1. Geneva, Switzerland: The World Intellectual Property Organization (WIPO).
   Google Scholar
• Ionescu, T. B. 2020. “Meet Your Personal Cobot, but Don’t Touch It Just Yet.” In Proceedings of the 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Naples, Italy, 1113–1118. IEEE.
   Google Scholar
• Ionescu, T. B. 2021a. “Adaptive Simplex Architecture for Safe, Real-Time Robot Path Planning.” Sensors 21 (8): 2589. https://doi.org/10.3390/s21082589.
   PubMed Web of Science ®Google Scholar
• Ionescu, T. B. 2021b. “Leveraging Graphical User Interface Automation for Generic Robot Programming.” Robotics 10 (1): 3. https://doi.org/10.3390/robotics10010003.
   Web of Science ®Google Scholar
• Ionescu, T. B., and S. Schlund. 2021. “Programming Cobots by Voice: A Human-Centered, Web-Based Approach.” Procedia CIRP 97:123–129. https://doi.org/10.1016/j.procir.2020.05.213.
   Google Scholar
• Ionescu, T. B., and S. Schlund. 2019. “A Participatory Programming Model for Democratizing Cobot Technology in Public and Industrial Fablabs.” Procedia CIRP 81:93–98. https://doi.org/10.1016/j.procir.2019.03.017.
   Google Scholar
• Jia, Y., Y. Li, B. Xin, and C. Chen. 2020. Path Planning with Autonomous Obstacle Avoidance Using Reinforcement Learning for Six-Axis Arms. In Proceedings of the 17th IEEE International Conference on Networking, Sensing and Control (ICNSC), Nanjing, China, October 30 – November 2, 1–6.
   Google Scholar
• Ji, M., L. Zhang, and S. Wang. 2019. A Path Planning Approach Based on Q-Learning for Robot Arm. In Proceedings of the 3rd International Conference on Robotics and Automation Sciences (ICRAS), Wuhan, China, June 1–3, 15–19.
   Google Scholar
• Krämer, M., C. Rösmann, F. Hoffmann, and T. Bertram. 2020. “Model Predictive Control of a Collaborative Manipulator Considering Dynamic Obstacles.” Optimal Control Applications & Methods 41 (4): 1211–1232. https://doi.org/10.1002/oca.2599.
   Web of Science ®Google Scholar
• Larsen, L., and J. Kim. 2021. “Path Planning of Cooperating Industrial Robots Using Evolutionary Algorithms.” Robotics and Computer-Integrated Manufacturing 67:102053. https://doi.org/10.1016/j.rcim.2020.102053.
   Web of Science ®Google Scholar
• Larsen, L., A. Schuster, J. Kim, and M. Kupke. 2018. “Path Planning of Cooperating Industrial Robots Using Evolutionary Algorithms.” Procedia Manufacturing 17:286–293. https://doi.org/10.1016/j.promfg.2018.10.048.
   Google Scholar
• LaValle, S. M., and J. Kuffner Jr. 2001. “Randomized Kinodynamic Planning.” The International Journal of Robotics Research 20 (5): 378–400. https://doi.org/10.1177/02783640122067453.
   Web of Science ®Google Scholar
• Lavalle, S. M., and J. J. Kuffner. 2000. “Rapidly-Exploring Random Trees: Progress and Prospects.” In Algorithmic and Computational Robotics New Directions, edited by Bruce Donald, Kevin Lynch and Daniela Rus, 293–308. Boca Raton, FL, USA: CRC Press.
   Google Scholar
• McCool, M. D. 2000. “Shadow Volume Reconstruction from Depth Maps.” ACM Transactions on Graphics (TOG) 19 (1): 1–26. https://doi.org/10.1145/343002.343006.
   Web of Science ®Google Scholar
• Mert, W. 2018. “Autonome individualisierte Produktion. hi!tech - Siemens innovation magauone 01/2018.” Accessed October 15, 2021. https://hitech.at/sites/default/files/magazin/1801hitech-ebook-1.pdf.
   Google Scholar
• Miura, J. Support Vector Path Planning. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 9–15 October 2006, 2894–2899.
   Google Scholar
• Mukherjee, D., K. Gupta, L. H. Chang, and H. Najjaran. 2022. “A Survey of Robot Learning Strategies for Human-Robot Collaboration in Industrial Settings.” Robotics and Computer-Integrated Manufacturing 73:102231. https://doi.org/10.1016/j.rcim.2021.102231.
   Web of Science ®Google Scholar
• Otte, M. W. 2015. A Survey of Machine Learning Approaches to Robotic Path-Planning. Boulder, CO, USA: University of Colorado at Boulder.
   Google Scholar
• Otte, S., L. Hofmaier, and M. V. 2018, October 4–7 Butz Integrative Collision Avoidance within RNN-Driven Many-Joint Robot Arms. In Proceedings of the 27th International Conference on Artificial Neural Networks, Rhodes, Greece, 748–758.
   Google Scholar
• Pires, J. N., and A. S. Azar. 2018. “Advances in Robotics for Additive/Hybrid Manufacturing: Robot Control, Speech Interface and Path Planning.” Industrial Robot: An International Journal 45 (3): 311–327. https://doi.org/10.1108/IR-01-2018-0017.
   Web of Science ®Google Scholar
• Prianto, E., M. Kim, J.-H. Park, J.-H. Bae, and J.-S. Kim. 2020. “Path Planning for Multi-Arm Manipulators Using Deep Reinforcement Learning: Soft Actor–Critic with Hindsight Experience Replay.” Sensors 20 : 5911. https://doi.org/10.3390/s20205911.
   PubMed Web of Science ®Google Scholar
• Robotiq, and Bayerdynamic. 2022. Bayerdynamic Scenario. Available online: https://robotiq.com/resource-center/case-studies/doubled-production-on-limited-floor-space (accessed on 1 February).
   Google Scholar
• Robotiq and Bayerdynamic. Accessed November 26, 2022. https://robotiq.com/resource-center/case-studies/doubled-production-on-limited-floor-space.
   Google Scholar
• Ruiz, S. G., L. V. Calderita, A. Hidalgo-Paniagua, and J. P. B. Rubio. 2020. “Measuring Smoothness as a Factor for Efficient and Socially Accepted Robot Motion.” Sensors 20 (23): 6822. https://doi.org/10.3390/s20236822.
   PubMed Web of Science ®Google Scholar
• Schäfer, P. M., F. Steinmetz, S. Schneyer, T. Bachmann, T. Eiband, F. S. Lay, and K. Nottensteiner. 2021, September. “Flexible Robotic Assembly Based on Ontological Representation of Tasks, Skills, and Resources.” In Proceedings of the International Conference on Principles of Knowledge Representation and Reasoning, 18 ( 1): 702–706.
   Google Scholar
• Schmidbauer, C., S. Schlund, T. B. Ionescu, and B. Hader. 2020. “Adaptive Task Sharing in Human-Robot Interaction in Assembly.” In Proceedings of the 2020 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), Singapore, 546–550. IEEE.
   Google Scholar
• Seals, C., M. B. Rosson, J. M. Carroll, T. Lewis, and L. Colson. 2002, September. “Fun Learning Stagecast Creator: An Exercise in Minimalism and Collaboration.” In Proceedings of the IEEE 2002 Symposia on Human Centric Computing Languages and Environments, Arlington, VA, USA, 177–186. IEEE.
   Google Scholar
• Seo, D. J., N. Y. Ko, and R. G. Simmons. 2009. “An Elastic Force Based Collision Avoidance Method and Its Application to Motion Coordination of Multiple Robots.” International Journal of Computer Integrated Manufacturing 22 (8): 784–798. https://doi.org/10.1080/09511920902741083.
   Web of Science ®Google Scholar
• Shimizu, M., K. Kobayashi, and K. Watanabe Clothoidal Curve-Based Path Generation for an Autonomous Mobile Robot. In Proceedings of the SICE-ICASE International Joint Conference, Busan, Korea, 18–21 October 2006, 478–481.
   Google Scholar
• Shome, R., K. Solovey, A. Dobson, D. Halperin, and K. E. Bekris. 2020. “Drrt*: Scalable and Informed Asymptotically-Optimal Multi-Robot Motion Planning.” Autonomous Robots 44 (3–4): 443–467. https://doi.org/10.1007/s10514-019-09832-9.
   Web of Science ®Google Scholar
• Spahn, M., M. Wisse, and J. Alonso-Mora. 2023. “Dynamic Optimization Fabrics for Motion Generation.” IEEE Transactions on Robotics 39 (4): 2684–2699. https://doi.org/10.1109/TRO.2023.3255587.
   Web of Science ®Google Scholar
• Steinmetz, F., V. Nitsch, and F. Stulp. 2019. “Intuitive Task-Level Programming by Demonstration Through Semantic Skill Recognition.” IEEE Robotics and Automation Letters 4 (4): 3742–3749. https://doi.org/10.1109/LRA.2019.2928782.
   Web of Science ®Google Scholar
• Steinmetz, F., A. Wollschläger, and R. Weitschat. 2018a. “Razer—a hri for visual task-level programming and intuitive skill parameterization.” IEEE Robotics and Automation Letters 3 (3): 1362–1369. https://doi.org/10.1109/LRA.2018.2798300.
   Google Scholar
• Tai, L., S. Li, and M. Liu A Deep-Network Solution Towards Model-Less Obstacle Avoidance. In Proceedings of the EEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 9–14 October 2016, 2759–2764.
   Google Scholar
• Tai, L., G. Paolo, and M. Liu Virtual-to-real deep reinforcement learning: Continuous control of mobile robots for mapless navigation. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, 24–28 September 2017, 31–36.
   Google Scholar
• Thomsen, M. R., P. Nicholas, M. Tamke, S. Gatz, Y. Sinke, and G. Rossi. 2020. “Towards Machine Learning for Architectural Fabrication in the Age of Industry 4.0.” International Journal of Architectural Computing 18 (4): 335–352. https://doi.org/10.1177/1478077120948000.
   Web of Science ®Google Scholar
• Tsarouchi, P., S. Makris, and G. Chryssolouris. 2016. “Human–Robot Interaction Review and Challenges on Task Planning and Programming.” International Journal of Computer Integrated Manufacturing 29 (8): 916–931. https://doi.org/10.1080/0951192X.2015.1130251.
   Web of Science ®Google Scholar
• Video 1. 2022. https://assembly.comemak.at/videos/video%20hrc1.mp4.
   Google Scholar
• Video 2. 2022. https://assembly.comemak.at/videos/video%20hrc2.mp4.
   Google Scholar
• Video 3. 2022. https://assembly.comemak.at/videos/video%20hrc3.mp4.
   Google Scholar
• Video 4. 2022. https://assembly.comemak.at/videos/video%20rrc1.mp4.
   Google Scholar
• Video 5. 2022. https://assembly.comemak.at/videos/video%20rrc2.mp4.
   Google Scholar
• Video 6. 2023. https://assembly.comemak.at/videos/video%20rrc3.mp4.
   Google Scholar
• Villarrubia, G., J. F. De Paz, P. Chamoso, and F. De la Prieta. 2018. “Artificial Neural Networks Used in Optimization Problems.” Neurocomputing 272:10–16. https://doi.org/10.1016/j.neucom.2017.04.075.
   Web of Science ®Google Scholar
• Wang, Y., H. He, and C. Sun. 2018. “Learning to Navigate Through Complex Dynamic Environment with Modular Deep Reinforcement Learning.” IEEE Transactions on Games 10 (4): 400–412. https://doi.org/10.1109/TG.2018.2849942.
   Web of Science ®Google Scholar
• Weintrop, D., A. Afzal, J. Salac, P. Francis, B. Li, D. C. Shepherd, and D. Franklin. 2018, April. Evaluating CoBlox: A comparative study of robotics programming environments for adult novices. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, Canada, 1–12.
   Google Scholar
• Wei, K., and B. Ren. 2018. “A Method on Dynamic Path Planning for Robotic Manipulator Autonomous Obstacle Avoidance Based on an Improved RRT Algorithm.” Sensors 18 (2): 571. https://doi.org/10.3390/s18020571.
   PubMed Web of Science ®Google Scholar
• Wildgrube, F., A. Perzylo, M. Rickert, and A. Knoll, 2019. Semantic Mates: Intuitive Geometric Constraints for Efficient Assembly Specifications, In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Presented at the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 6180–6187. https://doi.org/10.1109/IROS40897.2019.8968041
   Google Scholar
• Wong, C. C., S. Y. Chien, H. M. Feng, and H. Aoyama. 2021. “Motion Planning for Dual-Arm Robot Based on Soft Ac-Tor-Critic.” IEEE Access 2021 9:26871–26885. https://doi.org/10.1109/ACCESS.2021.3056903.
   Google Scholar
• Xie, Z., D. Shang, and P. Ren. 2015. “Optimization and Experimental Verification of Pick-And-Place Trajectory for a Delta Parallel Robot Based on Lamé Curves.” Journal of Mechanical Engineering 51 (1): 52–59. https://doi.org/10.3901/JME.2015.01.052.
   Google Scholar
• Xie, Z., P. Wu, and P. Ren 2016, August A Comparative Study on the Pick-and-Place Trajectories for a Delta Robot. In Proceedings of the International Design Engineering Technical Conference & Computers and Information in Engineering, Charlotte, NC, USA, 21–24.
   Google Scholar
• Zhang, X., and Z. Ming. 2019. “Trajectory Planning and Optimization for a Par4 Parallel Robot Based on Energy Consumption.” Applied Science 9 (13): 2770. https://doi.org/10.3390/app9132770.
   Google Scholar
• Zhu, Y., R. Mottaghi, E. Kolve, J. J. Lim, A. Gupta, L. Fei-Fei, and A. Farhadi. 2017. Target-driven visual navigation in indoor scenes using deep reinforcement learning. In Proceedings of the IEEE international conference on robotics and automation (ICRA), Singapore, 29 May – 3 June, 3357–3364.
   Google Scholar