The concept of collaborative engineering: a systematic literature review

Figures & data

Figure 1. Proposed collaborative engineering conceptual model.

A pyramid hierarchizing the proposed collaborative engineering conceptual model divided in a lower level and a higher level of collaboration sub concepts.

Table 1. Main references supporting the proposed CollEng-M&M framework’s sub concepts.

CollEng-M&M sub concepts	References
Application	Eijnatten & Putnik, 2004; Abreu & Camarinha-Matos, 2008; Lai, 2011; Pfaff & Hasan, 2011; Hancock et al., 2013; Brettel et al., 2014; Hummel et al., 2015; Lun & Zhao, 2015; Quint et al., 2015; Römer & Bruder, 2015; Khalid et al., 2016; Landherr et al., 2016; Nelles et al., 2016; Posselt et al., 2016; Romero et al., 2016, Romero et al., 2017; Syberfeldt et al., 2016; Bochmann et al., 2017; Longo et al., 2017; Peruzzini et al., 2017: Reuter et al., 2017; Sacha et al., 2017; Stern & Becker, 2017; Ustundag & Cevikcan, 2017; Büth et al., 2018; Darvish et al., 2018; Malik & Bilberg, 2018; Papazoglou et al., 2018; Petrillo et al., 2018; Posada et al., 2018; Tvenge & Martinsen, 2018; Bilberg & Malik, 2019; Cherubini et al., 2019; Demir et al., 2019; Emmanouilidis et al., 2019; Guerin et al., 2019; Ma et al., 2019; Nikolakis et al., 2019; Oyekan et al., 2019; Putnik & Putnik, 2019; Schuhmacher & Hummel, 2019; Ansari et al., 2020; Bousdekis et al., 2020; Birch-Jensen et al., 2020; Çil et al., 2020; Cimini et al., 2020; Fantini et al., 2020; Fletcher et al., 2020; Kaasinen et al., 2020; Liu & Wang, 2020; Pace et al., 2020; Rauch et al., 2020; Putnik et al., 2020, Putnik et al., 2021a,b,c; Manupati et al., 2022; L. Varela et al., 2022.
Co-creation	Lai, 2011; Pfaff & Hasan, 2011; Hancock et al., 2013; Brettel et al., 2014; Hummel et al., 2015; Romero et al., 2015, Romero et al., 2016, Romero et al., 2017; Syberfeldt et al., 2016; Bochmann et al., 2017; Longo et al., 2017; Peruzzini et al., 2017; Sacha et al., 2017; Van Laar et al., 2017; Ansari et al., 2018; Büth et al., 2018; Darvish et al., 2018; Fernández-Caramés & Fraga-Lamas, 2018; Petrillo et al., 2018; Posada et al., 2018; Cherubini et al., 2019; Demir et al., 2019; Emmanouilidis et al., 2019; Guerin et al., 2019; Nikolakis et al., 2019; Oyekan et al., 2019; Birch-Jensen et al., 2020; Bousdekis et al., 2020; Cimini et al., 2020; Çil et al., 2020; Fletcher et al., 2020; Kaasinen et al., 2020; Liu & Wang, 2020; Putnik et al., 2020; Rauch et al., 2020; Zolotová et al., 2020; Putnik et al., 2021a,b,c; Manupati et al., 2022; L. Varela et al., 2022.
Learning	Eijnatten & Putnik, 2004; Hummel et al., 2015; Quint et al., 2015; Kafle et al., 2016; Posselt et al., 2016; Peruzzini et al., 2017; Reuter et al., 2017; Sacha et al., 2017; Trstenjak & Cosic, 2017; Van Laar et al., 2017; Ansari et al., 2018; Büth et al., 2018; Fernández-Caramés & Fraga-Lamas, 2018; Juraschek et al., 2018; Petrillo et al., 2018; Posada et al., 2018; Tvenge & Martinsen, 2018; Ottogalli et al., 2019; Putnik & Putnik, 2019; Schuhmacher & Hummel, 2019; Arias et al., 2000; Birch-Jensen et al., 2020; Rauch et al., 2020; Zolotová et al., 2020.Putnik et al., 2020, Putnik et al., 2021a,Putnik et al., 2021b,Putnik et al., 2021c; Manupati et al., 2022; L. Varela et al., 2022.
Sharing	Abreu & Camarinha-Matos, 2008; Lai, 2011; Hancock et al., 2013; Brettel et al., 2014; Landherr et al., 2016; Longo et al., 2017; Zhao et al., 2017; Ansari et al., 2018; Darvish et al., 2018; Malik & Bilberg, 2018; Bilberg & Malik, 2019; Ma et al., 2019; Nikolakis et al., 2019; Oyekan et al., 2019; Arias et al., 2000; Bousdekis et al., 2020; Liu & Wang, 2020; Rauch et al., 2020; Putnik et al., 2021a,b; Manupati et al., 2022.
Communication	Eijnatten & Putnik, 2004; Abreu & Camarinha-Matos, 2008; Pfaff & Hasan, 2011; Hancock et al., 2013; Brettel et al., 2014; Haddara & Elragal, 2015; Quint et al., 2015; Römer & Bruder, 2015; Romero et al., 2015, Romero et al., 2016, Romero et al., 2017; Kafle et al., 2016; Khalid et al., 2016; Landherr et al., 2016; Posselt et al., 2016; Longo et al., 2017; Stern & Becker, 2017; Peruzzini et al., 2017; Van Laar et al., 2017; Zhao et al., 2017; Darvish et al., 2018; Malik & Bilberg, 2018; Papazoglou et al., 2018; Posada et al., 2018; Varela et al., 2018; Bilberg & Malik, 2019; Tvenge & Martinsen, 2018; Nikolakis et al., 2018; Petrillo et al., 2018; Guerin et al., 2019; Ma et al., 2019; Oyekan et al., 2019; Ansari et al., 2018, Ansari et al., 2020; Arias et al., 2000; Cimini et al., 2020; Fantini et al., 2020; Fletcher et al., 2020; Liu & Wang, 2020; Pace et al., 2020; Rauch et al., 2020; Zolotová et al., 2020; Putnik et al., 2021a,b,c; Manupati et al., 2022.
Connection	Pfaff & Hasan, 2011; Hancock et al., 2013; Haddara & Elragal, 2015; Chen et al., 2016; Kafle et al., 2016; Landherr et al., 2016; Posselt et al., 2016; Ustundag & Cevikcan, 2017; Ansari et al., 2018; Fernández-Caramés & Fraga-Lamas, 2018; Papazoglou et al., 2018; Emmanouilidis et al., 2019; Ma et al., 2019; Arias et al., 2000; Birch-Jensen et al., 2020; Çil et al., 2020; Cimini et al., 2020; Fantini et al., 2020; Kaasinen et al., 2020; Pace et al., 2020; Rauch et al., 2020.

Table 2. Groups of keywords.

KWG1 (How?)	KWG2 (Who?, Where?, What?)	KWG3 (Through which/ what I4.0 pillar?)
Collaboration Collaborative Collective Collaborating Co-creation Co-work Co-design Co-learn Open design Open Innovation Interoperation Interoperability Interaction Cognition Connection Communication Sharing Dialogue Networking Group decision Emergence Socializing Mindful Mindedness	Manufacturing Management Organization Enterprise Factory Production System Cyber physical Process Method Model Resource Robot Machine, Human Person User	Industry 4.0 Industrie 4.0 I4.0 Digital Integration Servitization Service Share Connect Communicate Integrate Distribute Smart Intelligent Learning Cognitive Autonomous Automatic Self P2P B2B X2X Point-to-point End-to-end Real time
Total = 648 publications

Table 3. Publications selection and evaluation process.

Publications analysis process	Number of publications analysis task performed	Number of publications removed	Number of publications considered
Identification	648 publications were identified through the WoS and Scopus databases searching and three groups of keywords, (Editors: Taylor & Francis, Science Direct, Elsevier, MDPI, IEEE, others).	–	–
Screened/ Exclusion	648 publications screened, and exclusion criteria defined applied	180 publications excluded, based on the exclusion criteria considered	424 publications reached, after the application of the exclusion criteria
Analyzed/ Inclusion	424 publications analyzed, to verify its accomplishment of the main inclusion criteria defined, for further general bibliographic analysis and classification (clustered)	177 publications not fully complying to the main inclusion criteria defined (not related to Industry – Manufacturing/ Production or Management)	291 publications reached, after the application of the inclusion criteria
Deeply analyzed	291 records identified as relevant publications, after a refined analysis, according to the defined inclusion criteria	164 publications (not really considering some level of the proposed Coll-M&M concept)	127 publications considered for a deeper analysis (more or less close or to some extend related with the proposed collaboration concept)
Deeper analysis of top most relevant publications for refined analysis and discussion	127 publications considered most important ones in the focused research domain	59 publications (not most impacting publications)	68 top most relevant publicationsa for further deeper analysis and discussion

aaccording to the process for refined publications screening and analysis referred in section 4.3.

Table 4. Principal characteristics regarding cooperation and collaboration issues in the main publications’ clusters.

Collaboration Type Level	Not human based (M-M)	Human-based (H-H, H-M)	Main skills focus
2nd level (higher level): with learning, and/or co-creation	Machine/ deep learning; automation; self-organization; neural networks; intelligent systems, exponential technology, collaborative robots, AI, CPS, …	Learning organization; semiotics; pragmatics; emergence; innovation; through co-x (co-design (open design), co-conceptualize, co-learn, co-decide, co-evolve, co-innovate, co-analyze, co-do or co-think), …	Hard + Soft skills -> business/ organizational oriented: paradigms, models, methodologies, methods, systems, and platforms (based on feedback, dialogue, and, higher level approaches, through learning paradigms, means, and software, besides other kind of technological support)
1st level (lower level): connection, communication, and sharing	Digitalization; integration, smart systems; smart objects, automatization, self-parametrization, semantic web; servitization, point-to-point, end-to-end communication, …	Recommendation models and systems, DSS, supervised machine learning, human-machine interactions, human-robot, co-x: co-work, co-act, co-produce, co-operate, co-maintain, co-transport …	Mainly hard skills oriented -> models, architectures, methods, algorithms, tools, devices, systems, and platforms (based on data, knowledge, mainly transactional processes, means, and tools)
Main paradigm focus	cooperation	collaboration

Figure 2. Number of publications from 2010 to 2021 in each cluster.

A bar chart expressing the total number of publications obtained from 2010 to 2021 divided in four groups of ‘Human-Learning’, ‘Human-NotLearning’, ‘NotHuman-Learning’, and ‘NotHuman-NotLearning’ clusters.

Figure 3. Evolution of the number of publications from 2010 to 2021 in each cluster.

A line chart representing the evolution of the number of publications obtained over the time period from 2010 to 2021 about each of the four groups of ‘Human-Learning’, ‘Human-NotLearning’, ‘NotHuman-Learning’, and ‘NotHuman-NotLearning’ clusters.

Table 5. Main outcomes from the literature supporting the proposed CollEng-M&M model and research questions.

Research question	Concepts	Outcomes	References
RQ1. The importance of learning in collaboration	Learning/ co-learning; Learning organization; Organizational learning; Semiotics; Pragmatics; Emergence; Evolution; Innovation;	Learning, the learning organization, chaordic enterprise, chaos &, complexity, and organizational learning The importance of lifelong learning/ co-learning	(Eijnatten & Putnik, 2004; Hummel et al., 2015; Quint et al., 2015; Reuter et al., 2017; Sacha et al., 2017; Trstenjak & Cosic, 2017; Büth et al., 2018; Juraschek et al., 2018; Posada et al., 2018; Ottogalli et al., 2019; Putnik & Putnik, 2019; Schuhmacher & Hummel, 2019; Putnik et al., 2021a,b,c). (Eijnatten & Putnik, 2004; Posselt et al., 2016; Van Laar et al., 2017; Tvenge & Martinsen, 2018; Putnik et al., 2021a,b,c; Manupati et al., 2022; L. Varela et al., 2022).
RQ2. The importance of the human in collaboration	Human centered collaboration, interactions or interplay, human-robot operation, co-X (co-work, co-operate, co-produce, co-do, co-maintain, co-transport, co-act, co-conceptualize, co-learn, co-decide, co-evolve, co-innovate, co-analyze, co-think, …) through: business/ organizational oriented paradigms, models, methodologies, methods, systems, and platforms, based on discussion, dialogue, and approaches, involving learning paradigms, means, devices, software, tools, and further technology	Central role of the human in collaboration Relevance of virtualization, networking, and dialogue for collaborating and building change in I4.0 manufacturing Creating shared understanding through collaborative design 21st century skills: the ‘knowledge worker’, and co-worker; request of the operators’ competencies in the I4.0, the Operator 4.0 Importance of human-machine collaboration or cooperation or human-AI symbiosis	(Eijnatten & Putnik, 2004; Syberfeldt et al., 2016; Birch-Jensen et al., 2020; Cimini et al., 2020; Putnik et al., 2020; Putnik et al., 2021a,b,c; Manupati et al., 2022; L. Varela et al., 2022). (Eijnatten & Putnik, 2004; Abreu & Camarinha-Matos, 2008; Hancock et al., 2013; Brettel et al., 2014; Quint et al., 2015; Khalid et al., 2016; Zolotová et al., 2020; Putnik et al., 2021a,b). (Arias et al., 2000; Abreu & Camarinha-Matos, 2008; Longo et al., 2017; Ma et al., 2019; Putnik et al., 2021a). (Hancock et al., 2013; Haddara & Elragal, 2015; Romero et al., 2016; Longo et al., 2017; Peruzzini et al., 2017; Van Laar et al., 2017; Fernández-Caramés & Fraga-Lamas, 2018; Petrillo et al., 2018; Bousdekis et al., 2020; Fletcher et al., 2020; Kaasinen et al., 2020; Zolotová et al., 2020; Putnik et al., 2021a). (Hancock et al., 2013; Lun & Zhao, 2015; Romero et al., 2015, Romero et al., 2016, Romero et al., 2017; Sacha et al., 2017; Malik & Bilberg, 2018; Tvenge & Martinsen, 2018; Bilberg & Malik, 2019; Demir et al., 2019; Emmanouilidis et al., 2019; Guerin et al., 2019; Nikolakis et al., 2019; Schuhmacher & Hummel, 2019; Ansari et al., 2020; Bousdekis et al., 2020; Fantini et al., 2020).
RQ3. The importance of the collaboration in the I4.0	Relevance of collaboration and/or of some main underlying issues in the I4.0: connection/ connectivity, communication, sharing, learning, co-creation: co-X (co or open design, co-working, cooperation, …), and applications	Importance of collaboration, and/or of its main sub concepts Collaboration along with learning as important issues in the I4.0 General requisite on humans’ skills and experience to collaborate in the I4.0	(Eijnatten & Putnik, 2004; Abreu & Camarinha-Matos, 2008; Lai, 2011; Römer & Bruder, 2015; Nelles et al., 2016; Posselt et al., 2016; Bochmann et al., 2017; Sacha et al., 2017; Papazoglou et al., 2018; Cherubini et al., 2019; Nikolakis et al., 2019; Putnik & Putnik, 2019; Birch-Jensen et al., 2020; Çil et al., 2020; Pace et al., 2020; Putnik et al., 2021a,b,c); Manupati et al., 2022; L. Varela et al., 2022; (Hummel et al., 2015; Kafle et al., 2016; Peruzzini et al., 2017; Reuter et al., 2017; Van Laar et al., 2017; Ansari et al., 2018; Fernández-Caramés & Fraga-Lamas, 2018; Petrillo et al., 2018; Zolotová et al., 2020; Putnik et al., 2021a). (Hancock et al., 2013; Haddara & Elragal, 2015; Römer & Bruder, 2015; Khalid et al., 2016; Stern & Becker, 2017; Longo et al., 2017; Ansari et al., 2018, Ansari et al., 2020; Putnik et al., 2021a).
RQ4. The importance of the I4.0 to reinforce or promote collaboration	I4.0 oriented models, architectures, methods, algorithms, approaches, methodologies, tools, devices, systems, and platforms, based on: machine/ deep learning; digital twin; augmented and mixed reality, self-organization; automation; neural networks; intelligent systems, exponential technology, collaborative robots, other AI, and CPS issues, devices and systems, DSS, H-H, H-M and M-M collaboration, digitalization; integration, smart systems; smart objects, self-parametrization, automatization, semantic web; servitization, point-to-point, end-to-end interactions, …	I4.0 managing the digital transformation, organizational and management change, with the human in the loop Need for technological support for communication, co-working/ collaborating, and collaborative robots Real time connectivity, middleware support, digitalization, devices, systems, tools and platforms for collaborating in the I4.0 I4.0 enabling new types of interactions between operators and machines	(Pfaff & Hasan, 2011; Hancock et al., 2013; Ustundag & Cevikcan, 2017; Ansari et al., 2018; Emmanouilidis et al., 2019; Nikolakis et al., 2019; Cimini et al., 2020). (Haddara & Elragal, 2015; Longo et al., 2017; Peruzzini et al., 2017; Ansari et al., 2018; Darvish et al., 2018; Oyekan et al., 2019; Ma et al., 2019; Varela et al., 2018; Liu & Wang, 2020; Pace et al., 2020; Zolotová et al., 2020) (Hancock et al., 2013; Chen et al., 2016; Kafle et al., 2016; Landherr et al., 2016; Ansari et al., 2018; Birch-Jensen et al., 2020; Çil et al., 2020; Fantini et al., 2020; Kaasinen et al., 2020; Pace et al., 2020). (Hancock et al., 2013; Römer & Bruder, 2015; Romero et al., 2015, Romero et al., 2016, Romero et al., 2017; Zhao et al., 2017; Malik & Bilberg, 2018; Posada et al., 2018; Tvenge & Martinsen, 2018; Petrillo et al., 2018; Bilberg & Malik, 2019; Guerin et al., 2019; Ansari et al., 2020; Fantini et al., 2020; Rauch et al., 2020;).

Eijnatten, F. M., & Putnik, G. D. (2004). Chaos, complexity, learning, and the learning organization: Towards a chaordic enterprise. The Learning Organization.

 Google Scholar

Abreu, A., & Camarinha-Matos, L. M. (2008). A benefit analysis model for collaborative networks. In Camarinha-Matos, L. M., Afsarmanesh, H. (Eds.), Collaborative networks: Reference modeling (pp. 253–276). Springer.

 Google Scholar

Lai, E. R. (2011). Collaboration: A literature review. Pearson Publisher. Retrieved. November, 11, 2016.

 Google Scholar

Pfaff, C. C., & Hasan, H. (2011). Wiki-based knowledge management systems for more democratic organizations. Journal of Computer Information Systems, 52(2), 73–82. https://www.tandfonline.com/doi/abs/10.1080/08874417.2011.11645542

 Web of Science ®Google Scholar

Hancock, P. A., Jagacinski, R. J., Parasuraman, R., Wickens, C. D., Wilson, G. F., & Kaber, D. B. (2013). Human-automation interaction research: Past, present, and future. Ergonomics in Design, 21(2), 9–14. https://doi.org/10.1177/1064804613477099

 Google Scholar

Brettel, M., Friederichsen, N., Keller, M., & Rosenberg, M. (2014). How virtualization, decentralization and network building change the manufacturing landscape: An industry 4.0 perspective. International Journal of Information and Communication Engineering, 8(1), 37–44. doi:10.5281/zenodo.1336426

 Google Scholar

Hummel, V., Hyra, K., Ranz, F., & Schuhmacher, J. (2015). Competence development for the holistic design of collaborative work systems in the logistics learning factory. Procedia CIRP, 32, 76–81. https://doi.org/10.1016/j.procir.2015.02.111

 Google Scholar

Lun, R., & Zhao, W. (2015). A survey of applications and human motion recognition with microsoft kinect. International Journal of Pattern Recognition and Artificial Intelligence, 29(5), 1555008. https://doi.org/10.1142/S0218001415550083

 Web of Science ®Google Scholar

Quint, F., Sebastian, K., & Gorecky, D. (2015). A mixed-reality learning environment. Procedia Computer Science, 75, 43–48. https://doi.org/10.1016/j.procs.2015.12.199

 Google Scholar

Römer, T., & Bruder, R. (2015). User centered design of a cyber-physical support solution for assembly processes. Procedia Manufacturing, 3, 456–463. https://doi.org/10.1016/j.promfg.2015.07.208

 Google Scholar

Khalid, A., Kirisci, P., Ghrairi, Z., Thoben, K. D., & Pannek, J. (2016). A methodology to develop collaborative robotic cyber physical systems for production environments. Logistics Research, 9(1), 23. https://doi.org/10.1007/s12159-016-0151-x

 Google Scholar

Landherr, M., Schneider, U., & Bauernhansl, T. (2016). The Application Center Industrie 4.0 Industry-driven manufacturing, research and development. Procedia Cirp, 57, 26–31. https://doi.org/10.1016/j.procir.2016.11.006

 Google Scholar

Nelles, J., Kuz, S., Mertens, A., & Schlick, C. M. Human-centered design of assistance systems for production planning and control: The role of the human in industry 4.0, in Proceedings of the 2016 IEEE International Conference on Industrial Technology (ICIT), Taipei, IEEE, 2016, pp. 2099–2104. https://ieeexplore.ieee.org/abstract/document/7475093

 Google Scholar

Posselt, G., Böhme, S., Aymans, S., Herrmann, C., & Kauffeld, S. (2016). Intelligent learning management by means of multi-sensory feedback. Procedia CIRP, 54, 77–82. https://doi.org/10.1016/j.procir.2016.05.061

 Google Scholar

Romero, D., Bernus, P., Noran, O., Stahre, J., & Fast-Berglund, Å. (2016). The operator 4.0: Human cyber-physical systems & adaptive automation towards human-automation symbiosis work systems. In IFIP international conference on advances in production management systems (pp. 677–686). Springer, Cham.

 Google Scholar

Romero, D., Wuest, T., Stahre, J., & Gorecky, D. (2017). Social factory architecture: Social networking services and production scenarios through the social internet of things, services and people for the social operator 4.0. In IFIP international conference on advances in production management systems (pp. 265–273). Springer, Cham.

 Google Scholar

Syberfeldt, A., Holm, M., Danielsson, O., Wang, L., & Lindgren Brewster, R. (2016). Support systems on the industrial shop-floors of the future: operators’ perspective on augmented reality. In 6th CIRP Conference on Assembly Technologies and Systems (CATS), Gothenburg, Sweden, May 16-18, 2016 (Vol. 44, pp. 108–113). Elsevier.

 Google Scholar

Bochmann, L., Bänziger, T., Kunz, A., & Wegener, K. (2017). Human-robot collaboration in decentralized manufacturing systems: An approach for simulation-based evaluation of future intelligent production. Procedia CIRP, 62, 624–629. https://doi.org/10.1016/j.procir.2016.06.021

 Google Scholar

Longo, F., Nicoletti, L., & Padovano, A. (2017). Smart operators in industry 4.0: A human centered approach to enhance operators’ capabilities and competencies within the new smart factory context. Computers & Industrial Engineering, 113, 144–159. https://doi.org/10.1016/j.cie.2017.09.016

 Web of Science ®Google Scholar

Peruzzini, M., Grandi, F., & Pellicciari, M. (2017). Benchmarking of tools for user experience analysis in industry 4.0. Procedia Manufacturing, 11, 806–813. https://doi.org/10.1016/j.promfg.2017.07.182

 Google Scholar

Reuter, M., Oberc, H., Wannöffel, M., Kreimeier, D., Klippert, J., Pawlicki, P., & Kuhlenkötter, B. (2017). Learning factories’ trainings as an enabler of proactive workers’ participation regarding Industrie 4.0. Procedia Manufacturing, 9, 354–360. https://doi.org/10.1016/j.promfg.2017.04.020

 Google Scholar

Sacha, D., Sedlmair, M., Zhang, L. S., Lee, J. A., Peltonen, J., Weiskopf, D., North, S. C., & Keim, D. A. (2017). What you see is what you can change: Human-centered machine learning by interactive visualization. Neurocomputing, 268, 164–175. https://doi.org/10.1016/j.neucom.2017.01.105

 Web of Science ®Google Scholar

Stern, H., & Becker, T. (2017). Development of a model for the integration of human factors in cyber-physical production systems. Procedia Manufacturing, 9, 151–158. https://doi.org/10.1016/j.promfg.2017.04.030

 Google Scholar

Ustundag, A., & Cevikcan, E. (2017). Industry 4.0: Managing the digital transformation. Springer.

 Google Scholar

Büth, L., Blume, S., Posselt, G., & Herrmann, C. (2018). Training concept for and with digitalization in learning factories: An energy efficiency training case, ECIS 2009 Proceedings. 161. 23, 171–176. https://aisel.aisnet.org/ecis2009/161/?utm_source=aisel.aisnet.org%2Fecis2009%2F161&utm_medium=PDF&utm_campaign=PDFCoverPages

 Google Scholar

Darvish, K., Wanderlingh, F., Bruno, B., Simetti, E., Mastrogiovanni, F., & Casalino, G. (2018). Flexible human–robot cooperation models for assisted shop-floor tasks. Mechatronics, 51, 97–114. https://doi.org/10.1016/j.mechatronics.2018.03.006

 Web of Science ®Google Scholar

Malik, A. A., & Bilberg, A. (2018). Digital twins of human robot collaboration in a production setting. Procedia Manufacturing, 17, 278–285. https://doi.org/10.1016/j.promfg.2018.10.047

 Google Scholar

Papazoglou, M. P., Elgammal, A., & Krämer, B. J. (2018). Collaborative on-demand product-service systems customization lifecycle. CIRP Journal of Manufacturing Science and Technology, 29(Part B), 205–219. doi:10.1016/j.cirpj.2018.08.003

 Google Scholar

Petrillo, A., De Felice, F., Cioffi, R., & Zomparelli, F. (2018). Fourth industrial revolution: Current practices, challenges, and opportunities. Digital Transformation in Smart Manufacturing, 1–20, 2018. doi:10.5772/interchopen.72304

 Google Scholar

Posada, J., Zorrilla, M., Dominguez, A., Simoes, B., Eisert, P., Stricker, D., Rambach, J., Dollner, J., & Guevara, M. (2018). Graphics and media technologies for operators in industry 4.0. IEEE Computer Graphics and Applications, 38(5), 119–132. https://doi.org/10.1109/MCG.2018.053491736

 PubMed Web of Science ®Google Scholar

Tvenge, N., & Martinsen, K. (2018). Integration of digital learning in industry 4.0. Procedia Manufacturing, 23, 261–266. https://doi.org/10.1016/j.promfg.2018.04.027

 Google Scholar

Bilberg, A., & Malik, A. A. (2019). Digital twin driven human–robot collaborative assembly. CIRP Annals, 68(1), 499–502. https://doi.org/10.1016/j.cirp.2019.04.011

 Web of Science ®Google Scholar

Cherubini, A., Passama, R., Navarro, B., Sorour, M., Khelloufi, A., Mazhar, O., Fraisse, P., Tempier, O., Crosnier, A., Fraisse, P., Ramdani, S., & Tarbouriech, S. (2019). A collaborative robot for the factory of the future: Bazar. The International Journal of Advanced Manufacturing Technology, 105(9), 3643–3659. https://doi.org/10.1007/s00170-019-03806-y

 Web of Science ®Google Scholar

Demir, K. A., Döven, G., & Sezen, B. (2019). Industry 5.0 and human-robot co working. Procedia Computer Science, 158, 688–695. https://doi.org/10.1016/j.procs.2019.09.104

 Google Scholar

Emmanouilidis, C., Pistofidis, P., Bertoncelj, L., Katsouros, V., Fournaris, A., Koulamas, C., & Ruiz-Carcel, C. (2019). Enabling the human in the loop: Linked data and knowledge in industrial cyber-physical systems. Annual Reviews in Control, 47, 249–265. https://doi.org/10.1016/j.arcontrol.2019.03.004

 Web of Science ®Google Scholar

Guerin, C., Rauffet, P., Chauvin, C., & Martin, E. (2019). Toward production operator 4.0: Modelling human machine cooperation in industry 4.0 with. Cognitive Work Analysis. IFAC-PapersOnLine, 52(19), 73–78. https://doi.org/10.1016/j.ifacol.2019.12.111

 Google Scholar

Ma, X., Tao, F., Zhang, M., Wang, T., & Zuo, Y. (2019). Digital twin enhanced human machine interaction in product lifecycle. Procedia CIRP, 83, 789–793. https://doi.org/10.1016/j.procir.2019.04.330

 Google Scholar

Nikolakis, N., Maratos, V., & Makris, S. (2019). A cyber physical system (CPS) approach for safe human-robot collaboration in a shared workplace. Robotics and Computer-Integrated Manufacturing, 56, 233–243. https://doi.org/10.1016/j.rcim.2018.10.003

 Web of Science ®Google Scholar

Oyekan, J. O., Hutabarat, W., Tiwari, A., Grech, R., Aung, M. H., Mariani, M. P., López-Dávalos, L., Ricaud, T., Singh, S., & Dupuis, C. (2019). The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans. Robotics and Computer-Integrated Manufacturing, 55, 41–54. https://doi.org/10.1016/j.rcim.2018.07.006

 Web of Science ®Google Scholar

Putnik, G. D., & Putnik, Z. (2019). Defining sequential engineering (SeqE), simultaneous engineering (SE), concurrent engineering (CE) and collaborative engineering (ColE): On similarities and differences. Procedia CIRP, 84, 68–75. https://doi.org/10.1016/j.procir.2019.07.005

 Google Scholar

Schuhmacher, J., & Hummel, V. (2019). Self-organization of changeable intralogistics systems at the ESB Logistics Learning Factory. Procedia Manufacturing, 31, 194–199. https://doi.org/10.1016/j.promfg.2019.03.031

 Google Scholar

Ansari, F., Hold, P., & Khobreh, M. (2020). A knowledge-based approach for representing Jobholder profile toward optimal human–machine collaboration in cyber physical production systems. CIRP Journal of Manufacturing Science and Technology, 28, 87–106. https://doi.org/10.1016/j.cirpj.2019.11.005

 Web of Science ®Google Scholar

Bousdekis, A., Apostolou, D., & Mentzas, G. (2020). A human cyber physical system framework for operator 4.0–artificial intelligence symbiosis. Manufacturing Letters, 25, 10–15. https://doi.org/10.1016/j.mfglet.2020.06.001

 Google Scholar

Birch-Jensen, A., Gremyr, I., & Halldórsson, Á. (2020). Digitally connected services: Improvements through customer-imitated feedback. European Management Journal, 38(5), 814–825. https://doi.org/10.1016/j.emj.2020.03.008

 Web of Science ®Google Scholar

Çil, Z. A., Li, Z., Mete, S., & Özceylan, E. (2020). Mathematical model and bee algorithms for mixed-model assembly line balancing problem with physical human–robot collaboration. Applied Soft Computing, 93, 106394. https://doi.org/10.1016/j.asoc.2020.106394

 Web of Science ®Google Scholar

Cimini, C., Pirola, F., Pinto, R., & Cavalieri, S. (2020). A human-in-the-loop manufacturing control architecture for the next generation of production systems. Journal of Manufacturing Systems, 54, 258–271. https://doi.org/10.1016/j.jmsy.2020.01.002

 Web of Science ®Google Scholar

Fantini, P., Pinzone, M., & Taisch, M. (2020). Placing the operator at the centre of industry 4.0 design: Modelling and assessing human activities within cyber-physical systems. Computers & Industrial Engineering, 139, 105058. https://doi.org/10.1016/j.cie.2018.01.025

 Web of Science ®Google Scholar

Fletcher, S. R., Johnson, T., Adlon, T., Larreina, J., Casla, P., Parigot, L., Del Mar Otero, M., & Alfaro, P. J. (2020). Adaptive automation assembly: Identifying system requirements for technical efficiency and worker satisfaction. Computers & Industrial Engineering, 139, 105772. https://doi.org/10.1016/j.cie.2019.03.036

 Web of Science ®Google Scholar

Kaasinen, E., Schmalfuß, F., Özturk, C., Aromaa, S., Boubekeur, M., Heilala, J., Heikkilä, P., Kuula, T., Liinasuo, M., Mach, S., Mehta, R., Petäjä, E., & Walter, T. (2020). Empowering and engaging industrial workers with Operator 4.0 solutions. Computers & Industrial Engineering, 139, 105678. https://doi.org/10.1016/j.cie.2019.01.052

 Web of Science ®Google Scholar

Liu, H., & Wang, L. (2020). Remote human–robot collaboration: A cyber–physical system application for hazard manufacturing environment. Journal of Manufacturing Systems, 54, 24–34. https://doi.org/10.1016/j.jmsy.2019.11.001

 Web of Science ®Google Scholar

Pace, F., Manuri, F., Sanna, A., & Fornaro, C. (2020). A systematic review of augmented reality interfaces for collaborative industrial robots. Computers & Industrial Engineering, 149, 106806. https://doi.org/10.1016/j.cie.2020.106806

 Web of Science ®Google Scholar

Rauch, E., Linder, C., & Dallasega, P. (2020). Anthropocentric perspective of production before and within Industry 4.0. Computers & Industrial Engineering, 139, 105644. IEEE. https://doi.org/10.1016/j.cie.2019.01.018

 Google Scholar

Putnik, G. D., Shah, V., Putnik, Z., & Ferreira, L. (2020). Machine learning in cyber-physical systems and manufacturing singularity - it does not mean total automation, human is still in the centre: Part I - manufacturing singularity and an intelligent machine architecture. Journal of Machine Engineering, 20(2020), 133–153. https://bibliotekanauki.pl/articles/1428709

 Google Scholar

Putnik, G. D., Putnik, Z., Shah, V., Varela, L., Ferreira, L., Castro, H., Catia, A., & Pinheiro, P. Collaborative engineering definition: Distinguishing it from concurrent engineering through the complexity and semiotics lenses. (2021a). IOP Conference Series: Materials Science and Engineering, 1174(1), 012027. IOP Publishing. https://doi.org/10.1088/1757-899X/1174/1/012027

 Google Scholar

Manupati, V. K., Putnik, G. D., & Varela, M. L. R. (2022). Smart and sustainable manufacturing systems for industry 4.0. CRC Press, Taylor & Francis Group.

 Google Scholar

Varela, L., Ávila, P., Castro, H., Putnik, G. D., Fonseca, L. M. C., & Ferreira, L. (2022). Manufacturing and management paradigms, methods and tools for sustainable industry 4.0-oriented manufacturing systems. Sustainability, 14(3), 1574. Editorial. MDPI, Swizerland .https://doi.org/10.3390/su14031574

 Web of Science ®Google Scholar

Romero, D., Noran, O., Stahre, J., Bernus, P., & Fast-Berglund, Å. (2015, September). Towards a human-centred reference architecture for next generation balanced automation systems: Human-automation symbiosis. In IFIP International Conference on Advances in Production Management Systems (pp. 556–566). Springer, Cham.

 Google Scholar

Van Laar, E., Van Deursen, A. J., Van Dijk, J. A., & De Haan, J. (2017). The relation between 21st century skills and digital skills: A systematic literature review. Computers in Human Behavior, 72, 577 588. https://doi.org/10.1016/j.chb.2017.03.010

 Web of Science ®Google Scholar

Ansari, F., Khobreh, M., Seidenberg, U., & Sihn, W. (2018). A problem-solving ontology for human-centered cyber physical production systems. CIRP Journal of Manufacturing Science and Technology, 22, 91–106. https://doi.org/10.1016/j.cirpj.2018.06.002

 Web of Science ®Google Scholar

Fernández-Caramés, T. M., & Fraga-Lamas, P. (2018). A review on human-centered IoT connected smart labels for the industry 4.0. IEEE Access, 6, 25939–25957. https://doi.org/10.1109/ACCESS.2018.2833501

 Web of Science ®Google Scholar

Zolotová, I., Papcun, P., Kajáti, E., Miškuf, M., & Mocnej, J. (2020). Smart and cognitive solutions for operator 4.0: laboratory H-CPPS case studies. Computers & Industrial Engineering, 139, 105471. https://doi.org/10.1016/j.cie.2018.10.032

 Web of Science ®Google Scholar

Kafle, V. P., Fukushima, Y., & Harai, H. (2016). Internet of things standardization in ITU and prospective networking technologies. IEEE Communications Magazine, 54(9), 43–49. https://doi.org/10.1109/MCOM.2016.7565271

 Web of Science ®Google Scholar

Trstenjak, M., & Cosic, P. (2017). Process planning in Industry 4.0 environment. Procedia Manufacturing, 11, 1744–1750. https://doi.org/10.1016/j.promfg.2017.07.303

 Google Scholar

Juraschek, M., Büth, L., Posselt, G., & Herrmann, C. (2018). Mixed reality in learning factories. Procedia Manufacturing, 23, 153–158. https://doi.org/10.1016/j.promfg.2018.04.009

 Google Scholar

Ottogalli, K., Rosquete, D., Amundarain, A., Aguinaga, I., & Borro, D. (2019). Flexible framework to model industry 4.0 processes for virtual simulators. Applied Sciences, 9(23), 4983. https://doi.org/10.3390/app9234983

 Google Scholar

Arias, E., Eden, H., Fischer, G., Gorman, A., & Scharff, E. (2000). Transcending the individual human mind—creating shared understanding through collaborative design. ACM Transactions on Computer-Human Interaction (TOCHI), 7(1), 84–113. https://doi.org/10.1145/344949.345015

 Google Scholar

Putnik, G. D., Putnik, Z., Shah, V., Varela, L., Ferreira, L., Castro, H., Catia, A., & Pinheiro, P. Collaborative engineering: a review of organisational forms for implementation and operation. (2021b). IOP Conference Series: Materials Science and Engineering, 1174(1), 012028. IOP Publishing. https://doi.org/10.1088/1757-899X/1174/1/012028

 Google Scholar

Putnik, G. D., Shah, V., Putnik, Z., & Ferreira, L. (2021c). Machine learning in cyber-physical systems and manufacturing singularity - it does not mean total automation, human is still in the centre: Part II - In-CPS and a view from community on Industry 4.0 impact on society. Journal of Machine Engineering, 21, 133–153. https://doi.org/10.36897/jme/134245

 Google Scholar

Zhao, W., Lun, R., Gordon, C., Fofana, A. B. M., Espy, D. D., Reinthal, M. A., Ekelman, B., Goodman, G. D., Niederriter, J. E., & Luo, X. (2017). A human-centered activity tracking service: Towards a healthier workplace. IEEE Transactions on Human-Machine Systems, 47(3), 343–355. https://doi.org/10.1109/THMS.2016.2611825

 Web of Science ®Google Scholar

Haddara, M., & Elragal, A. (2015). The readiness of ERP systems for the factory of the future. Procedia Computer Science, 64, 721–728. https://doi.org/10.1016/j.procs.2015.08.598

 Google Scholar

Varela, M. L., Putnik, G. D., Manupati, V. K., Rajyalakshmi, G., Trojanowska, J., & Machado, J. (2018). Collaborative manufacturing based on cloud, and on other I4. 0 oriented principles and technologies: A systematic literature review and reflections. Management and Production Engineering Review, 9(3), 90–99. https://doi.org/10.24425/119538

 Web of Science ®Google Scholar

Nikolakis, N., Sipsas, K., & Makris, S. (2018). A cyber-physical context-aware system for coordinating human-robot collaboration. Procedia CIRP, 72, 27–32. https://doi.org/10.1016/j.procir.2018.03.033

 Google Scholar

Chen, Y., Lee, G. M., Shu, L., & Crespi, N. (2016). Industrial internet of things-based collaborative sensing intelligence: Framework and research challenges. Sensors, 16(2), 215. https://doi.org/10.3390/s16020215

 PubMed Web of Science ®Google Scholar

Data Availability Statement

The authors confirm that the main data supporting the findings of this study are available within the article, and that the full data can be retrieved according to the search process conducted and described in the article, through the open Web of Science and Scopus repositories, correspondingly, at https://www.webofscience.com/wos/woscc/advanced-search, and https://www.scopus.com/search/form.uri?display=advanced.