2,268
Views
3
CrossRef citations to date
0
Altmetric
Literature Review

Taking DevOps mainstream: a critical review and conceptual framework

&
Pages 548-567 | Received 13 Jun 2020, Accepted 11 Oct 2021, Published online: 14 Nov 2021

References

  • Badshah, S., Khan, A. A., & Khan, B. (2020). Towards process improvement in DevOps: A systematic literature review. Proceedings of the evaluation and assessment in software engineering, 427–433. https://doi.org/10.1145/3383219.3383280
  • Bandara, W., Miskon, S., & Fielt, E. (2011). A systemantic tool-supported method for conduction literature reviews in information systems. Proceedings of The19th European Conference on Information Systems (ECIS 2011), 14.
  • Biddle, R., Brown, J., & Greenspan, S. (2017). from incident to insight: Incident responders and software innovation. IEEE Software, PP, 36 , (1), 56–62. https://doi.org/10.1109/MS.2017.442103917
  • Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007). Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software, 80(4), 571–583. https://doi.org/10.1016/j.jss.2006.07.009
  • Bucena, I., & Kirikova, M. (2017). Simplifying the DevOps adoption process. In BIR Workshops 16th International Conference on Perspectives in Business Informatics Research, Copenhagen, Denmark (pp. 15).
  • Callanan, M., & Spillane, A. (2016). DevOps: Making it easy to do the right thing. IEEE Software, 33(3), 53–59. https://doi.org/10.1109/MS.2016.66
  • Cao, L., Mohan, K., Xu, P., & Ramesh, B. (2009). A framework for adapting agile development methodologies. European Journal of Information Systems, 18(4), 332–343. https://doi.org/10.1057/ejis.2009.26
  • CAPES. (2017). CAPES qualis 2017—ranking of software engineering journals. Medium. https://medium.com/@aserg.ufmg/qualis-capes-ranking-of-software-engineering-journals-2013-2016-a76fbb5205a4
  • Chen, L. (2017). Continuous delivery: Overcoming adoption challenges. Journal of Systems & Software, 128, 72–86. bth. https://doi.org/10.1016/j.jss.2017.02.013.
  • Claps, G. G., Berntsson Svensson, R., & Aurum, A. (2015). On the journey to continuous deployment: Technical and social challenges along the way. Information and Software Technology, 57, 21–31. https://doi.org/10.1016/j.infsof.2014.07.009
  • Davis, J., & Daniels, R. (2016). Effective DevOps: Building a culture of collaboration, affinity, and tooling at scale (1st ed.). O’Reilly Media.
  • Debois, P. (2008). Agile Infrastructure and Operations: How Infra-gile are You? Agile 2008 Conference, (Toronto, ON, Canada: IEEE), 202–207. https://doi.org/10.1109/Agile.2008.42
  • Diaz, J., López-Fernández, D., Perez, J., & González-Prieto, Á. (2021). Why are many business instilling a DevOps culture into their organization? Empir Software Eng, 26: 25 . http://proxy.grenoble-em.com/login?url=https://www-proquest-com.proxy.grenoble-em.com/working-papers/why-are-many-business-instilling-devops-culture/docview/2405773489/se-2?accountid=42864
  • Dybå, T., & Dingsøyr, T. (2008). Empirical studies of agile software development: A systematic review. Information and Software Technology, 50(9), 833–859. https://doi.org/10.1016/j.infsof.2008.01.006
  • Ebert, C., Gallardo, G., Hernantes, J., & Serrano, N. (2016). DevOps. IEEE Software, 33 (3), 94. Business Premium Collection. https://doi.org/10.1109/MS.2016.68
  • Eck, A., Uebernickel, F., & Brenner, W. (2014). Fit for continuous integration: How organizations assimilate an agile practice. AMCIS 2014 proceedings, (Savannah, GA, United States of America: Association for Information Systems). https://aisel.aisnet.org/amcis2014/SystemsAnalysis/GeneralPresentations/7
  • Elgarah, W., Falaleeva, N., Saunders, C. C., Ilie, V., Shim, J. T., & Courtney, J. F. (2005). Data exchange in interorganizational relationships: Review through multiple conceptual lenses. SIGMIS Database, 36(1), 8–29. https://doi.org/10.1145/1047070.1047073
  • Erich, F., Amrit, C., & Daneva, M. (2014b). Cooperation between information system development and operations: A literature review. Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, 69(1–69), 1. https://doi.org/10.1145/2652524.2652598
  • Erich, F., Amrit, C., & Daneva, M. (2014a). A mapping study on cooperation between information system development and operations. In A. Jedlitschka, P. Kuvaja, M. Kuhrmann, T. Männistö, J. Münch, & M. Raatikainen (Eds.), Product-focused software process improvement (Vol. 8892, pp. 277–280). Springer International Publishing. https://doi.org/10.1007/978-3-319-13835-0_21
  • Fitzgerald, B., & Stol, K.-J. (2017). Continuous software engineering: A roadmap and agenda. Journal of Systems and Software, 123, 176–189. https://doi.org/10.1016/j.jss.2015.06.063
  • Forsgren, N. (2018). DevOps Delivers. Commun. ACM, 61(4), 32–33. https://doi.org/10.1145/3174799
  • Gall, M., & Pigni, F. (2018). Leveraging DevOps for mission critical software. AMCIS 2018 proceedings, (New Orleans, LA, United States of America: Association for Information Systems). https://aisel.aisnet.org/amcis2018/ITProjMgmt/Presentations/2
  • Ghantous, G. B., & Gill, A. (2017). DevOps: Concepts, practices, tools, benefits and challenges. PACIS 2017 Proceedings, (Pulau Langkawi, Langkawi, Malaysia: Association for Information Systems). https://aisel.aisnet.org/pacis2017/96
  • Gill, A. Q., Loumish, A., Riyat, I., & Han, S. (2018). DevOps for information management systems. VINE Journal of Information and Knowledge Management Systems, 48 (1), 122–139. Business Premium Collection. https://doi.org/10.1108/VJIKMS-02-2017-0007
  • Grover, V. (1999). From business reengineering to business process change management: A longitudinal study of trends and practices. IEEE Transactions on Engineering Management, 46(1), 36–46. https://doi.org/10.1109/17.740036
  • Holz, B., & West, M. (2019). Agile in the Enterprise 2019—Results Summary. Gartner Inc.
  • Humble, J., & Farley, D. (2010). Continuous delivery: Reliable software releases through build, test, and deployment automation (1st ed.). Addison Wesley.
  • Humble, J., & Molesky, J. (2011). Why enterprises must adopt devops to enable continuous delivery | cutter consortium. Cutter Business Techology Journal, 24(8) . https://www.cutter.com/article/why-enterprises-must-adopt-devops-enable-continuous-delivery-416516
  • Ivarsson, M., & Gorschek, T. (2011). A method for evaluating rigor and industrial relevance of technology evaluations. Empirical Software Engineering, 16(3), 365–395. https://doi.org/10.1007/s10664-010-9146-4
  • Jabbari, R., Ali, N. B., Petersen, K., & Tanveer, B. (2018). Toward a benefits dependency network for DevOps based on a systematic literature review. Journal of Software: Evolution and Process, 30(11), e1957. https://doi.org/10.1002/smr.1957
  • Jones, S., Noppen, J., & Lettice, F. (2016). Management challenges for DevOps adoption within UK SMEs. Proceedings of the 2Nd International Workshop on Quality-Aware DevOps, (Saarbrücken Germany: Association for Computing Machinery, New York, NY, United States of America), 7–11. https://doi.org/10.1145/2945408.2945410
  • Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. EBSE Technical Report (Keele University and Durham University Joint Report), 1.
  • Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009). Systematic literature reviews in software engineering – A systematic literature review. Information and Software Technology, 51(1), 7–15. https://doi.org/10.1016/j.infsof.2008.09.009
  • Kitchenham, B., Pfleeger, S. L., Pickard, L. M., Jones, P. W., Hoaglin, D. C., Emam, K. E., & Rosenberg, J. (2002). Preliminary guidelines for empirical research in software engineering. IEEE Transactions on Software Engineering, 28(8), 721–734. https://doi.org/10.1109/TSE.2002.1027796
  • Kranz, J., Leonhardt, D., & Kolbe, L. (2016). The enabling effect of collaborative innovation in information technology outsourcing on individual intrapreneurial behavior. ICIS 2016 Proceedings, (Dublin, Ireland: Association for Information Systems).
  • Lawson, J. (2021, January 18). In the digital economy, your software is your competitive advantage. Harvard Business Review. https://hbr.org/2021/01/in-the-digital-economy-your-software-is-your-competitive-advantage
  • Loukides, M. (2015, February 3). What is DevOps (yet again)? O’Reilly Media. https://www.oreilly.com/ideas/what-is-devops-yet-again
  • Lwakatare, L. E., Kuvaja, P., & Oivo, M. (2015). Dimensions of DevOps. In C. Lassenius, T. Dingsøyr, & M. Paasivaara (Eds.), Agile processes in software engineering and extreme programming (Vol. 212, pp. 212–217). Springer International Publishing. https://doi.org/10.1007/978-3-319-18612-2_19
  • Lwakatare, L. E., Kuvaja, P., & Oivo, M. (2016). Relationship of DevOps to Agile, lean and continuous deployment. In P. Abrahamsson, A. Jedlitschka, A. Nguyen Duc, M. Felderer, S. Amasaki, & T. Mikkonen (Eds.), Product-focused software process improvement (Vol. 10027, pp. 399–415). Springer International Publishing. https://doi.org/10.1007/978-3-319-49094-6_27
  • Middleton, P., & Joyce, D. (2012). Lean software management: BBC worldwide case study. IEEE Transactions on Engineering Management, 59(1), 20–32. https://doi.org/10.1109/TEM.2010.2081675
  • Mikkonen, T., Lassenius, C., Männistö, T., Oivo, M., & Järvinen, J. (2018). Continuous and collaborative technology transfer: Software engineering research with real-time industry impact. Information and Software Technology, 95, 34–45. https://doi.org/10.1016/j.infsof.2017.10.013
  • Miles, M., Huberman, A. M., & Saldana, J. (2021). Qualitative data analysis A methods sourcebook. SAGE Publications Ltd. https://us.sagepub.com/en-us/nam/qualitative-data-analysis/book246128
  • Muñoz, M., Negrete, M., & Mejía, J. (2019). Proposal to avoid issues in the DevOps implementation: A systematic literature review. In Á. Rocha, H. Adeli, L. P. Reis, & S. Costanzo (Eds.), New knowledge in information systems and technologies (Vol. 930, pp. 666–677). Springer International Publishing. https://doi.org/10.1007/978-3-030-16181-1_63
  • Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015). Synthesizing information systems knowledge: A typology of literature reviews. Information & Management, 52(2), 183–199. https://doi.org/10.1016/j.im.2014.08.008
  • Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008). Systematic mapping studies in software engineering. EASE, 8, 68–77 doi:10.14236/ewic/EASE2008.8.
  • Phillips, A. (2016). SE-Radio Episode 247: Andrew Phillips on DevOps : Software engineering radio. Software Engineering Radio, IEEE Computer Society . http://www.se-radio.net/2016/01/se-radio-episode-247-andrew-phillips-on-devops/
  • Rayome, A. D. (2018). Why 78% of organizations fail to get DevOps right. TechRepublic. https://www.techrepublic.com/article/why-78-of-organizations-fail-to-get-devops-right/
  • Resurchify. (2021). Conferences ranking/rating | top conferences. https://www.resurchify.com/conferences_ranking.php?query=software+engineering
  • Rodríguez, P., Haghighatkhah, A., Lwakatare, L. E., Teppola, S., Suomalainen, T., Eskeli, J., Karvonen, T., Kuvaja, P., Verner, J. M., & Oivo, M. (2017). Continuous deployment of software intensive products and services: A systematic mapping study. Journal of Systems and Software, 123, 263–291. https://doi.org/10.1016/j.jss.2015.12.015
  • Sánchez-Gordón, M., & Colomo-Palacios, R. (2018). Characterizing DevOps culture: A systematic literature review. In I. Stamelos, R. V. O’Connor, T. Rout, & A. Dorling (Eds.), Software process improvement and capability determination (Vol. 918, pp. 3–15). Springer International Publishing. https://doi.org/10.1007/978-3-030-00623-5_1
  • Sharp, J., & Babb, J. (2018, August 16). Is information systems late to the party? The current state of DevOps research in the association for information systems eLibrary. AMCIS 2018 Proceedings (New Orleans, LA, United States of America: Association for Information Systems). https://aisel.aisnet.org/amcis2018/AdvancesIS/Presentations/26
  • Smeds, J., Nybom, K., & Porres, I. (2015). DevOps: A definition and perceived adoption impediments. In C. Lassenius, T. Dingsøyr, & M. Paasivaara (Eds.), Agile processes in software engineering and extreme programming (Vol. 212, pp. 166–177). Springer International Publishing. https://doi.org/10.1007/978-3-319-18612-2_14
  • Snyder, B., & Curtis, B. (2018). Using analytics to guide improvement during an Agile–DevOps transformation. IEEE Software, PP, 35(99), 1. https://doi.org/10.1109/MS.2018.110162910
  • Stahl, D., Martensson, T., & Bosch, J. (2017). Continuous practices and devops: Beyond the buzz, what does it all mean? 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA), (Vienna, Austria: Piscataway, IEEE), 440–448. https://doi.org/10.1109/SEAA.2017.8114695
  • Stol, K.-J., Ralph, P., & Fitzgerald, B. (2016, May 18). Grounded Theory in Software Engineering Research: A Critical Review and Guidelines 120–131 . https://doi.org/10.1145/2884781.2884833
  • Stroud, R. (2017) Forrester. Cambridge, MA, United States of America: Forrester Research. https://go.forrester.com/blogs/2018-the-year-of-enterprise-devops/
  • Thomas, D. (2006). A general inductive approach for analyzing qualitative evaluation data. American Journal of Evaluation, 27(2), 237–246. https://doi.org/10.1177/1098214005283748
  • Unterkalmsteiner, M., Gorschek, T., Islam, A. K. M. M., Cheng, C. K., Permadi, R. B., & Feldt, R. (2012). Evaluation and measurement of software process improvement—A systematic literature review. IEEE Transactions on Software Engineering, 38(2), 398–424. https://doi.org/10.1109/TSE.2011.26
  • Van Belzen, M., Trienekens, J., & Kusters, R. (2019). Critical success factors of continuous practices in a DevOps context. International Conference on Information Systems Development (ISD), (Toloun, France: ISEN Yncréa Méditerranée). https://aisel.aisnet.org/isd2014/proceedings2019/ISDMethodologies/6
  • Vosniadou, S. (2013). International Handbook of Research on Conceptual Change. Routledge.
  • Webster, J., & Watson, R. T. (2002). Analyzing the past to prepare for the future: Writing a literature review. Management Information Systems Quarterly, 26(2), 3 doi:10.2307/4132319.
  • Wiedemann, A. (2017, July 19). A new form of collaboration in IT teams—exploring the DevOps Phenomenon. PACIS 2017 Proceedings. Pulau Langkawi, Langkawi, Malaysia: Association for Information Systems. http://aisel.aisnet.org/pacis2017/82
  • Wohlin, C. (2007). An analysis of the most cited articles in software engineering journals—2000. Information and Software Technology, 49(1), 2–11. https://doi.org/10.1016/j.infsof.2006.08.004
  • Yang, H., & Tate, M. (2012). A descriptive literature review and classification of cloud computing research. Communications of the Association for Information Systems, 29. https://doi.org/10.17705/1CAIS.03102.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.