343
Views
0
CrossRef citations to date
0
Altmetric
Current Issues in Method and Practice

Development of a maturity assessment model for sustainable tourism

ORCID Icon & ORCID Icon
Received 20 Sep 2023, Accepted 07 May 2024, Published online: 16 May 2024

ABSTRACT

Sustainability has become one of the most pressing worldwide concerns for the tourism sector. Destination managers face the challenge of developing strategies and assessing their success in pursuing sustainable development. However, the concept of sustainability is still vague, and existing measurement frameworks are complex and fail to sufficiently include relevant factors such as digitalisation. This article adopts a design science research (DSR) approach to address these issues, creating a conceptual solution for assessing sustainability in tourism destinations and providing directions for destinations’ future development based on a maturity model concept. Objectives for this conceptual solution are developed by critically reviewing relevant literature and existing assessment models for sustainable tourism and operationalised by designing a maturity assessment model for sustainable tourism. To validate this model, interviews with tourism experts and stakeholders are conducted in the Algarve region, Portugal. The study concludes by acknowledging limitations and offering directions for further research.

1. Introduction and motivation

Over the past decades, before the COVID-19 pandemic, tourism has become one of the largest and fastest-growing economic sectors worldwide (UNWTO, Citation2021). With an increase of 6% compared to the prior year, 2019 marked the tenth consecutive year of growth in international tourism (UNWTO, Citation2021), and post-pandemic statistics indicate a rapid return to previous trends (WEF, Citation2023). With this ongoing increase in demand, tourism practitioners have the crucial responsibility to manage growth effectively so that it aligns with the needs of local communities, the environment and tourists alike (Liu, Citation2003). Sustainable tourism development has been widely acknowledged as a means to mitigate adverse impacts and ensure destinations’ long-term viability and competitiveness (Bramwell & Lane, Citation1993; Simpson, Citation2001). Destinations must devise strategies and policies that balance utilising (natural) resources while safeguarding the territory and well-being of local communities, and based on these, design tools and approaches that enable continuous monitoring and timely corrective interventions (Marinello et al., Citation2023). Consequently, assessing existing and potential sustainability levels leveraging benchmarks becomes crucial to guide decision-making for future development (Ceron & Dubois, Citation2003).

Because sustainability and sustainable development have been a focus of the academic literature for decades, one could assume that a consensus about the term and its definition has been established. However, somewhat paradoxically, the opposite seems to be true: the concept of sustainability is still criticised as vague or confusing, varying from concept to philosophy, process or product in the context of tourism (Bloyer et al., Citation2004; Wall, Citation1997). Research reveals that this imprecision and ambiguity of the concept lends itself to misinterpretation and misuse (Butler, Citation1999) and inhibits effective monitoring of the successful implementation of sustainable tourism development plans within destinations (Bloyer et al., Citation2004). While several tools and practices have been developed for the evaluation and control of tourism activities (Marinello et al., Citation2023; Schianetz et al., Citation2007), no universal set of sustainable tourism indicators has been established (Alfaro Navarro et al., Citation2020), which leads to even more complexity for tourism stakeholders due to choice-overload, lacking clarity and description of metrics (Agyeiwaah et al., Citation2017; Marinello et al., Citation2023; Punzo et al., Citation2022). Simultaneously, while digitalisation has started to rapidly transform the tourism industry, even before the Covid-19 pandemic (Buhalis & Law, Citation2008), existing tourism assessment models show limited integration regarding its potential as a sustainability driver (Ivars-Baidal et al., Citation2023; Shafiee et al., Citation2019). Given these circumstances, Estêvão et al. (Citation2019) note that properly implementing practices to foster sustainability remains sporadic within the tourism sector.

Employing a Design Science Research (DSR) approach (Hevner et al., Citation2004), this article addresses this research gap by developing a contemporary and comprehensive maturity assessment model for sustainable tourism incorporating digitalisation potentials. Thus, we aim to offer an operational framework to enable practitioners to address sustainable development challenges in their location by assessing their destinations’ current maturity state and developing a vision, priorities and course of action towards a more sustainable future. Additionally, this article seeks to contribute to the existing literature on measuring sustainable tourism and inspire more extensive research into maturity assessment models for sustainable tourism. The remainder of this article is structured firstly by explaining the research method used. Secondly, a literature review of the main underlying concepts of sustainable tourism, the measurement of sustainable tourism and existing assessment models is conducted to formulate objectives for the conceptual solution. Next, the research results in the form of the designed and validated maturity assessment model for sustainable tourism are presented and discussed. The final considerations and direction for further research conclude the article.

2. Research methodology

2.1. Design science research (DSR)

Design Science Research (DSR) is dedicated to creating innovative artefacts, such as constructs, models, methods and instantiations, to resolve human or organisational challenges (Hevner et al., Citation2004). Formularende DSR is centred around addressing complex and relevant real-world issues from a solution-oriented perspective, leveraging scientific reasoning such as forecasting, recognising or clarifying phenomena (van Aken & Romme, Citation2009). Its focus on practical problem-solving for human challenges makes DSR especially useful for the research gap previously identified.

Following the sequential phases of the DSR approach highlighted by Vaishnavi and Kuechler (Citation2007), awareness of the problem, suggestion, development, evaluation, and conclusion, our approach began with a literature review for related solution approaches, i.e. existing assessment models for sustainable tourism, their integration of technological aspects, and the potential of maturity models (Section 3) to inform the formulation of the conceptual solution's objectives and its development, described in Section 4. Evaluation of the design artifact is an essential part of DSR as it provides essential feedback on the design process and the developed product (Hevner et al., Citation2004). Qualitative methods, such as interviews, field or case studies are hereby potential methods to underpin the rigor and study socio-technical characteristics such as usefulness of a designed artifact (Hevner & Chatterjee, Citation2010). In our study, validation of the model was obtained using semi-structured interviews with tourism experts and stakeholders in the region of Algarve, Portugal. In the last step, policy recommendations and implications for tourism agencies conclude the process (Section 5).

2.2. Literature review process

This article undertook an extensive literature review, encompassing academic-natured documents accessible on Scopus, b-On, Google and Google Scholar and associated with the relevant field of study. To include influential institutions’ sustainability assessment models, such as those of the UNWTO, and non-scientific sources, such as websites, were reviewed. Articles that include keywords relevant to the research domain, such as sustainable tourism, maturity assessment, maturity model, sustainability maturity model and smart tourism, in either title, keywords or abstract, and that were published between January 2004 and December 2022 were selected for the review based on the perceived relevance for the defined research scope. Publications not related to the research scope and publications not written in English were excluded. In the last step, the final set of publications was analysed to extract relevant sustainability dimensions and sub-domains and to identify missing concepts or links to be addressed in the subsequent model design. To select existing assessment models as a sub-process of the general literature review, the following general criteria were applied: (i)the model needs to state that it is measuring tourism destination sustainability clearly; (ii)sufficient detailed information about indicators and underlying methodologies of the model had to be available online; (iii)the model should be widely used and well-known.

Publications related to the models were scrutinised in three stages, i.e. by title, abstract and full-text, meaning that the titles of the models were evaluated, the abstracts (if available) were reviewed to ensure the model fit the desired scope, and finally, the full-text of each model was thoroughly reviewed using the inclusion and exclusion criteria. At each stage, publications that did not satisfy the abovementioned criteria were excluded (Meade & Richardson, Citation1997). It must be noted that the researchers performed this screening independently. A total of four models were selected for further analysis based on this approach.

3. Gaps and potentials in measuring tourism sustainability

3.1. Reviewing existing assessment models

In the past two decades, several operational tools and frameworks around tourism indicators have been created by various institutions (EC, Citation2016; GDSM, Citation2019; GSTC, Citation2019; UNWTO, Citation2004; WEF, Citation2022), as well as researchers in the tourism domain (e.g. Choi & Sirakaya, Citation2006; Crotts et al., Citation2022; Gato et al., Citation2021; Punzo et al., Citation2022; Schianetz & Kavanagh, Citation2008). Consequently, many sustainability indicators exist, which are poorly aligned and do not follow a pattern (Agyeiwaah et al., Citation2017; Marinello et al., Citation2023; Santana et al., Citation2019).

Based on the aforementioned screening process, four models were selected for a deeper analysis regarding their features, dimensions and sub-domains of sustainable tourism: ‘Indicators of Sustainable Development for Tourism Destinations’ (UNWTO, Citation2004), ‘European Tourism Indicators System – ETIS’ (EC, Citation2016), ‘GSTC Destination Criteria’ (GSTC, Citation2019) and ‘Global Destination Sustainability Index – GDSI’ (GDSM, Citation2022).

When reviewing the four models in detail, significant overlaps were identified regarding the chosen dimensions centred around socio-cultural, environmental and economic sustainability, along with a view on governance (). Consequently, the models are in line with prevailing literature on the dimensions of sustainable tourism destinations (Asmelash & Kumar, Citation2019; Blancas et al., Citation2010; Farrell & Twining-Ward, Citation2004; Postma et al., Citation2017). What can be seen from the selected models, however, is that they differ in the total number of indicators and their distribution across the dimensions. While the dimension of socio-cultural sustainability has an equal weight of around 30% of associated indicators in the models of ETIS, UNWTO and GSTC, this aspect is relatively underrepresented in the GDSI model, with a mere 12% related to the indicators of Social Progress Performance, not specifically addressing culture. Environmental sustainability is the highest represented dimension in the models of ETIS and GSTC, with 40% and 37% of all indicators, respectively, while only accounted for 19% in the GDSI model and 14% in the model of UNWTO. Economic sustainability is attributed with moderate importance of around 20% in the models of UNWTO and ETIS but only 7% in the GSTC model. The GDSI model focuses on supplier performance instead of an overall economic dimension and attributes 14% of indicators to this topic. Finally, the dimension concerned with governance and sustainable management of destinations has only a minor share of 7% of indicators in the ETIS model. However, it holds a share of around 30% in the GSTC and UNTWO models and even represents 54% of indicators of the GDSI model.

Table 1. Overall levels of the developed maturity assessment model.

What is interesting to note is that none of the models specifically emphasises aspects related to technology or data analytics. Indicators included in the GDSI and GSTC models are phrased rather vaguely (e.g. around a system to monitor and respond to socio-economic, cultural and environmental issues and impacts arising from tourism’) and disproportionate to the remaining dimensions and sub-domains.

As noted before, there is some general criticism of the overall concepts of indicators for sustainable tourism from the literature. When reviewing the four selected models in detail, some shortcomings can be identified that align with the general criticisms, along with gaps in the model design that may hinder the applications of these models by tourism practitioners.

The often-criticised complexity and ambiguity of indicators that may inhibit a broad adaption of sustainable tourism practices (Agyeiwaah et al., Citation2017; Jovicic, Citation2014; Marinello et al., Citation2023) is demonstrated in at least three of the models, ranging from 169 to over 700 indicators. The UNWTO (Citation2004) suggests its model to function as a ‘menu’, allowing destinations to select relevant indicators. However, despite the definition of twelve baseline indicators, non-expert stakeholders may find the number of options challenging to handle in practice. Additionally, there is a notable variation in the granularity and concreteness of indicators across and within models. Without a weighting system, this may distort assessment results, potentially biasing certain aspects without theoretical justification (Ivars-Baidal et al., Citation2023). The GDSI model attempts to rectify this issue with precise definitions and a scoring system yet fails to provide a transparent rationale for applying weighting logic. Divergent levels of granularity and concreteness create many indicator variations on similar topics, further preventing the emergence of clarity and unambiguity regarding the sustainability concept (Tanguay et al., Citation2013).

Santana et al. (Citation2019) criticise that existing sustainability assessment models often fail to provide clear definitions for the indicators’ aspired targets, numerical values or thresholds that limit their practical value. This critique applies in part to the four models under investigation. While the UNWTO model gives general recommendations regarding suitable benchmark data, the GDSM model provides numerical ranges for quantitative indicators for the assessment and provides benchmarks upon results analysis. However, the GSTC and ETIS models do not detail targets or thresholds.

To allow for an intuitive interpretation and understanding of assessment results by different stakeholders, a model’s assessment methodology, as well as underlying assumptions and meanings of indicators, needs to be explained and graphically represented, highlighting how they compare to the past and future goal or benchmarks (Waldron & Williams, Citation2002). In addition, an action framework or guidance that translates the information from indicators into suitable management actions is crucial for successfully implementing the models in practice (Agyeiwaah et al., Citation2017; Twining-Ward & Butler, Citation2002). While the literature review did not reveal any details about the presentation of the GDSI result and related recommendations, it can be said that the other three models do not include any features for a clear display and communication of assessment results or a translation of the assessment results into management actions.

3.2. Digitalisation and its reflection on existing assessment models

Information and communications technology (ICT) research shows how the tourism industry has been forever altered by digitalisation. Buhalis and Law (Citation2008) argue that technology will remain one of the most significant influences to drive change within tourism. The Covid-19 pandemic further acerbated this development, with tourism businesses adapting to the demands of the ‘new normal’ as a critical factor for future competitiveness and survival, e.g. through the adaptation of intelligent means such as AI, robotics, sensors, digital marketing or booking services (Cheng et al., Citation2023). This rapid digitalisation of the industry, accelerated by cloud technology, has enabled unprecedented capabilities regarding big data, bridging the existing information gaps between all stakeholders in the tourism ecosystem (Rahmadian et al., Citation2022). While the contribution and potential exploitation of ICT to support the development of sustainable tourism had long remained an underexplored gap in tourism research (Ali & Frew, Citation2014a; Dao et al., Citation2011; Melville, Citation2010), it is becoming a dedicated research stream with significant potential (Ali & Frew, Citation2014b; Goessling, Citation2017; Rahmadian et al., Citation2022) that runs in parallel with research focusing on smart tourism destinations (Buhalis & Amaranggana, Citation2013; Gretzel et al., Citation2015). Ali and Frew (Citation2014a) note how ICT can drive environmental sustainability through its application in managing and controlling tourism development and identifying sensitive areas. In terms of economic sustainability, ICT can be leveraged to better manage and provide fast, accurate and up-to-date information, and map and monitor economic impacts. In the context of socio-cultural sustainability, the use of smartphone and sensor data can help to manage tourist flows, optimise parking sites and disperse tourists away from congested areas, thereby tackling overtourism, preserving historical attractions and improving residents’ quality of life (Lawson, Citation2006; Soares et al., Citation2022). Regarding sustainable destination management and governance, ICT and open data can enhance stakeholder collaboration and decision-making processes (Soares et al., Citation2022). In addition, DMOs can leverage real-time visitor data to understand their customers’ needs better and, therefore, enhance the tourism experience, improve business operations and drive competitiveness (Shen et al., Citation2020).

While all of these potential benefits of ICTs on sustainable tourism are noted in theory, it is interesting to see that hardly any of the existing smart city or smart destination concepts translate this into measurable actions (Hoejer & Wangel, Citation2015; Ivars-Baidal et al., Citation2023). Ivars-Baidal et al. (Citation2023), therefore, formulate the need for researchers, policymakers and planners to redesign indicator systems to fully account for sustainability aspects and integrate these into smart city and smart destination agendas, models and continuous management.

3.3. Using maturity models to assess tourism sustainability

Originating from Information Systems (IS) research and the so-called ‘Capability Maturity Model’ (Paulk et al., Citation1993), maturity models (MMs) have proliferated across various domains. They are most commonly applied in business practice by software companies and consultancies (Poeppelbuss & Roeglinger, Citation2011). MMs generally assume that organisational development follows predictable patterns of evolution and change (Gottschalk, Citation2009). In an MM, these patterns are conceptualised in terms of linear, evolutionary stages or levels that indicate how capabilities progressively evolve along a desired, expected, or logical maturity path from an initial stage of development towards total maturity with high performance (Poeppelbuss & Roeglinger, Citation2011; Warnecke et al., Citation2019).

Maturity models are commonly applied as a strategic tool to perform comparisons of current and desirable maturity levels, to determine a path or roadmap for each level depending on existing maturity gaps and eventually to control the progress of their implementation (Becker et al., Citation2010). A characteristic of MMs is that they are mainly applied in defining, delimiting and accounting for new and emerging social or technological phenomena (such as digitalisation) and their impact on organisations or other entities (Bley & Schoen, Citation2019). Regarding the sustainability domain, a small number of MM applications can be found in the literature, mainly focused on organisations’ supply chain and environmental management capabilities (Aguiar et al., Citation2021). MM applications in the context of tourism are scarce and usually follow the IS perspective by focusing on smart tourism. Lim et al. (Citation2019) build upon existing applications for smart to develop a capability maturity framework for smart tourism destinations. Imboden et al. (Citation2022) apply the principles of smart destinations to develop a maturity model for lesser-known, peripheral mountain resorts. Afonso et al. (Citation2015) use public data mining to define a regional maturity model to measure and assess differences in smart cities in Brazil and propose managerial mechanisms to improve policy-making based on these findings. What can be seen from these few applications is that MMs have the potential to go beyond an assessment of a current state of performance metrics, like is the case for indicator models, and add value for practitioners by guiding improvement measures, required for further development within a given domain.

4. Designing the maturity model

Based on the literature review on gaps and potentials regarding the measurement of sustainable tourism, it can be concluded that different methods, such as indicator models, have been developed to assess the sustainability of tourism destinations. However, existing models provide a high level of complexity and ambiguity within a narrow focus, hence needing more clarity regarding implementation, deduction of management actions and communication. A maturity model concept can help compare current and desirable developmental stages and provide relevant guidance to derive and prioritise suitable improvement measures and courses of action for future development. Consequently, the objectives of the conceptual solution can be summarised as follows: To provide an operational tool for the assessment of tourism destinations with regards to sustainability, we aim to develop a model that provides usefulness for tourism managers in the evaluation of the current and desired maturity levels of their destination and deduction of a potential development path (Usefulness). The model should provide actionable guidance for destinations and allow for further prioritisation and planning of measures to develop their sustainability maturity (Implementation). While compiled from objective, research-funded indicators on all relevant dimensions for sustainable tourism under consideration of technology integration (Coverage and Completeness), the model should balance theoretical complexity and practical ease of use. Finally, the tool should include data visualisation features to support the communication of assessment results and the translation of assessment results into actions (Simplicity).

4.1. Implementation

Following the approach suggested by Agyeiwaah et al. (Citation2017) for the composition of indicator models, the model design commenced with an initial formulation of dimensions and sub-domains based on a documental analysis of the existing tourism sustainability indicator models selected in Section 3.1. All indicators and their related sub-domains identified from the models were collated in one long list in Excel. Indicators were then reviewed and mapped to the four sustainability dimensions identified in the literature review, i.e. an environmental, economic, socio-cultural and destination management dimension. Each dimension’s long list of indicators was reviewed to eliminate duplicates from synthesising the different models. Common themes for the sub-domains of indicators were identified and updated as new items emerged from the analysis of the remaining models. This updating process continued until saturation, upon which new data categories were fit into existing ones.

To account for the potential impacts of technology on the sustainable development of destinations, the defined dimensions and sub-domains were cross-checked against the findings from the literature review and, in particular, the Smart Destination Indicator model (SDRV) defined by Ivars-Baidal et al. (Citation2017, p. 2021a, 2021b). Sub-domains or indicators not previously included in the list were either added as new items or fit into existing data categories within the dimensions. The resulting four sustainability dimensions and 30 sub-domains are summarised in .

Table 2. Maturity model dimensions and sub-domains.

Four sequential maturity levels were defined, including qualitative or quantitative requirements and indicators that distinguish each level, ranging from 1 to 4: 1-Basic, 2-Progressing, 3-Advanced, and 4-Leading (). In Level 1, there is a basic understanding of tourism impacts and sustainability requirements in the destination; however, no formalised approach to sustainable tourism development has been implemented, and ICT integration is limited. In Level 4, sustainability is a central guiding principle for tourism development in the destination; continuous planning takes place based on real-time data advanced analytics, and DMO leadership focuses on driving the further development of the destination's sustainability strategy, continuous performance management and active support and information for all tourism stakeholders.

Table 3. Overall levels of the developed maturity assessment model.

The synthesised list of dimensions and sub-domains was extended based on these common characteristics by adding the four maturity levels. The evaluation criteria for each level and each sub-domain were specified. The resulting maturity assessment model for sustainable tourism uses a matrix-type based on the maturity domains and levels, describing the characteristics and indicators that determine the criteria for each maturity level per sub-domain, as illustrated in .

Figure 1. Matrix-type maturity model (exemplary ratings).

Source: Own elaboration.

Figure 1. Matrix-type maturity model (exemplary ratings).Source: Own elaboration.

The conceptual model has been developed in Excel. In the input matrices, drop-down menus in each sub-domain enable the rating of as-is and desired to-be maturity level which forms an integral part of the practical implementation of the model. The results from this maturity assessment are provided as a graphical analysis. shows exemplary outputs for the maturity assessment, summarising the average maturity level for each dimension based on the sub-domain results and detailed analyses for each dimension. The radar charts hereby show the as-is maturity state of the destination and the desired to-be maturity state. The table on the left displays the absolute numbers’ maturity level and gap in each dimension or sub-domain. The developed model allows the destination to assess their maturity level and compare results across the four dimensions and sub-domains of sustainability easily and intuitively. In addition, it shows a more detailed assessment of current and desired maturity levels and resulting gaps in each sub-domain, both graphically and numerically. To provide practitioners with actionable guidance for the design of measures to address maturity gaps, the results view per dimension includes a section regarding ‘Top areas for improvement’, which gives an inventory of relevant metrics for those sub-domains with the numerically highest difference between current and desired maturity level.

Figure 2. Maturity assessment output: Maturity radar charts (exemplary ratings).

Source: Own elaboration, metrics collated from EC (Citation2016); GDSM (Citation2022); GSTC (Citation2019); Ivars-Baidal et al. (Citation2021); UNWTO (Citation2004).

Figure 2. Maturity assessment output: Maturity radar charts (exemplary ratings).Source: Own elaboration, metrics collated from EC (Citation2016); GDSM (Citation2022); GSTC (Citation2019); Ivars-Baidal et al. (Citation2021); UNWTO (Citation2004).

4.2. Validation

In order to support the construct validity of the designed model and to ensure that the incremental development of the model held practical relevance, semi-structured interviews with tourism experts and stakeholders were conducted.

The number of necessary interviews in qualitative research is difficult to quantify as the variable is experience-based, varying across research domains and objectives (Kurz et al., Citation2007). Moreover, interviewee availability and willingness within the designated timeframe can affect the required number of interviews (Glaeser & Laudel, Citation2010). Based on the availabilities during the validation period, a final number of six participants from the fields of tourism administration, regional planning and sustainable tourism research was achieved.

The interview process was designed as follows. Before the individual interviews, participants were provided with a pre-read to familiarise themselves with the background and design of the maturity assessment model. The interviews themselves were set up in two parts. The first part included an introduction of the participants. A presentation of the maturity model followed this introduction. The second part used a semi-structured interview guide to gather participants’ feedback on the model across the categories of Simplicity, Coverage and Completeness, Usefulness and Implementation. It can be noted that a saturation regarding three of the four assessed dimensions was achieved in these interviews, where redundancy signalled that data collection was ceasing. For the fourth dimension of Coverage and Completeness, relevant insights were achieved. However, a larger sample would be required to assess common themes and similarities in the interviewee’s replies, as highlighted in the limitations in Section 6.

For each interview, a synopsis of the results was done, and content analysis was applied as an objective approach to analyse and summarise the data and identify similarities and differences in the participants’ feedback (Krippendorff, Citation2004). The interviews held in the validation stage can be described as confirmatory or feedback-oriented because they were aimed at evaluating a given tool (Warnecke et al., Citation2019). However, experts were asked to provide suggestions for improvement and constructive criticism to inform potential needs for further refinement of the model in the future. Finally, additional qualitative information gathered during the interviews (e.g. regarding potential risks and challenges for implementation) was used to identify potential directions for future research and further development of the model.

In terms of Coverage and Completeness, the interviewees agreed that the model covers the relevant scope of sustainable tourism for different types of destinations and shows alignment with international sustainability agendas. The separation of the Destination Management dimension gained specific support as it emphasises the governance and management of destinations. The inclusion of technology as a transversal factor gained broad agreement due to its significance for developing destination capabilities nowadays. Additionally, the maturity levels were supported by all interviewees to depict a delineated and adequate developmental path for destinations.

Concerning the model's Usefulness, interviewees rated it as a highly valuable operational tool for managing tourism destinations, particularly regarding planning and evaluation. All participants praised the model's innovative application of a maturity concept to sustainable tourism for its potential for industry and academia. Its dynamic approach was highlighted as instrumental in fostering a holistic perspective on sustainability and prioritising all relevant dimensions beyond economic growth.

Feedback on assumed challenges and success factors for the Implementation of the model revealed a common concern regarding stakeholder coordination and management, including a potential resistance to change and lack of acceptance of assessment results, especially from the side of policymakers. While the model design cannot solve these concerns, this feedback informs recommendations for practical implementation in the next section.

5. Discussion and implications

The proposed maturity assessment model, including the application of technology, offers valuable potential for destinations, particularly those with limited resources, to prioritise areas for development strategically and, based on that, allocate public funds efficiently, thereby enhancing tourism planning and management (Punzo et al., Citation2022). The model's outcomes can contribute to effective governance for sustainable tourism through various means, including the definition of rules and guidelines, policy evaluations, establishment of adequate regulatory and legal frameworks, destination and site management plans, contingency plans, standards and practices to monitor safety and security, and policies promoting socially beneficial tourism initiatives (Punzo et al., Citation2022; UNWTO, Citation2004).

The model's specific emphasis on destination management can help tourism agencies establish a vision and roadmap for developing capabilities to support other tourism stakeholders with training, capacity building, professional and technical assistance or financial incentives to make changes towards a more sustainable future. Moreover, tourism agencies can use the assessment results to drive further knowledge-sharing and innovation processes by connecting the different stakeholders in the tourism sector or building partnerships or joint venture arrangements (Dwyer & Kim, Citation2003; UNWTO, Citation2004), and therefore, move from sustainability as a mere marketing claim towards establishing credibility and public accountability (Ivars-Baidal et al., Citation2021).

However, successful implementation of the model hinges on a receptive mindset among stakeholders and decision-makers (Dodds, Citation2007). The use of the maturity assessment model and the related potential for internal and external benchmarking can help as a vehicle to break up old views and institutional patterns. Applying a participatory approach to the implementation of the model, supported by change management, transparent communication and stakeholder engagement, the review and evaluation of the destination should ideally become an intuitive part of continuous improvement and strategic development of the destination instead of a one-time performance assessment (Warnecke et al., Citation2019).

Global advances in connectivity and data availability pave the way for DMOs and tourism agencies to evolve into data-driven organisations. Embracing technology and building analytical capabilities as part of their development strategy will enable them to become drivers for change and foster not only a progression towards higher maturity levels but a continuous improvement and sustained competitiveness of their destination.

6. Conclusion and future recommendations

Following a design science research approach, we developed a maturity assessment model for sustainable tourism based on a literature review, which informed the objectives of the model, its dimensions, sub-domains and maturity levels. The eloped Excel tool assesses the sustainability of tourism destinations across four dimensions and related sub-domains and supplies different graphical visualisations of current and desired future maturity levels, resulting in maturity gaps and priority areas for improvement, including potentially relevant metrics. With the first maturity model of this scale developed in its domain, we demonstrate how methods and artefacts from different scientific backgrounds can be combined and leveraged to enhance decision-making and planning for sustainable tourism destinations.

Limitations to the research may be found because the study is conceptual, and more in-depth validation and practical application would be required to iterate and further advance the model design. Empirical testing of maturity models and the underlying assumption of maturity as a linear progression towards the better has so far been problematic in academic research (Becker et al., Citation2010), hence, findings of current models can only be considered preliminary and tentative conclusions. Despite the rigorous process applied to review existing assessment models, the adoption of a qualitative approach to derive the sustainability dimensions and sub-domains in this study has the inherent risk to introduce subjectivity (Roberts & Tribe, Citation2008). As such, the model dimensions and sub-domains must not be considered exhaustive. Within the qualitative model validation process, this study conducted multiple interviews with tourism experts and stakeholders in the region of Algarve. Despite the fact that the DSR paradigm approves of the use of a qualitative evaluation of the designed artifact, the results of the validation phase could be regarded as relatively subjective. With time as a scarce resource for the development of the study, the validation had to be limited to a relatively small number of five tourism experts and stakeholders with limited timeframes for each interview. Although the inclusion of academic experts as well as tourism stakeholders intended to blend different viewpoints on the subject of sustainable tourism assessments, the small sample and unitary cultural background implies a limitation on the generalization of the model validation. A next step for the further development of the model would be to expand on the evaluation of the design process, by e.g. conducting interviews with a larger sample of experts and tourism stakeholders, in addition to potential quantitative analyses (Venable et al., Citation2016). In order to establish the generalisability of the model, the evaluation may entail its deployment and testing in different use cases. Insights into the practical application and whether it truly facilitates destination management and planning need to be fed back into the model design.

As a final note, the topic of sustainability itself as well as the application of ICT for sustainable tourism are fluid and ever-evolving; therefore the developed maturity model will need to be continuously maintained to ensure that the dimensions, sub-domains and definitions of maturity progress and stay relevant over time.

Acknowledgements

The authors acknowledge all the interview participants for their valuable contribution to this article.

Data availability statement

Due to ethical reasons, supporting data for this research is not available.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by Fundação para a Ciência e a Tecnologia (Foundation for Science and Technology, Portugal), awarded through the University of Algarve : [grant no https://doi.org/10.54499/CEECINST/00052/2021/CP2792/CT0003]; Fundação para a Ciência e a Tecnologia: [grant no https://doi.org/10.54499/UIDB/04020/2020].

References

  • Afonso, R. A., dos Santos Brito, K., do Nascimento, C. H., Garcia, V. C., & Álvaro, A. (2015). Brazilian smart cities: Using a maturity model to measure and compare inequality in cities. Proceedings of the 16th Annual International Conference on Digital Government Research.
  • Aguiar, M. F., Jugend, D., & Fiorini, P. C. (2021). Maturity models for sustainability: A review of ongoing research streams. In B. F. Giannetti, C. M. V. B. Almeida, & Agostinho (Hrsg.), Advances in cleaner production, Proceedings of the 10 h international workshop, Ferrara, Italy. November 11th, 2021.
  • Agyeiwaah, E., McKercher, B., & Suntikul, W. (2017). Identifying core indicators of sustainable tourism: A path forward? Tourism Management Perspectives, 24, 26–33. https://doi.org/10.1016/j.tmp.2017.07.005
  • Alfaro Navarro, J.-L., Andrés Martínez, M.-E., & Mondéjar Jiménez, J.-A. (2020). An approach to measuring sustainable tourism at the local level in Europe. Current Issues in Tourism, 23(4), 423–437. https://doi.org/10.1080/13683500.2019.1579174
  • Ali, A., & Frew, A. J. (2014a). Technology innovation and applications in sustainable destination development. Information Technology & Tourism, 14(4), 265–290. https://doi.org/10.1007/s40558-014-0015-7
  • Ali, A., & Frew, A. J. (2014b). ICT for sustainable tourism: A challenging relationship? Information Technology & Tourism, 14(4), 261–264. https://doi.org/10.1007/s40558-014-0020-x
  • Asmelash, A. G., & Kumar, S. (2019). Assessing progress of tourism sustainability: Developing and validating sustainability indicators. Tourism Management, 71, 67–83. https://doi.org/10.1016/j.tourman.2018.09.020
  • Becker, J., Niehaves, B., Poeppelbuss, J., & Simons, A. (2010, Januar 1). Maturity models in IS research. 18th European Conference on Information Systems, ECIS 2010.
  • Blancas, F. J., González, M., Lozano-Oyola, M., & Pérez, F. (2010). The assessment of sustainable tourism: Application to Spanish coastal destinations. Ecological Indicators, 10(2), 484–492. https://doi.org/10.1016/j.ecolind.2009.08.001
  • Bley, K., & Schoen, H. (2019). A role-based maturity model for digital relevance. In I. O. Pappas, P. Mikalef, Y. K. Dwivedi, L. Jaccheri, J. Krogstie, & M. Mäntymäki (Eds.), Digital transformation for a sustainable society in the 21st century (pp. Bd. 11701, S., 738–744). Springer International Publishing.
  • Bloyer, J. M., Gustke, L. D., & Leung, Y. (2004). Indicators for sustainable tourism development: Crossing the divide from definitions to actions. WIT Transactions on Ecology and the Environment, 76, 109–115.
  • Bramwell, B., & Lane, B. (1993). Sustainable tourism: An evolving global approach. Journal of Sustainable Tourism, 1(1), 1–5. https://doi.org/10.1080/09669589309450696
  • Buhalis, D., & Amaranggana, A. (2013). Smart tourism destinations. In Z. Xiang, & I. Tussyadiah (Eds.), Information and communication technologies in tourism 2014 (pp. 553–564). Springer International Publishing. https://doi.org/10.1007/978-3-030-29374-1_60
  • Buhalis, D., & Law, R. (2008). Progress in information technology and tourism management: 20 years on and 10 years after the Internet—The state of eTourism research. Tourism Management, 29(4), 609–623. https://doi.org/10.1016/j.tourman.2008.01.005
  • Butler, R. W. (1999). Sustainable tourism: A state-of-the-art review. Tourism Geographies, 1(1), 7–25. https://doi.org/10.1080/14616689908721291
  • Ceron, J.-P., & Dubois, G. (2003). Tourism and sustainable development indicators: The Gap between theoretical demands and practical achievements. Current Issues in Tourism, 6(1), 54–75. https://doi.org/10.1080/13683500308667944
  • Cheng, X., Xue, T., Yang, B., & Ma, B. (2023). A digital transformation approach in hospitality and tourism research. International Journal of Contemporary Hospitality Management, https://doi.org/10.1108/IJCHM-06-2022-0679
  • Choi, H. C., & Sirakaya, E. (2006). Sustainability indicators for managing community tourism. Tourism Management, 27(6), 1274–1289. https://doi.org/10.1016/j.tourman.2005.05.018
  • Crotts, J. C., Magnini, V. P., & Calvert, E. (2022). Key performance indicators for destination management in developed economies: A four pillar approach. Annals of Tourism Research Empirical Insights, 3(2), 100053. https://doi.org/10.1016/j.annale.2022.100053
  • Dao, V., Langella, I., & Carbo, J. (2011). From green to sustainability: Information Technology and an integrated sustainability framework. The Journal of Strategic Information Systems, 20(1), 63–79. https://doi.org/10.1016/j.jsis.2011.01.002
  • Dodds, R. (2007). Sustainable tourism and policy implementation: Lessons from the case of calviá, Spain. Current Issues in Tourism, 10(4), 296–322. https://doi.org/10.2167/cit278.0
  • Dwyer, L., & Kim, C. (2003). Destination competitiveness: Determinants and indicators. Current Issues in Tourism, 6(5), 369–414. https://doi.org/10.1080/13683500308667962
  • Estêvão, R. S. G., Ferreira, F. A. F., Rosa, ÁA, Govindan, K., & Meidutė-Kavaliauskienė, I. (2019). A socio-technical approach to the assessment of sustainable tourism: Adding value with a comprehensive process-oriented framework. Journal of Cleaner Production, 236, 117487. https://doi.org/10.1016/j.jclepro.2019.06.318
  • European Commission. Directorate general for internal market, industry, entrepreneurship and SMEs. (2016). The European Tourism Indicator System: ETIS toolkit for sustainable destination management. Publications Office. https://data.europa.eu/doi/10.2873983087.
  • Farrell, B. H., & Twining-Ward, L. (2004). Reconceptualizing tourism. Annals of Tourism Research, 31(2), 274–295. https://doi.org/10.1016/j.annals.2003.12.002
  • Gato, M. A., Tomaz, E., Costa, P., Cruz, A. R., & Perestrelo, M. (2021). An impact self-assessment tool for creative tourism with insights from its application to the CREATOUR ® project. In N. Duxbury, S. Albino, & C. P. de Carvalho (Hrsg.), Creative tourism: Activating cultural resources and engaging creative travellers (1. Aufl., S. 225–100238). CABI. https://doi.org/10.1079/9781789243536.0029
  • Glaeser, J., & Laudel, G. (2010). Experteninterviews und qualitative Inhaltsanalyse als Instrumente rekonstruierender Untersuchungen (4th edition). VS Verlag.
  • Global Destination Sustainability Movement. (2022). Gdsi benchmarking methodology. GDSM.
  • Global Sustainable Tourism Council. (2019). GSTC Destination Criteria.
  • Goessling, S. (2017). Tourism, information technologies and sustainability: An exploratory review. Journal of Sustainable Tourism, 25(7), 1024–1041. https://doi.org/10.1080/09669582.2015.1122017
  • Gottschalk, P. (2009). Maturity levels for interoperability in digital government. Government Information Quarterly, 26(1), 75–81. https://doi.org/10.1016/j.giq.2008.03.003
  • Gretzel, U., Sigala, M., Xiang, Z., & Koo, C. (2015). Smart tourism: Foundations and developments. Electronic Markets, 25(3), 179–188. https://doi.org/10.1007/s12525-015-0196-8
  • Hevner, A., & Chatterjee, S. (2010). Design science research frameworks. In A. Hevner, & S. Chatterjee (Eds.), Design research in information systems: Theory and practice (pp. 23–31). Springer US. https://doi.org/10.1007/978-1-4419-5653-8_3.
  • Hevner, A., March, S., Park, J., & Ram, S. (2004). Design science in information systems research. MIS Quarterly, 28(1), 75–105. https://doi.org/10.2307/25148625
  • Hoejer, M., & Wangel, J. (2015). Smart sustainable cities: Definition and challenges. In L. M. Hilty, & B. Aebischer (Hrsg.), ICT innovations for sustainability (S. 333–349). Springer International Publishing. https://doi.org/10.1007/978-3-319-09228-7_20.
  • Imboden, A., Buercher, S. G., Fumeaux, D., Fragnière, E., & Fux, M. (2022). Piloting a digital maturity model for smart destinations. International Journal of Technology Marketing, 16(4), 304. https://doi.org/10.1504/IJTMKT.2022.126271
  • Ivars-Baidal, J. A., Celdrán-Bernabeu, M. A., & Femenia-Serra, F. (2017). Guía de implantación. Destinos turísticos inteligentes comunitat valenciana. Agencia Valenciana de Turismo - Invat.tur.
  • Ivars-Baidal, J. A., Celdrán-Bernabeu, M. A., Femenia-Serra, F., Perles-Ribes, J. F., & Giner-Sánchez, D. (2021). Measuring the progress of smart destinations: The use of indicators as a management tool. Journal of Destination Marketing & Management, 19, 100531. https://doi.org/10.1016/j.jdmm.2020.100531
  • Ivars-Baidal, J. A., Vera-Rebollo, J. F., Perles-Ribes, J., Femenia-Serra, F., & Celdrán-Bernabeu, M. A. (2023). Sustainable tourism indicators: what’s new within the smart city/destination approach?. Journal of Sustainable Tourism, 1556–1582. https://doi.org/10.1080/09669582.2021.1876075.
  • Jovicic, D. Z. (2014). Key issues in the implementation of sustainable tourism. Current Issues in Tourism, 17(4), 297–302. https://doi.org/10.1080/13683500.2013.797386
  • Krippendorff, K. (2004). Content analysis: An introduction to its methodology (2nd edition). SAGE.
  • Kurz, A., Stockhammer, C., Fuchs, S., & Meinhard, D. (2007). Das problemzentrierte Interview. In R. Buber, & H. H. Holzmüller (Eds.), Qualitative marktforschung (pp. 463–475). Gabler. https://doi.org/10.1007/978-3-8349-9258-1_29.
  • Lawson, S. R. (2006). Computer simulation as a tool for planning and management of visitor Use in protected natural areas. Journal of Sustainable Tourism, 14(6), 600–617. https://doi.org/10.2167/jost625.0
  • Lim, C., Baba, K., & Iijima, J. (2019). Smart tourism capability maturity framework : A design science research approach. Asia Pacific Journal of Information Systems, 29(3), 503–523. https://doi.org/10.14329/apjis.2019.29.3.503
  • Liu, Z. (2003). Sustainable tourism development: A critique. Journal of Sustainable Tourism, 11(6), 459–475. https://doi.org/10.1080/09669580308667216
  • Marinello, S., Butturi, M. A., Gamberini, R., & Martini, U. (2023). Indicators for sustainable touristic destinations: A critical review. Journal of Environmental Planning and Management, 66(1), 1–30. https://doi.org/10.1080/09640568.2021.1978407
  • Meade, M. O., & Richardson, S. (1997). Selecting and appraising studies for a systematic review. Annals of Internal Medicine, 127(7), 531. https://doi.org/10.7326/0003-4819-127-7-199710010-00005
  • Melville, N. P. (2010). Information systems innovation for environmental sustainability. MIS Quarterly, 34(1), 1–21. https://doi.org/10.2307/20721412
  • Paulk, M., Curtis, B., Chrissis, M., & Weber, C. (1993). Capability Maturity Model for Software, Version 1.1.
  • Poeppelbuss, J., & Roeglinger, M. (2011). What makes a useful maturity model? A framework of general design principles for maturity models and its demonstration in business process management. In: V. Tuunainen, M. Rossi and J. Nandhakumar (eds.) Proceedings of the 19th European conference on information systems (ECIS, 2011), Helsinki, Finland, 9-11 June 2011. Atlanta, USA: AIS, 28.
  • Postma, A., Cavagnaro, E., & Spruyt, E. (2017). Sustainable tourism 2040. Journal of Tourism Futures, 3(1), 13–22. https://doi.org/10.1108/JTF-10-2015-0046
  • Punzo, G., Trunfio, M., Castellano, R., & Buonocore, M. (2022). A multi-modelling approach for assessing sustainable tourism. Social Indicators Research, 163(3), 1399–1443. https://doi.org/10.1007/s11205-022-02943-4
  • Rahmadian, E., Feitosa, D., & Zwitter, A. (2022). A systematic literature review on the use of big data for sustainable tourism. Current Issues in Tourism, 25(11), 1711–1730. https://doi.org/10.1080/13683500.2021.1974358
  • Roberts, S., & Tribe, J. (2008). Sustainability indicators for small tourism enterprises – An exploratory perspective. Journal of Sustainable Tourism, 16(5), 575–594. https://doi.org/10.1080/09669580802159644
  • Santana, E. d. S. d., Nunes, É. d. O., Passos, D. C., & Santos, L. B. (2019). Smm: A maturity model of smart cities based on sustainability indicators of the ISO 37122. International Journal of Advanced Engineering Research and Science, 6(2), 13–20. https://doi.org/10.22161/ijaers.6.2.2
  • Schianetz, K., & Kavanagh, L. (2008). Sustainability indicators for tourism destinations: A complex adaptive systems approach using systemic indicator systems. Journal of Sustainable Tourism, 16(6), 601–628. https://doi.org/10.1080/09669580802159651
  • Schianetz, K., Kavanagh, L., & Lockington, D. (2007). Concepts and tools for comprehensive sustainability assessments for tourism destinations: A comparative review. Journal of Sustainable Tourism, 15(4), 369–389. https://doi.org/10.2167/jost659.0
  • Shafiee, S., Ghatari, A. R., Hasanzadeh, A., & Jahanyan, S. (2019). Developing a model for sustainable smart tourism destinations: A systematic review. Tourism Management Perspectives, 31, 287–300. https://doi.org/10.1016/j.tmp.2019.06.002
  • Shen, S., Sotiriadis, M., & Zhang, Y. (2020). The influence of smart technologies on customer journey in tourist attractions within the smart tourism management framework. Sustainability, 12(10), 4157. https://doi.org/10.3390/su12104157
  • Simpson, K. (2001). Strategic planning and community involvement as contributors to sustainable tourism development. Current Issues in Tourism, 4(1), 3–41. https://doi.org/10.1080/13683500108667880
  • Soares, J. C., Domareski Ruiz, T. C., & Ivars Baidal, J. A. (2022). Smart destinations: A new planning and management approach? Current Issues in Tourism, 25(17), 2717–2732. https://doi.org/10.1080/13683500.2021.1991897
  • Tanguay, G. A., Rajaonson, J., & Therrien, M. C. (2013). Sustainable tourism indicators: Selection criteria for policy implementation and scientific recognition. Journal of Sustainable Tourism, 21(6), 862–879. https://doi.org/10.1080/09669582.2012.742531.
  • Twining-Ward, L., & Butler, R. (2002). Implementing STD on a small island: Development and Use of sustainable tourism development indicators in Samoa. Journal of Sustainable Tourism, 10(5), 363–387. https://doi.org/10.1080/09669580208667174
  • Vaishnavi, V. K., & Kuechler, W. (2007). Design science research methods and patterns: Innovating information and communication technology. Auerbach Publications. https://doi.org/10.1201/9781420059335.
  • van Aken, J. E., & Romme, G. (2009). Reinventing the future: Adding design science to the repertoire of organization and management studies. Organization Management Journal, 6(1), 5–12. https://doi.org/10.1057/omj.2009.1
  • Venable, J., Pries-Heje, J., & Baskerville, R. (2016). Feds: A framework for evaluation in design science research. European Journal of Information Systems, 25(1), 77–89. https://doi.org/10.1057/ejis.2014.36
  • Waldron, D., & Williams, P. W. (2002). Steps towards sustainability monitoring: The case of the Resort Municipality of Whistler. In R. Harris, T. Griffin, & P. Williams (Eds.), Sustainable tourism (2nd ed., pp. 180–194). Sydney, Australia: Butterworth-Heinemann.
  • Wall, G. (1997). Forum: Is ecotourism sustainable? Environmental Management, 21(4), 483–491. https://doi.org/10.1007/s002679900044
  • Warnecke, D., Wittstock, R., & Teuteberg, F. (2019). Benchmarking of European smart cities – a maturity model and web-based self-assessment tool. Sustainability Accounting, Management and Policy Journal, 10(4), 654–684. https://doi.org/10.1108/SAMPJ-03-2018-0057
  • World Economic Forum. (2022). Travel & tourism development index 2021: Rebuilding for a sustainable and resilient Future. World Economic Forum.
  • World Economic Forum. (2023). Charted: How international travel bounced back strongly in 2022.
  • World Tourism Organization. (2004). Indicators of sustainable development for tourism destinations: A guidebook. UNWTO.
  • World Tourism Organization. (2021). International tourism highlights, 2020 Edition. UNWTO.