2,473
Views
37
CrossRef citations to date
0
Altmetric
Articles

Comparing the innovation performance of EU candidate countries: an entropy-based TOPSIS approach

, &
Pages 31-54 | Received 10 Oct 2015, Accepted 16 Aug 2016, Published online: 15 Mar 2017

Abstract

Innovation is important for countries in the competitive global economy. It is one of the main criteria for countries to be superior, to remain competitive, and to produce high technology products. Countries allocate different types of incentives to encourage innovation activities in their countries. Innovation is also one of the strategic issues for the European Union (EU). The aim of this study is to compare the innovation performance of four EU candidate countries, Macedonia (FYR), Iceland, Serbia and Turkey. The entropy-based Technique for Order Performance by Similarity to Ideal Solution (TOPSIS) approach is proposed in this paper. First, the importance of each variable is computed by the entropy method to reflect on the differences among the variables in the calculation process. Subsequently, the TOPSIS method is performed by using the value and importance of variables for prioritisation of the candidate countries with respect to their innovation performance. Four case studies are conducted to show the viability of the proposed approach. Each cases study uses different reports, namely The Global Competitiveness Index, Innovation Union Scoreboard, Knowledge Assessment Methodology (KAM) and Global Innovation Index. The results of this study show that the proposed approach provides the same ranking as Innovation Union Scoreboard and KAM.

JEL classifications:

1. Introduction

Innovation provides economic growth for a country, region or enterprise (Paas & Poltimäe, Citation2010). There is no doubt that the effect of innovation on economic grow positively enhances the competitive power of countries in the present knowledge-based economy. Furthermore, there is a strong relationship between innovation, economic development and welfare (Autant-Bernard, Chalaye, Manca, Moreno, & Surinach, Citation2010). Seeing the benefits many countries allocate different types of incentives to entrepreneurs for spurring innovation in their country. The importance of innovation has increased for European policymaking over the last several years following the financial crisis of 2008 (Dodd, Franke, & Moody, Citation2011). The European Union (EU) determined its Europe 2020 strategy in 2010 to address growing economic concerns (Leschke, Theodoropoulou, & Watt, Citation2012). One of the main strategic issue and factor mentioned in Europe 2020 strategy was ‘innovation’. The First Action Plan for Innovation in Europe report was published in Citation1996 to create awareness for innovation among EU countries. Innovation makes a significant contribution to growth (Torun & Çiçekci, Citation2007). It also enhances countries’ current marketing potentials, competitive power and affects many different areas in social life positively by means of its positive effect on economy. Therefore, the EU also published the Innovation Union (IU) report in 2010 (Soylu, Citation2011). The aim of the IU is to increase the innovation activities in Europe region. The EU established a significant step for providing improvements in its economic development by the IU (Vaidere, Citation2011). Details on IU can be found in Karataş and Ayrım (Citation2010).

It has been emphasised in many studies that there is a positive correlation between economic development and innovation (Işık & Kılınç, Citation2012). The countries that are aware of the importance of innovation want to be leaders in innovative activities, while others fall in follower class for innovative activities. If one does not conduct innovative activities within its own country, there is a high possibility that this country will go abroad for many products and create a high current account deficit ratio. In this case, technology transfer takes place from the developed country to developing/underdeveloped country. In addition, the countries want to decrease current account deficit ratio in their economy. On the other hand, they would like to improve export potential and have high growing ratio in their economies. However, there is a trade-off herein between the current account deficit and high growing ratio. Because, if a country’s growing ratio begins to increase year by year, this generally causes high current account deficit in the economy. In order to cope with this paradox, the importance of innovation-driven development for countries appears due to the fact that innovation provides both higher growing ratio and lowers current account deficit simultaneously in the country. The importance of innovation is gaining more attention from the EU because of the fact that EU countries want to be leader and avoid possible financial crisis in the future. In this regard, an objective examination of ‘innovation performance’ of EU candidate countries is quite vital. Hence, this research has attempted to compare the ‘innovation performance’ of EU candidate countries.

Candidate countries, which are striving for full EU membership, are carrying out structural reforms by means of negotiations while simultaneously targeting innovation based strategies in science and technology areas to increase their competitive power. Paas and Poltimäe (Citation2010) emphasised that ‘the assessment of innovation is important for the development and implementation of public policies’. Europe has to create innovative strategies and develop a strong, competitive framework for innovations (Vaidere, Citation2011). Innovation has been recognised as one of the key EU strategies (Ramadani, Gërguri, Rexhepi, & Abduli, Citation2013). Therefore, comparison of the innovation performance of EU candidate countries emerged as an important research question. This article attempts to find reasonable answers through comparing several EU candidate countries. The results of this work, of course, are expected to be used by policymakers of those countries as well as their innovators.

The EU should consider the innovation potential of candidate countries during their negotiation to make certain countries less likely to fall behind the EU countries’ innovation potential. A candidate country with high innovation potential should take high priority among candidate countries during negotiation. High innovation potential means that there is a high probability for the country to conduct successful innovation activity and to manufacture high technology in the future.

The EU countries have increased their internal and external trade volume, their balance of payments, and decreased their inflation and unemployment rates since their membership was accepted (Akal & Şen, Citation2004). Hence, most of the countries want to join the EU. Currently, four countries, namely Iceland, Turkey, Serbia and Macedonia (FYR) are official candidates for EU membership, which is actually the reason why we selected these countries for this study. Motivation details are presented below.

Iceland started considering EU membership more seriously after economic and political crisis in the country (Weber, Citation2010). Iceland applied for EU membership in July 2009 (http://ec.europa.eu, accessed 9 March 2014). Discussions on Iceland’s membership in the EU and some of the benefits and costs resulting from its membership for both Iceland and the union can be found in Busch and Molendowski (Citation2011).

The second country under consideration in this study is Turkey. ‘Turkey’s relationship with the EU dates back to the late 1950s when the Democrat Party government applied for an associate membership in the European Economic Community’ (Yesilada, Citation2002, p. 94). Turkey has insisted on being accepted into the EU since then. EU membership is still one of the main issues for Turkey’ government. There are more studies related to EU membership for Turkey than other countries because of the fact that Turkey is the oldest candidate country among the other three, namely Iceland, Serbia and Macedonia. Among these studies, details on the future of Turkey in the EU are discussed in Güney (Citation2005). Tokgöz et al. (Citation2002) also examined relationship between Turkey and the EU. Şahinöz (Citation2004) studied this relationship in terms of commercial relations and the customs union.

The third country analysed in this study is Serbia. Serbia submitted its formal application in December 2009 for EU membership (Archick & Morelli, Citation2014). According to the some experts, Serbia may not be admitted by the EU until issues related to Kosovo’s independence status are fully resolved (Archick & Morelli, Citation2014). Although Grk (Citation2012) mentioned that Serbia is far away from Europe, Đekić (Citation2010) summarised Serbia’s path to the EU and emphasised that Serbia has also made improvements in the fulfilment of the economic demands for EU membership.

The last country considered in this article is Macedonia. Macedonia applied for EU membership in March 2004 (Archick & Morelli, Citation2014). The EU is the main economic partner of Macedonia because many companies from the EU affect sectors such as banking and telecommunications in Macedonia (Mavromatidis, Citation2010). Therefore, EU membership for Macedonia has a special property in terms of economy.

These four countries are ranked by the proposed approach with respect to their innovation performance in this article. It should be noted that all four countries are classified in Europe and Central Asia Group by the World Bank (http://www.worldbank.org).

The contribution of the present study is threefold. Firstly, the proposed approach takes the importance of the variables into account in the calculation process. Secondly, the entropy-based Technique for Order Performance by Similarity to Ideal Solution (TOPSIS) approach is employed for ranking. Thirdly, comparison with the other methods is also presented and discussed in detail.

The article is organised as follows. The literature review is outlined in Section 2. The proposed approach is presented in Section 3. An application of the proposed approach is given in Section 4. A discussion and recommendations are provided in Section 5 and Section 6 concludes.

2. Literature review

The majority of the literature focused on the countries’ relations with the EU, preconditions, procedures, structural reforms and requirements that should be done by EU candidate countries, advantage and disadvantage of EU membership; and peoples’ attitude towards EU membership for the candidate countries. Comparing some of the countries’ innovation potential, especially in the context of the EU candidate countries, has great importance as mentioned in the introduction section. In this section, studies that examined the EU member states in terms of innovation from different perspectives are considered and summarised.

Lööf, Heshmati, Asplund, and Nåås (Citation2001) examined the relationship between ‘innovation’ and ‘productivity’ using data from a Community Innovation Survey and a model named CDM for three countries, namely; Finland, Norway and Sweden. Borrás (Citation2003) discussed the innovation policy of the EU from different perspectives. Jungmittag (Citation2004) assessed the effects of innovations, technological specialisation and technology diffusion on economic growth and convergence of EU countries from 1969 to 1998 by using a panel data model. Dikbaş and Akkoyun (Citation2006) evaluated European Technology Platforms in the context of national technology, Research and Development (R&D) and innovation policies. Oprean and Tănăsescu (Citation2007) examined innovation potential of the Romanian economy in comparison with Turkey as a candidate country in 2007 and EU-25 member, non-members and non-candidate countries through using data obtained from the European Innovation Scoreboard. Tokumasu and Watanabe (Citation2008) analysed 15 EU member states (Belgium, Denmark, Germany, Greece, Spain, France, Ireland, Italy Luxembourg, the Netherlands, Austria, Portugal, Finland, Sweden, and the UK) with respect to their innovation capability using three indicators, namely innovation capability, innovation generation, and institutional structure. They performed the principal component analysis, multi-regression analysis, and cluster analysis in their paper. Ünlükaplan (Citation2009) examined the relation between economic development, competitiveness and innovation in EU using canonical correlation analysis. Autant-Bernard et al. (Citation2010) assessed the magnitude of innovation adoption for 22 EU countries and different industries. They suggested new indicators based on the Community Innovation Survey for innovation adaption. Roper, Youtie, Shapira, and Fernández-Ribas (Citation2010) compared the US and Europe with respect to factors which effect innovation performance of manufacturing firms in Georgia (US), Wales (UK), the West Midlands (UK), and Catalonia (Spain) by using multivariate probit models. De Saá-Pérez and Díaz-Díaz (Citation2010) analysed ultra-peripheral region of the EU, namely the Canary Islands to find the relationship between innovation and human resource. To obtain data from firms which operate in the Canary Islands, an empirical study was conducted in their study. Suurna and Kattel (Citation2010) examined the EU’s impact on innovation policies in Central and Eastern Europe. Paas and Poltimäe (Citation2010) assessed national innovation performance of the Baltic States based on European Innovation Scoreboard in the EU Context by using factor analysis. Pan, Hung, and Lu (Citation2010) measured the performance of the national innovation system in 33 Asian and European countries by using a Data Envelopment Analysis approach. Kaynak (Citation2010) used Knowledge Assessment Methodology (KAM) to compare innovation performances of Croatia, Macedonia and Turkey. However, general ranking with respect to overall innovation performance was not performed in this study and the importance of the variables was not considered. Filippetti, Frenz, and Ietto-Gillies (Citation2011) investigated relationship between innovation and internationalisation for European countries using correlation analyses based on the data obtained from European Innovation Scoreboard. Ökem (Citation2011) conducted a study based on SWOT analysis to evaluate innovation performance of Turkey with respect to health care during the negotiation with the EU. She suggested constructive comments to improve innovation activity for health care in Turkey. Işık and Kılınç (Citation2012) compared the EU countries and Turkey with respect to innovation by using raw data included in The Global Competitiveness Report 2010–2011. Ramadani et al. (Citation2013) examined innovation and economic development in Macedonia (FYR), which is currently an EU candidate country by using Innovation Union Scoreboard. Hashi and Stojčić (Citation2013) revealed the impact of innovation activities on ‘firm performance’ by using a multi-stage model and the data obtained from fourth Community Innovation Survey which includes the data gathered from 90,000 firms established in 16 European countries. Şahinli and Kılınç (Citation2013) compared the EU countries and Turkey with respect to innovation indicators through data obtained from Eurostat and World Databank, Their comparison is just based on raw data included in these databanks. Özbek and Atik (Citation2013) analysed the place of Turkey within the EU countries in terms of innovation indicators using hierarchical clustering analysis. Ünlü (Citation2013) compared the EU and candidate countries with respect to innovation indicators by using data obtained from TUBİTAK, Turkish Patent Institute and Innovation Union Scoreboard 2013. The article includes the results from the raw data found in these data sources.

Baležentis and Balkienė (Citation2014) used three indexes, namely the Innovation Union Scoreboard, which provides Summary Innovation Index, the Global Innovation Index and the Global Competitiveness Index to analyse the innovation policy of Lithuania. They discussed the Lithuanian innovation policy based on the raw data provided in these three indexes.

Majerová (Citation2015) recently presented the innovation performances of four EU countries, namely; the Czech Republic, Poland, Austria, and Germany along with Switzerland through using the Summary Innovation Index. Eurostat Pocketbooks (Citation2013) provided the information on activities and processes devoted to science, technology and innovation within Europe together with several EU candidate countries.

In addition to the above studies, the following are also examined in the literature: the impact of institutional quality on regional innovation performance of EU countries (Laboutkova, Citation2013); innovation policies in the context of knowledge-based economy for three EU member states, Bulgaria, Finland and the UK (Galabova, Citation2012); the role of innovation in the technological development of four new members of the EU, the Czech Republic, Hungary, Poland, and Slovakia through using the data obtained from the OECD and Eurostat (Uzagalieva, Kočenda, & Menezes, Citation2012); the impact of innovations on regional development in the EU (Vaidere, Citation2011); and the factors influencing innovation performance in new EU member countries, particularly in the Czech Republic (Müller, Citation2006).

Details on innovation policy in candidate countries can be found in studies conducted by Enterprise Directorate-General Innovation Directorate(Citation2003) and Mickiewicz and Radosevic (Citation2001).

The EU candidate countries are also compared with each other in terms of different criteria in the literature. For example, Akyazı (Citation1998) compared the EU countries and the EU candidate countries with respect to some economic and socio-economic indicators. Bilgin, Cin, and Lopcu (Citation2006) also compared the EU candidate countries in terms of the Maastricht criteria using logit analysis.

The entropy-based TOPSIS approach was also conducted to assess some systems in the literature. Hsu and Hsu (Citation2008) proposed the entropy-based TOPSIS approach to assess the quality of an information technology supplier for clinics. Li et al. (Citation2011) used the entropy and the TOPSIS method to evaluate safety conditions in four coal mines. Akyene (Citation2012) evaluated cell-phones using the entropy and the TOPSIS method. Li, Zhao, and Suo (Citation2014) assessed the sustainable development of highway transportation capacity based on the entropy and TOPSIS method. Aksakal and Dagdeviren (Citation2015) incorporated the entropy and the TOPSIS method to select a suitable wind-turbine for personal use in rural areas. Dashore, Pawar, Sohani, and Verma (Citation2013) proposed the entropy-based TOPSIS approach to assess personal data assistant design alternatives

As can be seen from the above-mentioned literature, the entropy-based TOPSIS approach was not performed previously in order to compare the innovation performance of the EU-candidate countries. The concluding remarks of most of the studies that used some reports and databanks, such as the Global Competitiveness Report, the Innovation Union Scoreboard, Eurostat and World Databank are based on raw data included in these reports and databanks. However, the raw data in this article is processed by using the entropy-based TOPSIS approach. The proposed approach in this article calculates the importance of each variable with respect to innovation by the entropy method. Based on the results obtained from the entropy method, it then sorts the EU candidate countries in descending order with respect to their innovation potential by using the TOPSIS method.

3. The proposed approach

There are multiple criteria affecting the innovation performance of countries. It is necessary to consider all these criteria to prioritise countries with respect to their innovation performance. Therefore, the problem this article is concerned with is the multiple criteria decision-making (MCDM) problem. MCDM is extensively utilised to rank alternatives from a set of available alternatives with multiple criteria (Wang & Lee, Citation2009). In this article, the entropy method is used to determine the weight of each variable. There are many methods used in the literature for weighing, such as the Analytical Hierarchy Process (Lee, Mogi, & Kim, Citation2008; Zhao, Zhou, Xie, & Li, Citation2011) and the Analytical Network Process (Bayazit & Karpak, Citation2007; Khadivi & Fatemi Ghomi, Citation2012). However, these methods are only suitable if there is a need to consult the experts’ or decision-makers’ opinions. One of the main disadvantages of the usage of the experts’ or decision-makers’ opinions is subjectivity and the results mostly includes the preference or judgements of the experts or decision-makers. On the other hand, the entropy method is objective, far from the experts’ or decision-makers’ bias, and therefore, it does not need experts’ or decision-makers’ opinion. Lastly, in this article the TOPSIS method is used to compare the innovation performance of the EU candidate countries based on the entropy weight. The TOPSIS method can effectively be used to order the alternatives in terms of considered criteria, when the alternatives, criteria, criteria values for each alternative, and the weight of each criterion, are known.

The four main steps, that involve the entropy method and the TOPSIS method, are conducted to compare the ‘innovation performance’ of candidate countries are presented below.

Step 1: Determine countries which are candidates for the EU

Step 2: Determine variables that affect the innovation potential of countries

Step 3: Calculate the weight of each variable by using the entropy method

Step 4: Rank all candidate countries by using the TOPSIS method

3.1. The entropy method

The entropy method is developed by Shannon (Citation1948). This method has been widely used for evaluating the weights of indicators (Hsu, Citation2013). Several studies, such as Çakır and Perçin (Citation2013), Akyene (Citation2012) and Hsu (Citation2013), used the entropy method for weighing. The method composed of five steps which are presented next.

Step 1: Construct decision matrix. This matrix described by:(1)

Where,

m: number of alternatives, A = (ai i=1,2, . . .,m)

n: number of criteria, C = (cj, j = 1,2, . . .,n)

Xij: the performance rating of ith alternative with respect to jth criteria

Step 2: Normalise the decision matrix by using formula (2)(2)

Step 3: Compute Ej value by using formula (3)(3)

Where, k = 1/ln(m)

Step 4: Compute dj value by using formula (4)(4)

Step 4: Calculate wj value, which shows the weight of jth criteria, by using formula (5). The sum of the weights of all criteria must be equal to 1.(5)

3.2. The TOPSIS method

The TOPSIS method was introduced by Hwang and Yoon (Citation1981). It finds the relative closeness of each alternative to the ideal solution. Alternatives are sorted in descending order based on this closeness in the method. The importance of the each criterion can be considered in the computational process. Details on the TOPSIS method and its various applications can be found in Behzadian, Khanmohammadi Otaghsara, Yazdani, and Ignatius (Citation2012). The entropy weight is used for weighing each criterion in this study and the overall methodology is presented in a stepwise manner below.

Step 1: Construct decision matrix. This matrix is the same as the available decision matrix given in (1).

Step 2: Calculate the normalised decision matrix (Rij) by using formula (6).(6)

Then, calculated the normalised decision matrix should be like a matrix depicted in (7).(7)

Step 3: Compute the weighted normalised decision matrix (Vij). This matrix calculated as:(8)

wi is the weight of the jth criterion which are obtained from the entropy method.

Then, calculated the weighted normalised decision matrix should be like a matrix depicted in (9).(9)

Step 4: Determine the positive ideal and negative ideal solutions by using formula (Equation10) and (Equation11).(10) (11)

Step 5: Calculate the separation measures. The separation of each alternative from the ideal solution is calculated by using formula (Equation12) and (Equation13).(12) (13)

Step 6: Calculate the relative closeness to the ideal solution for each alternative by using formula (Equation14) and rank the alternatives in descending order with respect to their relative closeness to the ideal solution.(14)

4. Applications of the proposed approach

Four case studies illustrate viability of the proposed approach.

4.1. Case study 1

KAM is used in case study 1. The proposed approach is conducted based on variables used in KAM 2012 to compare the innovation performance of four EU candidate countries, Macedonia (FYR), Iceland, Serbia and Turkey as shown in Figure . The steps of the proposed approach are conducted and explained as follows.

Figure 1. Map of Europe and the candidate countries. Source: http://www.worldatlasbook.com/europe/europe-blank-map.html

Figure 1. Map of Europe and the candidate countries. Source: http://www.worldatlasbook.com/europe/europe-blank-map.html

Step 1: Determine countries which are candidate for the EU:

As mentioned previously, the four EU candidate countries, Macedonia (FYR), Iceland, Serbia and Turkey are considered in this study.

Step 2: Determine variables that affect the innovation potential of countries:

The 16 variables, which are given in Table , are determined and the value of each variable is obtained from the Custom Scorecards mode included in KAM (www.worldbank.org/kam, accessed 10 February 2014) for comparison. Table shows the definitions of these variables. Actually, there are 29 variables used for innovation system in the Custom Scorecards. However, 13 variables are not available for at least one country considered. Therefore, 13 variables are excluded in the computational process. KAM has been extensively used by government officials, policymakers, researchers, etc. (Chen & Dahlman, Citation2005). Details on KAM can be found in the KAM Citation2008 Booklet.

Table 1. Evaluation variables for case study 1.

Step 3: Calculate the weight of each variable by using the entropy method:

In this step, the weight of each variable is calculated by the entropy method. Table shows the normalised decision matrix for the method. Table also presents Ej, dj and wj values obtained from the method. As can be seen from Table , the weights (wj) take the values between 0 and 1, and they sum to 1. The variable called ‘J’ (Patents Granted by USPTO / Mil. People) is the most important variable because it has the highest weight based on the entropy method. This implies that the number of patents produced per population million in a country is vital for measuring innovation potential of a country. It also signs that it is one of the most significant variable to see a big picture of the conducted innovation-based research in service and manufacturing systems in the countries. The remaining first four highest weights are allocated to ‘S&E Journal Articles / Mil. People’ (0.1803), ‘Total Expenditure for R&D as % of GDP’ (0.1413), ‘Royalty Payments and receipts’ (0.0517), and ‘S&E articles with foreign co-authorship’(0.0358). Finally, ‘Availability of Venture Capital’ (0.0005) has the lowest weight.

Table 2. The normalised decision matrix (Pij) for the entropy method in case study 1.

Table 3. Ej, dj and wj values in Case study 1.

Step 4: Rank all candidate countries by using the TOPSIS method:

The normalised decision matrix (Rij) for the TOPSIS method and the result of the TOPSIS method are given in Table and Table , respectively. As can be seen from Table , Iceland ranked first based on the results of the entropy-based TOPSIS method. Iceland has the highest innovation potential compared to the others. The ranking produced by the proposed approach is Iceland > Serbia > Turkey > Macedonia. This ranking is the same as KAM 2012, which assumes that the variables have the same importance. The results of this study obviously show that considering the ‘importance of the variables’ does not produce any different ranking for KAM 2012.

Table 4. The normalised decision matrix (Rij) for the TOPSIS method in case study 1.

Table 5. Result of the entropy-based TOPSIS approach in case study 1.

4.2. Case study 2

The Global Competitiveness Index 2014–2015 report (Schwab & Sala-i-Martín, Citation2015) is used in case study 2. The first step of the algorithm is the same as in case study 1. Thus, application of the proposed approach in case study 2 begins at Step 2 as presented next.

Step 2: Determine variables that affect the innovation potential of countries:

In this case study, the proposed approach is conducted based on the variables used for innovation in The Global Competitiveness Index, which is published by World Economic Forum. Seven variables, which are presented in Table , are determined in case study 2. The value of each variable is obtained from The Global Competitiveness Index 2014–2015 report. There are 12 main criteria included in the index. One of these main criteria is innovation. This case study takes into account innovation criteria and its sub criteria to present the proposed methodology.

Table 6. Evaluation variables in case study 2.

Step 3: Calculate the weight of each variable by using the entropy method:

In this step, the normalised decision matrix for the entropy method and the weight of each variable are presented in Tables and , respectively. The variable called ‘G_2’ (PCT Patents, Applications/Million Pop.) is the most important variable because it has the highest weight based on the entropy method. The remaining variables have low weight compared to ‘PCT Patents, Applications/Million Pop’ criteria.

Table 7. The normalised decision matrix (Pij) for the entropy method in case study 2.

Table 8. Ej, dj and wj values in case study 2.

Step 4: Rank all candidate countries by using the TOPSIS method:

The normalised decision matrix (Rij) for the TOPSIS method and the result of the TOPSIS method are given in Table and Table . As can be seen from Table , Iceland ranked first based on the results of the entropy-based TOPSIS method. Iceland has the highest innovation potential compared to the others. The ranking produced by the proposed approach for The Global Competitiveness Index 2014–2015 report is Iceland > Turkey > Serbia > Macedonia. This ranking is not the same as The Global Competitiveness Index 2014–2015 that assumes that the variables have the same importance. The results of this study show that considering the ‘importance of the variables’ produce different ranking for The Global Competitiveness Index 2014–2015 which sorts the candidate countries as Iceland > Turkey > Macedonia > Serbia.

Table 9. The normalised decision matrix (Rij) for the TOPSIS method in case study 2.

Table 10. Result of the entropy-based TOPSIS approach in case study 2.

4.3. Case study 3

Innovation Union Scoreboard (Citation2015) report is used in case study 3. The first step of the algorithm is the same as in case studies 1 and 2. Macedonia (FYR), Iceland, Serbia and Turkey are considered in the first step of the algorithm. Therefore, like cases study 2, the application of the proposed approach in case study 3 begins at Step 2, as presented next.

Step 2: Determine variables that affect the innovation potential of countries:

The variables and the value of each variable are obtained from Innovation Union Scoreboard (Citation2015) report, which is published by European Commission. Table presents the evaluation variables for case study 3.

Table 11. Evaluation variables for case study 3.

Step 3: Calculate the weight of each variable by using the entropy method:

The normalised decision matrix for the method is given in Table , while Ej, dj and wj values are presented in Table . The most important variable is ‘Intellectual Assets’(F_3). It is followed by ‘Open, Excellent and Attractive Research Systems’ (B_3), ‘Linkages & Entrepreneurship’ (E_3), ‘Finance and Support’ (C_3), ‘Human Resources’ (A_3), ‘Firm Investments’ (D_3), ‘Innovators’ (G_3), ‘Economic Effects’ (H_3)

Table 12. The normalised decision matrix (Pij) for the entropy method in case study 3.

Table 13. Ej, dj and wj values for case study 3.

Step 4: Rank all candidate countries by using the TOPSIS method:

The normalised decision matrix (Rij) for the TOPIS method in case study 3 is presented in Table . The result of the proposed approach for case study 3 is presented in Table . As can be seen from Table , the countries ranked as Iceland > Serbia > Turkey > Macedonia. The results of case study 3 show that considering the ‘importance of the variables’ does not produce any different ranking for Innovation Union Scoreboard (Citation2015) which does not consider the ‘importance of the variables’.

Table 14. The normalised decision matrix (Rij) for the TOPIS method in case study 3.

Table 15. Result of the entropy-based TOPSIS approach for case study 3.

4.4. Case study 4

The Global Innovation Index, Citation2015 report is used in this case study. The first step of the algorithm is the same as in all case studies. Hence, application of the proposed approach in case study 4 begins at Step 2, as presented next.

Step 2: Determine variables that affect the innovation potential of countries:

In this case study, the proposed approach is conducted based on the variables used for innovation in Global Innovation Index, Citation2015. Global Innovation Index, Citation2015 considers seven variables, which are presented in Table to measure the innovation performance of the contries.

Table 16. Evaluation variables in case study 4.

Step 3: Calculate the weight of each variable by using the entropy method:

Table presents the normalised decision matrix for the entropy method and Table shows the weight of each variable for case study 4. As can be seen from Table , Creative (G_4) has the highest weight and is the most important variable. It is followed by Business sophistication (E_4), Human capital and research (B_4), Knowledge and technology (F_4), Infrastructure (C_4), Market sophistication (D_4), Institutions (A_4).

Table 17. The normalised decision matrix (Pij) for the entropy method in case study 4.

Table 18. Ej, dj and wj values in case study 4.

Step 4: Rank all candidate countries by using the TOPSIS method:

The normalised decision matrix (Rij) for the TOPSIS method and the result of the TOPSIS method are given in Table and Table . Iceland ranked first again based on the proposed approach. The ranking produced by the proposed approach in case study 4 is Iceland > Turkey > Macedonia > Serbia. This ranking is not obtained before. Considering the ‘importance of the variables’ produce different ranking for Global Innovation Index, Citation2015 which sorts the candidate countries as Iceland > Macedonia > Turkey > Serbia.

Table 19. The normalised decision matrix (Rij) for the TOPSIS method in case study 4.

Table 20. Result of the entropy-based TOPSIS approach in case study 4.

5. Benchmarking innovation performance

Table summarises countries’ innovation performance with respect to case studies. As can be seen from a comparative assessment of innovation performance in Table , the ranking produced by the proposed approach, KAM and Innovation Union Scoreboard is Iceland > Serbia > Turkey > Macedonia. Iceland is the overall innovation leader (see Figure ). The main difference occurs in case study 2 and case study 4. The results of case studies show that considering the ‘importance of the variables’ does not produce any different ranking for Innovation Union Scoreboard (Citation2015), KAM and the proposed approach corresponding to these. It should be noted that the variables considered are also different in each case study.

Table 21. Benchmarking innovation performance.

Figure 2. Ranking with respect to different tools/methods.

Figure 2. Ranking with respect to different tools/methods.

It should also be noted that Iceland has the highest ‘innovation potential’ among the candidate countries for the results obtained by all methods mentioned above. According to the income categories created by the World Bank (http://go.worldbank.org/Q08GIVEDK0, accessed 26 April 2014), Iceland is in the ‘High Income’ category, while Serbia, Turkey and Macedonia are in the ‘Upper-Middle Income’ category. This result also implies that there is a positive relationship between ‘income’ and ‘innovation’ in a typical country.

6. Conclusion

In this article, the entropy-based TOPSIS approach was proposed and employed for comparison of innovation performances of EU candidate countries. First, the weight of each variable (together with the value of the variables) that affects innovation potential was computed for EU candidate countries, including Turkey. The results of the entropy method provides information for both governments and investors to sort the variables in descending order with respect to importance of the variables in innovation process. Based on the results obtained from the entropy method, all candidate countries were then examined in a comparative way with respect to their ‘innovation performance’ by using the TOPSIS method. Four case studies were conducted to demonstrate the viability of the proposed approach. This study differs from previous work, such as the Global Competitiveness Index, Innovation Union Scoreboard, Global Innovation Index and KAM, in that it considers the weight of each variable reflecting the importance of the variable in the calculation process.

The results of this study demonstrate that Iceland emerged ahead of the other three countries. Developments in manufacturing and service sectors, computer equipment as well as bio-technology inclined Iceland’s economy positively because of the energy-intensive industries established in recent years (http://www.ekonomi.gov.tr, accessed 6 March 2016). Iceland is the overall innovation leader for all case studies presented in this article. The innovation success of Iceland above other countries under consideration can be explained by several economic facts. Among these facts, Iceland has a population of less than half a million and the unemployment rate in Iceland is approximately 4.9%, which is the lowest unemployment-rate among the countries considered in this study, and the GDP for Iceland is $43,993 (OECD, Citation2014). Furthermore, Iceland is in the ‘High Income’ category according to the income categories created by the World Bank (http://go.worldbank.org/Q08GIVEDK0, accessed 26 April 2014). Finally, it is emphasised in ‘the ‘Human Development Report Citation2015’ that Iceland has the highest telecommunication infrastructure, which is very important for innovation capability, and included in the Very High Human Development category with respect to the Human Development Index.

The economy in Macedonia is generally based on agriculture (http://www.ekonomi.gov.tr, accessed 6 March 2016). In addition, R&D expenditure is approximately 0.2% (Human Development Report, Citation2015). Therefore, we cannot expect high innovation performance in an economy based on agriculture with a low percentage of R&D expenditure. Although the decision-makers in Macedonia tried to join the EU, it is necessary to modernise almost every field of economy. Furthermore, the unemployment rate in Macedonia is about 26% (http://www.mfa.gov.tr, accessed 6 March 2016). The current bureaucracy also negatively upsets the innovation environment in Macedonia.

The economy in Serbia is mainly based on public sector investments and many structural reforms are still needed to prepare innovation environment. R&D expenditure in Serbia is around 0.78% whereas it is approximately 2% in EU countries (http://ec.europa.eu/eurostat, accessed 6 March 2016). GDP growth in Serbia is unstable. GDP growth in 2012 and 2014 is negative (http://www.tradingeconomics.com/serbia/gdp-per-capita, accessed 19 March 2016). Therefore, in case study 4, Serbia ranked fourth based on the results of the entropy-based TOPSIS method and Global Innovation Index 2015 report. It is vital to construct an innovation- and technology-based eco-system for the economy to accelerate Serbia on the road to EU accession.

Although Turkey is the first country that applied for EU membership among the candidates considered in this study, it comes second and third in case studies in terms of ‘innovation performance’ among the candidates. Therefore, in order to change and improve the current situation, it is quite obvious that Turkey should allocate more incentives to the investors who will produce high-added value products and provide more qualified innovation facilities through a well-structured R&D strategy. A law related to promoting research infrastructure (law no: 6550) was approved by the presidency of the Republic of Turkey on 9 July 2014 and published in the official gazette on 10 July 2014. This law can be considered as one of the most important initiatives to support R&D activities and sustain innovation-driven development in Turkey. Turkey should also pay more attention to innovation activities and create awareness for the contribution of innovation to both country and investors sides. This will help Turkey jump to the top stage of development in the future. It should be underlined here that investment in innovation also plays an important role in meeting a broad range of challenges and opportunities that our society faces today (Dikbaş & Akkoyun, Citation2006). It means that making the right investment decisions (at the right time) are as important as innovation itself. Therefore, it is vital to develop an effective eco-system for innovators, investors and policy-/decision-makers that gathers efforts in evaluation measurement, prioritisation and commercialisation of both innovations and investments in Turkey (Altuntas, Citation2014; Altuntas & Dereli, Citation2012). This will probably accelerate Turkey on the road to EU accession.

There are some limitations to this study. Iceland had ongoing candidate status at the time the study was conducted, although it withdrew its application for EU membership on 12 March 2015. Montenegro and Albania were accepted for candidate status in 2015. However, these two countries were not considered in this study for two reasons: First, their negotiations for EU membership had only recently started so that the data related to these two countries was not included in the Innovation Union Scoreboard, Citation2015 report; Second, the population, geographic size, and economic potential of Montenegro and Albania are quite different from the other countries discussed in this article, and considering these two countries could lead to misleading results with respect to comparisons.

As for future research, the proposed approach in this study can be conducted including all EU countries, along with the comparison of the candidate countries. Furthermore, other weighing methods can be used instead of the entropy method to reflect the importance of the variables in the calculation process.

Disclosure statement

No potential conflict of interest was reported by the authors.

References

  • Akal, M., & Şen, R. (2004). Economical and political implications of the European union. İktisat İsletme ve Finans, 19, 31–45. doi:10.3848/iif.2004.220ek.4152.
  • Aksakal, E., & Dagdeviren, M. (2015). Integrated wind turbine selection model under multi-criteria decision making methods: Entropy and TOPSIS. Proceedings of the 2015 International Conference on Industrial Engineering and Operations Management, Dubai, United Arab Emirates (UAE), March 3 – 5.
  • Akyazı, H. (1998). European union, candidate countries and Turkey: An economic comparison. İktisat İsletme ve Finans, 13, 67–80. doi:10.3848/iif.1998.147.9516
  • Akyene, T. (2012). Cell phone evaluation base on entropy and TOPSIS. Interdisciplinary Journal of Research in Business, 1, 09–15.
  • Altuntas, S. (2014). Development of new methods for prioritization and evaluation of investment projects in the context of technology management ( Ph.D thesis. (Supervisor: Prof.Dr. Türkay Dereli)). University of Gazantep, Graduate School of Natural & Applied Science, Industrial Engineering Department.
  • Altuntas, S., & Dereli, T. (2012). An evaluation ındex system for prediction of technology commercialization of investment projects. Journal of Intelligent & Fuzzy Systems, 23, 327–343. doi:10.3233/IFS-2012-0524
  • Archick, K., & Morelli, V. L. (2014). European union enlargement ( Congressional Research Service Report).
  • Autant-Bernard, C., Chalaye, S., Manca, F., Moreno, R., & Surinach, J. (2010). Measuring the adoption of innovation. A typology of EU countries based on the innovation survey. Innovation: the European Journal of Social Science Research, 23, 199–222. doi:10.1080/13511610.2010.547739.
  • Baležentis, A., & Balkienė, K. (2014). Innovation policy measurement: Analysis of Lithuania’s case. Economic Research-Ekonomska Istraživanja, 27, 1–14. doi:10.1080/1331677X.2014.947103
  • Bayazit, O., & Karpak, B. (2007). An analytical network process-based framework for successful total quality management (TQM): An assessment of Turkish manufacturing industry readiness. International Journal of Production Economics, 105, 79–96. doi:10.1016/j.ijpe.2005.12.009
  • Behzadian, M., Khanmohammadi Otaghsara, S. K., Yazdani, M., & Ignatius, J. (2012). A state-of the-art survey of TOPSIS applications. Expert Systems with Applications, 39, 13051–13069. doi:10.1016/j.eswa.2012.05.056.
  • Bilgin, K. S., Cin, M. F., & lopcu, K. (2006). Turkey as a candidate country for full membership in the European union: A comparison with Maastricht criteria. İktisat İsletme ve Finans, 21, 98–109. doi:10.3848/iif.2006.246.4164
  • Borrás, S. (2003). The ınnovation policy of the European union. USA: Edward Elgar Publishing. doi:10.4337/9781781009789
  • Busch, M., & Molendowski, E. (2011). The global financial crisis and the problem of Iceland’s membership in the European union. Folia Oeconomica Stetinensia, 10, 110–119. doi:10.2478/v10031-011-0004-3
  • Çakır, S., & Perçin, S. (2013). R&D performance measurement in EU countries using combined entropy weight-topsis method. Uludağ Journal of Economy and Society, 32, 77–95.
  • Chen, D. H. C., & Dahlman, C. J. (2005). The knowledge economy. The World Bank Washington DC: The Kam Methodology and World Bank Operations 20433.
  • Dashore, K., Pawar, S. S., Sohani, N., & Verma, D. S. (2013). Product evaluation using entropy and multi criteria decision making methods. International Journal of Engineering Trends and Technology, 4, 2183–2187.
  • Đekić. (2010). Transitional priorities of Serbia in the light of European integration. Megatrend Review, 7, 327–344.
  • Dikbaş, A., & Akkoyun, I. (2006). ETP: European technology platforms - a challenge for Turkey’s strategic innovation agenda. ITU A|Z, 3, 53-70.
  • Dodd, J. A., Franke, J., & Moody, R. (2011). Total innovation - Towards a localised, comprehensive EU innovation policy. The Innovation Journal: The Public Sector Innovation Journal, 16, 1–18.
  • Enterprise Directorate-General Innovation Directorate. (2003). Innovation policy in seven candidate countries: The challenges ( Final Report Volume 1, Contract: INNO-02-06: 1-181).
  • Filippetti, A., Frenz, M., & Ietto-Gillies, G. (2011). Are innovation and internationalization related? An analysis of European countries. Industry and Innovation, 18, 437–459. doi:10.1080/13662716.2011.583461
  • First Action Plan for Innovation in Europe. (1996). Retrieved from http://cordis.europa.eu/documents/documentlibrary/21926641EN6.pdf
  • Galabova, L. P. (2012). Developing a knowledge-based economy through innovation policy: The cases of Bulgaria, Finland and Scotland. Science and Public Policy, 39, 802–814. doi:10.1093/scipol/scs050
  • Global Innovation Index. 2015. Retrieved from https://www.globalinnovationindex.org/userfiles/file/reportpdf/GII-2015-v5.pdf
  • Grk, S. (2012). Serbia – so close, yet so far away from Europe. Megatrend Review, 9, 1–16.
  • Güney, A. (2005). The future of Turkey in the European union. Futures, 37, 303–316 doi:10.1016/j.futures.2004.07.001
  • Hashi, I., & Stojčić, N. (2013). The impact of innovation activities on firm performance using a multi-stage model: Evidence from the community innovation survey 4. Research Policy, 42, 353–366. doi:10.1016/j.respol.2012.09.011
  • Hsu, L. C. (2013). Investment decision making using a combined factor analysis and entropy-based topsis model. Journal of Business Economics and Management, 14, 448–466. doi:10.3846/16111699.2011.633098
  • Hsu, P. F., & Hsu, M. G. (2008). Optimizing the information outsourcing practices of primary care medical organizations using entropy and TOPSIS. Quality & Quantity, 42, 181–201. doi:10.1007/s11135-006-9040-8
  • Human Development Report. (2015). Retrieved from http://hdr.undp.org/sites/default/files/2015_human_development_report_1.pdf
  • Hwang, C. L., & Yoon, K. (1981). Multiple attribute decision making: Methods and applications. New York, NY: Springer-Verlag. doi:10.1007/978-3-642-48318-9
  • Işık, N., & Kılınç, E. C. (2012). Innovation-driven development: An examination on the European Union countries and Turkey. Journal of Entrepreneurship and Innovation Management, 1, 31–68. (In Turkish).
  • Jungmittag, A. (2004). Innovations, technological specialisation and economic growth in the EU. International, Economics and Economic Policy, 1, 247–273. doi:10.1007/s10368-004-0018-5
  • KAM 2008 Booklet: Measuring knowledge in the world economies. (2008). Knowledge assessment methodology and knowledge economy ındex. Washington, DC: Knowledge For Development Program, World Bank.
  • Karataş, H., & Ayrım, Y. Z. (2010). “Yenilikçilik Birliği bilgi notu [Innovation Union information note].” Retrieved from http://www.abgs.gov.tr/files/SBYPB/Bilim%20ve%20Arastirma/yenilikcilikbirligi.pdf
  • Kaynak, S. (2010). Comparative analysis of innovation performance of EU candidate countries. In I. G. Yumuşak (Ed.), Knowledge economy and management (pp. 107–115). İstanbul: Avcı Ofset Matbaacılık.
  • Khadivi, M. R., & Fatemi Ghomi, S. M. T. (2012). Solid waste facilities location using of analytical network process and data envelopment analysis approaches. Waste Management, 32, 1258–1265. doi:10.1016/j.wasman.2012.02.002
  • Laboutkova, S. (2013). The impact of ınstitutional quality on regional innovation performance of EU countries. Proceedıngs of The 11th International Conference on Liberec Economic Forum, Sychrov, Czech Republıc, Sep16-17, 353-362.
  • Lee, S. K., Mogi, G., & Kim, J. W. (2008). Multi-criteria decision making for measuring relative efficiency of greenhouse gas technologies: AHP/DEA hybrid model approach. Engineering Letters, 16, 493–497.
  • Leschke, J., Theodoropoulou, S., & Watt, A. (2012). How do economic governance reforms and austerity measures affect inclusive growth as formulated in the Europe 2020 Strategy. In S. Lehndorff (Ed.), A triumph of failed ideas – European models of capitalism in the crisis (pp. 243–281). Brussels: European Trade Union Institute (ETUI), ETUI aisbl.
  • Li, X., Wang, K., Liu, L., Xin, J., Yang, H., & Gao, C. (2011). Application of the entropy weight and topsıs method in safety evaluation of coal mines. Procedia Engineering, 26, 2085–2091. doi:10.1016/j.proeng.2011.11.2410
  • Li, Y., Zhao, L., & Suo, J. (2014). Comprehensive assessment on sustainable development of highway transportation capacity based on entropy weight and TOPSIS. Sustainability, 6, 4685–4693. doi:10.3390/su6074685
  • Lööf, H., Heshmati, A., Asplund, R., & Nåås,S. O. (2001). Innovation and performance in manufacturing industries: a comparison of the Nordic Countries ( SSE/EFI Working Paper Series in Economics and Finance No. 457). Retrieved from http://swopec.hhs.se/hastef/papers/hastef0457.pdf
  • Majerová, I. (2015). Measurement of innovative performance of selected economies of the European union and Switzerland. International Journal of Information and Education Technology, 5, 228–232. doi:10.7763/IJIET.2015.V5.506
  • Mavromatidis, F. (2010). The role of the European union in the name dispute between Greece and FYR Macedonia. Journal of Contemporary European Studies, 18, 47–62. doi:10.1080/14782801003638703
  • Mickiewicz, M., & Radosevic, S. (2001). Innovation capabilities of the six EU candidate countries: Comparative data based analysis ( Report, Contract: INNO-99-02: 1-45).
  • Müller, K. (2006). Innovation performance of new EU memeber countries - situation in the Czech republic. Politická ekonomie, 54, 778–801.10.18267/j.polek.583
  • OECD. (2014). OECD factbook 2014: Economic. Environmental and social statistics. OECD Publishing. Retrieved from http://dx.doi.org/10.1787/factbook-2014-en
  • Ökem, Z. G. (2011). Türkiye’nin Avrupa Birliği’ne üyelik sürecinde sağlıkta inovasyon ( Publication no: TÜSİAT-T/2011/02/511). Retrieved from http://www.tusiad.org.tr/rsc/shared/file/SagliktaInovasyon-rapor.pdf
  • Oprean, C., & Tănăsescu, C. (2007). The convergence degree of innovation potential of Romanian economy, by comparison with the developed economies of the EU Member States. The Romanian Economic Journal, 25, 285–304.
  • Özbek, H., & Atik, H. (2013). The place of Turkey within the European union countries in terms of innovation indicators: A statistical analysis. Erciyes Üniversitesi İktisadi ve İdari Bilimler Fakültesi Dergisi, 42, 193–210. (In Turkish).
  • Paas, T., & Poltimäe, H. (2010). A comparative analysis of national innovation performance: The Baltic states in the EU context ( Working Paper No. 78). University of Tartu Faculty of Economics and Business Administration. Retrieved from http://ssrn.com/abstract=1722717 doi:10.2139/ssrn.1722717
  • Pan, T. W., Hung, S. W., & Lu, W. M. (2010). Dea performance measurement of the national innovation system in Asia and Europe. Asia-Pacific Journal of Operational Research, 27, 369–392. doi:10.1142/S0217595910002752
  • Eurostat Pocketbooks. (2013). Science, technology and innovation in Europe. Luxembourg: Publications Office of the European Union.
  • Ramadani, V., Gërguri, S., Rexhepi, G., & Abduli, S. (2013). Innovation and economic development: The case of FYR of Macedonia. Journal of Balkan and Near Eastern Studies, 15, 324–345. doi:10.1080/19448953.2013.789326
  • Roper, S., Youtie, J., Shapira, P., & Fernández-Ribas, A. (2010). Knowledge, capabilities and manufacturing innovation: A USA–Europe comparison. Regional Studies, 44, 253–279. doi:10.1080/00343400802360410
  • De Saá-Pérez, P. D., & Díaz-Díaz, N. L. (2010). Human resource management and innovation in the Canary islands: An ultra-peripheral region of the European union. The International Journal of Human Resource Management, 21, 1649–1666. doi:10.1080/09585192.2010.500488
  • Şahinli, M. A., & Kılınç, E. (2013). Innovation and innovation indicators: Compare of EU countries and Turkey. Selçuk University. The Journal of Social and Economic Research, 25, 329-355 ( In Turkish).
  • Şahinöz, A. (2004). Europen union-Turkey: Commercial relations and customs union. İktisat İsletme ve Finans, 19, 28–45. doi:10.3848/iif.2004.219.7284
  • Schwab, K., & Sala-i-Martín, X. (2015). The Global Competitiveness Report 2014–2015. World Economic Forum.
  • Shannon, C. E. (1948). The mathematical theory of communication. Bell System Technical Journal, 27, 379–423. doi:10.1002/j.1538-7305.1948.tb01338.x
  • Soylu, A. (2011). The comparison of innovation targets regarding “AB 2020” and “Vision 2023” strategies. Journal of Süleyman Demirel University Institute of Social Sciences, 14, 105–122.
  • Suurna, M., & Kattel, R. (2010). Europeanization of innovation policy in central and eastern Europe. Science and Public Policy, 37, 646–664. doi:10.3152/030234210X12778118264459
  • Tokgöz, E., Gürel, Ş. S., Uygur, E., Manisali, E., Zeytinoğlu, Y., & Şahinöz, A. (2002). Türkiye AB ilişkilerinde neredeyiz? İktisat İsletme ve Finans, 17, 13–44. doi:10.3848/iif.2002.196.3104
  • Tokumasu, S., & Watanabe, C. (2008). Institutional structure leading to the similarity and disparity in innovation inducement in EU 15 countries-finnish conspicuous achievement triggered by Nokia’s IT driven global business. Journal of Services Research, 8, 1–38.
  • Torun, H., & Çiçekci, C. (2007). Innovation: Is the engine for the economic growth?. Retrieved from http://www.tcmb.gov.tr/yeni/iletisimgm/Innovation.pdf
  • Ünlü, F. (2013). European union innovation scoreboard and Turkey: A comparatıve assessment. Erciyes Üniversitesi İktisadi ve İdari Bilimler Fakültesi Dergisi, 42, 161–192 (In Turkish).
  • Ünlükaplan, İ. (2009). The spesification of the relationship between economic development, competitiveness and innovation in European union using canonical correlation analysis. Maliye Journal, 157, 235-250(In Turkish).
  • Uzagalieva, A., Kočenda, E., & Menezes, A. (2012). Technological innovation in new EU markets. Emerging Markets Finance & Trade, 48, 48–65. doi:10.2753/REE1540-496X480503
  • Vaidere, I. (2011). The Paradigm of competitiveness and impact of innovations on regional development in the EU. Human Resources: The Main Factor of Regional Development, 5, 282–291.
  • Wang, T. C., & Lee, Hsien-Da (2009). Developing a fuzzy TOPSIS approach based on subjective weights and objective weights. Expert Systems with Applications, 36, 8980–8985. doi:10.1016/j.eswa.2008.11.035
  • Weber, S. (2010). Iceland and EU membership. European View, 9, 285–286. doi:10.1007/s12290-010-0148-9
  • Retrieved March 09, 2014, from http://ec.europa.eu
  • Retrieved from http://ec.europa.eu/growth/industry/innovation/facts-figures/scoreboards/files/ius-2015_en.pdf
  • Retrieved April 26, 2014, from http://www.worldbank.org
  • Retrieved April 26, 2014, from http://go.worldbank.org/Q08GIVEDK0
  • Retrieved March 10, 2014, from http://info.worldbank.org/etools/kam2/KAM_page5.asp
  • Retrieved March 06, 2016, from http://www.ekonomi.gov.tr/portal/faces/home/disIliskiler/ulkeler/ulke-detay/İzlanda
  • Retrieved March 06, 2016, from http://ec.europa.eu/eurostat/tgm/table.do?tab=table&init=1&language=en&pcode=tsc00001&plugin=1
  • Retrieved March 06, 2016, from http://www.mfa.gov.tr
  • Retrieved March 19, 2016, from http://www.tradingeconomics.com/serbia/gdp-per-capita
  • Innovation Union Scoreboard. (2015). European commission. Retrieved from http://ec.europa.eu/growth/industry/innovation/facts-figures/scoreboards/files/ius-2015_en.pdf
  • Retrieved February 10, 2014, from www.worldbank.org/kam
  • Yesilada, B. A. (2002). Turkey’s candidacy for EU membership. Middle East Journal, 56, 94–111.
  • Zhao, Q. H., Zhou, X., Xie, R. F., & Li, Z. C. (2011). Comparison of three weighing methods for evaluation of the HPLC fingerprints of cortex fraxini. Journal of Liquid Chromatography & Related Technologies, 34, 2008–2019. doi:10.1080/10826076.2011.582912