1,199
Views
7
CrossRef citations to date
0
Altmetric
Research Article

The gold rush: Analysis of the performance of the Spanish Olympic federations

ORCID Icon, ORCID Icon & | (Reviewing Editor)
Article: 1446689 | Received 09 Oct 2017, Accepted 22 Feb 2018, Published online: 13 Mar 2018

Abstract

Research question: This study assesses the performance of the Spanish Sports Federations in the Olympic Games of Beijing 2008 and London 2012 from the point of view of their efficiency in the use of the available resources. The research aims to identify the possible existence of a behaviour pattern in the performance of these sports federations and, particularly, the influence of the different funding sources on the results. Research methods: The measurement of the relative efficiency of the 22 federations that participated in both editions is carried out by applying the Data Envelopment Analysis methodology. The Malmquist index is used to analyse the evolution of the efficiency and, a persistence study, to evaluate the consistency of the results. Finally, correlations are estimated to verify the possible links between the efficiency of the federations and their funding sources. Results and findings: The study captures the relative efficiency of the federations in the sample, a deceleration in the performance being observed between Beijing 2008 and London 2012. It finds little relation between the relative efficiency of the federations and their different funding sources. Implications: This study may be especially relevant in a context where an important amount of public resources is earmarked for elite sports, without clarifying the “value for money” of such investments. It hopes to contribute to the existing literature with regard to the measurement of efficiency in sports through the introduction of indicators which can capture the performance of sports federations more precisely.

Public Interest Statement

The Olympic Games are probably the most popular sporting event in the world. States allocate a great amount of public resources to sports federations to prepare athletes who take part in this competition, and citizens are interested in knowing the value for money of this investment. However, the measurement of high-level sport performance is very complex due to the diversity of the factors that determine sporting success. This paper creates a more sophisticated tool to evaluate the relative efficiency of Spanish Olympic federations in the Olympic Games (OG) of Beijing 2008 and London 2012. The results show a slight decrease in the efficiency of the Spanish Olympic team between the two Games. During this period, the Spanish federations received an increase in private revenues that compensated for the decrease in public funds, so these results contradict the belief that private funding leads to higher efficiency than public funding.

1. Introduction

Although sports economics literature agrees on the large economic and social impact of major sport events, there is no consensus about the convenience or value for money of public spending in these events (Crompton, Citation1995; Gratton, Shibli, & Coleman, Citation2006; Preuss, Citation2004). States allocate public resources to this sector through sports federations, and they have to invest them in the most efficient way to promote and develop their sports, as well as to prepare the athletes who take part in competitions. The Olympic Games (OG) are considered one of the most important competitions of the sporting world because their participants come from almost every country.

The Spanish sports system is articulated within a public structure whose governing body is the Supreme Council for Sports (Consejo Superior de Deportes or CSD) and a private structure whose governing body is the Spanish Olympic Committee (Comité Olímpico Español or COE) (CSD, http://www.csd.gob.es/).

Sports federations 1 , along with the Autonomous Communities, are responsible for the development of high-level and high-performance sports. High-level sports are considered a matter of State interest (article 6 of the Sports Law 10/1990) and the State gives an important amount of public resources to an elite that represents a small section of the sports’ universe. It has no guarantee of a return on this investment in terms of results, be it from a sporting, economic, or social point of view. Therefore, it is necessary to set limits to the aforementioned support and assess the use of these resources because they are required in other fields.

The object of this study is to analyse the efficiency of the Spanish sports federations in their participation in the OG of Beijing 2008 and London 2012. Efficiency can be defined as the relationship between the outputs achieved and the inputs consumed in the process (Intervención General de la Administración del Estado –IGAE, Citation1997). In this case, the efficiency of the federations will be determined by the scores achieved in both OG editions in comparison to the resources available to each. The periods of preparation of these Games (2005 to 2008 and 2009 to 2012) took place before and during the global financial crisis, so the country was in very different scenarios. This allows us to analyse the impact of the crisis on Spanish Olympic sport from the point of view of the results, as well as from the point of view of the funds received. To do so, we will identify the variables of inputs and outputs that describe the resources available and the results obtained with them. We will also analyse the different funding sources of the sports federations to determine the existence of a possible relationship between the relative efficiency of the federations and the way they are financed. We need to be aware of the fact that the study will provide a relative measurement of the efficiency within the sample. Therefore, the results will not imply that federations achieving the efficiency level are acting to the best of their abilities. Furthermore, it does not take into account the effect caused by federations whose teams did not qualify for one of the two OG.

The study is divided into the following sections. Section 2 provides the background and the literature related to the topics of efficiency and sports. Section 3 develops the methodology to be applied. Section 4 presents the results of the work, which are debated and commented on in Section 5. Finally, Section 6 contains the conclusions and describes future developments.

2. Background

2.1. Efficiency in Olympic Sports

Efficiency studies applied to the field of sports constitute a wide literature that can be classified into two main blocks, one focused on international multi-sports events and the other on case studies of specific sports. The present study belongs to the first block. The classification of the OG participant countries is usually based on the multi-criteria lexicographic method which considers, first, the total number of gold medals, followed by the silver medals and, finally, the bronze medals. So, if a country manages to win many silver and bronze medals, it will be below any country that only wins one gold medal, with the consequent bias of overestimating the latter. Furthermore, this classification does not take into account the resources consumed to achieve the results.

The efficiency studies that are focused on multi-sports events, generally the OG, look for alternatives to assess the performance of the participants. Most of them apply the Data Envelopment Analysis (DEA) or other similar non-parametric (linear programming) techniques such as the Free Disposal Hull. The crucial element in these methods is the selection of the inputs and outputs. Concerning the outputs, most of the studies have defined different systems of weightings considering exclusively the number of gold, silver and bronze medals (Lins, Gomes, Soares de Mello, & Soares de Mello, Citation2003; Lozano, Villa, Guerrero, & Cortés, Citation2002; Soares de Mello, Angulo, & Gomes, Citation2012; Soares de Mello, Angulo, Gonçalves, Biondi, & Gouvêia, Citation2004; Zhang, Li, Meng, & Liu, Citation2009). However, this strategy has been questioned for not being able to discriminate the results of athletes appropriately, in particular for those countries that win few medals (Santos, Angulo, & Soares de Mello, Citation2011). As the finalists that do not win medals obtain “diplomas”, some recent studies suggest that the Olympic diplomas (4th to 8th positions) should be also considered as a relevant output in each competition (Shibli, De Bosscher, van Bottenburg, & Westerbeek, Citation2013, Citation2015). Another difficulty to evaluate performance in multi-sports events is the comparison of sports with different chances of winning a medal because of the number of participants or because of the number of competitions. (De Bosscher, Citation2007). For this reason, some studies take into account the proportion of medals won in each sport (“market share”) instead of using absolute terms (Angulo, Pescarini, & Soares de Mello, Citation2015; De Bosscher, Citation2007).

As regards the inputs, much of the specialised literature seeks to relate the results of the elite sport systems with the human potential and the economic power of each country (Goldman Sachs, Citation2012). Consequently, the population and the GDP of each country are the most frequent inputs included in previous studies (Churilov & Flitman, Citation2006; Lins et al., Citation2003; Lozano et al., Citation2002; Wu, Liang, Wu, & Yang, Citation2008; Wu, Zhou, & Liang, Citation2010). According to De Bosscher (Citation2007), these two variables explain more than half (53%) of the success of the nations in the OG. On the other hand, Vagenas and Vlachokyriakou (Citation2012) point out that the traditional “population-GDP” approach is insufficient in explaining Olympic success on the basis of the number of medals won by the participating countries. Wu, Liang, and Chen (Citation2009) introduce the GDP per capita as a more accurate indicator of the wealth of a country than the GDP expressed in absolute values. Furthermore, the greater wealth of a country does not necessarily imply a stronger investment in sports. Vagenas and Vlachokyriakou (Citation2012) suggest that the Olympic team size is a good proxy for the investment in sports and, at the same time, a better indicator of the chances of winning a medal than any monetary indicator. For this reason, more recent studies use the number of athletes as a proxy of the investment of the country in each sport (Benicio, Bergiante, & Soares de Mello, Citation2013; Debnath & Malhotra, Citation2015; Soares de Mello et al., Citation2012). Finally, other authors question the link between the sports achievements of countries and their population and economic wealth. For them, public policies in the field of high-performance sports and the capacity of the government and social organizations to form an efficient system of Olympic preparation are much more important than the GDP or the population of the country (Platonov, Citation2011). The results of the “SPLISS” project (Sports Policy factors Leading to International Sporting Success) conducted by De Bosscher, Bingham, Shibli, van Bottenburg, and de Knop (Citation2008) evidence the complexity of the sporting success. They compare over 100 factors that may lead to international sporting success and classify them into 9 pillars of success (De Bosscher et al., Citation2008) that correspond to the following 9 policy areas: (1) financial support; (2) integrated approach to policy development; (3) participation in sport; (4) talent identification and development systems; (5) athletic and post career support; (6) training facilities; (7) coaching provision and coach development; (8) international competition; and (9) scientific research. The first one (financial support) is an input variable and the rest can be considered throughputs.

2.1.1. Impact of the Financial Structure and Performance of the Sports Federations

According to Sánchez and Barajas (Citation2009), the study of the funding of high-level sports remains almost unexplored despite the large amount of money involved and the need to evaluate the socioeconomic profitability of the money spent on athletes.

Sports federations, as most nonprofit organizations, depend to a great extent on external financing provided by public and private entities (Friedrich, Helmig, & Ingerfurth, Citation2014). Three funding models can be identified: public, private and mixed (López-Egea, Sanchís, Sánchez, & Ortega, Citation2008). Spain, as well as the United Kingdom, Italy and France, has developed a mixed model in which sports federations receive funds from unconditional grants from the CSD, specific grants from the Olympic Sports Association (Asociación de Deportes Olímpicos, ADO) and revenues from private sources (licenses and sponsors). Public resources have traditionally constituted the main source of funding for non-professional sport but the trend is to increase private contributions. The diversification of the funding sources reduces the financial instability of sport federations if one of them fails and provides a greater degree of autonomy from public authorities (Lasby & Sperling, Citation2007; Pfeffer & Salancik, Citation1978). Furthermore, the recent deep financial crisis has fuelled the debate on the effectiveness of the investments in top-level sports and the role that public funding should play in their financing (Langer, Citation2006; Papadimitriou, Citation1999). There is a controversy about the convenience of focusing this funding on grassroots sports (Inglés & Seguí, Citation2014; Romeo-Velilla & Shibli, Citation2011) or on top-level sports (De Bosscher, Van Hoecke, Truyens, van Bottenburg, & De Knop, Citation2009). In general, with the exception of the USA, governments are willing to participate in the development and financing of top-level sports (De Bosscher et al., Citation2009). Sporting triumphs contribute to enhancing the image of a country and to hiding other deficiencies (Green & Houlihan, Citation2005).

3. Methodology

Spain has 66 sports federations, 26 belonging to the summer Olympic program. The sample is made up of the 22 Spanish Olympic federations that participated in both the Summer Games of Beijing 2008 and London 2012. The data have been obtained from the sports statistic database DEPORTEData, compiled by the Office of the Deputy Director on Statistics and Studies of the General Technical Secretariat of the Ministry of Education, Culture and Sports which is available at the CSD webpage 2 .

In order to conduct an analysis of the efficiency of the resources used with respect to the results obtained by the Spanish Olympic federations in the Olympic Games of Beijing and London, Data Envelopment Analysis (DEA) has been used. The relative efficiency obtained through the DEA is compared with the weight of each funding source for each federation. Then, the Malmquist index has been used to analyse the variation in efficiency in the period studied. Finally, the performance persistence of the federations in consecutive periods is studied in order to evaluate the consistency of the results obtained and to try to identify a behavioural pattern.

3.1. Data Envelopment Analysis (DEA)

The DEA analysis is a mathematical and non-parametric technique which is used to assess the relative efficiency of a group of productive units that, using the same type of resources (inputs), generate similar products (outputs). These units are called “Decision-Making Units” (DMUs). The DEA allows the measurement of efficiency to be focused on the assessment of the inputs necessary to produce a certain level of output or the maximum output that can be obtained with the inputs used. The first approach is known as input-oriented and the second as output-oriented.

Assuming the existence of f DMUs that consume m inputs to produce s outputs, the mathematical approach of the DEA can be expressed through the following fractional model (Charnes, Cooper, & Rhodes, Citation1978):

Maximize Hz=r=1suryrzi=1mvixiz

which is subject to:r=1suryrzi=1mvixiz1,f=1,,nur0,r=0,,svi0,i=0,,m

where y r  = outputs obtained (r = 1, …, s); x i  = inputs used (i = 1, …, m); f = number of DMUs assessed (f = 1, …, n); z = DMUs to be assessed; u r  = weight applicable to the i inputs to assess the DMU z; v i  = weight applicable to the r outputs to assess the DMU z; and h z  = coefficient of relative efficiency DMU z.

The measurement of efficiency adopted by the model relates the weighted sum of the outputs plus the inputs, h z being the value of the efficiency ratio of the evaluated unit z. As the ratio of any DMU cannot surpass 1, a DMU will be efficient if h z has a value of 1 and it will be inefficient if the contrary occurs. For the proposed technique to have discriminatory power, it is necessary for the total number of elements of the sample f to be superior to the total amount of inputs/outputs included in the model. Some authors even suggest that the total number of DMUs should be at least three times the total number of variables used (El-Mahgary & Lahdelma, Citation1995).

The two DEA models that are most frequently applied, from the approach of Farrell (Citation1957), are the CCR model of Charnes et al. (Citation1978), and the BCC model of Banker, Charnes, and Cooper (Citation1984). The basic difference between them can be found in the returns to scale. The CCR model assumes that DMUs operate with constant returns to scale, that is to say that changes in the outputs are proportional to changes in the inputs. The BCC model assumes variable returns to scale, meaning that the change in the outputs is not necessarily proportional to the change in the inputs. We apply a model of variable returns to scale (BCC model) that compares DMUs of similar size.

3.1.1. Selection of the model and the variables

The output-oriented DEA, which is predominant in the sports literature (Angulo et al., Citation2015; Lozano et al., Citation2002; Soares de Mello, Angulo, & Branco, Citation2008; Soares de Mello, Gomes, Angulo, & Biondi, Citation2008; Wu et al., Citation2008; Wu, Liang, & Yang, Citation2009; Zhang et al., Citation2009) has been used in this paper since the coaches, athletes and members of the federations give priority to the results over the resources used.

The selection of the inputs and outputs to be included in the model is critical in the development of the DEA because they should reflect the essence of the “productive process” of the units evaluated and because the results are sensitive to the number of variables. The higher the number of variables, the higher the number of efficient DMUs and, consequently, the model will have less power of discrimination (Cooper, Seiford, & Tone, Citation2000). Thus, the total number of inputs and outputs included in the model should be less than a third of the number of DMUs (El-Mahgary & Lahdelma, Citation1995).

Regarding the inputs, the predominant criteria in the literature for multi-sports events is to use the GDP and the population as proxies, respectively, of the economic and demographic factors of each country (Lozano et al., Citation2002). However, as this study is focused on the same country, it is necessary to propose two, more specific inputs. The first is a measure of the spending per capita for each sport (Wu, Liang, & Chen, Citation2009), calculated as the total amount of resources available to federations during each OG period over the number of athletes belonging to a federation in the years in which OG were held (see Appendix 1). The use of this indicator assumes that the success in elite sports is more related to the expenditure in grassroots sport than the specific investment in elite athletes. Although this statement is controversial and cannot be generalised to any context, the study conducted by Romeo-Velilla and Shibli (Citation2011) within the framework of the SPLISS project proves that, in Spain, success in elite sport depends on the absolute, rather than relative, expenditure on elite sport. The second input is the size of the delegation (number of athletes of each federation participating in the OG), already used by Benicio et al. (Citation2013) and Debnath and Malhotra (Citation2015). It can be considered to be a proxy of the investment of each federation in the Olympic program. In the Spanish Olympic team, there is a highly significant correlation for both years between the size of the delegation in each sport and the funds for that sport (R 2 = 0.792** in 2008 and R2 = 0.808** in 2012). Although winning Olympic medals depends on the combined potential of diverse factors, it appears that the size of the Olympic team plays the role of transmitting the composite impact of a country’s size and economy to the end-phase of Olympic success (Vagenas & Vlachokyriakou, Citation2012). Evidence suggests that the larger the size of an Olympic delegation, the greater the chance of achieving a medal. Nevertheless, the introduction of this variable may impair team sports, since they require a larger number of participants to compete for just one medal. The results of the DEA will verify whether federations with team sports systematically achieve lower scores than federations with individual sports. We believe that the negative effect for team sports of using this variable may be compensated by the composition of the first input variable that introduces the number of licenses in the denominator of the variable.

With regard to the outputs, the predominant criterion in the literature is to consider the gold, silver and bronze medals obtained, in a weighted form (Soares de Mello, Angulo, & Branco, Citation2008; Wu et al., Citation2008; Wu, Liang, & Yang, Citation2009; Zhang et al., Citation2009). This criterion does not take into account the different number of medals offered in each sport which creates a favourable scenario for some sports and less favourable for others (Lins et al., Citation2003). Because of this, as in Angulo et al. (Citation2015), the results achieved by each federation were divided by the total number of competitions in which they participated (some athletes participated in several competitions while, in collective sports, several athletes are required for one single competition). In this way, as in De Bosscher et al. (Citation2008), the result would be linked to the “market share” corresponding to each federation based on the total number of events in the Olympic program.

Furthermore, to consider exclusively the first three places of the classification as outputs is an insufficient measure of the performance of each federation. In the Spanish case, this criterion would not allow as to measure the efficiency of more than 50% of the federations because they did not obtain any medals (thirteen federations for each edition, nine of which did not obtain medals in either of the OG studied). In order to strengthen the model, and given the fact that the athletes are awarded a diploma when they come between 4th and 8th (Olympic Charter, Citation1984), these results are also considered within the outputs, as in Nielsen (Citation2012). The scores for the federations are now assigned as follows: 1st place-1 point, 2nd place-1/2 point … 8th place-1/8 point. Additionally, 1/9 point is assigned for all federations in order to avoid technical problems of DEA with DMUs showing 0 units of output. This additional score could be considered as a bonus to be qualified for the OG. However, it does not affect the results, since it is added to all participants. Although this output indicator is more sophisticated than those that are most frequently found in the literature, it still has the shortcoming of not discriminating after the 8th position. The following ratio summarizes, in a single figure, the results of each federation:IOt=i=1m1ntmt

where IO is the index of the output; n is the position obtained in the competition; m is the total number of competitions offered in which each federation participates.

Table shows inputs and outputs included in the study.

Table 1. Variable inputs and outputs

The BCC model has been chosen because it takes into account the effect of variable returns to scale. In this case, the changes in the results obtained (outputs) may not be proportional to the size of the delegation or to the relation between the available budget and the number of athletes of each federation (inputs). The variables of inputs and outputs for the two OG analysed are shown in Appendix 2.

To evaluate the influence of the financial structure of the federations on their performance, an analysis of the correlations of the relative efficiencies obtained with regard to the different funding sources of the federations (CSD grants, ADO grants and private revenues) (see Appendix 3) is carried out with the Pearson coefficient. The coefficients closer to ±1 imply a higher linear correlation, while those closer to 0 imply less linear correlation between the observed variables.

3.2. Dynamic Analysis of Efficiency

The Malmquist index allows us to perform an analysis of the variations in efficiency during a given period, based on the Data Envelopment Analysis (DEA) results. The change in the efficiency between two points is measured by calculating the quotient of the distances to each point in relation to a common technology -production frontier- (Färe, Grosskopf, Norris, & Zhang, Citation1994), through the following formula:

(1) M1(xt,yt,xt+1,yt+1)=D1t(xt+1,yt+1)D1t+1{xt+1,yt+1)D1t(xt,yt)D1t+1(xt,yt)12(1)

where x and y represent the inputs and outputs of the DMUs whose efficiency is to be studied and t represents the period analysed. From an output orientated perspective, a value of M > 1 means an efficiency increase and a value of M < 1 denotes a decrease. A value of M = 1 means there is no efficiency variation during the period.

The variation in efficiency might be a consequence of a change in the relative position of the DMU with respect to the production frontier or because the frontier has moved for the whole system (Färe et al., Citation1994). The original expression of the Malmquist index (1) is factorised by identifying two sources of change in efficiency: the technical change and the technological change.

M1(xt,yt,xt+1+1,yt+1)=D1t+1(xt+1,yt+1)D1t(xt,yt)D1t(xt+1,yt+1)D1t{xt,yt)D1t+1(xt+1,yt+1)D1t+1(xt,yt)12

The first factor (outside the square brackets) represents the technical change, i.e., the evolution of the distance of a DMU from the production frontier. The factor that determines the technical change is the evolution of the efficiency of a DMU with respect to the others, based on its capacity to reduce inputs and/or increase outputs. The second factor (between square brackets) measures the changes in technology during the periods under study, i.e. if the frontier is changing over time. The technological change measures the movement in the production frontier, determined by the efficiency of all DMUs of the sample in each period. The main factors explaining movements in the production frontier are technological advances or organizational changes that affect all the DMUs.

3.3. Performance persistence

The study of performance persistence consists of the comparison of the efficiency level of a sample of units in consecutive periods. This allows us to evaluate the consistency of the results obtained and to forecast future results.

There are different methodologies to test the existence of persistence in performance: regression analysis (parametric methodology) and efficiency rankings and double-entry contingency tables (non-parametric technique). In order to be consistent with DEA analysis -whose nature is non-parametric- contingency charts have been used.

The contingency tables technique is based on the comparison of efficiency classifications from two consecutive periods. For each period, a sub classification of “winning” and “losing” entities is carried out. The characterization of an entity as “winning” or “losing” comes from the median. The most efficient half of each classification is made up of winning entities, and the less efficient half is made up of losing entities. Then, a double-entry contingency chart is constructed (see Table ). This is a 2 × 2 matrix in which the labels WW (winning entities in both periods), WL (winning entities in the first period, losing entities in the second period), LW (losing entities in the first period, winning entities in the second period) and LL (losing entities in both periods) are used. In order to determine the robustness of the possible performance persistence phenomenon, Malkiel (Citation1995)’s statistic Z will be used:

(2) Z=(Y-np)np(1-p)(2)

where Z represents the statistic, which follows a normal distribution (0, 1); Y indicates the number of winning entities in two consecutive periods; n is WW + WL; Malkiel gives p a value of 0.5, assuming a neutrality hypothesis regarding persistence in performance.

4. Results

4.1. Efficiency analysis

Table shows the results of the DEA 3 and Malmquist index of the Spanish Federations in the Beijing 2008 and London 2012 Olympic Games.

Table 2. DEA and Malmquist coefficients in the Beijing 2008 and London 2012 Olympic Games

At the Beijing Games, ten federations achieve an efficiency of over 50% while eight do so in London. Seven are 100% efficient in Beijing 2008 (basketball, judo, taekwondo, tennis, archery, triathlon and volleyball) and five in London 2012 (basketball, judo, wrestling, taekwondo and triathlon). Only the basketball, judo, taekwondo and triathlon sports federations achieve 100% efficiency in both the Beijing and London games.

The temporal analysis is performed through the Malmquist index. It would not be appropriate to interpret a trend based on the efficiency indices because they are relative valuations based on the behavior of the set of DMUs for each period studied. Malmquist index values above 1 indicate an increase in efficiency between the two Games and values below 1 indicate a decrease. On average, as can be seen in the Table , the federations were less efficient (0.971) due to a decrease in the results and an increase in inputs: “income per capita” increased 16.7%, a greater weight than the reduction in “size” of only 6.8% (See Appendix 2).

This behavior can be observed in the tennis (0.187), cycling (0.214) and hockey (0.572) federations whose inputs increase while their results worsen. The federations of boxing (0.423), archery (0.500) and volleyball (0.589) show efficiency decreases as a result of increasing their inputs and of not getting any results. Although basketball (0.834) and judo (0.478) are efficient in both periods, in the values of the Malmquist index, we see a reduction of their efficiency due to a decline in their results despite having decreased or maintained their inputs. Finally, the results of the athletics (0.417) and canoeing (0.734) federations have a negative impact on their efficiency, in the latter accompanied by a significant increase in income per capita. The only federation that does not improve or get worse is badminton (1.000), with no results and no significant variations in its inputs.

On the contrary, the equestrian (2.345), gymnastic (1.111) and sailing (1.474) federations increase their efficiency by reducing their inputs and improving their results. The efficiency of the federation of table tennis (1.256) increases as a result of decreasing its inputs and maintaining its outputs. In the case of the swimming (2.212) and triathlon (1.008) federations, efficiency increases when the results improve, despite the fact that in the latter, the size of the delegation grows while its per capita expenditure decreases. Other federations, such as handball (1.176), weightlifting (2.091), taekwondo (5.719) and Olympic shooting (2.509), despite increasing per capita spending and maintaining or increasing the size of the delegation, improve their efficiency as a result of better performance. Finally, in wrestling (3.994), the size of the delegation decreases and per capita spending increases, but the federation obtains better results, leading to an improvement in efficiency.

If we divide the index into its technical and technological changes, a positive displacement of the latter, the production frontier (>1) formed by the efficient sports federations, can be seen. This suggests that, during the period analysed, the expectations of performance of the majority of the federations increase. The technical change (<1) indicates that, on average, federations do not fully achieve the expected results. Therefore, the DMUs are located in a zone further from the efficiency frontier in comparison to the zone they were in at the beginning of the period.

The increase of resources available, mainly financing sources and, therefore, per capita spending (see Appendix 1) has not meant an improvement in the sports results achieved in London compared to those in Beijing. This is illustrated in Table :

Table 3. Spanish sports results in the Beijing 2008 and London 2012 Olympic Games

The analysis of persistence in performance through the methodology of contingency charts shows that the number of federations that repeat as winners (W) or losers (L) in both OG is higher than the number of federations that do not. This shows the presence of persistence, and its statistical significance is confirmed through the Malkiel statistic, as can be seen in Table . These results show that some federations are systematically more efficient than others.

Table 4. Persistence in the efficiency of Spanish of Spanish federations

4.2. Funding structure and the performance of sports federations

The analysis of the funding structure of sports federations shows an increase in their resources during the 2009–2012 period (see Appendix 3). This is due to an increase in the private revenues collected by the federations that compensated for the decrease in public funding -grants issued by the CSD and the ADO- in the same period. On average, private revenues have increased from 49% in 2008 to more than 55% in 2012. The other important source comes from the CSD grants, which are the main funding source of more than half of the Spanish sports federations. However, the ADO funding is, on average, under 10% of the total funding sources, and decreases during the period (see Table ).

Table 5. Efficiency indexes and funding structure of Spanish federations

Table shows the relative efficiency of each sports federation in the two OG and the share of each funding component, for which a Pearson correlation test was applied. The results show no linear relation among them (see Table ).

Table 6. Pearson correlation test among efficiency and funding sources for Beijing 2008 and London 2012

5. Discussion

The lack of a framework that allows countries to be realistic about their sports performance expectations (Shibli et al., Citation2013) has increased interest in improving sports efficiency measurements (Lozano et al., Citation2002; Wu et al., Citation2008; Wu, Liang, & Chen, Citation2009; Zhang et al., Citation2009). Some authors also emphasize the need to estimate the social-economic cost-effectiveness of the money spent on athletes and federations (Sánchez & Barajas, Citation2009). This has led to improvements in performance measurements to evaluate a wider range of issues related to the federations’ performance in the OG (Nielsen, Citation2012; Shibli et al., Citation2015). However, the measurement of performance in multi-sports competitions, such as the OG, is a controversial issue and some weaknesses have been found in the most frequent indicators used in the literature. The main criticisms are that they do not capture some of the results and that they fail to differentiate properly between federations participating in several competitions or not, or between team and individual sports (Angulo et al., Citation2015; Soares de Mello, Angulo, & Gomes, Citation2012).

The synthetic indicator proposed in this study overcomes these weaknesses. Extending the positions considered to include more than just the medal winners allows us to better discriminate the efficiency of the federations. Furthermore, the best results in terms of efficiency are now achieved by the basketball, judo, taekwondo and triathlon federations, one of which is a team sport. The other three team sport federations of the sample (handball, hockey and volleyball) obtained relatively high efficiency scores in at least one of the Olympic Games. So, as in Debnath and Malhotra (Citation2015), the size of the delegation as an input indicator does not cause a negative impact on the efficiency of team sports’ federations.

Although some federations are systematically more efficient than others, the Malmquist index shows an overall decrease in the efficiency of the sample between the two OG. This worsening in their performance is a consequence of both the decrease in the sports results (output) and the increase in the funding sources (inputs) from one OG to the other. The expenditure per capita, a proxy of the economic capacity of each federation, increased by 16.78% between the two OG although the delegation size, a proxy of the elite sports investment, decreased by 7.31%. Romeo-Velilla and Shibli (Citation2011) state that success in elite sports responds mainly to the grassroots sports expenditure rather than to specific expenditure in elite sports, but our results do not support this conclusion, providing evidence that the performance of federations depends on more factors than the money spent.

During the period analysed, there were cuts in the public funds allocated to sports, which forced federations to look for new sources of incomes from the private sector. The analysis of the federative funding structure in the two OG shows important differences in the obtaining of private resources. A few federations (athletics, basketball, handball and tennis) received most of these private funds. The results of the study show that the efficiency of the federations is not related to the nature, public or private, of their funding sources. This is the case of the gymnastics and athletics federations which, despite changes in their financial structures, achieved a low efficiency in both OG. Furthermore, fencing, modern pentathlon and rowing, with heavy dependence on the CSD grants, did not qualify for the London 2012 OG, and the Spanish Football Federation, with a very low dependence on public funds, did not qualify for the Beijing 2008 OG. The low relationship between the sports results and the type of funding of federations would explain the deceleration of the return on investment (ROI) observed after the Barcelona 1992 OG (López-Egea et al., Citation2008).

The results of this study provide evidence that the international competitiveness of elite sports does not only depend on the available resources, but also on the capacity of transforming these resources into competitive results (Storm & Nielsen, Citation2010). Furthermore, it would be necessary to take into account the evolution of the resources available to competitors. According to De Bosscher et al. (Citation2008), the sporting success of a nation depends on not what a nation does relative to what it did in the past but what it does now relative to what its competitors are doing now. Thus, Spanish federations may be less competitive because their rivals are spending more. The study also highlights the importance of public policies and the ability of both governmental and social organizations (CSD, ADO and the national sports federations, in the Spanish case) in high-performance sports (De Bosscher, Shibli, Westerbeek, & van Bottenburg, Citation2015; Platonov, Citation2011). At the same time, it acknowledges the difficulty to measure high-level sport performance, the complexity of their processes and the factors involved. The SPLISS project identifies more than 100 factors, but in addition, discretional variables such as the innate talent of some athletes, the role of private clubs or just the luck at the time of competition must be considered. It is difficult to evaluate the success of four-year policies just by a few seconds of performance during the Games. It would require to take into account the results of other competitions held during the four-year period. This study, as well as others aiming to synthesize high-level sport performance in a few variables, provides a partial view of the efficiency and, therefore, the results are more academic than operational.

6. Conclusions

This study contributes to the measurement of the Spanish performance in the OG by using a comprehensive index that evaluates the efforts of the federations more accurately. On average, the efficiency of the Spanish federations decreased from Beijing 2008 to London 2012. This reflects that they were unable to take advantage of the improvement in production factors in the framework of the economic crisis.

The Spanish sports federations display a heavy dependency on the ordinary grants issued by the CSD. As these grants decreased, the federations felt compelled to look for new private sources. However, this study shows that none of the funding sources conditions the efficiency of the federations. The performance of the Spanish federations has worsened despite increasing their funding in the period analysed. This suggests that the sports results do not depend exclusively on economic investment, although this is a necessary element. There are many other factors which influence the results, including the individual talent of some athletes in a given period. Furthermore, these results contradict the idea that sports with a higher percentage of private funding get better results than those that are funded mainly with public funds (Crompton, Citation2015).

The results of this study are useful for the entities in charge of designing policies and allocating resources to sports in each country. They also provide criteria to determine the level of public funding policies depending on the characteristics of each federation and taking into account factors such as the popularity of each sport and its capacity to generate revenues.

Future research will appraise the Spanish federations’ efficiency in later OG editions, analysing the federations’ performance through time in order to capture the possible long-term effects of certain strategies such as the investment in grassroots sport versus top-level sport. It would also be of interest to determine how efficiency is affected by operative variables such as the number of high-level athletes and trainers, the structure of governmental agencies, the number of clubs, and the financial situation of the sports federations.

Funding

This work was supported by the Spanish National Research and Development Plan [project number ECO 2015 66240] and the Regional Government of Aragón and the European Social Fund through Research Project S05 and the University of Zaragoza through the project JIUZ-2017-SOC-11.

Correction

This article has been republished with minor changes. These changes do not impact the academic content of the article.

Additional information

Notes on contributors

Lourdes Torres

Emilio Martin is a lecturer in the Accounting and Finance Department at the University of Zaragoza (Spain). His research interests are focused on the governance and performance measurement of public utility entities. An ongoing area of work refers to the field of sport, where he is analysing the management of sporting organisations from the point of view of both the economic and financial performance.

Emilio Martin

Lourdes Torres, PhD and full professor at the University of Zaragoza (Spain), is teaching and researching in public sector accounting, auditing and management. She has published in some of the best public administration ISI journals and coordinates the Doctoral Program in Accounting and Finance with mention of Excellence.

Juan Carlos Guevara

Juan Carlos Guevara is a Venezuelan PhD student at the University of Zaragoza (Spain). He has collaborated with the Venezuelan Olympic Committee as the research director of the Centre for Advanced Studies and Sports Research (CESID).

Notes

1. Sports federations are private nonprofit entities and act as collaborative agents of public administrations (article 30.2 of the Sports Law and STC 05/24/84).

2. http://www.csd.gob.es/csd/estadisticas.

http://www.csd.gob.es/csd/asociaciones/1fedagclub/otras-estadisticas/.

3. For the data processing, DEAP software Version 2.1 by the Queensland University Centre for Efficiency and Productivity Analysis (CEPA) was used.

References

  • Angulo, M. , Pescarini, V. , & Soares de Mello, J. C. C. B. (2015). Assessing the efficiency of sports in using financial resources with DEA models. Procedia Computer Science , 55 , 1151–1159. doi:10.1016/j.procs.2015.07.086
  • Banker, R. D. , Charnes, A. , & Cooper, W. W. (1984). Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis. Management Science , 30 , 1078–1092. doi:10.1287/mnsc.30.9.1078
  • Benicio, J. , Bergiante, N. , & Soares de Mello, J. (2013). A FDH study of the Vancouver 2010 Winter Olympic Games. WSEAS Transaction on Systems , 1 , 179–188 . Retrieved from https://www.researchgate.net/publication/236963938_A_FDH_Study_of_the_Vancouver_2010_Winter_Olympic_Games
  • Charnes, A. , Cooper, W. W. , & Rhodes, E. (1978). Measuring the efficiency of decision-making units. European Journal of Operational Research , 2 , 429–444. doi:10.1016/0377-2217(78)90138-8
  • Churilov, L. , & Flitman, A. (2006). Towards fair ranking of Olympics achievements: The case of Sydney 2000. Computers and Operations Research , 33 , 2057–2082. doi:10.1016/j.cor.2004.09.027
  • Cooper, W. W. , Seiford, L. M. , & Tone, K. (2000). Data envelopment analysis: A comprehensive text with models, applications, references and DEA- Solver Software . New York, NY: Kluwer Academic.
  • Crompton, J. (1995). Economic impact analysis of sports facilities and events: Eleven sources of misapplication. Journal of Sport Management , 9 (1), 14–35. doi:10.1123/jsm.9.1.14
  • Crompton, J. (2015). Potential negative outcomes from sports sponsorship. International Journal of Sports Marketing and Sponsorship , 16 (3), 20–34. doi:10.1108/IJSMS-16-03-2015-B003
  • De Bosscher, V. (2007). Sports policy factors leading to international sporting success (Doctoral Thesis). Brussel. VUBPRESS. ISBN 978-905487-421-8.
  • De Bosscher, V. , Bingham, J. , Shibli, S. , van Bottenburg, M. , & de Knop, P. (2008). The global sporting arms race: An international comparative study on sports policy factors leading to international sporting success . Aachen: Meyer & Meyer Sport.
  • De Bosscher, V. , Van Hoecke, J. , Truyens, J. , van Bottenburg, M. , & De Knop, P. (2009). Multidimensional approach to the measurement of effectiveness of elite sport policies. The case of Flanders . Paper presented at the 17th European Association for Sport Management Conference, Amsterdam
  • De Bosscher, V. , Shibli, S. , Westerbeek, H. , & van Bottenburg, M. (2015). Successful elite sport policies. An international comparison of the sports policy factors leading to international sporting success (SPLISS 2.0) in 15 nations . Aachen: Meyer & Meyer.
  • Debnath, R. M. , & Malhotra, A. (2015). Measuring efficiency of nations in multi sport events: A case of Commonwealth Games XIX. Naše Gospodarstvo our Economy , 61 , 25–36. doi:10.1515/ngoe-2015-0003
  • El-Mahgary, S. , & Lahdelma, R. (1995). Data envelopment analysis: Visualizing the results. European Journal of Operational Research , 83 , 700–710. doi:10.1016/0377-2217(94)00303-T
  • Färe, R. , Grosskopf, S. , Norris, M. , & Zhang, Z. (1994). Productivity growth, technical progress, and efficiency changes in industrialized countries. American Economic Review , 84 , 66–83 . Retrieved from http://www.jstor.org/stable/2117971?origin=JSTOR-pdf
  • Farrell, M. J. (1957). The measurement of production efficiency. Journal of the Royal Statistical Society. Series A (General) , 120 , 253–290 . Retrieved from http://www.jstor.org/stable/2343100 10.2307/2343100
  • Friedrich, M. , Helmig, B. , & Ingerfurth, S. (2014, September). Efficiency evaluation in sports clubs . Paper presented at the 22nd European Association for Sport Management Conference, Coventry
  • Goldman Sachs . (2012). The Olympics and economics 2012 . Goldman Sachs Global Economics, Commodities and Estrategy Research.
  • Gratton, C. , Shibli, S. , & Coleman, R. (2006). The economic impact of major sports events: A review of ten events in the UK. The Sociological Review , 54 (2_suppl), 41–58. doi:10.1111/j.1467-954X.2006.00652.x
  • Green, M. , & Houlihan, B. (2005). Elite sport development. Policy learning and political priorities . London and New York: Routledge.
  • Inglés, E. , & Seguí, J. (2014). Elite Sport: A remedy or an obstacle for sport participation? The case of Spain (1980–2012) . European Association for Sport Management.
  • International Olympic Committee IOC, Olympic Charter . (1984). BYE-LAWS. To rule 64 medals and diplomas (pp. 66–67).
  • Intervención General de la Administración del Estado –IGAE . (1997). The establishment of objectives and the measurement of results in the public sphere . Madrid: MEH.
  • Langer, M. (2006). Öffentliche Förderung des Sports. Eine ordnungspolitische Analyse . Berlin: Duncker & Humblot.
  • Lasby, D. , & Sperling, J. (2007). Understanding the capacity of Ontario sports and recreation organizations . Toronto: Imagine Canada.
  • Lins, M. P. E. , Gomes, E. G. , Soares de Mello, J. C. C. B. , & Soares de Mello, A. J. R. (2003). Olympic ranking based on a zero sum gains DEA model. European Journal of Operational Research , 148 , 312–322. doi:10.1016/S0377-2217(02)00687-2
  • López-Egea, S. G. , Sanchís, C. M. , Sánchez, J. P. G. , & Ortega, A. M. (2008). Measuring the return on investment when sponsoring the Spanish Olympic team . European Association for Sport Management. Retrieved from https://www.easm.net/download/2008/bbda6817add89e17b599dc5962fb9383.pdf
  • Lozano, S. , Villa, G. , Guerrero, F. , & Cortés, P. (2002). Measuring the performance of nations at the Summer Olympics using data envelopment analysis. Journal of the Operational Research Society , 53 , 501–511. doi:10.1057/palgrave.jors.2601327
  • Malkiel, B. (1995). Returns from investing in equity mutual funds 1971 to 1991. The Journal of Finance , 50 , 549–572. doi:10.2307/2329419
  • Nielsen, K. (2012, September). London 2012: Recent trends in the international competitiveness of national elite sport systems . Presented at 19th of the European Association for Sport Management Conference, Aalborg.
  • Papadimitriou, D. (1999). Voluntary boards of directors in Greek sport governing bodies. European Journal for Sport Management , 6 (Special Issue), 78–103.
  • Pfeffer, J. , & Salancik, G. B. (1978). The external control of organizations . New York, NY : Harper and Row.
  • Platonov, V. (2011). El deporte de alto rendimiento en diferentes países y la participación en los juegos olímpicos (pp. 11–12). Caracas: Editorial Episteme.
  • Preuss, H. (2004). Calculating the regional economic impact of the Olympic Games. European Sport Management Quarterly , 4 (4), 234–253. doi:10.1080/16184740408737479
  • Romeo-Velilla, M. , & Shibli, S. (2011, September). An analysis of the financial support to elite sports in Spain . Presented at the 19th European Association for Sport Management Conference, Madrid.
  • Sánchez, P. , & Barajas, A. (2009, September). Financing high-performance athletes through National Sport Associations in Spain: Comparative analysis with other European countries . Presented at 17th of the European Association for Sport Management Conference, Amsterdam.
  • Santos, T. P. , Angulo, L. , & Soares de Mello, J. C. C. B. (2011). Allocating economic resources for Olympic sports in Brazil using a DEAZSG model . 3rd IMA International Conference on Mathematics in Sport, Manchester.
  • Shibli, S. , De Bosscher, V. , van Bottenburg, M. , & Westerbeek, H. (2013, September). Alternative measures of performance in the Olympic Games . Paper presented at the 21st European Association for Sport Management Conference, Istanbul.
  • Shibli, S. , De Bosscher, V. , van Bottenburg, M. , & Westerbeek, H. (2015). Winning streaks: A proxy for effective elite sport policies? In Sport in a digital age (pp. 27–28). European Association for Sport Management.
  • Soares de Mello, J. C. C. B. , Angulo, L. , Gonçalves, E. , Biondi, L. , & Gouvêia, P. (2004). A modified cross evaluations DEA model for DMU ranking: An Olympic case study . Retrieved from https://www.researchgate.net/
  • Soares de Mello, J. C. C. B. , Angulo, L. , & Branco, B. (2008). Some rankings for the Athens Olympic Games using DEA models with a constant input. Investigação Operacional , 28 , 77–89 . Retrieved from http://www.uff.br/decisao/IOolympic2008.pdf
  • Soares de Mello, J. C. C. B. , Gomes, E. G. , Angulo, L. , & Biondi, L. (2008). Cross evaluation using weight restrictions in unitary input DEA models: Theoretical aspects and application to Olympic Games ranking. WSEAS Transactions on Systems , 7 , 31–39 . Retrieved from http://www.wseas.us/e-library/transactions/systems/2008/30-231 N.pdf
  • Soares de Mello, J. C. C. B. , Angulo, L. , & Gomes, F. (2012). A DEA model with a non-discretionary variable for Olympic evaluation. Pesquisa Operacional , 32 , 21–30 . Retrieved from http://www.scielo.br/pdf/pope/v32n1/aop0212.pdf 10.1590/S0101-74382012005000004
  • Storm, R. K. , & Nielsen, K. (2010). Dansk eliteidraets konkurrenceevne: Resultater, malemetoder og investeringer [The competitiveness of Danish Elite Sports: Results, Measurement and Policy]. Scandinavian Sport Studies Forum , 1 , 27–50. Retrieved from http://sportstudies.org/wp-content/uploads/2014/01/027-049_vol_1_2010_storm-nielsen.pdf
  • Vagenas, G. , & Vlachokyriakou, E. (2012). Olympic Medals and demo-economic factors: Novel predictors, the ex-host effect, the exact role of team size, and the ‘population-GDP’ model revisited. Sport Management Review , 15 , 211–217. doi:10.1016/j.smr.2011.07.001
  • Wu, J. , Liang, N.A. , Wu, D. , & Yang, F. (2008). Olympics ranking and benchmarking based on cross efficiency evaluation method and cluster analysis: The case of Sydney 2000. International Journal of Enterprise Network Management , 2 , 377–392. doi:10.1504/IJENM.2008.02064
  • Wu, J. , Liang, L. , & Chen, Y. (2009). DEA game cross-efficiency approach to Olympic rankings. Omega , 37 , 909–918.10.1016/j.omega.2008.07.001
  • Wu, J. , Liang, L. , & Yang, F. (2009). Achievement and benchmarking of countries at the Summer Olympics using cross efficiency evaluation method. European Journal of Operational Research , 197 , 722–730. doi:10.1016/j.ejor.2008.06.030
  • Wu, J. , Zhou, Z. , & Liang, L. (2010). Measuring the performance of nations at Beijing summer Olympic using integer-valued DEA model. Journal of Sports Economics , 11 , 549–566. doi:10.1177/1527002509352619
  • Zhang, D. , Li, X. , Meng, W. , & Liu, W. (2009). Measuring the performance of nations at the Olympic Games using DEA models with different preferences. Journal of the Operational Research Society , 60 , 983–990. Retrieved from http://www.jstor.org/stable/40206817 10.1057/palgrave.jors.2602638

Appendix 1

Funding of the Olympic games Beijing 2008 proportionally to the federation licenses

Source: Ministry of Education, Culture and Sports. Supreme Council for Sports. Office of the Deputy Director of Sports Promotion and Paralympic Sports.

Funding of the Olympic games London 2012 proportionally to the federation licenses

Source: Ministry of Education, Culture and Sports. Supreme Council for Sports. Office of the Deputy Director of Sports Promotion and Paralympic Sports.

Appendix 2

Inputs and outputs variables Beijing 2008

Inputs and outputs variables London 2012

Source: Author’s elaboration.

Appendix 3

Structure of the funding sources of the Olympic sports federations period 2005-2008

Source: Author’s elaboration.

Structure of the funding sources of the Olympic sports federations period 2009–2012

Source: Author’s elaboration.