10,027
Views
90
CrossRef citations to date
0
Altmetric
Workshop Report

A Causal Analysis of Observed Declines in Managed Honey Bees (Apis mellifera)

, , &
Pages 566-591 | Received 08 Jul 2013, Published online: 25 Nov 2013

ABSTRACT

The European honey bee (Apis mellifera) is a highly valuable, semi-free-ranging managed agricultural species. While the number of managed hives has been increasing, declines in overwinter survival, and the onset of colony collapse disorder in 2006, precipitated a large amount of research on bees’ health in an effort to isolate the causative factors. A workshop was convened during which bee experts were introduced to a formal causal analysis approach to compare 39 candidate causes against specified criteria to evaluate their relationship to the reduced overwinter survivability observed since 2006 of commercial bees used in the California almond industry. Candidate causes were categorized as probable, possible, or unlikely; several candidate causes were categorized as indeterminate due to lack of information. Due to time limitations, a full causal analysis was not completed at the workshop. In this article, examples are provided to illustrate the process and provide preliminary findings, using three candidate causes. Varroa mites plus viruses were judged to be a “probable cause” of the reduced survival, while nutrient deficiency was judged to be a “possible cause.” Neonicotinoid pesticides were judged to be “unlikely” as the sole cause of this reduced survival, although they could possibly be a contributing factor.

INTRODUCTION

The European honey bee (Apis mellifera) is a semi-free-ranging managed agricultural species, highly valued throughout the world for its production of honey and its ecological importance in plant reproduction, and increasingly, for pollination of many economically important crops. Although the worldwide number of managed hives has increased since the 1960s, declines in overwintering survival have been reported in the United States and in some European countries (Ellis Citation2012). Prior to 2006, annual average “expected” losses in the United States were approximately 15% (vanEngelsdorp et al. Citation2007), but since then, U.S. beekeepers have been reporting losses (overwintering mortality) of about 30% (vanEngelsdorp et al. Citation2011). These losses have not resulted in a pronounced decline in the overall number of honey-producing colonies managed in the United States, because beekeepers have apparently been replacing colonies to cover the losses (vanEngelsdorp et al. Citation2011). However, concern about these declines, which were perceived as widespread and substantial, as well as the onset of a particular phenomenon labeled colony collapse disorder (CCD; first described by vanEngelsdorp et al. Citation2007), has precipitated a large amount of research on bees’ health over the past several years.

A number of possible causes for reduced overwinter survival of managed honey bees have been put forth in both the scientific literature and the popular media, including pests and parasites, bacteria, fungi, viruses, pesticides, nutrition, management practices, and environmental factors (vanEngelsdorp et al. Citation2010; vanEngelsdorp and Meixner Citation2010). Scientists are increasingly postulating that a combination of these factors is responsible (Kluser et al. Citation2010), and new hypotheses continue to surface. However, there is no consensus about the cause or combination of causes (vanEngelsdorp and Meixner Citation2010). A workshop of honey bee experts was convened in 2012 to use a formal causal analysis approach to elicit expert opinion and evaluate the possible causes of declining overwinter survival of honey bee colonies. Exponent, Inc. was contracted by Bayer CropScience to arrange and conduct the workshop.

CAUSAL ANALYSIS WORKSHOP

The goal of the workshop was to develop an organized framework to support an objective approach to evaluating the cause(s) of reduced overwinter survival of honey bees in the United States. The approach used a formal causal analysis approach to elicit and organize expert opinions. This method has been applied to various environmental problems where multiple causes were suspected (Suter et al. Citation2010; Wickwire and Menzie Citation2010). Using this systematic approach, the workshop participants identified and ranked the most important candidate causes of reduced overwinter survival and determined whether any of the candidate causes could be negated; critical data gaps and research needs that prohibited reaching a definitive conclusion were identified.

The causal analysis workshop was held at the Airlie Conference Center in Warrenton, Virginia, on September 25–27, 2012. The workshop participants included 19 honey bee experts chosen to represent a diversity of expertise in various factors affecting honey bee health, based on a literature search of relevant publications, and to represent the academic, industrial, and government sectors in North America and Europe. Areas of specialization included honey bees’ biology and health, ecotoxicology, and beekeeping practices. The workshop was guided by causal analysis experts from Exponent; the U.S. Environmental Protection Agency (USEPA), Office of Research and Development; and the University of California Davis. Their areas of expertise include development of the USEPA causal analysis/diagnosis decision information system (CADDIS) and methods for exploring causation (e.g., change-point analysis, information theory, and expert elicitation) (http:// www.epa.gov/caddis; Suter et al. Citation2010; Cormier et al. Citation2010; Liu et al. Citation2012; Martin et al. Citation2011; Moore and Runge Citation2012; Thomson et al. Citation2010). The honey bee experts were provided with an introduction to the causal analysis framework and were presented with an example of the approach, showing how it was used to identify the primary cause of the decline of the San Joaquin kit fox population in the southern Central Valley of California.

THE CAUSAL ANALYSIS FRAMEWORK

The causal analysis framework used for this exercise was adapted from the process developed by USEPA for causal assessments in impaired aquatic systems (CADDIS) (Suter et al. Citation2010; Cormier et al. Citation2010) and adaptations to terrestrial systems by Wickwire and Menzie (Citation2010) and to evaluations of endangered species (Gard and Menzie Citation2012). The underlying approach and concepts have been used in applications related to environmental impacts on human health (Hill Citation1965) and more recently, in ecological impairment (USEPA Citation2000; Menzie et al. Citation2007). The causal analysis approach focuses on a specific individual case or problem and therefore is applicable to addressing the question of causation of reduced overwinter survival of honey bees.

A causal analysis framework leads to a supportable conclusion, because it is designed to (a) guard against gaps in logic concerning candidate causes and their effects, or prematurely identifying a singular cause; (b) provide transparency for professional judgments and scientific opinions; (c) identify principal causes; (d) distinguish among probable, possible, unlikely, and uncertain causes. The causal analysis method is intended to support expert judgments concerning the relative importance of each cause in decreased honey bees’ survival and considers all major causes with a potential role in the problem. The causal analysis framework provides an outcome that categorizes the causes, based on the weight-of-evidence, as being probable, possible, or unlikely causes of declining honey bees’ overwinter survival. The framework also helps identify data gaps and therefore can be used to guide the collection of additional data or novel research (Menzie et al. Citation2007).

As outlined by Wickwire and Menzie (Citation2010), the causal analysis process includes the steps presented in : (a) identifying the problem statement, (b) listing the candidate causes, (c) developing a conceptual model, (d) analyzing the strength of evidence compared to criteria, and (e) summarizing the significance of each cause.

Figure 1 Causal analysis approach used for assessing reduced overwinter survival of honey bee colonies. (Color figure available online.)

Figure 1 Causal analysis approach used for assessing reduced overwinter survival of honey bee colonies. (Color figure available online.)

PROBLEM STATEMENT

As a first step, the issue and problem statement was stated clearly, to identify the temporal and spatial bounds of the issue and the specific effect being studied. By placing bounds on the problem statement, the assessment became more tractable for a focused analysis. This was necessary because, without it, the problem was too broad and invited debate about its occurrence. For example, “global declines in honey bee populations” have been alleged (De Grandi-Hoffman et al. Citation2013) but lack rigorous scientific support. Therefore, it was decided among the workshop participants to focus on overwinter survival of honey bees managed for use in the California almond industry. There are nearly 740,000 acres of almond orchards in California that produce approximately 80% of the global almond market (Carman Citation2011), requiring honey bee pollination during the bloom period. The large pollination need for this industry has prompted U.S. beekeepers to move their colonies from states all over the country to provide contracted pollination services. It is estimated that nearly 60% of the bee colonies in the United States are used in pollination services for the California almond industry (Carman Citation2011). This scenario was therefore chosen due to its economic importance and the great number of colonies involved.

The problem statement for this causal analysis was refined as follows:

What are the causes of the lowered probability of survival (on an annualbasis) of productive* commercial colonies of honey bees for almond pollination dating from approximately 2006 (recognizing preceding conditions)?

Annual is defined as the middle of almond pollination to the middle of this event the following year.

*Productive colonies have all stages of brood, good queen, good food stores, and so on.

The date included in the problem statement reflects the fact that various factors have caused declines in honey bees in the past, but around 2006, higher-than-normal overwintering losses began to be reported (Ellis Citation2012). Although this time frame is also when the problem of CCD began to be recognized, the workshop participants specifically chose not to focus on CCD, due to the lack of clarity about the extent of this specific syndrome (Ellis Citation2012).

CAUSE IDENTIFICATION AND CONCEPTUAL MODEL

After agreeing on a focused problem statement, the next step was to create a list of candidate causes that influence the survival of honey bees. An initial list was generated from literature information and refined at the workshop through discussion with the honey bee experts (). The initial list included the most discussed and published causes—causes that may be linked to honey bees’ health based on reports in popular media and those of particular concern to scientists and beekeepers but whose causal relationships are not currently known. At this initial stage, all candidate causes were included.

Table 1 List of candidate causes.

A conceptual model of how the candidate causes affect bees’ survival was developed based on the honey bees’ life cycle. The conceptual model characterizes the honey bee's biological characteristics and ecological requirements to assist in identifying its vulnerabilities to the candidate causes. The conceptual model also illustrates the relationships between the honey bees’ life stages and each cause, as well as among the various candidate causes. If known, the relative magnitudes of the candidate causes on the life stages are also identified, such as indicating reproductive effects versus mortality effects. If known and recognized, causal relationships between candidate causes and the honey bee were also depicted in the conceptual model.

Causal Criteria

The causal criteria used to evaluate the strength of evidence for how each candidate cause reduces survival of honey bees used in the California almond industry scenario are described below:

Evidence of time order: A candidate cause must always precede or coincide with the event of concern. Temporality is an important consideration and should include knowledge of the life history of the species (e.g., seasonality) to determine whether the cause occurred just prior to a critical life stage, as well as more broadly, such as a few years prior to the problem. For this causal analysis, the decline in probability of survival for honey bees in the California almond scenario appeared to have started sometime around 2006. Candidate causes that were known to have occurred just prior to 2006 (or emerged at that time) provide stronger evidence of possible causality. Causes that were documented only after 2006 were given little further consideration in the assessment, because the evidence is considered weak.

Co-occurrence: To cause a problem, the candidate cause must have interacted both spatially and temporally with managed honey bee colonies. This criterion does not require physical contact between the cause and the effect and also includes the absence of the factor (e.g., lack of water and food sources). Time lags are considered, because some causes may have always been present but may not have been reported until later.

Cause–response relationship: This criterion is meant to describe the relationship between the candidate cause and its intensity, frequency, and duration. It is intended to determine whether the observed magnitude of the effect is concordant with the amount of the causal agent present in the environment. These relationships can be defined in the laboratory or in the field. Sufficiency in the laboratory can be elucidated from controlled experiments that have been performed to examine responses at various levels of stress. A classic example is dose and response testing of chemicals on test organisms. Sufficiency in the field relates to observed effects seen in field-scale experiments or reports from commercial beekeepers.

Interaction: The candidate cause must have a known (or hypothesized) mechanism of action that can result in the observed effect. This criterion is important in cases where the candidate cause and effect are spatially and temporally coincident but there is little information about the nature of the connection between the two.

Alteration: The candidate cause should result in some alteration to the honey bee that is notable, either decreased survival or some sublethal effect that has the potential to cause colony failure. The more specific the symptoms are to the candidate cause, the stronger is the weight-of-evidence that supports its diagnosis.

Scoring

The impact of each candidate cause and the relative strength of its association to the observed effect (overwinter survival of honey bees) was evaluated by the experts. A scoring system was used to assign the candidate cause to a category for each of the criteria described above, based on the degree of confidence expressed by the experts (USEPA Citation2008; USEPA CADDIS). Categories were designated by a range of “+” and “−” scores, as follows:

+++ convincingly supports

++ strongly supports

+ somewhat supports

0 neither supports or weakens

− somewhat weakens

−− strongly weakens

− − − convincingly weakens

NE no evidence

After each candidate cause was evaluated for each criterion, the body of evidence was evaluated for consistency by reviewing the overall pattern of “+” and “−” scores. A cause with many “++” and “+++” for multiple criteria was deemed to be a “probable cause” of reduced commercial honey bees’ survival in the California almond scenario. In contrast, causes with a multitude of “− − −” and “− −” scores were considered to be unlikely causes ().

Table 2 Weight-of-evidence for candidate causes and consistency of evidence.

Consistency of Evidence

To assist in organizing the data and interpreting the evidence, a weight-of-evidence table was created (). The causes were determined to be probable, possible, unlikely, or indeterminate. These categories are defined as:

Probable: There is convincing evidence that the cause has led to a decline in the survival probability of commercial honey bee colonies in the California almond industry, is impeding the recovery, and may cause further decline and/or continue to impede recovery.

Possible: There is some convincing evidence that the cause, acting alone, could contribute to the decline in survival probability of commercial honey bee colonies in the California almond industry. There is some evidence that the cause can contribute to a negative change in the population at the hive or colony level.

Possible in combination with other factors: There is some convincing evidence that the cause, in combination with one or more other causes, could contribute to a decline in the survival probability of commercial honey bee colonies in the California almond industry. There is weak evidence that the cause, acting alone, can contribute to a negative change in the population at the hive or colony level.

Unlikely: The evidence is too small or runs counter to the criterion that the cause can elicit a decline in the survival probability of commercial honey bee colonies in the California almond industry. Consistent negative evidence can be used to eliminate a potential cause.

Indeterminate: The evidence for the cause is not available, or more information and data are required to assess its effects on the survival probability of commercial honey bee colonies in the California almond industry.

RESULTS

Due to time limitations, workshop participants were unable to perform a detailed evaluation of the evidence for (and against) each candidate cause, and reaching a final conclusion is beyond the scope of this article. However, several examples are provided below to illustrate the causal analysis approach and the manner in which a weight-of-evidence argument can be developed to support a final conclusion. The evidence cited is not exhaustive but indicates the types of information that can be used in the analysis. An example is provided for causes that the workshop participants rated in each of the following three categories: probable cause, possible cause, and unlikely cause. These examples were selected to represent three different categories of conclusions as well as three different major categories of stressors (Pests and Parasites; Pesticides; and Nutrition).

Example of a Probable Cause

The combination of the parasitic mite Varroa destructor plus viruses received the highest ranking and was judged to be a “probable cause” of reduced honey bees’ survival, as described in the problem statement (). Either Varroa or viruses occurring separately were felt to be “possible” causes, but the combination was assessed to be “probable.” Varroa destructor (formerly known as Varroa jacobsoni) is a mite that feeds on the hemolymph of both immature and adult honey bees. If not controlled, it is devastating to beekeepers in most parts of the world (ISSG Citation2006). Rosenkranz et al. (Citation2010) stated that, without periodic treatment for Varroa, most of the honey bee colonies in temperate climates would collapse within 2–3 years. The following effects of Varroa on honey bees have been reported: decreased weight and lifespan of adult bees; severe nutritional deficits for the developing bee; malformations (shortened abdomens, misshapen wings, deformed legs); decreased flight duration, and reduced sperm production in drones (which at the colony level can result in reduced mating opportunities and swarms); increased absences and lower rate of return to the hive (possibly due to altered learning and navigation ability); reductions in emergence weights, water, protein, and carbohydrate levels (which may affect navigation and also compromise immune response); and reductions in indicators of long-term survival and endocrine function (Amdam et al. Citation2004; Bowen-Walker and Gunn Citation2001; LeConte et al. Citation2012; Ellis and Zettle Nalen Citation2010; Rosenkranz et al. Citation2010; Sammataro Citation2012; Duay et al. Citation2003; Garedew et al. Citation2004; DeJong Citation1997).

In addition, Varroa can transmit multiple viruses as well as activate dormant viruses, and it is increasingly believed that the viruses, not the mites, may be responsible for the majority of damage that bees experience while hosting the mites (Webster and Delaplane Citation2001; Hung et al. Citation1995, Citation1996). Bee viruses were considered a minor problem before the occurrence of Varroa (Rosenkranz et al. Citation2010), although viral disease outbreaks in colonies infected with Varroa inevitably result in the collapse of the colony (Allen and Ball Citation1996; Ball and Allen Citation1988). Transmission by Varroa has been proven experimentally for several honey bee viruses, as summarized by de Miranda et al. (Citation2012). The list of viruses vectored by Varroa destructor includes ABPV, KBV, DWV, IAPV, VDV-1, SBPV, and SBV (Sammataro et al. 2000; Rosenkranz et al. Citation2010; de Miranda et al. Citation2012). This is supported by specific laboratory and field evidence (Ball and Allen Citation1988) for APV. Yang and Cox-Foster (Citation2007) found that a combination of Varroa, the interaction of DWV and microbes, and a developmental immune incompetency decreased survivorship and colony fitness.

V. destructor is a new parasite of A. mellifera, as it has shifted from its original host (A. ceranae). Thus, the natural, relatively benign evolutionary compromise between bee viruses and their hosts has been seriously destabilized (de Miranda et al. Citation2012). The first record of Varroa in the United States dates to 1987 (DeJong 1977) and it is present on all continents except Australia (Rosenkranz et al. Citation2010). Thus, its appearance pre-dates the advent of the declines in honey bees’ survivorship, as described in the problem statement, which began to occur around 2006. In addition, Varroa do not occur in Australia, a continent that has not experienced similar declines in honey bees’ survival. Colony losses have not been significant in Africa and South America either, where African and Africanized bees, respectively, exhibit high survival without treatment for Varroa (Cobey et al. Citation2012). These points thus resulted in strong positive scores in the causal criteria for time order and co-occurrence.

The impacts of Varroa infestation on colony health are well documented. Although the relationship between the level of infestation (cause) and the damage produced (response) is complex (Rosenkranz et al. Citation2010), the level required to produce damage appears to have decreased over time (vanEngelsdorp and Meixner Citation2010). The effects of viruses on bees are becoming better understood. With experimental evidence from laboratory and field-scale studies that Varroa can transmit viruses (de Miranda et al. Citation2012), the causal criteria regarding the cause–response relationship and interaction (mechanism of action) can be judged to be convincingly or strongly supportive. The causal criterion of specific symptoms experienced by colonies suffering from the combination of Varroa and viruses was also judged to be convincingly supportive. These symptoms include reduced colony development, the presence of malnourished, deformed, and underweight bees, or crawling bees that are unable to fly or that have crippled wings.

The evidence for Varroa acting alone as a cause of low honey bees’ survival is less compelling, probably because it is difficult to separate the effects of viruses from those of the mites. Thus, while Varroa destructor was rated as a possible cause, when the impact of viruses was added, this became a probable cause.

Observations suggest that infection with a contagious agent is responsible for colony loss (vanEngelsdorp et al. 2009; Cornman et al. Citation2012; Cox-Foster et al. Citation2007), which lends further support to viruses transmitted by Varroa as the proximate cause of honey bees’ death and colony loss.

Example of a Possible Cause

The health of a colony depends on the presence of well-nourished bees that are capable of producing progeny and resisting multiple stress factors (Brodschneider and Crailsheim Citation2010). There are two issues related to food for bees. Nutrition deficiency is associated with the quality of the food. The second issue is starvation and the lack of availability of food, such as over winter. The example presented here as a possible cause of reduced colony survival is nutrient deficiency ().

Honey bees require a diverse diet that includes protein, carbohydrates, lipids, vitamins, minerals, and water for maintaining good health (Huang Citation2011). Carbohydrates from the sugars in nectar and honey are used as an energy source. Sugar content in nectar can vary from 5% to 75%, depending on the plant species (Huang Citation2011). Pollen provides a source of protein, minerals, lipids, and vitamins (Herbert and Shimanuki Citation1978). The nutritional value of pollen varies among plant species and regions (Brodschneider and Crailsheim Citation2010). Due to the variable nutrients in pollen and nectar, honey bee colonies can experience a deficiency in one or more nutrients if they are visiting the wrong plants—blueberries are such an example (vanEngelsdorp et al. Citation2007). Nutrient deficiency can lead to reductions in adult survival, including decreased lifespan of worker bees, compromised brood development, and subsequent depopulation of the colony (Naug Citation2009).

Nutrient deficiency has an indirect effect on adults’ survival. Sufficient food stores are required for adults to feed larvae and rear the larvae into adulthood. An inadequate store of pollen can affect the quality of the next generation of adults, and thus, can influence the rearing of subsequent brood. Larvae that are reared during nutrient-deficient periods have a reduced lifespan as adults or develop into adults with impaired brood rearing or foraging abilities (Brodschneider and Crailsheim 2010).

There is experimental evidence that a lack of nutrients in honey bees’ diets is linked to immunocompetence. Eischen and Graham (Citation2008) found that well-nourished honey bees are less susceptible to Nosema cerane, in comparison to less well-nourished bees. In another controlled study, bees that were fed a polyfloral diet of mixed pollen had enhanced immune functions, such as glucose oxidase activity, leading to better in-hive antiseptic protection. Glucose oxidase activity allows bees to sterilize colony and brood food (Alaux et al. Citation2010). The results suggest that there is a link between nutrition and immunity and underscores the critical role of resource availability to bees’ health.

Nutrition is related to the proximity of the hives to available food. Evaluation of the co-occurrence criterion would indicate that, for our problem statement, it would be reasonable to expect that a lack of adequate nutrition is partly a management issue. Due to the relationship of nutrient deficiency and immunocompetence in bees, specificity in response is low, because other factors can result in similar responses. The weight-of-evidence evaluation indicates that there are data and information that somewhat support nutrient deficiency as a possible cause of the decreased survival of bees used to pollinate California almond orchards. Although nutrient deficiency can impair adult survival and lead to lack of immunocompetence, this cause does not translate well into reduced overwinter survival, and more research is needed to establish a causative link.

Example of an Unlikely Sole Cause

Neonicotinoid pesticides were considered to be an unlikely sole cause of reduced honey bee overwintering survival, although some of the experts thought they may be a contributory cause (). This class of pesticides includes clothianidin, imidacloprid, thiamethoxam, and thiacloprid. These compounds are systemic (e.g., are taken up throughout the plant tissues), and concern has been raised that bees can be exposed through pollen and nectar.

Imidacloprid was the first of the neonicotinoids to be approved for agricultural use (in 1994), and since then, its use in the United States, as well as that of other neonicotinoids, has increased greatly (Cresswell et al. Citation2012). Thus, these potential causes precede the decline in honey bees’ survival, although the increased use between 1994 and 2005 did not precipitate such a response. Therefore, the evidence for the criterion of “time order” was scored as weakly supportive.

Colony loss monitoring does not show a correlation with the use pattern of pesticides (Kluser et al. Citation2010; vanEngelsdorp et al. Citation2010, 2011; vanEngelsdorp and Meixner Citation2010). In Canada, where most honey production is from bees foraging on canola, hive numbers and productivity have increased steadily since neonicotinoid-treated canola seed were introduced (Canadian Honey Council Citation2009; Statistics Canada Citation2012). In contrast, high colony losses have occurred on Vancouver Island, where agrochemical use is virtually non-existent (http://www.cbc.ca/news/canada/british-columbia/story/2010/03/09/bc-vancouver-island-bees-die.html). Neonicotinoids are used in Australia, where honey bee losses have not occurred. Conversely, imidacloprid use was restricted in France beginning in 1999, yet reduced survival rates of adult honey bees have continued to be observed since that time. Chauzat et al. (Citation2010) investigated colony mortality in the winter of 2005–2006 in 20 French apiaries, finding no significant residues of agricultural pesticides. The criterion of co-occurrence is thus scored “−.”

A cause–response relationship has been demonstrated for neonicotinoids in laboratory studies and contact and oral LD50 values are known (Hopwood et al. Citation2012; Blacquière et al. Citation2012) but the nature of effects at field-realistic doses is debatable. Henry et al. (Citation2012) reported that sub-lethal concentrations of thiamethoxam reduced homing behavior, but the exposure levels were considered unrealistically high (EFSA Citation2012; DEFRA Citation2013). Cresswell (Citation2011) performed a meta-analysis of 14 published studies on the effects of imidacloprid on honey bees under laboratory and semi-field conditions, reporting that fitted dose-response relationships estimate that trace dietary levels at field-realistic levels will have no lethal effects but will cause sublethal effects expressed as 6–20% reduced performance. This conclusion contrasts with that of Cutler and Scott-Dupree (Citation2007), who found no adverse chronic effects in field trials in which honey bee colonies were exposed to clothianidin-treated seeds of canola. Studies have shown no adverse acute effects on bees from imidacloprid-treated seeds of maize (Nguyen et al. Citation2009). Laboratory evidence for a cause–response relationship with neonicotinoids was judged equivocal by the workshop experts, while the evidence from field studies was scored as “somewhat weakening” the support for this cause, although one expert noted that field studies currently being conducted appear to support a cause–response relationship. No link has been found between the expression of genes that code for proteins associated with detoxification of insecticides and collapsed colonies (Johnson et al. Citation2009).

The mechanism of action of neonicotinoids is known. They are neurotoxins, acting as agonists of insect acetylcholine receptors, disrupting the nervous system and causing death (Matsuda et al. Citation2001). While the doses needed to produce mortality are well understood, fewer studies have assessed effects at low doses. The evidence for this causal criterion was considered “somewhat supportive.” However, the symptoms resulting from exposure to neonicotinoids are not particularly specific, and not all are directly lethal. Schneider et al. (Citation2012) reported that neonicotinoids can cause behavioral changes (e.g., proboscis extention reflex), reduce foraging activity, and increase foraging flight distance. Decourtye et al. (Citation2003) reported that imidacloprid can affect the learning performance of honey bees. Some of these same symptoms have also been reported as effects of Varroa plus viruses, as discussed previously.

There are some studies that suggest an interaction between pesticides, including neonicotinoids, and other of the candidate causes as potential contributors to colony loss. The intentional use of antibiotics and miticides may enhance bees’ susceptibility to neonicotinoids (Hawthorne and Dively Citation2011). Some pesticides (though not neonicotinoids) are known to kill cells in the midgut of immature bees at sublethal doses, raising the concern that pesticides may affect disease resistance and nutrition absorption (Gregorc and Ellis Citation2011; Ellis Citation2012). Interactions between neonicotinoids and Nosema have been reported (Alaux et al. Citation2010; Pettis et al. Citation2012; Vidau et al. 2011), although results are inconsistent. For example Pettis et al. (Citation2012) reported increased Nosema infection levels in bees exposed to imidacloprid while Alaux et al. (Citation2010) reported just the opposite. Thompson (Citation2012) summarized evidence from recent monitoring studies in Europe that assessed both pesticide residues within colonies and the presence of pests and pathogens; none clearly identified an interaction between pesticides and disease. The workshop participants concluded that, while neonicotinoids alone were an unlikely cause of honey bee colony losses, they could possibly be a contributing factor.

CONCLUSIONS

A causal analysis methodology was introduced to bee experts at a workshop, in which a problem was defined within a temporal and spatial scale. Experts used a set of causal criteria against which evidence was logically evaluated. Thirty-nine candidate causes were put forth as potential causes of reduced survivability since 2006 of commercial bees used in the California almond industry. Based on the weight-of-evidence against each criterion, candidate causes were categorized as being probable, possible, or unlikely. Due to lack of information and data, several candidate causes were categorized as indeterminate. The parasitic mite Varroa destructor plus viruses was judged to be a “probable cause,” while nutrient deficiency was judged to be a “possible cause” of the reduced survival probability of commercial honey bee colonies in the California almond scenario since approximately 2006. Neonicotinoid pesticides were judged to be “unlikely” as the sole cause of this reduced survival probability, although they could possibly be a contributing factor. The duration of the workshop was insufficient to complete the analysis for all the identified candidate causes ().

The causal analysis presented here represents a general agreement among the workshop experts, but it is not a formal consensus, and dissenting opinions were expressed on a variety of topics. The results of this analysis should be considered preliminary, because many data gaps remain, especially surrounding environmental factors and beekeeping practices that may potentially affect colony survival but for which the consistency of evidence is “indeterminate” (). Moreover, it is likely that multiple causes, rather than one single cause, are responsible for the reduced survival of commercial honey bee colonies. The number of potential causes and the likelihood that they are interacting complicates the design of future research investigations. However, a better understanding of these causes can lead to the development of methods to better manage honey bees in commercial beekeeping operations.

ACKNOWLEDGMENTS

We acknowledge the bee experts who attended the workshop: Troy Anderson, Tjeerd Blacquière, Jerry Bromenshenk, Diana Cox-Foster, James Cresswell, Chris Cutler, Galen Dively, Frank Drummond, David Epstein, Richard Fell, Gerald Hayes, Josephine Johnson, Christian Maus, Richard Rogers, Melinda Rostal, Cynthia Scott-Dupree, Thomas Steeger, Helen Thompson, and Geoffrey Williams. Special thanks to Glenn Suter, Susan Cormier, and Erica Fleishman for their expertise in causal analysis. Financial support for this workshop was provided by Bayer CropScience.

This article reflects the findings of the workshop according to the authors, absent substantive input from the sponsor.

REFERENCES

  • Agricultural Research Council (ARC LNR) . 2010 . Sacbrood . Available at: http://www.arc.agric.za/home.asp?PID=3062&ToolID=63&ItemID=3082 (accessed August 20, 2012)
  • Alaux , C , Brunet , J-L and Dussaubat , C . 2010 . Interactions between Nosema microspores and a neonicotinoid weaken honeybees (Apis mellifera) . Environ Microbiol , 12 : 774 – 82 .
  • Alaux , C F , Ducloz , F , Crauser , D and Le Conte , Y . 2010 . Diet effects on honeybee immunocompetence . Biology Letters , 6 : 562 – 7 .
  • Allen , M and Ball , B V . 1996 . The incidence and world distribution of the honey bee viruses . Bee World , 77 : 141 – 62 .
  • Amdam , G , Hartfelder , K and Norberg , K . 2004 . Altered physiology in worker honey bees (Hymenoptera: Apidae) infested with the mite Varroa destructor (Acari: Varroidae): A factor in colony loss during overwintering . J Econ Entomol , 97 : 741 – 7 .
  • Aronstein , K A and Murray , K D . 2010 . Chalkbrood disease in honey bees . Journal of Invertebrate Pathology , 103 : 520 – 9 .
  • Ball , B V and Allen , M F . 1988 . The prevalence of pathogens in honey bee colonies infected with the parasitic mite Varroa jacobsoni . Ann Appl Biol , 113 : 237 – 44 .
  • Beeologics . Israeli acute paralysis virus . Available at: http://www.beeologics.com/iapv.asp (accessed August 22, 2012)
  • Biosecurity Authority Ministry of Agriculture and Forestry . 2003 . Available at: http://www.biosecurity.govt.nz/files/regs/imports/risk/honey-bee-genetic-material-ra.pdf (accessed August 24, 2012)
  • Blacquière , T , Smagghe , G and van Gestel , C AM . 2012 . Neonicotinoids in bees: A review on concentrations, side-effects and risk assessment . Ecotoxicol , 21 : 973 – 92 .
  • Bowen-Walker , P L and Gunn , A. 2001 . The effect of the ectoparasitic mite, Varroa destructor, on adult worker honeybee (Apis mellifera) emergence weights, water, protein, carbohydrate and lipid levels . Entomol Experi Appl , 101 : 207 – 17 .
  • British Columbia Ministry of Agriculture . 2012 . Kashimir Bee Virus . Apiculture Factsheet #230, Available at: http://www.agf.gov.bc.ca/apiculture/factsheets/230_kashmir.htm (accessed August 8, 2012)
  • Brodschneider , R and Crailsheim , K. 2010 . Nutrition and health in honey bees . Apidologie , 41 : 278 – 84 .
  • Bromenshenk , J J , Henderson , C B and Wick , C H . 2010 . Iridovirus and Microsporidian linked to honey bee colony decline . PLoS ONE , 5 ( 10 ) : e13181 doi:10.1371/journal.pone.0013181
  • Burley , LM. 2007 . The effects of miticides on the reproductive physiology of honey bee (Apis mellifera L.) queens and drones Thesis submitted to the faculty of Virginia Polytechnic Institute and State University in partial fulfillment of the requirements for the degree of Master of Science
  • Calderone , N. 2001 . “ Management of honey bee brood diseases ” . In Part I: Identification and treatment, Dyce Laboratory for Honey Bee Studies, Department of Entomology , Ithaca, NY : Cornell University . Available at http://www.masterbeekeeper.org/B_files/disease1.htm (accessed March 12, 2012)
  • Canadian Association of Professional Apiculturists, undated, “Nosema disease – diagnosis and control.” Available at http://www.capabees.com/main/files/downloads/nosema.pdf (accessed February 22, 2012)
  • Canadian Honey Council . 2009 . Pollinating Hybrid Canola—The Southern Alberta Experience. H. Clay, Chief Executive Officer, Canadian Honey Council , 14 – 6 . Calgary, AB , , Canada : HiveLights .
  • Carman , H. 2011 . The Estimated Impact of Bee Colony Collapse Disorder on Almond Pollination Fees . ARE Update , 14 ( 5 ) : 9 – 11 . University of California, Giannini Foundation of Agricultural Economics. Available at http://giannini.ucop.edu/media/are-update/files/articles/v14n5_4.pdf (accessed February 14, 2012)
  • Chauzat , M-P , Martel , A-C and Zeggane , S . 2010 . A case control study and a survey on mortalities of honey bee colonies (Apis mellifera) in France during the winter of 2005-6 . J Agric Res. , 49 : 40 – 51 .
  • Cobey , S W , Sheppard , W S and Tarpy , D R . 2012 . “ Status of breeding practices and genetic diversity in U.S. honey bees ” . In Honey Bee Colony Health: Challenges and Sustainable Solutions , Edited by: Sammataro , D and Yoder , J A . 25 – 36 . Boca Raton, FL , , USA : CRC Press .
  • Core , A , Runckel , C and Ivers , J . 2012 . A new threat to honey bees, the parasitic phorid fly Apocephalus borealis . PloS ONE , 7 ( 1 ) : e29639 Available online at: http://www.plosone.org
  • Cormier , S M , Suter , G W and Norton , S B . 2010 . Causal characteristics for ecoepidemiology . Hum Ecol Risk Assess , 16 : 53 – 73 .
  • Cornman , R S , Tarpy , D R and Chen , Y . 2012 . Pathogen webs in collapsing honey bee colonies . PLoS ONE , 7 ( 8 ) : e43562 Doi:10.1371/journal.pone.0043562
  • Cox-Foster , D L , Conlan , S and Holmes , E C . 2007 . A metagenomics survey of microbes in honey bee colony collapse disorder . Science , 318 : 283 – 97 .
  • Cresswell , JE. 2011 . A meta-analysis of experiments testing the effects of a neonicotinoid insecticide (imidacloprid) on honey bees . Ecotoxicol , 20 : 149 – 57 .
  • Cresswell , J E , Desneux , N and vanEngelsdorp , D. 2012 . Dietary traces of neonicotinoid pesticides as a cause of population declines in honey bees: An evaluation by Hill's epidemiological criteria . Pest Manage Sci , 68 : 819 – 27 .
  • Cutler , G C and Scott-Dupree , C D . 2007 . Exposure to clothianidin seed-treated canola has no long-term impact on honey bees . J Econ Entomol , 100 : 765 – 72 .
  • Decourtye , A , Lacassie , E and Pham-Deleque , M-H . 2003 . Learning performances of honeybees (Apis mellifera L.) are differentially affected by imidacloprid according to the season . Pest Manage Sci. , 69 : 269 – 78 .
  • DEFRA (Department for Environment, Food and Rural Affairs) . 2013 . An Assessment of Key Evidence about Neonicotinoids and Bees. PB 13937 . Available at https://www.gov.uk/government/publications/an-assessment-of-key-evidence-about-neonicotinoids-and-bees
  • De Grandi-Hoffman , G , Chen , Y and Simonds , R. 2013 . The effects of pesticides on queen rearing and virus titers in honey bees (Apis mellifera L.) . Insects. , 4 : 71 – 89 .
  • DeJong , D. 1997 . “ Mites: Varroa and other parasites of brood ” . In Honey Bee Pests, Predators and Diseases , Edited by: Morse , R A and Flottum , K . 200 – 18 . Medina, OH , , USA : A.I. Root Company .
  • De Miranda , J R , Gautheir , L and Ribière , M . 2012 . “ Honey bee viruses and their effect on bee and colony health ” . In Honey Bee Colony Health: Challenges and Sustainable Solutions , Edited by: Sammataro , D and Yoder , J A . 71 – 102 . Boca Raton, FL , , USA : CRC Press .
  • Duay , P , DeJong , D and Engels , W. 2003 . Weight loss in drone pupae (Apis mellifera) multiply infested by Varroa destructor mites . Apidologie. , 34 : 61 – 5 .
  • EFSA (European Food Safety Authority) . 2012 . Inventory of EFSA's Activities on Bees. Supporting Publication 2012-EN-358 . Available at http://www.efsa.europa.eu/en/search/doc/358e.pdf. Accessed 20 May 2013
  • Eischen , FA. 1987 . Overwintering performance of honey bee colonies heavily infested with Acarapis woodi (Rennie) . Apidologie , 18 : 293 – 304 .
  • Eischen , F A and Graham , R H . 2008 . Feeding overwintering honey bee colonies infected with Nosema ceranae . Proceedings of the American Bee Research Conference. Am Bee J , 148 : 555 [as cited in Huang 2011]
  • Ellis , J. 2012 . “ The honey bee crisis ” . In Outlooks on Pest Management 35 – 40 . Feb
  • Ellis , JD. 2012 . “ Small hive beetle (Aethina tumida) contributions to colony losses ” . In Honey Bee Colony Health: Challenges and Sustainable Solutions, Ch. 13 , Edited by: Sammataro , D and Yoder , J A . Boca Raton, FL , , USA : CRC Press .
  • Ellis , J D and Ellis , A . 2010 . “ Featured creatures: Small hive beetle ” . University of Florida IFAS . Publication No. EENY-474
  • Ellis , J D and Zettle Nalen , C M . 2010 . “ Featured creatures: Varroa mite ” . University of Florida IFAS . Publication No. EENY-473. Available at http://entnemdept.ufl.edu/creatures/misc/bees/varroa_mite.htm (accessed March 16, 2012)
  • Ellis , J D and Zettle Nalen , C M . 2010 . Featured Creatures , Varroa Mite : University of Florida IFAS . Publication EENY-473. Available at http://entnemdept.ufl.edu/creatures/misc/bees/varroa_mite.htm. (accessed March 16, 2012)
  • EMBL-EBI. Acute bee paralysis virus causes paralysis in bees (Apis mellifera) . Available at: http://www.ebi.ac.uk/2can/genomes/viruses/Acute_bee_paralysis_virus.html (accessed August 23, 2012)
  • Evans , J D and Schwarz , R S . 2011 . Bees brought to their knees: Microbes affecting honey bee health Trends in Microbiology . 19 ( 12 ) : 614 – 20 .
  • FERA (Food and Environment Research Agency) . 2009 . Foul brood disease of honey bees and other common brood disorders . Published by DEFRA, UK
  • Ferrari TE and Cobb AB . 2010 . Could sunspots cause colony collapse? . Available at: http://www.growingproduce.com/article/19535/could-sunspots-cause-colony-collapse (accessed March 16, 2013)
  • Fries , I. 2010 . Nosema ceranae in European honey bees (Apis mellifera) . Journal of Invertebrate Pathology , 103 : 573 – 9 .
  • Frost , E. 2010 . “ Effects of a miticide on honebee memory: Is the cure worse than the disease? ” . In American Bee Research Conference Orlando, FL January 15, 2010
  • Gard , N W and Menzie , C A . 2012 . “ A causal/risk analysis framework for informing endangered species jeopardy reviews for pesticides ” . In Pesticide Regulation and the Endangered Species Act , 1111 ACS Symposium Series . Available at: http://pubs.acs.org/isbn/9780841227033. (accessed May 20, 2013)
  • Garedew , A , Schmolz , E and Lamprecht , I. 2004 . The energy and nutritional demand of the parasitic life of the mite Varroa destructor . Apidologie , 35 : 419 – 30 .
  • Gregorc , A and Ellis , J D . 2011 . Cell death localization in situ in laboratory reared honey bee (Apis mellifera L.) larvae treated with pesticides . Pestic Biochem Physiol , 99 : 200 – 7 .
  • Haarmann , T M , Spivak , D , Weaver , B and Glenn , T . 2002 . Effects of fluvalinate and coumaphos on queen honey bees (Hymenoptera: Apidae) in two commercial queen rearing operations . Journal of Economic Entomology , 95 : 28 – 35 .
  • Hathaway , B. 2012 . Study suggests antibiotics might be another suspect in honey bee die-offs. Yale News . Available at: http://news.yale.edu/2012/10/30/study-suggests-antibiotics-might-beanother-suspect-honey-bee-die (accessed March 16, 2013)
  • Hawthorne , D J and Dively , G P . 2011 . Killing them with kindness? In-hive medications may inhibit xenobiotic efflux transporters and endanger honey bees . PLosONE , 6 ( 11 ) : 1 – 9 .
  • Henry , M , Beguin , M and Requier , F . 2012 . A common pesticide decreases foraging success and survival in honey bees . Science , 336 ( 6079 ) : 348 – 50 .
  • Herbert , E W Jr and Shimanuki , H. 1978 . Chemical composition and nutritive value of bee-collected and bee stored pollen . Apidologie , 9 : 33 – 40 .
  • Highfield , A C , Nagar , A E , Mackinder , L CM , Noel , L J , Hall , M J , Martin , S J and Schroeder , D C . 2009 . Deformed wing virus implicated in overwintering honeybee colony losses . Applied Environmental Microbiology , 75 ( 22 ) : 7212 – 20 .
  • Hill , AB. 1965 . The environment and disease: Association or causation . Proc Royal Soc Med , 58 : 295 – 300 .
  • Hopwood , J , Vaughan , M and Shepherd , M . 2012 . Are Neonicotinoids Killing Bees? A Review of Research into the Effects of Neonicotinoid Insecticides on Bees, with Recommendations for Action , Portland, OR , , USA : The Xerces Society for Invertebrate Conservation .
  • Huang , Z. 2011 . Honey bee nutrition , Michigan State University . Available at http://www.beeccdcap.uga.edu/documents/CAPArticle10.html. (accessed March 12, 2012)
  • Hung , A C , Shimanuki , H and Portland , O R . 1995 . Bee parasitic mite syndrome: II. The role of Varroa mite and viruses . Am Bee J , 135 : 702
  • Hung , A C , Shimanuki , H and Portland , O R . 1996 . The role of viruses in bee parasitic mite syndrome: II. The role of Varroa mite and viruses . Am Bee J , 136 : 731 – 2 .
  • ISSG (Invasive Species Specialist Group) . 2006 . Ecology of Varroa destructor , Compiled by National Biological Information Infrastructure (NBII) and IUCN/SSC . Available at http://www.issg.org/database/species/ecology.asp?si=478&fr=1&sts=sss&lang=EN. (accessed March 16, 2012)
  • Johnson , R. 2010 . Honey bee colony collapse disorder . CRS Report for Congress, 7-5700
  • Johnson , R M , Evans , J D and Robinson , G E . 2009 . Changes in transcript abundance relating to colony collapse disorder in honey bees (Apis mellifera) . Proc Natl Acad Sci , 106 : 14790 – 95 .
  • Johnson , R , Peters , L , Siegfriedd , B and Elis , M D . 2010 . Drug interactions between in-hive miticides and fungicides in honey bees . Available at: http://www.extension.org/pages/30365/abrc2010-drug-interactions-between-in-hive-miticidesand-fungicides-in-honey-bees (accessed March 16, 2013)
  • Kluser , S , Neumann , P and Chauzat , M-P . 2010 . UNEP Emerging Issues: Global Honey Bee Colony Disorder and Other Threats to Insect Pollinators , Nairobi , , Kenya : United Nations Environment Program .
  • LeConte , Y , Brunet , J-L , McDonnell , C , Dussaubat , C and Alaux , C . 2012 . “ Interactions between risk factors in honey bees ” . In Honey Bee Colony Health: Challenges and Sustainable Solutions. Ch. 18 , Edited by: Sammataro , D and Yoder , J A . 215 – 22 . Boca Raton, FL , , USA : CRC Press .
  • Liu , S , Walshe , T and Long , G . 2012 . Evaluation of potential responses to invasive non-native species with structured decision-making . Conserv Biol , 26 : 539 – 46 .
  • Martin , T G , Burgman , M A and Fidler , R . 2011 . Eliciting expert knowledge in conservation science . Conserv Biol , 26 : 29 – 38 .
  • Mattila , H R and Otis , G W . 2007 . Dwindling pollen resources trigger the transition to broodless populations of long-lived honeybees each autumn . Ecological Entomology , 32 : 496 – 505 .
  • Matsuda , K , Buckingham , S D and Kleier , D . 2001 . Neonicotinoids: Insecticides acting on insect nicotinic acetylcholine receptors . Trends Pharmacol Sci , 22 : 573 – 80 .
  • Menzie , C A , Henning , M H and Cura , J. 2007 . A phased approach for assessing combined effects from multiple stressors . Environ Health Perspect , 115 : 807 – 16 .
  • Mid-Atlantic Apicultural Research & Extension Consortium . 2000 . Wax moth . MAAREC Publication 4.5, February
  • Moore , J , Aleksey , J , Chandler , D , Burroughs , N , Evans , D J and Ryabov , E V . 2011 . Recombinants between deformed wing virus and Varroa destructor virus—1 may prevail in Varroa destructor-infested honeybee colonies . Journal of General Virology , 92 : 156 – 61 .
  • Moore , J L and Runge , M C . 2012 . Combining structured decision making and value-of-information analyses to identify robust management strategies . Conserv Biol , 26 : 810 – 20 .
  • Mussen , E. 2011 . Diagnosing and treating Nosema disease . Available at: http://entomology/ucdavis.edu/faculty/Mussen/beebriefs/Nosema_Disease.pdf (accessed February 22, 2012)
  • Naug , D. 2009 . Nutritional stress due to habitat loss may explain recent honeybee colony collapses . Biol Conserv , 142 : 2369 – 72 .
  • NC State University, undated . Effects of genetic diversity on honey bee colony phenotype . Available at: http://www.cals.ncsu.edu/entomology/apiculture/research_projects.html (accessed March 16, 2013)
  • Nguyen , B K , Saegerman , C and Pirard , C . 2009 . Does imidacloprid seed-treated maize have an impact on honey bee mortality? . J Econ Entomol , 102 : 616 – 23 .
  • Oliver , R. 2010 . Sick bees – Part 2: A model of colony collapse . American Bee Journal , 150 ( 9 ) : 865 – 72 .
  • 2008 . Black queen-cell virus . Oregon State University , Available at: http://www.science.oregonstate.edu/bpp/insect_clinic/dieseases/black_queen_cell_virus.htm (accessed August 23, 2012)
  • Pernal , S F and Currie , R W . 2001 . The influence of pollen quality on foraging behavior in honeybees (Apis mellifera L.) . Behavioral Ecology and Sociobiology , 51 : 53 – 68 .
  • Pettis , J S , vanEngelsdorp , D and Johnson , J . 2012 . Pesticide exposure in honey bees results in increased levels of the gut pathogen Nosema . Naturwissenschaften , 99 : 153 – 8 .
  • Rosenkranz , P , Aumier , P and Ziegelmann , B. 2010 . Biology and control of Varroa destructor . J Invertebr Pathol , 103 : S96 – S119 .
  • Rose , R , Dively , G P and Pettis , J . 2007 . Effects of Bt corn pollen on honey bees: Emphasis on protocol development . Apidologie , 38 ( 4 ) : 368 – 77 .
  • Runckel , C , Flenniken , M L , Engel , J C , Ruby , J G , Ganem , D , Andino , R and DeRisi , J L . 2011 . Temporal analysis of the honey bee microbiome reveals four novel viruses and seasonal prevalence of known viruses, Nosema, and Crithidia . PLoS ONE , 6 ( 6 ) : e20656 doi:10.1371/journal.pone.0020656
  • Sammataro , D. 2012 . “ Global status of honey bee mites ” . In Honey Bee Colony Health: Challenges and Sustainable Solutions , Edited by: Sammataro , D and Yoder , J A . 37 – 54 . Boca Raton, FL , , USA : CRC Press .
  • Sammataro , D U , Gerson , U and Needham , G . 2000 . Parasitic mites of honey bees: Life history, implications, and impact . Annual Reviews in Entomology , 45 : 519 – 48 .
  • Sanford , MT. 1995 . “ Wax moth control ” . University of Florida . IFAS Extension, Document ENY121
  • Schneider , C W , Tautz , J and Grunewald , B . 2012 . RFID tracking of sublethal effects of two neonictinoid insecticides on the foraging behavior of Apis mellifera . PLos ONE , 7 ( 1 ) : 1 – 9 .
  • Schneider , C W , Tautz , J , Brunewald , B and Fuch , S . 2012 . RFID tracking of sublethal effects of two neonicotinoid insecticides on the foraging behavior of Apis mellifera . PLoS ONE , 7 ( 1 ) : e30023 doi:10.1371/journal.pone.0030023
  • Shimanuki , H and Knox , D A . 2000 . “ Diagnosis of honey bee diseases ” . In USDA ARS, Agriculture Handbook Number 690
  • Simone-Finstrom , M and Spivak , M . 2010 . Propolis and bee health: The natural history and significance of resin use by honey bees . Apidologie , 41 ( 3 ) : 295 – 311 .
  • Statistics Canada . 2012 . Production and value of honey and maple products . Available at http://www.statcan.gc.ca/daily-quotidien/121214/dq121214c-eng.htm (accessed February 19, 2013)
  • Stindl , R and Stindl , W Jr. 2010 . Vanishing honey bees: Is the dying of adult worker bees a consequence of short telomeres and premature aging? . Medical Hypotheses , 75 ( 4 ) : 387 – 90 .
  • Suter , G W , Norton , S B and Cormier , S M . 2010 . The science and philosophy of a method for assessing environmental causes . Hum Ecol Risk Assess , 16 : 19 – 34 .
  • Thompson , HM. 2012 . Interaction between Pesticides and Other Factors in Effects on Bees. Supporting Publications 2012:EN-340 , European Food Safety Authority . Available at www.efsa.europa.eu/publications. (accessed May 20, 2013)
  • Thomson , J R , Kimmerer , W J and Brown , L R . 2010 . Bayesian change point analysis of abundance trends for pelagic fishes in the upper San Francisco Estuary . Ecol Appl , 20 : 1431 – 48 .
  • Underwood , R M and vanEngelsdorp , D . 2007 . Colony collapse disorder: Have we seen this before? The Pennsylvania State University Department of Entomology . Available at: http://www.beeculture.com/content/ColonyCollapseDisorderPDFs/7%20Colony%20Collapse%20Disorder%20Have%20We%20Seen%20This%20Before%20-%20Robyn%20M.%20Underwood%20and%20Dennis%20vanEngelsdorp.pdf (accessed August 23, 2012)
  • University of Georgia, College of Agriculture and Environmental Sciences . 2011 . “ Honey bee disorders: Bacterial diseases ” . In American Foulbrood Available at: http://www.ent.uga.edu/bees/disorders/bacterial.html#afb (accessed March 1, 2012)
  • USDA . 2012 . Honey bees and colony collapse disorder . Available at: http://www.ars.usda.gov/News/docs.htm?docid = 15572&pf = 1&cg_id = 0 (accessed March 16, 2013)
  • USDA BARC (Beltsville Agricultural Research Center) . 2002 . Honey bee tracheal mite – Acarapis woodi . Available at http://www.ba.ars.udsa.gov/psi/brl/mite-aw.htm (accessed February 2, 2012)
  • USEPA (US Environmental Protection Agency) . 2000 . Stressor Identification Guidance Document. EPA/822/B-00/025 , Washington, DC , , USA : Office of Water .
  • USEPA . 2008 . Analysis of the Causes of a Decline in the San Joaquin kit Fox Population on the Elk Hills, Naval Petroleum Reserve #1, California. EPA/600/R-08/130 , Cincinnati, OH , , USA : National Center for Environmental Assessment, Office of Research and Development .
  • USEPA . 2012 . CADDIS, The Causal Analysis/Diagnosis Decision Information System Available at http://www.epa.gov/caddis/. (accessed February 15, 2013)
  • vanEngelsdorp , D and Meixner , M D . 2010 . A historical review of managed honey bee populations in Europe and the United States and the factors that may affect them . J Invertebr Pathol , 103 : 580 – 95 .
  • vanEngelsdorp , D , Cox Foster , D and Frazier , M . 2007 . Fall-dwindle Disease: Investigations into the Causes of Sudden and Alarming Colony Losses Experienced by Beekeepers in the Fall of 2006. Preliminary Report: First Revision , 22 Harrisburg, PA , , USA : Pennsylvania Department of Agriculture .
  • vanEngelsdorp , D , Speybroeck , N and Evans , J D . 2010 . Weighing risk factors associated with bee colony collapse disorder by classification and regression tree analysis . J Econ Entomol , 103 : 1517 – 23 .
  • vanEngelsdorp , D , Hayes , J Jr. and Underwood , R M . 2011 . A survey of managed honey bee colony losses in the USA, fall 2009 to winter 2010 . J Agric Res. , 50 ( 1 ) : 1 – 10 .
  • Vidau , C , Diogon , M and Aufauvre , J . 2011 . Exposure to sublethal doses of fipronil and thiacloprid highly increases mortality of honeybees previously infected by Nosema ceranae . PLoS ONE , 6 ( 6 ) : e21550 doi:10.1371/journal.pone.0021550
  • Webster , T C and Delaplane , K S . 2001 . Mites of the Honey Bee , Hamilton, IL , , USA : Dadant and Sons, Inc .
  • Wickwire , T and Menzie , C A . 2010 . The causal analysis framework: Refining approaches and expanding multidisciplinary applications . Hum Ecol Risk Assess , 16 : 19 – 18 .
  • Yang , X and Cox-Foster , D. 2007 . Effects of parasitization by Varroa destructor on survivorship and physiological traits of Apis mellifera in correlation with viral incidence and microbial challenge . Parasitol , 134 : 405 – 12 .
  • Zawislak , J. Managing small hive beetles . (undated) University of Arkansas Division of Agriculture, FSA7075