4,158
Views
9
CrossRef citations to date
0
Altmetric
Research Article

Understanding literature reviews: Implications for music therapy

Pages 97-125 | Received 09 Mar 2017, Accepted 04 Jul 2017, Published online: 11 Sep 2017

ABSTRACT

Social science and health care researchers, including music therapy researchers, have conducted various types of literature reviews; these types have largely been understood as either traditional or systematic reviews. However, authors, both within and outside of music therapy, have used mixed terminology, provided questionable rationales for categorization, disagreed about categorization, or used ambiguous language to describe broad review methodologies. As an alternative to categorization, one could view literature review processes and methodologies from the standpoint of historical development and methodological value; each methodology answers different types of questions through review’s characteristics. The purpose of this article is to present a comprehensive overview of literature review processes and methodologies by (a) describing the general purposes of narrow and broad literature reviews, (b) providing a historical overview of broad reviews, and (c) describing broad review methodologies in relation to their respective definitions, histories, methodological characteristics, purposes, example questions, and study examples from healthcare and music therapy literature. After providing a general overview of categories and histories of reviews, the author analyzes a total of 25 broad literature review methodologies and 2 salient broad review procedures. The author then discusses implications for music therapy research and practice, specifically in relation to current broad review publications, policy development, information flow, stakeholder engagement, and tertiary reviews. Furthermore, this article may act as an initial reference for researchers and educators.

Introduction

Research can be understood as a methodical procedure of inquiry that leads to new ways of understanding. Research produces some type of outcome that “contributes to or modifies existing knowledge or practice” (Bruscia, Citation1995, p. 21). In other words, research informs and reorganizes an evidence base through a multiplicity of perspectives.

History plays an important role in research. One engages with present inquiry by understanding prior evidence. An evidence-based practice that includes clinician expertise, patient experience, and context will also take into account extant literature (Rycroft-Malone et al., Citation2003). Regardless of research questions, philosophical positions, or methodology within a study, one investigates effectively by understanding what has been investigated beforehand.

The term literature review refers to a documented summary of prior research, and is therefore also known as an evidence summary. Literature review exists as a foundational task in almost any research project. Reviews connect past studies to present and future inquiry, and connect individual studies with the collective body of knowledge.

Researchers have recognized the importance of evidence summary and evidence synthesis for more than two centuries. Naval surgeon James Lind described the cumulative research review in relation to 18th century scurvy treatment (Chalmers, Hedges, & Cooper, Citation2002; Grant & Booth, Citation2009; Hampton, Citation1998). Statistician Legendre developed the method of least squares to promote statistical synthesis in the early 19th century. Strutt (Citation1885) acknowledged the importance of those instances “in which discovery and explanation go hand in hand, in which not only are new facts presented, but their relation to old ones is pointed out” (p. 20). In some cases, authors have noted the challenges in promoting quality evidence summary. Wright Mills stated “There are never enough bricks and there are too few good synthesizers to search out the bricks and thus put the wall together” (Citation1959, p. 65). More specific to health care, Solesbury noted that “Social science is very bad at the cumulation and re-use of past research results” (Citation2002, p. 92).

Two overarching categories—narrow and broad—differentiate general approaches to literature review. Where a narrow literature review occurs within a primary study, a broad literature review acts as a stand-alone evidence summary (Cooper, Citation1998). Authors have historically categorized broad review methodologies into dichotomous types: traditional and systematic. Disagreements regarding categorization, as well as inconsistent and ambiguous language in the literature, have likely promoted confusion. The broad range of review methodologies demonstrate nuance and complexity; they can be more clearly articulated when acknowledged as a set of singular historical contributions, each with a set of characteristics that address a particular type of need. Healthcare disciplines, including music therapy, benefit by understanding the histories, values, and characteristic differences between broad review methodologies.

Purpose

The purpose of this article is to provide a comprehensive overview of literature review processes and methodologies. To achieve this purpose, the author will (a) describe general purposes of narrow and broad literature reviews; (b) provide a historical overview of broad literature reviews; and (c) describe 25 broad review methodologies and 2 salient broad review procedures in relation to their respective definitions, histories, characteristics, purposes, example questions, and study examples from healthcare and music therapy literature. The article will conclude with implications for music therapy research and practice.

Narrow and broad literature reviews described

Most researchers write literature reviews in the narrow sense. Narrow reviews summarize past literature in order to inform, justify, and substantiate primary studies (Hanson-Abromeit & Sena Moore, Citation2014). In contrast to the narrow type, a broad literature review is a stand-alone study. A broad review inquires about the relationships between prior studies to create an evolved whole (Onwuegbuzie, Collins, Leech, Dellinger, & Jiao, Citation2010). In this sense, the broad review generally seeks to synthesize some amount of past literature for a particular purpose. describes the purposes of narrow and broad literature reviews.

Figure 1. Literature reviews: overarching types and their purposes.

Figure 1. Literature reviews: overarching types and their purposes.

Historical categorization of broad literature review methodologies

Authors have categorized broad methodologies into dichotomous categories: “traditional” (or “non-systematic”) reviews and “systematic” reviews (Gough, Oliver, & Thomas, Citation2012; Hanson-Abromeit & Sena Moore, Citation2014). Researchers have defined the systematic review as a literature review that includes rigorous literature selection, appraisal, analysis, synthesis, and reporting in order to answer specific research questions (Gough, Oliver, & Thomas, Citation2012; Hanson-Abromeit & Sena Moore, Citation2014; Khan, Kunz, Klijnen, & Antes, Citation2011; Porta, Citation2008). However, categorizations have not always appeared straightforward.

Challenges with categorization, terminology, and consensus

Researchers have historically used the terms systematic review, integrative review, research synthesis, knowledge synthesis, and meta-analysis interchangeably (Kastner et al., Citation2012; LoBiondo-Wood, Citation2014). More recently, authors have sought to clarify and differentiate these terms. According to A Dictionary of Epidemiology (Porta, Citation2008), a systematic review and a meta-analysis are differentiated in that meta-analysis is the application of strategies that limit bias in the assembly, critical appraisal, and synthesis of all relevant studies on a specific topic. Hanson-Abromeit and Sena Moore (Citation2014) also differentiated meta-analysis from systematic review, noting the use of a “specialized statistical technique that results in an effect size” (p. 11) in order to locate a weighted average effect for the particular intervention or event. The meta-analysis procedure may be, but is not necessarily, used as a part of the systematic review process. However, any systematic review that seeks to assess efficacy must aim to include a meta-analysis.

Authors may occasionally disagree about how to categorize particular broad review methodologies, or may not provide adequate rationales for exclusion. Where Hanson-Abromeit and Sena Moore (Citation2014) note that meta-ethnography does not qualify as a systematic review, other authors articulate differently (Chalmers, Hedges, & Cooper, Citation2002; Gough et al., Citation2012; Harden, Citation2010). Hanson-Abromeit and Sena Moore (Citation2014) note that an integrative review includes diverse methodologies, and is therefore not a systematic review. However, some systematic review types include examination and synthesis of heterogeneous methodologies (see ).

Table 1. Broad literature review types: methodological characteristics.

Understanding components of broad literature reviews

Dichotomous categorization can limit a broader and deeper understanding of individual methodologies. The author contends that each literature review methodology contains unique value due to the various components each possesses. Each component, as related to research questions and methodological characteristics, deserves further consideration.

Research questions

Questions guide each step of the investigative process, and therefore play a role in determining a researcher’s chosen methodology. Researchers can investigate a range of questions, including but not limited to outcomes, methods, theories, applications, or combinations thereof (Cooper, Citation1998). Each broad review type caters to particular types of research questions and particular types of outcomes (see ).

Table 2. Broad literature review methodologies: example questions.

Methodological characteristics

A methodology frames a set of research methods in order to gain a specific result (Crotty, Citation1998). Methods can be understood as a set of specific steps, whether predefined or iterative, that move a study through data retrieval, analysis, outcome, and reporting (Crotty, Citation1998). Various methodologies approach methods differently, resulting in a set of unique methodological characteristics. These distinctions include but are not limited to: (a) researchers, (b) search, (c) appraisal, (d) analysis, (e) and primary outcome emphases, (see ). Each characteristic is discussed below.

Researchers

Most broad review methodologies allow for single or multiple researchers; some require multiple researchers. Some methodologies encourage stakeholder participation. A stakeholder is a person or organization that has direct interest in research outcomes, and may include clients, caretakers, or policy makers (Hovland, Citation2005).

Literature search

Some broad methodologies require a comprehensive literature search, while others do not. Some methodologies review only primary studies while others focus on analyzing secondary studies (i.e. other literature reviews). Some tertiary reviews analyze both primary and secondary studies.

Appraisal

Some review methodologies require that both inclusion and exclusion procedures are conducted and reported. Some methodologies require formal quality assessment for each included study, while others encourage informal quality assessment. Some methodologies may not require study exclusion or promote any assessment of study quality, in some cases because the research questions that the methodology addresses do not benefit from such.

Analysis

The purpose of each methodology reflects an emphasis on different types of analysis. Analysis characteristics note whether or not the methodology focuses on assessing highly similar or purposefully diverse (a) methodologies, (b) study contexts, and (c) study outcomes. These three areas are described below.

Primary study methodologies include but are not limited to controlled trials, phenomenological studies, ethnographies, descriptive studies, and case studies. Meta-analysis focuses only on randomized controlled trials (RCTs) (homogenous) while realist synthesis is able to examine different (heterogeneous) methodologies.

Context, for the sake of this article, refers to the sameness or diversity of environmental underpinnings. Context can include the population, setting, the need being addressed, and even the intervention itself. Meta-analysis again provides a useful example, in that the primary studies must be addressing the same contextual problem and intervention. A content analysis, however, does not require that the same intervention be studied, because it focuses on the communication patterns used to describe an intervention or process. For example, a content analysis may analyze how often research articles report the instruments being used.

Some broad review methodologies must analyze the same types of outcomes, while other methodologies are able to examine diverse types of outcomes. Meta-analysis will assess similar outcomes related to a particular intervention for a particular problem. Critical interpretive synthesis may look at the same problem and outcomes from the same RCTs, but may also analyze primary studies discussing personal and social experiences.

Synthesis outcome focus

Different broad review methodologies report different types of outcomes. Outcome focus characteristics include the following:

  • Efficacy/effectiveness: measures the capability of an intervention to either promote efficacy in an ideal laboratory setting, or promote effectiveness in a realistic clinical setting (Godwin et al., Citation2003).

  • Impact/meaning: explains how clients, caretakers, clinicians, or others experience changes through a phenomenon/intervention.

  • Concept/theme creation: promotes the construction or organization of words or ideas in order to better understand a particular phenomenon.

  • Theory development/analysis: focuses on developing theory through construction, analysis, comparison, or a combination thereof.

  • Gaps in literature: analyzes and reports areas that have not yet been studied.

  • Theoretical critique/Problematizing: a unique type of theory analysis that warrants its own consideration; focus on critical inquiry (Barnett-Page & Thomas, Citation2009).

  • Effect critique/bias reduction: seeks to understand the occurrence or cause of a problem by locating issues with study bias.

  • Risk/Heterogeneity assessment: presents information, usually in descriptive table format, related to control group risk levels. Describes differences between study methods.

  • Language or content outcome: presents results of communication patterns.

  • Policy /guideline development: Seeks to inform administrators and stakeholders and promote policies on a health care need, or to promote guidelines in clinical practice or assessment.

  • Information linkage and flow: describes what evidence there is, what subsets of evidence exist, how subsets relate to each other, and how information regarding this evidence is accessed.

  • Mapping of content: Results require a visual map or flowchart to provide complete understanding of results to reader.

  • Author expertise: focuses on promoting awareness through an individual’s knowledge on a topic.

Types of outcome reporting

Every methodology can report outcomes through tables, figures, and narrative results. However, some methodologies will tend to focus on one of these three.

Each of the above components—questions and methodological characteristics—help to comprise singular broad review methodologies. The following section promotes a greater contextual and historical understanding of each methodology.

Broad literature review methodologies: descriptions and histories

Content analysis

Content analysis reviews human communication within researcher-selected literature in order to locate frequencies, patterns, and trends (Babbie, Citation2010). Word frequency may reveal empirical tendencies in practice (e.g. frequency of “piano” instead of “guitar”) or political tendencies within communication (e.g. the use of person-first language in journal articles). Holsti (Citation1969) notes three purposes of content analysis: to describe trends in communication content, to compare content to standards, and to describe patterns of communication. Examples of communication patterns include (a) what was said, (b) who said it, (c) to whom was it said, (d) where or on what platform was it said, and (e) what function did the communication serve. The researcher can choose the units of analysis, including but not limited to words, concepts, phrases. The researcher can also design the content analysis to measure the objective use of units, to construct and analyze themes from units, or both. For example, Matney (Citation2015) analyzed the use of percussion in therapy in peer-reviewed articles over seven decades. Matney used descriptive statistics to present trends in instrumental use, and populations using percussion. He also employed concept construction and analysis of themes to communicate how and why percussion has been used in the field.

The exact origin for content analysis appears unknown (Hanson-Abromeit & Sena Moore, Citation2014). However, the written history of content analysis suggests associations with political analysis (Kaplan, Citation1943, p. 230), hermeneutics and psychology (Rust, Citation1983), sociology (Glaser & Strauss, Citation1967), and grounded theory (Crotty, Citation1998). Berelson (Citation1952) wrote the first book on the methodology.

Stand-alone narrative review

A stand-alone narrative review, also known as a stand-alone literature review, may be understood as a summary of author-selected literature. Results demonstrate an author’s expertise on a particular topic (Cipriani & Geddes, Citation2003). Narrative reviews largely rely on the experience of the author and do not promote transparent procedures. For these reasons, narrative reviews may suffer from selection bias (Gough et al., Citation2012) and publication bias (Cipriani & Geddes, Citation2003).

The stand-alone narrative review does not appear to have a definitive historical origin (Hanson-Abromeit & Sena Moore, Citation2014), but is the likely precursor of all other broad reviews. Researchers appear to have originally used narrative reviews for “academic debates” and “think pieces” (Gough et al., Citation2012, p. 5), but the methodology evolved to promote general theory development, identify the state of current knowledge, and promote historical analysis (Baumeister & Leary, Citation1997). For example, Tang and Vezeau (Citation2010) completed a narrative review to identify the implementation of music interventions in music therapy. The authors sought to understand with whom interventions were completed, what outcomes were sought, how interventions were operationalized, what comprised the music interventions, what measurement tools were used, and how effective were the interventions.

Theoretical review

The theoretical review, or “critical review,” analyzes a theory or theories in relation to phenomenon, idea, concept, or issue. Researchers may analyze the “breadth, internal consistency, and the nature of their (theoretical) predictions” (Cooper, Citation1998, p.4). Researchers may examine coherence (does the theory make sense for practice), fidelity (are people actually and faithfully applying the theory) or reliability (does the theory promote a particular effectiveness or type of meaningful outcome). In some cases, two or more theories may be compared to each other (Hanson-Abromeit & Sena Moore, Citation2014). For example, Dimitriadis and Smeijsters (Citation2011) analyzes treatment theories related to autism spectrum disorder (ASD). The authors present select psychological theories (e.g. Damasio, Stern) and provide linkages to select music therapy theories (e.g. Stige, Ansdell, Lee) and applied techniques (i.e. Wigram’s descriptions of clinical improvisation techniques). Results suggested particular types of connection that may be relevant to the educator or researcher.

Cooper (Citation1998) implied a common separation between a theoretical review and a “research synthesis” (p. 4). The theoretical review has historically assessed critical experiments—those studies that seek to directly test the strength and/or superiority of a theory for the social science community. Interestingly, literature does not clarify whether the theoretical review originated in scientific theory (fact-supported theories within the natural world), critical theory (addressing historical, social, and political components of the world), or a combination of the two. The theoretical review may have acted as a precursor to current theory-driven “systematic review” methodologies.

Rapid review, scoping review, state-of-the-art review, and mapping review

Four review methodologies use methods that inform evidence-based policy while dealing with time constraints. Researchers, administrators and government officials may seek to make informed decisions based on these evidence summary types. Each review type warrants brief description. A rapid review, or rapid evidence assessment, uses abridged systematic review techniques to provide policymakers evidence-based information within a five-week timeline (Grant & Booth, Citation2009; Khangura, Konnyu, Cushman, Grimshaw, & Moher, Citation2012). A scoping review offers a preliminary evaluation of available research literature on a topic or issue (Grant & Booth, Citation2009), and may be used to inform the development of a systematic review (Gough, Oliver, & Thomas, Citation2013). A state-of-the-art review highlights a contemporary issue in regard to current research. A mapping review, or systematic map, maps out current literature to identify gaps in the literature; this information may be used for either a primary study or a more rigorous evidence summary.

The author of this study located one scoping review related to music therapy. Scott and Kidd (Citation2016) summarized the current research regarding music participation and anxiety, depression, and agitation with people who have dementia. The authors review suggested insufficient evidence in this area, and recommended that researchers become more specific about interventions in future studies.

British Prime Minister Tony Blair and his administration popularized, and then Adrian Smith substantiated, evidence-based policy just before the turn of the century (Boaz, Ashby, & Young, Citation2002). The scoping review originated in 2001 (Dijkers, Citation2015; Mays, Roberts, & Popay, Citation2001). Arksey and O’Malley (Citation2005) created a methodological framework for the scoping review. The Evidence for Policy and Practice and Coordinating Centre in London developed the mapping review (Grant & Booth, Citation2009; James, Randall, & Haddaway, Citation2016), and Khangura et al. (Citation2012) provided a detailed set of methods for the methodology.

Systematized review

A systematized review abridges a “systematic review” methodology for educational purposes; changes in methods often seek to shorten time to complete. A master’s degree student may complete a systematized review for a research assignment or thesis; such may also facilitate a future complete systematic review. Some journals have published systematized reviews (see ) (Grant & Booth, Citation2009).

Table 3. Broad literature review methodologies: journal article examples.

Meta-ethnography

Researchers use meta-ethnography to build a comparative social understanding from “interpretive” studies (Barnett-Page & Thomas, Citation2009; Noblit & Hare, Citation1988). A meta-ethnography generally moves through three stages: (a) identifying concepts in the literature, (b) description of the primary study concepts as provided by the original author, and (c) constructing the reviewer’s synthesis. A meta-ethnography seeks to develop an awareness of underlying concepts found within interpretive literature through three distinctive types of synthesis: reciprocal translation (focusing on agreement), refutational synthesis (focusing on conflicts), and line of argument synthesis (building up parts of information to create a wider narrative, such as building up a greater understanding of culture or organization) (Gough et al., Citation2012; Noblit & Hare, Citation1988).

Ethnographic research originated as a participant-observer, fieldwork methodology within the discipline of anthropology. Educational researchers initially created meta-ethnography in the early 1980s to synthesize ethnographic studies (Noblit & Hare, Citation1988). However, authors have since used the methodology with various primary study types (Gough et al., Citation2012). Meta-ethnography has produced theories with “greater explanatory power” than narrative reviews through the use of higher-order synthesis constructs (Barnett-Page & Thomas, Citation2009).

Integrative review

The integrative review synthesizes information from both empirical and theoretical literature. The integrative review analyzes a phenomenon to highlight gaps in the literature, construct new concepts and theoretical frameworks, and locate new issues (Broome, Citation2000; Hanson-Abromeit & Sena Moore, Citation2014). For example, Burns (Citation2012) conducted an integrative review to assess the use of theories underpinning music selection for interventions. She found that most studies did not provide a rationale or an intervention theory related to music selection. Furthermore, intervention reporting lacked in general.

The term “integrative review” was used interchangeably with, and then largely replaced by “systematic review” in the Cumulative Index of Nursing and Allied Health Literature (Stevens, Citation2001, p. 536). One may wonder whether the change in terminology occurred merely due to semantics, a change in methods, or a new focus on rigor.

Stand-alone systematic review

Stand-alone systematic reviews answer questions related to populations, interventions, outcomes, study designs, and theories (Okoli, Citation2015). Authors note the review’s capability to locate gaps within the literature, and to design new theory for future research through the synthesis of evidence (Hanson-Abromeit & Sena Moore, Citation2014). For example, Sena Moore (Citation2013) sought to synthesize research related to music experiences and their impact on the neural mechanisms of emotional regulation. Results suggested neural activation related to regulation occurred with familiar and preferred music and when singing. More complex and unexpected music structures were more likely to activate neural mechanisms related to stress.

The stand-alone systematic review originated in health care (Hanson-Abromeit & Sena Moore, Citation2014; Khan et al., Citation2011). However, a particular origin is difficult to locate, largely due to the term being used interchangeably with integrative review and meta-analysis. Several authors have provided updated methods for the methodology (Gough et al., Citation2012; Whittemore & Knafl, Citation2005). Key to understanding the versatility of the systematic review is its relationship to the particular research question or questions being asked. As mentioned earlier, any systematic review that seeks to assess efficacy must include a meta-analysis.

Meta-analysis

Researchers and stakeholders often wish to understand the efficacy or effectiveness of interventions, as based in numerical analysis, probability, and generalizability. The meta-analysis procedure promotes statistical synthesis of data amongst studies judged sufficiently similar (Thomas, Harden, & Newman, Citation2012). Researchers achieve results by locating or computing effect sizes of individual studies for specific outcomes, and using statistical analysis to compute a pooled effect size per selected outcome. A meta-analysis provides more accurate estimates of treatment efficacy than a single study (Bradt, Citation2016). Implementation of statistics for the purpose of summary apparently originated in gambling (O’ Rourke, Citation2007), math (O’ Rourke, Citation2007), and astronomy Airy (Citation1861). However, these concepts and mathematical operations were not employed in the medical sciences until the 20th century (Chalmers et al., Citation2002). Karl Pearson (Citation1904) published a key paper in the British Medical Journal, using statistical analysis to synthesize information from 11 separate studies measuring the effects of a typhoid vaccine.

Standley (Citation1986) conducted the first meta-analysis in music therapy, analyzing the efficacy of music in medical and dental treatments; the author included applications for clinical practice and medical programming. More recently, Lee (Citation2016) synthesized current research on music and pain management. Results suggested that music interventions could decrease pain through various self-report and biomedical measures.

Cochrane review

The Cochrane review—an umbrella of collaborative, comprehensive systematic review types—focuses on the power of multiple experts and stakeholders to synthesize and communicate evidence (Porta, Citation2008). There exist five Cochrane review types that are published and maintained by the Cochrane Library (www.cochrane.org): (a) intervention reviews, (b) diagnostic test accuracy reviews, (c) methodology reviews, (d) qualitative reviews, and (e) prognosis reviews (see www.cochranelibrary.com/about/about-cochrane-systematic-reviews.html for further details)

Cochrane reviews originated in health care (Khan et al., Citation2011). Archie Cochrane’s Effectiveness and efficiency: Random reflections on health services (Citation1972) challenged the medical community to obtain better evidence for their practices, most specifically by critically analyzing and collectively summarizing RCTs (Starr, Chalmers, Clarke, & Oxman, Citation2009). The Cochrane Collaboration was formed in 1992. Whereas the Cochrane Collaboration focuses on health sciences reviews, the Campbell Collaboration is a research network that promotes evidence production and dissemination regarding the social sciences (https://www.campbellcollaboration.org).

Geretsegger, Elefant, Mössler, and Gold (Citation2014) assessed the effects of music therapy interventions for children with autism spectrum disorder. The authors analyzed a total of 10 RCTs. Results suggest music therapy interventions promoted development in social interaction, social reciprocity, and communication, with either moderate or low quality evidence.

Narrative synthesis

Narrative synthesis, or “textual narrative synthesis” (Barnett-Page & Thomas, Citation2009, p. 7), provides researchers a way to compare and contrast diverse studies through the language used. Narrative synthesis “relies primarily on the use of words and text to summarize and explain the findings of the synthesis” (Popay et al., Citation2006, p. 5). While statistical analysis may be included in narrative synthesis, the study must include how and why an intervention works. Popay et al. (Citation2006) note that narrative synthesis, as a form of integrated storytelling, “is one of the ways in which the gap between research, policy and practice can start to be bridged” (p. 5), and stakeholders and policy makers may locate greater resonance with research results. Narrative synthesis can help clarify the context and characteristics of a study, promoting implications for theory and future research (Barnett-Page & Thomas, Citation2009). Popay and colleagues (Citation2006) provided guidance for narrative synthesis through the following four steps: (a) developing a theoretical model, (b) developing a preliminary synthesis, (c) exploring relationships in the data, and (d) assessing the robustness of the synthesis product. Interested readers can refer to the Popay article for more details about these steps. McDermott, Crellin, Ridder, and Orell (Citation2013) followed these four steps to assess music therapy interventions with people who have dementia. Results noted the commonality of singing amongst studies, and that short-term improvement with mood and behavior were consistent. However, the authors noted the need for strong, long-term studies and more developed theoretical frameworks.

The origin of narrative synthesis appears unclear (Hanson-Abromeit & Sena Moore, Citation2014). Popay et al. (Citation2006) provided a set of guidelines that was later tested by Rodgers, Sowden, Petticrew, Arai, and Roberts (Citation2009). Results suggested that the guidelines increased transparency and promoted the original functions of narrative synthesis.

Meta-synthesis

Like meta-analysis, meta-synthesis can be understood as an example of a procedure that uniquely contributes to a systematic review methodology. Where meta-analysis assesses efficacy or effectiveness through statistical analysis of quantitative data within studies, meta-synthesis analyzes qualitative data to assess emergent phenomena (Walsh & Downe, Citation2005), or to construct and communicate a new theory (Khan et al., Citation2011). Research questions may (a) provide a broad description of a phenomenon, (b) build theory, (c) reconceptualize and explain theory, or (d) any combination thereof (Noblit & Hare, Citation1988). Researchers compare and contrast studies by locating, evaluating, and translating the following: phrases, keywords, concepts, metaphors, and relations (Walsh & Downe, Citation2005).

Within the meta-synthesis procedure, one may choose to approach analysis through reciprocal translation (analyzing similarities), refutational translation (analyzing contrasts), or an emerging approach specific to meta-synthesis known as ecological triangulation (Gough et al., Citation2012). Ecological triangulation employs two concepts: ecological perspective, and triangulation. Ecological perspective acknowledges a mutually interdependent system of behaviors, individuals, and environments that can play a role in intervention success or failure (Barnett-Page & Thomas, Citation2009); objective results are balanced with individual and social perspectives. Triangulation refers to looking at a phenomenon from “multiple vantage points” (Banning, Citationn.d., p. 1), including multiple researchers, multiple sources of data, or the consideration of multiple theories during analysis.

The author located one meta-synthesis specific to music therapy. Solli, Rolvsjord, and Borg (Citation2013) analyzed service users’ experiences of music therapy within mental health settings. Findings suggested four themes: (a) having a good time, (b) being together, (c) feeling, and (d) being someone; the authors concluded that these themes reflect music therapy as a recovery-oriented practice.

Meta-synthesis originated in healthcare (Khan et al., Citation2011). Stern and Harris (Citation1985) appear to have been the first to use the phrase “qualitative meta-synthesis.” Jim Banning authored ecological triangulation in order to better understand complex interventions, originally for youth with disabilities.

Meta-narrative review

Meta-narrative review looks at problems from a historical and philosophical perspective. Meta-narrative reviews “often look historically at how particular research traditions or epistemic traditions have unfolded over time and shaped the ‘normal science’ of a topic area” (Wong, Greenhalgh, Westhorp, Buckingham, & Pawson, Citation2013a, p. 6). This historical positioning promotes “sense making of a complex (and sometimes controversial) topic area” (Wong et al., Citation2013a, p. 6). For example, Murad, Chatterley, and Guiruis (Citation2013) assessed the quality of communications between pharmacists and patients. The overwhelming majority of studies presented evidence of a biomedical model for communication, while eight studies presented a patient-centered focus. Authors discuss how the chosen methodology of each primary study played a role in the type of communication model.

Meta-narrative review originated within the health sciences (Wong et al., Citation2013a). Greenhalgh, Robert, Macfarlane, Bate, and Kyriakidou (Citation2004) developed the meta-narrative review to examine a problem from a multiplicity of viewpoints, assumptions, and contexts. Wong et al. (Citation2013a) suggested preliminary publication standards for meta-narrative reviews, known as Realist and Meta-narrative Evidence Syntheses: Evolving Standards (RAMESES).

Critical interpretive synthesis

Critical interpretive synthesis (CIS) focuses on theory development through a socio-critical perspective. CIS “generates a coherent and illuminating theory of a body of evidence that is based on a detailed critical study of the theoretical contribution of the evidence” (Gough, Oliver, & Thomas, Citation2012, p. 258). Paramount to CIS is the inclusion of the reviewer’s voice as a critical guide. CIS focuses on inclusion and exclusion criteria related to theoretical quality of studies, rather than methodological quality. The primary methods in CIS include formulating the question, searching the literature, sampling, determination of study quality, data extraction, interpretive synthesis including critique, and reporting results (Dixon-Woods et al., Citation2006). For example, Comte (Citation2016) examined music therapy with refugees who have experienced trauma. The author synthesized and critiqued the following themes: (a) an initial, anchoring theme of neocolonialism, a subsequent theme communicating “refugees” as a homogenous group, and the notion of improvisation as a universal language.

Critical interpretive synthesis originated in the 21st century. Mary Dixon-Woods and colleagues proposed CIS (Citation2006), largely as an outgrowth of meta-ethnography and grounded theory methodologies. Critical interpretive synthesis historically aligns with critical theory and social justice perspectives and uses rigorous techniques to promote synthesis.

Thematic synthesis

Thematic synthesis explores whether clients need an intervention, whether an intervention type is appropriate to addressing a need, and whether clients find the intervention acceptable (Thomas & Harden, Citation2008). This methodology can thematically identify potential barriers and facilitators to intervention success. For example, a medical intervention may be less successful in some contexts, perhaps due to cultural norms or socioeconomic status. Rathbone, Todd, Jamie, Bonam, Banks, and Husband (Citation2016) conducted a systematic review and thematic synthesis to assess patients’ experiences regarding adherence to medicine. The authors located both descriptive themes and analytic themes, showing that cost-benefit considerations of medicine took into account patient identity as mediated by interactions with professionals, friends, and family.

Thomas and Harden (Citation2008) developed thematic synthesis. The methodology adapts ideas from meta-ethnography and grounded theory. From meta-ethnography, thematic synthesis borrows thematic analysis and higher order interpretations. From grounded theory, thematic analysis borrows the constant comparison method.

Framework analysis and best-fit framework synthesis

Framework analysis, also known as “framework summary,” promotes the emergence of thematic frameworks through the analysis of qualitative data within studies (Gough et al., Citation2012). The methodology explores general research questions, analyzes heterogeneous methodologies, and facilitates the emergence of iterative themes (Ward, Furber, Tierney, & Swallow, Citation2013). Framework analysis consists of five stages: (a) familiarization through immersion in the data, (b) developing a theoretical framework by identifying recurrent and important themes, (c) indexing and pilot charting, (d) summarizing data in an analytical framework, and (e) synthesizing data through mapping and interpreting.

Best-fit framework synthesis is a type of framework analysis that uses thematic analysis techniques and directs focus toward a more specific research question (Carroll, Booth, Leaviss, & Rick, Citation2013; Dixon-Woods, Citation2011). Where a framework analysis promotes a framework of themes, a best-fit framework synthesis seeks to develop a theoretical framework. “Best fit” refers to the creation of inclusion criteria specific enough to directly answer the chosen research question or questions. Carroll et al. (Citation2013) described the steps of framework synthesis: (a) systematically identify relevant studies in accordance with the research question; (b) generate a priori theory and appraise quality of studies; (c) code evidence, (d) create new themes through thematic analysis; (e) produce a new framework with developed themes; and (f) revisit literature to explore new relationships and to synthesize a new model. For example, Shaw, Holland, Pattison, and Cooke (Citation2016) assessed patient experiences of prevention programs for cardiovascular disease and diabetes. The authors began with an a priori selected Theoretical Domains Framework to assist with themes. Results for theory development included themes regarding the individual (knowledge, beliefs), and the social (cues, social influence, identity, and context).

Social policy researchers in the UK developed framework analysis (Ritchie & Spencer, Citation1994). Oliver et al. (Citation2008) provided the earliest example of a best-fit framework synthesis. Health care researchers have increasingly used framework analysis and best-fit framework synthesis.

Qualitative research synthesis (QRS) and arts-informed qualitative research synthesis (AI-QRS)

QRS analyzes “qualitative” studies to synthesize concepts, categories, or themes related to research questions (Major & Savin-Baden, Citation2010; Meadows & Wimpenny, Citation2016). QRS recognizes “the social, historical, and ideological context of the (reviewed) research” (Meadows & Wimpenny, Citation2016, p. 2). AI-QRS study uses the QRS model, while including an artistic interpretation of higher order themes (Savin-Baden & Wimpenny, Citation2014). Meadows and Wimpenny (Citation2016) assessed the ability of clinical improvisation to promote meaning-making. The authors concluded with an emergent conceptual framework.

Descriptions and citations related to QRS suggest a historical relationship to meta-ethnography and the ethnographic tradition. Major and Savin-Baden introduced the QRS methodology in 2010 in order promote both an inclusive and reflexive perspective within broad literature review. The first AI-QRS publication appeared in 2016 (Meadows & Wimpenny, Citation2016).

Metasummary

Metasummary, also known as “qualitative metasummary,” provides a unique alternative to typical systematic reviews, in that it synthesizes results of reports, surveys, observational studies, interviews, and a range of intervention studies. This methodology employs methods that aggregate descriptive results, not dissimilar to those that may be used in a survey (Barnett-Page & Thomas, Citation2009) or in manifest content analysis; “higher frequency findings” promote both statistical validity, as well as promote the claim of having “discovered a pattern or theme” (Sandelowski, Barroso, & Voils, Citation2007, p. 101). In order to promote sound synthesis, metasummary analyzes and promotes convergence in sampling, data collection, and analysis, as well as calculates frequency and intensity effect sizes (Sandelowski et al., Citation2007).

Metasummary originated within the field of nursing (Sandelowski et al., Citation2007). The original study focused on antiretroviral adherence in women who were HIV positive (Sandelowski et al., Citation2007). Authors originally developed the methodology to address the features of survey findings, but also allowed flexibility to assess a range of study types. For example, Childress (Citation2013) assessed literature related to domestic violence. The author located recurring themes related to effects of violence, the cyclical nature of violence, the normalization of violence, resilience, barriers, and the role of substance abuse. The author also noted cross-cultural differences in experiences, and a lack of study regarding domestic violence with people from particular countries.

Realist synthesis

Realist synthesis seeks to discern what works for whom in what environment. Realist synthesis therefore exists as a theory-building methodology, promoting understanding of how and why an intervention is or is not effective (Gough et al., Citation2012). The researcher locates connections between a context (e.g. population, location, and other factors), a mechanism (all components of an intervention), and an outcome (CMO). The resulting CMO configurations “can amplify or mute the fidelity of an intervention theory” (Pawson, Greenhalgh, Harvey, & Walshe, Citation2004, p. iii). Thomas and Thomas (Citation2014) conducted a critical appraisal and realist synthesis of studies discussing safe patient transfer. The realist synthesis component of the study located important programmatic mechanisms for safety: (a) management support, (b) policy, (c) ergonomic assessment of spaces, (d) appropriate transfer equipment, (e) risk assessment, and (f) training.

Realist synthesis originated in health care, first under the names “realistic synthesis” and “realist evaluation” (Pawson & Tilley, Citation1997, Citation2004). Pawson and Tilley (Citation1997) introduced the realist synthesis methodology in order to address the design and implementation of services covering a “multiplicity of goals” (p. iii). Wong, Greenhalgh, Westhorp, Buckingham, and Pawson (Citation2013b) promoted realist synthesis guidelines through RAMESES.

Mixed methods systematic review

Researchers may seek to answer complex questions related to both effectiveness/efficacy and impact/meaning (Bradt, Burns, & Creswell, Citation2013; Pearson et al., Citation2014). Mixed methods research in general refers to the collection, analysis and integration of two sets of data, one quantitative and the other qualitative, in order to “maximize” findings. A mixed methods systematic review includes three separate syntheses. The researcher first synthesizes quantitative and qualitative data through two broad review methodologies (e.g. meta-analysis and meta-ethnography), and then completes a final synthesis of the two sets of results (Gough et al., Citation2012). For example, Arrowsmith, Lau-Walker, Norman, and Maben (Citation2016) studied nurses’ perceptions of work role transitions. Synthesis of statistical and narrative data suggested differences between the experiences of novice nurses and more experienced nurses.

Current trends in research promote rigorous inquiry of complex questions. The mixed methods systematic review originated in health care (Harden, Citation2010). Pearson et al. (Citation2014) offered a specific guide with which to conduct mixed methods systematic reviews.

Tertiary reviews: meta-reviews, umbrella reviews, overviews of reviews, and meta-epidemiology

Broad literature reviews generally exist as a type of secondary literature. However, three review types are considered tertiary review methodologies: meta-reviews, meta-epidemiology, and umbrella reviews (Biondi-Zoccai, Citation2016; Gough et al., Citation2012). Tertiary reviews can analyze either secondary reviews or both primary and secondary studies. A primary strength of these tertiary studies is their ability to compile evidence for policy makers (Biondi-Zoccai, Citation2016). Similar to secondary review types, there exists some lack of clarity regarding each type. Each of these reviews is therefore briefly described below.

Meta-reviews, also known as overviews of reviews, synthesize information found in systematic reviews and other literature (Biondi-Zoccai, Citation2016). The methodology therefore provides a broader view of a research question, and requires a consistent and coherent body of literature to be worthwhile (Caldwell, Welton, & Ades, Citation2010). Meta-reviews may assess systematic reviews of similar methodologies, or may assess mixed methodologies (Gough et al., Citation2012). A meta-review includes the following steps: (a) identify the question, (b) establish the research team, (c) identify the outcomes of interest, (d) literature search and analysis, and (e) presentation of findings, primarily through narrative format. Meta-reviews are often registered with the Cochrane Library (Biondi-Zoccai, Citation2016).

Kamioka et al. (Citation2014) completed a meta-review of systematic reviews that focused on RCTs. Twenty-one systematic reviews met inclusion criteria, which included 16 Cochrane reviews. Results suggested that music therapy treatment improved global and social functioning in certain mental health disorders, gait in people diagnosed with Parkinson’s disease, general depressive symptoms, and general sleep quality.

Meta-epidemiology is a unique type of meta-review that specifically seeks to better understand cause by examining heterogeneity in otherwise homogenous studies, and reducing bias within those studies (Zhang, Citation2010). Meta-epidemiology focuses on two related areas: studying patterns of illness incidence and distribution in order to locate causes and effects, and controlling bias and confounding variables within studies (Sterne et al., Citation2002). There exist three subclassifications: simple meta-epidemiology (study of meta-analyses), meta-meta-epidemiology (study of meta-epidemiological studies), and network epidemiology (study of network meta-analyses) (Biondi-Zoccai, Citation2016; Trinquart, Dechartres, & Ravaud, Citation2013).

Umbrella reviews often focus on competing interventions to compare effectiveness, impact, and theoretical development (Biondi-Zoccai, Citation2016). An umbrella review is a review of systematic reviews that may include both primary and secondary studies on a topic, and that focuses on competing interventions for a specific problem or condition (Grant & Booth, Citation2009).

Researchers began considering literature reviews and other secondary literature as specific objects of study in the 1980s (Biondi-Zoccai, Citation2016; Oxman & Guyatt, Citation1991). Meta-epidemiology appears to have emerged in the literature in 1997 (Naylor, Citation1997; Zhang, Citation2010), with the evolution of the methodology beginning in the 21st century (Zhang, Citation2010). Meta-reviews appear to have been pioneered by the Child Health Cochrane Group (Biondi-Zoccai, Citation2016). The Cochrane group conducted its first umbrella review in 2015 (Biondi-Zoccai, Citation2016). Authors have published information regarding methods for tertiary reviews (Biondi-Zoccai, Citation2016; Smith, Devane, Begley, & Clarke, Citation2011).

Implications for music therapy practice

Broad literature reviews can employ a range of characteristics. Each methodology seeks to address different needs through specific characteristics. provides the research consumer an opportunity to compare and contrast different methodologies. provides example research questions, also for the sake of comparison. These two tables may assist in the formulation of research review, either at the student or professional level.

Authors from the field of music therapy have conducted a range of broad review types (). However, the author could not locate peer-reviewed published articles of particular methodologies; when this information is cross-referenced with , particular themes arise in regard to theory, policy, information flow, stakeholder engagement, and tertiary reviews.

Theory

To date, there appear to be no peer-reviewed published music therapy articles using the following theory-contributing methodologies: meta-narrative, thematic synthesis, framework analysis/synthesis, realist synthesis, metasummary, or mixed methods. These methodologies may promote the development of stronger conceptual and theoretical frameworks to inform interventions.

Policy development

To date, there appears to be one peer-reviewed, published music therapy article using a quick-review methodology that emphasizes policy/guideline development (Scott & Kidd, Citation2016). While the field has published Cochrane reviews, stand-alone systematic reviews, and narrative syntheses, there appear to be no studies using rapid review, state of the art review, meta-review, or umbrella review methodologies. Development and proper dissemination of diverse policy-oriented reviews (i.e. scoping review, rapid review, state of the art review) may benefit advocacy efforts.

Information flow and stakeholder engagement

Reviews that promote a better understanding of information flow (mapping reviews) and promote stakeholder engagement may also enhance efforts to empower the profession. Mapping reviews uniquely offer the opportunity to study how research information is gathered and disseminated. Mapping reviews and realist syntheses encourage stakeholder participation on the research team, while many Cochrane reviews appear to require such. Furthermore, other systematic review methodologies can choose to employ stakeholder participation.

Tertiary reviews

Evidence synthesis continues to evolve, and some health care fields are engaging in tertiary reviews. The field of music therapy has primarily pursued updated secondary reviews (Bradt, Dileo, Magill, & Teague, Citation2016; Geretsegger et al., Citation2014; Standley, Citation2012); the author located one meta-review specific to music therapy (Kamioka et al., Citation2014). The field of music therapy, due to both its youth and diversity, may more frequently employ tertiary reviews as the depth and breadth of the evidence base grows.

The need for effective and efficient evidence summaries continues, and has perhaps increased over time. Health care research continues to proliferate at a quick pace. Given the broad reach of music therapy practice, researchers and consumers benefit from a deeper and clearer understanding of literature review processes.

Conclusion

Research, as a historical act, includes review. Review can either support a primary study or be conducted through a broad methodology. This article discussed narrow and broad literature reviews in the following areas: descriptions, history, research questions, methodological characteristics, and example articles from music therapy and related fields. Implications for music therapy include the ability to compare methodologies for future research, and to envision what types of broad investigations may strengthen the evidence base and advocacy efforts; at this juncture, the past may meet the present and future to address the needs of the field.

Acknowledgment

The author wishes to acknowledge Deanna Hanson-Abromeit, Ph.D., MT-BC, and Cynthia Colwell, Ph.D., MT-BC for their engaged mentorship during the nascent stages of this manuscript.

Additional information

Notes on contributors

Bill Matney

Bill Matney is an assistant professor of music therapy at the University of Kansas. His research line includes the employment of broad literature review methodologies, as well as engagement with theoretical problems related to research and practice.

References

  • Adams, E., McCann, L., Armes, J., Richardson, A., Stark, D., Watson, E., & Hubbard, G. (2011). The experiences, needs and concerns of younger women with breast cancer: A meta-ethnography. Psychooncology, 20, 851–861. doi:10.1002/pon.v20.8
  • Afshar, M., Raju, M., Ansell, D., & Bleck, T. P. (2011). Narrative review: Tetanus – A health threat after natural disasters in developing countries. Annals of Internal Medicine, 154, 329–335. doi:10.7326/0003-4819-154-5-201103010-00007
  • Airy, G. B. (1861). On the algebraical and numerical theory of errors of observationsand the combination of observations. London: Macmillan.
  • Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. doi:10.1080/1364557032000119616
  • Arrowsmith, V., Lau-Walker, M., Norman, I., & Maben, J. (2016). Nurses’ perceptions and experiences of work role transitions: A mixed methods systematic review of the literature. Journal of Applied Nursing, 72, 1735–1750.
  • Babbie, E. (2010). The practice of social research. Wadsworth: Cengage Learning.
  • Bailey, C. D., Wagland, R., Dabour, R., Caress, A., Smith, J., & Molassiotis, A. (2010). An integrative review of systematic reviews related to the management of breathlessness in respiratory illness. Bio Med Central Pulmonary Medicine, 10(63), 1–13.
  • Banning, J. H. (n.d.). Ecological triangulation: An approach for qualitative meta-synthesis. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.152.5185&rep=rep1&type=pdf
  • Barnett-Page, E., & Thomas, J. (2009). Methods for the synthesis of qualitative research: A critical review. Bio Med Central Medical Research Methodology, 9. doi:10.1186/1471-2288-9-59
  • Barr-Walker, J. (2017). Evidence-based information needs of public health workers: A systematized review. Journal of the Medical Library Association, 105. doi:10.5195/jmla.2017.109
  • Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews. Review of General Psychology, 3, 311–320. doi:10.1037/1089-2680.1.3.311
  • Bennion, A. E., Shaw, R. L., & Gibson, J. M. (2012). What do we know about the experience of age related macular degeneration? A systematic review and meta-synthesis of qualitative research. Social Science & Medicine, 75, 976–985. doi:10.1016/j.socscimed.2012.04.023
  • Berelson, B. (1952). Content analysis in communication research. Glencoe, IL: Free Press.
  • Biondi-Zoccai, G. (2016). Umbrella reviews: Evidence synthesis with overviews of reviews and meta-epidemiologic studies. New York: Springer.
  • Boaz, A., Ashby, D., & Young, K. (2002). Systematic reviews: What have they got to offer evidence-based policy and practice? ESRC UK Centre for Evidence Based Policy and Practice. Retrieved from https://www.kcl.ac.uk/sspp/departments/politicaleconomy/research/cep/pubs/papers/assets/wp2.pdf
  • Bradt, J. (2016). Systematic review and meta-analysis in objectivist research. In B. L. Wheeler & K. Murphy (Eds.), Music therapy research. New Braunfels: Barcelona.
  • Bradt, J., Burns, D. S., & Creswell, J. W. (2013). Mixed methods research in music therapy research. Journal of Music Therapy, 50, 123–148. doi:10.1093/jmt/50.2.123
  • Bradt, J., Dileo, C., Magill, L., & Teague, A. (2016). Music interventions for improving psychological and physical outcomes in cancer patients. Cochrane Library. doi:10.1002/14651858.CD006911.pub3
  • Bradt, J., Magee, W. L., Dileo, C., Wheeler, B. L., & Mcgilloway, E. (2010). Musictherapy for acquired brain injury. Cochrane Database of Systematic Reviews, 2010(7), CD006787.
  • Bray, J. W., Cowell, A. J., & Hinde, J. M. (2011). Systematic review and meta-analysisof health care utilization outcomes in alcohol screening and brief intervention trials. Medical Care, 49, 287–294. doi:10.1097/MLR.0b013e318203624f
  • Broome, M. E. (2000). Integrative reviews for the development of concepts. In B. Rogers & K. Knafl (Eds.), Concept development in nursing (pp. 231–250). Philadelphia, PA: WB Saunders.
  • Brown, L. S., & Jellison, J. A. (2012). Music research in children and youth withdisabilities and typically developing peers: A systematic review. Journal of Music Therapy, 49, 335–364. doi:10.1093/jmt/49.3.335
  • Brown, S., Bevan, R., Rubin, G., Nixon, C., Dunn, S., Panter, S., & Rees, C. J. (2015). Patient-derived measures of GI endoscopy: A meta-narrative review of the literature. Gastrointestinal Endoscopy, 81, 1130–1140. doi:10.1016/j.gie.2014.11.047
  • Brunton, G., Oliver, S., Oliver, K., & Lorenc, T. (2006). A synthesis of research addressing children’s, young people’s and parents’ views of walking and cycling for Transport London. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London.
  • Bruscia, K. E. (1995). The boundaries of music therapy research. In B. L. Wheeler (Ed.), Music therapy research: Quantitative and qualitative perspectives (pp. 17–27). Gilsum, NH: Barcelona.
  • Burns, D. S. (2012). Theoretical rationale for music selection in oncology intervention research: An integrative review. Journal of Music Therapy, 49, 7–22. doi:10.1093/jmt/49.1.7
  • Caldwell, D. M., Welton, N. J., & Ades, A. E. (2010). Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. Journal of Clinical Epidemiology, 63, 875–882. doi:10.1016/j.jclinepi.2009.08.025
  • Carl, J. R., Soskin, D. P., Kerns, C., & Barlow, D. H. (2013). Positive emotion regulation in emotional disorders: A theoretical review. Clinical Psychology Review, 33, 343–360. doi:10.1016/j.cpr.2013.01.003
  • Carr, C., Odell-Miller, H., & Priebe, S. (2013). A systematic review of music therapy practice and outcomes with acute adult psychiatric in-patients. PLoS One, 8(8). doi:10.1371/journal.pone.0070252
  • Carroll, C., Booth, A., & Cooper, K. (2011). A worked example of “best-fit” framework synthesis: A systematic review of views concerning the taking of potential chemopreventive agents. BioMedCentral Medical Research Methodology, 11, 29. doi:10.1186/1471-2288-11-29
  • Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013). Best fit framework synthesis: Refining the method. BMC Medical Research Methodology, 13(37), 1–16. doi:10.1186/1471-2288-13-37
  • Chalmers, I., Hedges, L. V., & Cooper, H. (2002). A brief history of research synthesis. Evaluation & the Health Professions, 25(1), 12–37. doi:10.1177/0163278702025001003
  • Childress, S. (2013). A meta summary of qualitative findings on the lived experience among culturally diverse domestic violence survivors. Issues in Mental Health Nursing, 34, 693–705. doi:10.3109/01612840.2013.791735
  • Choudry, N. K., Fletcher, R. H., & Soumerai, S. B. (2005). Systematic review: The relationship between clinical experience and quality of health care. Improving Patient Care, 142, 260–273.
  • Cipriani, A., & Geddes, J. (2003). Comparison of systematic and narrative reviews. An example of the atypical antipsychotics. Epidemiologia E Psichiatria Social, 12(3), 146–154. doi:10.1017/S1121189X00002918
  • Cochrane, A. L. (1972). Effectiveness and efficiency: Random reflections on health services. London: Nuffield Provincial Hospitals Trust.
  • Comte, R. (2016). Neo-colonialism in music therapy: A critical interpretive synthesis of the literature concerning music therapy practice with refugees. Voices, 16. Retrieved from https://www.voices.no/index.php/voices/article/view/865
  • Cooper, H. (1998). Synthesizing research: A guide for literature reviews (3rd ed.). London: Sage Publications.
  • Crotty, M. (1998). The foundations of social research: Meaning and perspective in the research process. Thousand Oaks, CA: Sage Publications.
  • Dijkers, M. (2015). What is a scoping review? KT Update, 4(1). Retrieved from http://ktdrr.org/products/update/v4n1/dijkers_ktupdate_v4n1_12-15.pdf
  • Dileo, C. (2006). Effects of music and music therapy on medical patients: A meta-analysis of the research and implications for the future. Journal of the Society for Integrative Oncology, 4(2), 67–70. doi:10.2310/7200.2006.002
  • Dimitriadis, T., & Smeijsters, H. (2011). Autistic spectrum disorder and music therapy: Theory underpinning practice. Nordic Journal of Music Therapy, 20(2), 108–122.
  • Dixon-Woods, M. (2011). Using framework-based synthesis for conducting reviews of qualitative studies. Bio Med Central Medicine, 9(39). Retrieved from http://www.biomedcentral.com/1741-7015/9/39
  • Dixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Aurthur, A., Harvey, J., & Sutton, A. J. (2006). Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. Bio Med Central Medical Research Methodology, 6(35), 1–13.
  • Doherty, C., & Stravropoulou, C. (2012). Patients’ willingness and ability to participate actively in the reduction of clinical errors: A systematic literature review. Social Science and Medicine, 75, 257–263. doi:10.1016/j.socscimed.2012.02.056
  • Draper, K. (2016). Music and stroke rehabilitation: A narrative synthesis of the music-based treatments used to rehabilitate disorders of speech and language following left hemispheric stroke. Voices, 16(1). Retrieved from https://voices.no/index.php/voices/article/view/789/708
  • Fleming, K. (2010). Synthesis of quantitative and qualitative research. An example using critical interpretive synthesis. Journal of Advanced Nursing, 66(1), 201–217. doi:10.1111/j.1365-2648.2009.05173.x
  • Franzel, B., Schiegerhausen, M., Heusser, P., & Berger, B. (2013). Individualised medicine from the perspectives of patients using complementary therapies: A meta-ethnography approach. BMC Complementary and Alternative Medicine, 13, 1–17. doi:10.1186/1472-6882-13-124
  • Geretsegger, M., Elefant, C., Mössler, K. A., & Gold, C. (2014). Music therapy for people with autism spectrum disorder. Cochrane Library. doi:10.1002/14651858.CD004381.pub3
  • Glaser, B., & Strauss, A. (1967). The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine.
  • Godwin, M., Ruhland, L., Casson, I., MacDonald, S., Delva, D., Birtwhistle, R., … Seguin, R. (2003). Pragmatic controlled clinical trials in primary care: The struggle between external and internal validity. BioMed Central Research Methodolology, 3, 28. doi:10.1186/1471-2288-3-28
  • Gold, C., Solli, H. P., Krüger, V., & Lie, S. A. (2009). Dose-response relationship in music therapy for people with serious mental disorders: Systematic review and meta-analysis. Clinical Psychology Review, 29, 193–207. doi:10.1016/j.cpr.2009.01.001
  • Gordon, A. L., Logan, P. A., Jones, R. G., Forrester-Paton, C., Mamo, J. P., Gladman, J. R. F., & Medical Crises in Older People Study Group. (2012). A systematic mapping review of randomized controlled trials (RCTs) in care homes. BioMedCenteral Geriatrics, 12(31). doi:10.1186/1471-2318-12-31
  • Gough, D., Oliver, S., & Thomas, J. (2012). An introduction to systematic reviews. London: Sage Publications.
  • Gough, D., Oliver, S., & Thomas, J. (2013). Learning from research: Systematic reviews for informing policy decisions: A quick guide. EPPI-Centre, Social Science Research Unit, Institute of Education, University of London. Retrieved from http://www.alliance4usefulevidence.org/assets/Alliance-FUE-reviews-booklet-3.pdf
  • Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information and Libraries Journal, 26, 91–108. doi:10.1111/j.1471-1842.2009.00848.x
  • Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organisations: Systematic literature review and recommendations for future research. Milbank Quarterly, 82, 581–629. doi:10.1111/j.0887-378X.2004.00325.x
  • Hampton, J. R. (1998). The end of medical history? Journal of the Royal College of Physicians of London, 32, 366–375.
  • Hansen, H. P., Draborg, E., & Kristensen, F. B. (2011). Exploring qualitative research synthesis: The role of patients’ perspectives in health policy design and decision making. Patient, 4(3), 143–152. doi:10.2165/11539880-000000000-00000
  • Hanson-Abromeit, D., & Sena Moore, K. (2014). The systematic review as a research process in music therapy. Journal of Music Therapy, 51, 4–38. doi:10.1093/jmt/thu002
  • Harald, B., & Gordon, P. (2012). Meta-review of depressive subtyping systems. Journal of Affective Disorders, 139, 126–140. doi:10.1016/j.jad.2011.07.015
  • Harden, A. (2010). Mixed methods systematic reviews: Integrating quantitative and qualitative findings. Focus; Technical Brief, 25, 1–8.
  • Hodge, D. R., Horvath, V. E., Larkin, H., & Curl, A. L. (2012). Older adults’ spiritual needs in health care settings: A qualitative meta-synthesis. Research on Aging, 34(2), 131–155. doi:10.1177/0164027511411308
  • Holmes, S., & Padgeham, N. D. (2011). “Ringing in the Ears:” Narrative review of tinnitus and its impact. Biological Research for Nursing, 13(1), 97–108. doi:10.1177/1099800410382290
  • Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading, MA: Addison-Wesley.
  • Hovland, I. (2005). Successful communication: A toolkit for researchers and civil society organisations. London: Overseas Development Institute. Retrieved from http://www.alnap.org/resource/23498
  • James, K. L., Randall, N. P., & Haddaway, N. R. (2016). A methodology for systematic mapping in environmental sciences. Environmental Evidence, 1–18. doi:10.1186/s13750-016-0059-6
  • Jepson, R., Blasi, Z. D., Wright, K., & Riet, G. T. (2001). Scoping review of the effectiveness of mental health services (CRD Report 21). York: NHS Centre for Reviews and Dissemination, University of York.
  • Jones, J. (2006). The use of control groups in music therapy : A content analysis of articles in the Journal of Music Therapy. Journal Of Music Therapy, 43, 334–355.
  • Kales, H. C., Gitlin, L. N., & Lyketsos, C. G. 2015. Assessment and management of behavioral and psychological symptoms of dementia. British Medical Journal, 350. doi:10.1136/bmj.h369
  • Kamioka, H., Tsutani, K., Yamada, M., Park, H., Okuizumi, H., Tsuruoka, K., … Mutoh, Y. (2014). Effectiveness of music therapy: A summary of systematic reviews based on randomized controlled trials of music intervention. Patient Preference and Adherence, 8, 727–754. doi:10.2147/PPA.S61340
  • Kane, S. S., Gerretsen, B., Scherpbier, R., Poz, M. D., & Dieleman, M. (2010). Synthesis of randomized control trials involving use of community health workers delivering child health interventions in low to middle income countries. Health Services Reaearch, 10, 1–7. http://www.biomedcentral.com/1472-6963/10/286
  • Kaplan, A. (1943). Content analysis and the theory of signs. Philosophy of Science, 10, 230–247. doi:10.1086/286814
  • Kastner, M., Tricco, A. C., Soobiah, C., Lillie, E., Perrier, L., Horsley, T., & Straus, S. E. (2012). What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review. BMC Medical Research Methodology, 12(114), 1–10. doi:10.1186/1471-2288-12-114
  • Khan, K., Kunz, R., Klijnen, J., & Antes, G. (2011). Systematic reviews to support evidence based medicine. London: Hodder Arnold.
  • Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012). Evidence summaries: The evolution of a rapid review approach. Bio Med Central Systematic Reviews, 21, 10. doi:10.1186/2046-4053-1-10
  • Kilgour, J. M., Grundy, L., & Monrouxe, L. V. (2016). A rapid review of the factors affecting healthcare students’ satisfaction with small-group, active learning methods. Teaching and Learning in Medicine, 28(1), 15–25. doi:10.1080/10401334.2015.1107484
  • Krebs Seida, J., Ospina, M. B., Karkhaneh, M., Hartline, L., Smith, V., & Clark, B. (2009). Systematic reviews of psychosocial interventions for autism: An umbrella review. Developmental Medicine & Child Neurology, 51(2), 95–104. doi:10.1111/j.1469-8749.2008.03211.x
  • Latchem, J. M., & Greenhalgh, J. (2013). The role of reading on the health and well-being of people with neurological conditions: A systematic review. Aging & Mental Health, 18, 731–744. doi:10.1080/13607863.2013.875125
  • Lee, J. H. (2016). The effects of music on pain: A meta-analysis. Journal of Music Therapy, 53, 430–477. doi:10.1093/jmt/thw012
  • Leeman, J., Chang, Y. K., Lee, E. J., Voils, C. I., Crandell, J., & Sandelowski, M. (2010). Implementation of antiretroviral therapy adherence interventions: A realist synthesis of evidence. Journal of Advanced Nursing, 66, 1915–1930. doi:10.1111/jan.2010.66.issue-9
  • LoBiondo-Wood, G. (2014). Systematic reviews and clinical guidelines. In G. Lobiondo-Wood & J. Haber (Eds.), From nursing research: Methods and clinical appraisal for evidence-based practice. http://www.elsevieradvantage.com/samplechapters/9780323100861/LoBiondo-ch11-9780323100861.pdf
  • Major, C., & Savin-Baden, M. (2010). An introduction to qualitative research synthesis: Managing the information explosion in social science research. London: Routledge.
  • Matjasko, J. L., Vivolo-Kanto, A. M., Massetti, G. M., Holland, K. M., Holt, M. K., & Dela Cruz, J. (2012). A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews. Aggression and Violent Behavior, 17, 540–552. doi:10.1016/j.avb.2012.06.006
  • Matney, B. (2015). The use of percussion in music therapy: A content analysis of the literature. Nordic Journal of Music Therapy, 25, 372–403. doi:10.1080/08098131.2015.1084027
  • Mays, N., Roberts, E., & Popay, J. (2001). Synthesising research evidence. In N. Fulop, P. Allen, A. Clarke, & N. Black (Eds.), Studying the organisation and delivery of health services: Research methods (pp. 188–219). London: Routledge.
  • McDermott, O., Crellin, N., Ridder, H. M., & Orell, M. (2013). Music therapy in dementia: A narrative synthesis systematic review. International Journal of Geriatric Psychiatry, 28, 781–794. doi:10.1002/gps.3895
  • McFerran, K., Garrido, S., & Saarikallio, S. (2013). A critical interpretive synthesis of the literature linking music and adolescent mental health. Youth and Society. doi:10.1177/0044118X13501343
  • Meadows, T., & Wimpenny, K. (2016, April 8–12). Meaning-making processes in music therapy clinical improvisation: An arts-informed qualitative research synthesis. 2016 AERA Annual Meeting, Washington, DC. Retrieved from https://curve.coventry.ac.uk/open/file/81bee35b-2eab-46b9-bc3e-f02ed9e19643/1/Music%20therapy.pdf
  • Mossler, K., Chen, X., Heldal, T. O., & Gold, C. (2011). Music therapy for people with schizophrenia and schizophrenia-like disorders. Cochrane Database of Systematic Reviews, 2011(12), CD004025.
  • Murad, M. S., Chatterley, T., & Guiruis, L. M. (2013). A meta-narrative review of recorded patient pharmacist interactions: Exploring biomedical or patient-centered communication? Research in Social and Administrative Pharmacy, 10, 1–20. doi:10.1016/j.sapharm.2013.03.002
  • Naylor, C. D. (1997). Meta-analysis and the meta-epidemiology of clinical research. British Medical Journal, 315, 617–619. doi:10.1136/bmj.315.7109.617
  • Noblit, G. W., & Hare, R. D. (1988). Meta-ethnography: Synthesizing qualitative studies. Newbury Park, CA: Sage Publications.
  • O’ Rourke, K. (2007). An historical perspective on meta-analysis: Dealing quantitatively with varying study results. Journal of the Royal Society of Medicine, 100, 579–582. doi:10.1177/0141076807100012020
  • O’Callaghan, C. C., McDermott, F., Reid, P., Michael, N., Zalcberg, J. R., & Edwards, J. (2016). Music’s relevance for people affected by cancer: A meta-ethnography and implications for music therapists. Journal of Music Therapy, 53, 398–429. doi:10.1093/jmt/thw013
  • Okoli, C. (2015). A guide to conducting a standalone systematic literature review. Communications of the Association for Information Systems, 37, 879–910.
  • Oliver, S., Rees, R. W., Clarke-Jones, L., Milne, R., Oakley, A. R., Gabbay, J., & Gyte, G. (2008). A multidimensional conceptual framework for analyzing public involvement in health services research. Health Expectations, 11, 72–84. doi:10.1111/j.1369-7625.2007.00476.x
  • Onwuegbuzie, A. J., Collins, K., Leech, N. L., Dellinger, A. B., & Jiao, Q. G. (2010). A meta-framework for conducting mixed research synthesis for stress and coping research and beyond. In K. Collins, A. J. Onwuegbuzie, & Q. G. Jioa (Eds.), Toward a broader understanding of stress and coping (pp. 169–211). Charlotte, NC: Information Age.
  • Oxman, A. D., & Guyatt, G. H. (1991). Validation of an index of the quality of review articles. Journal of Clinical Epidemiology, 44, 1271–1278. doi:10.1016/0895-4356(91)90160-B
  • Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004, August). Realist synthesis: An introduction. Submitted to the ESRC Research Methods Programme Working Paper Series. Manchester: University of Manchester.
  • Pawson, R., & Tilley, N. (1997). Realistic synthesis. London: Sage.
  • Pawson, R., & Tilley, N. (2004). Realist evaluation. Retrieved from http://www.communitymatters.com.au/RE_chapter.pdf
  • Pearson, A., White, H., Bath-Hextall, F., Apostolo, J., Salmond, S., & Kirkpatrick, P. (2014). Methodology for JBI mixed methods systematic reviews. The Joanna Briggs Institute Reviewers Manual, 1, 5–34.
  • Pearson, K. (1904). Report on certain enteric fever inoculation statistics. British Medical Journal, 3, 1243–1246.
  • Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M., & Duffy, S. (2006). Guidance on the conduct of narrative synthesis in systematic reviews: A product from the ESRC Methods Programme. Retrieved from http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CCAQFjAA&url=http%3A%2F%2Fwww.researchgate.net%2Fpublication%2F233866356_Guidance_on_the_conduct_of_narrative_synthesis_in_systematic_reviews_A_product_from_the_ESRC_Methods_Programme%2Flinks%2F02e7e5231e8f3a6183000000&ei=dxgDVJSQAs7xgwSmkIDICg&usg=AFQjCNG97hf0MYGSm3TxXXi1AiacHfCuUg&sig2=21zLZd8SF5FjOoOdjtMLLw&bvm=bv.74115972,d.eXY
  • Porta, M. (2008). A dictionary of epidemiology (5th ed.). London: Oxford University Press.
  • Ramanadhan, S., Mendez, S. R., Rao, M., & Viswanath, K. (2013). Social media use by community-based organizations conducting health promotion: A content analysis. BioMedCentral Public Health, 13, 1129–1138.
  • Rathbone, A. P., Todd, A., Jamie, K., Bonam, M., Banks, L., & Husband, A. K. (2016). A systematic review and thematic synthesis of patients' experience of medicines adherence. research in social and administrative pharmacy 13, 403-439. dos: 10.1016/j.ijpsycho.2011.12.010. Sapharm, 2016(06), 004.
  • Ritchie, J., & Spencer, L. (1994). Qualitative data analysis for applied policy research. In A. Bryman & R. G. Burgess (Eds.), Analysing qualitative data (pp. 172–194). London: Routledge.
  • Roberts, M., & McFerran, K. (2008). Music therapy in the Australian print media: A content analysis. Australian Journal of Music Therapy, 19, 27–42.
  • Rodgers, M., Sowden, A., Petticrew, M., Arai, L., & Roberts, H. (2009). Testing methodological guidance on the conduct of narrative synthesis in systematic reviews: Effectiveness of interventions to promote smoke alarm ownership and function. Evaluation, 15, 47–71. doi:10.1177/1356389008097871
  • Rohrmeier, M. A., & Koelsch, S. (2012). Predictive information processing in music cognition: A critical review. International Journal of Psychophysiology, 83, 164–175. doi:10.1016/j.ijpsycho.2011.12.010
  • Rueda, J. R., Pascual, A., & Subirana Casacuberta, M. (2011). Non-invasive interventions for improving well-being and quality of life in patients with lung cancer. Cochrane Database of Systematic Reviews, 2011(9), CD004282. doi:10.1002/14651858.CD004282.pub3
  • Rust, H. (1983). Inhaltsanalyse: Die Praxis der indirekten Interaktionsforschung in Psychologie und Psychotherapie (Content analysis: The practice of indirect interaction research in psychology and psychotherapy). München: Urban & Schwarzenberg.
  • Rycroft-Malone, J., Seers, K., Titchen, A., Harvey, G., Kitson, A., & McKormack, B. (2003). What counts as evidence in evidence-based practice? Nursing and Health Care Management and Policy, 47, 81–90.
  • Sandelowski, M., Barroso, J., & Voils, C. I. (2007). Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. Research in Nursing and Health, 30, 99–111. doi:10.1002/nur.20176
  • Savin-Baden, M., & Wimpenny, K. (2014). A practical guide to arts-related research. Roggerdam: SENSE.
  • Schmidt, C. K., Raque-Bogdan, T. L., Piontkowski, S., & Schaefer, K. L. (2011). Putting the positive in health psychology: A content analysis. Journal of Health Psychology, 16, 607–620. doi:10.1177/1359105310384296
  • Schrank, B., Bird, V., Tylee, A., Coggins, T., Rashid, T., & Slade, M. (2013). Conceptualising and measuring the well-being of people with psychosis: Systematic review and narrative synthesis. Social Science & Medicine, 92, 9–21. doi:10.1016/j.socscimed.2013.05.011
  • Scott, S. C. E., & Kidd, A. C. (2016). A scoping review of music and anxiety, depression and agitation in older people with dementia in residential facilities and specialist care units. European Geriatric Medicine, 7(5), 488–491. doi:10.1016/j.eurger.2016.07.007
  • Sena Moore, K. (2013). A systematic review on the neural effects of music on emotion regulation: Implications for music therapy practice. Journal of Music Therapy, 50, 198–242. doi:10.1093/jmt/50.3.198
  • Shaw, R. L., Holland, C., Pattison, H. M., & Cooke, R. (2016). Patients’ perceptions and experiences of cardiovascular disease and diabetes prevention programmes: A systematic review and framework synthesis using the theoretical domains framework. Social Science & Medicine, 156, 192–203. doi:10.1016/j.socscimed.2016.03.015
  • Skewes McFerran, K., Hense, C., Medcalf, L., Murphy, M., & Fairchild, R. (2017). Integrating emotions into the critical interpretive synthesis. Qualitative Health Research, 27. Retrieved from http://journals.sagepub.com/doi/full/10.1177/1049732316639284
  • Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011). Methodology in conducting a systematic review of systematic reviews of healthcare interventions. Bio Med Central Research Methodology, 11. doi:10.1186/1471-2288-11-15.
  • Solesbury, W. (2002). The ascendancy of evidence. Planning Theory and Practice, 3, 90–96. doi:10.1080/14649350220117834
  • Solli, H. P., Rolvsjord, R., & Borg, M. (2013). Toward understanding music therapy as a recovery-oriented practice within mental health care: A meta-synthesis of service users’ experiences. Journal of Music Therapy, 50, 244–273. doi:10.1093/jmt/50.4.244
  • Standley, J. (2012). Music therapy research in the NICU: An updated meta-analysis. Neonatal Network, 31, 311–316. doi:10.1891/0730-0832.31.5.311
  • Standley, J. M. (1986). Music research in medical/dental treatment: Meta-analysis and clinical applications. Journal of Music Therapy, 23, 56–122. doi:10.1093/jmt/23.2.56
  • Standley, J. M. (2002). A meta-analysis of the efficacy of music therapy for premature infants. Journal of Pediatric Nursing, 17(2), 107–113. doi:10.1053/jpdn.2002.124128
  • Starr, M., Chalmers, I., Clarke, M., & Oxman, A. D. (2009). The origins, evolution, and future of the cochrane database of systematic reviews. International Journal of Technology Assessment in Health Care, 25(Supplement 1), 182–195.
  • Stern, P., & Harris, C. (1985). Women’s ‬health ‬and ‬the ‬self-care ‬paradox: A model ‬to ‬guide ‬self-care ‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬readiness – ‬clash between ‬the ‬client and nurse. Health ‬Care ‬For ‬Women ‬International, 6, 151–163.
  • Sterne, J. A., Jüni, P., Schulz, K. F., Altman, D. G., Barlett, C., & Egger, M. (2002). Statistical methods for assessing the influence of study characteristics on treatment effects in ‘meta-epidemiological’ research. Statistics in Medicine, 21, 1513–1524. doi:10.1002/sim.1184
  • Stevens, K. R. (2001). Systematic reviews: The heart of evidence-based practice. American Association of Clinical-Care Nurses (AACN) Clinical Care, 12, 529–538.
  • Strutt, J. W. (1885). Address. Report of the Annual Meeting. British Association for the Advancement of Science, 54, 1–23.
  • Tallentire, V. R., Smith, S. E., Skinner, J., & Cameron, H. S. (2015). Exploring patterns of error in acute care using framework analysis. Bio Med Central Medical Education, 15(3). doi:10.1186/s12909-015-0285-6.
  • Tang, H. Y., & Vezeau, T. (2010). The use of music intervention in healthcare research: A narrative review of the literature. Journal of Nursing Research, 18(3), 174–190. doi:10.1097/JNR.0b013e3181efe1b1
  • Thomas, D. R., & Thomas, Y. L. (2014). Interventions to reduce injuries when transferring patients: A critical appraisal of reviews and realist synthesis. International Journal of Nursing Studies, 51, 1381–1394. doi:10.1016/j.ijnurstu.2014.03.007
  • Thomas, J., & Harden, A. (2008). Methods for the thematic synthesis of qualitative research in systematic reviews. Bio Med Central Medical Research Methodology, 8. doi:10.1186/1471-2288-8-45.
  • Thomas, J., Harden, A., & Newman, M. (2012). Synthesis: Combining results systematically and appropriately. In D. Gough, S. Oliver, & J. Thomas (Eds.), An introduction to systematic reviews (pp. 179–226). London: Sage.
  • Thomas, J., Sutcliffe, K., Harden, A., Oakley, A., Oliver, S., & Kavanagh, J. (2003). Children and healthy eating: A systematic review of barriers and facilitators. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London.
  • Trinquart, L., Dechartres, A., & Ravaud, P. (2013). Commentary: Meta-epidemiology, meta-meta epidemiology, or network meta-epidemiology? International Journal of Medical Epidemiology, 42, 1131–1133. doi:10.1093/ije/dyt137
  • Tzoulaki, I. (2011). Prognostic effect size of cardiovascular biomarkers in datasets from observational studies versus randomised trials: Meta-epidemiology study. British Medical Journal, 343. doi:10.1136/bmj.d6829
  • Van Belle, S. (2016). What can we learn on public accountability from non-health disciplines: A meta-narrative review. British Medical Journal Open, 6(7). Retrieved from http://bmjopen.bmj.com/content/6/7/e010425
  • Van Dalen, E. C., Mank, A., Leclercq, E., Mulder, R. L., Davies, M., Kersten, M. J., & van de Wetering, M. D. (2012). Low bacterial diet versus control diet to prevent infection in cancer patients treated with chemotherapy causing episodes of neutropenia. Cochrane Database of Systematic Reviews, 2012(9), CD006247. doi:10.1002/14651858.CD006247.pub2.
  • Virues-Ortega, J., Julio, F. M., & Pastor-Barriuso, R. (2013). The TEACCH program for children and adults with autism. A meta-analysis of intervention studies. Clinical Psychology Review, 33, 940–953. doi:10.1016/j.cpr.2013.07.005
  • Walsh, D., & Downe, S. (2005). Meta-synthesis method for qualitative research: A literature review. Journal of Advanced Nursing, 50, 204–211. doi:10.1111/jan.2005.50.issue-2
  • Wang, H., & Yeh, M. C. (2012). Psychological resistance to insulin therapy in adults with type 2 diabetes: Mixed-method systematic review. Journal of Advanced Nursing, 68, 743–757. doi:10.1111/j.1365-2648.2011.05853.x
  • Ward, D. J., Furber, C., Tierney, S., & Swallow, V. (2013). Using Framework Analysis in nursing research: A worked example. Journal of Advanced Nursing, 69, 2423–2431.
  • Whittemore, R., & Knafl, K. (2005). The integrative review: Updated methodology. Journal of Advanced Nursing, 52, 546–553. doi:10.1111/jan.2005.52.issue-5
  • Williams, A. L. (2006). Perspectives on spirituality at the end of life: A meta-summary. Palliative and Supportive Care, 4, 407–417. doi:10.1017/S1478951506060500
  • Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013a). RAMESES publication standards: Meta-narrative reviews. BMC Medicine, 11(20), 1–15.
  • Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013b). RAMESES publication standards: Realist synthesis. BMC Medicine, 11, 21. doi:10.1186/1741-7015-11-21
  • Wright Mills, C. (1959). The sociological imagination. New York: Oxford University Press.
  • Yazdani, S., Lakeh, M. A., Ahmady, S., Foroutan, A., & Afshar, L. (2015). Critical interpretive synthesis of the concept of value in medical education. Research & Development in Medical Education, 4, 31–34. doi:10.15171/rdme.2015.005
  • Zhang, W. (2010). Meta-epidemiology: Building the bridge from research evidence to clinical practice. Osteoarthritis Cartilage, 18(Suppl 2), S1. doi:10.1016/S1063-4584(10)00293-1

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.