2,044
Views
0
CrossRef citations to date
0
Altmetric
Genomics

Toward genetic counseling practice standards for diagnostic testing in amyotrophic lateral sclerosis and frontotemporal dementia

ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Pages 562-574 | Received 19 Jan 2022, Accepted 28 Feb 2022, Published online: 27 Mar 2022

Abstract

Objective: Genetic counseling and diagnostic genetic testing are considered part of the multidisciplinary care of individuals with amyotrophic lateral sclerosis (ALS) and frontotemporal dementia (FTD). We aimed to investigate the ideal components of genetic counseling for ALS/FTD diagnostic testing amongst various stakeholders using an online, modified Delphi survey. Methods: Experts in genetic counseling and testing for ALS/FTD were purposively then snowball recruited and included genetic health professionals, health professionals outside of genetics and consumer experts (patients, relatives, and staff representatives from ALS/FTD support organizations). First-round items were informed by two systematic literature reviews and qualitative interviews with patients and families who had experienced diagnostic testing. Analysis of each round informed the development of the subsequent round and the final results. Results: Forty-six experts participated in the study, 95.65% completed both rounds. After round one, items were updated based on participant responses and were presented again for consensus in round two. After round two, a high level of consensus (≥80% agreement) was achieved on 16 items covering various topics related to genetic counseling service delivery, before and after diagnostic testing is facilitated. Conclusions: Genetic counseling for individuals with ALS/FTD and their families should include the provision of client-centered counseling, education and support throughout. The items developed are adaptable to varied healthcare settings and may inform a standard of genetic counseling practice for health professionals who facilitate testing and counseling discussions. This area of work is timely, given demand for testing is likely to increase as more genotype-driven clinical trials become available.

Introduction

As genotype-targeted therapy trials emerge for amyotrophic lateral sclerosis (ALS) and frontotemporal dementia (FTD), availability and interest in genetic testing will likely increase (Citation1). Diagnostic testing is the initial genetic testing performed in families to search for a pathogenic variant (mutation). Diagnostic testing may occur as part of the process of confirming a clinical diagnosis of ALS/FTD in an individual, or later, after a clinical diagnosis is made to confirm whether a familial ALS/FTD pathogenic variant is present. Genetic counseling enables clients to make informed testing decisions while minimizing adverse outcomes and should accompany any genetic testing discussion. However, the amount of counseling required or recommended is unknown (Citation2). We sought input from health professionals (HPs) and consumers to develop practice standards for genetic counseling when offering diagnostic testing for ALS and/or FTD.

Pathogenic variants in several genes associated with ALS, FTD, or both ALS and FTD have been identified (Citation3,Citation4). Approximately 20% of ALS and FTD patients have pathogenic/likely pathogenic variants (Citation5,Citation6), and family history cannot be relied upon to confirm the presence of all pathogenic variants (Citation7,Citation8). Consequently, offering diagnostic testing to all individuals with ALS/FTD is increasingly recommended (Citation3,Citation4). In addition to providing the opportunity for certain patients to be involved in emerging genotype-targeted therapy trials (Citation9), detection of a pathogenic variant provides relatives with the option to clarify their risk through predictive/presymptomatic genetic testing or to inform future family planning decisions through reproductive genetic testing. Clinical trials are being developed for presymptomatic carriers (Citation10), and requests for predictive testing are increasing (Citation11).

The decision of whether or not to proceed with testing is informed by personal, familial, and practical factors (Citation2). Genetic counseling is a communication process that accompanies genetic testing and integrates the following four goals:

  • Interpretation of family and medical histories to assess the chance of disease occurrence/recurrence (Citation12,Citation13).

  • Education about a condition’s natural history, inheritance pattern, testing, management, prevention, support resources, and research (Citation12,Citation13).

  • Counseling to promote informed choices in view of risk assessment, family goals, ethical and religious values (Citation12–14).

  • Support to encourage the best possible adjustment to the disorder and/or the risk of recurrence (Citation13,Citation14).

Genetic counseling and diagnostic testing practice in ALS/FTD may differ depending on the context in which testing is undertaken (Citation2,Citation15). As not all individuals with ALS/FTD have the capacity to consent for diagnostic testing, carers and/or relatives may be required to consent on the patient’s behalf (Citation16). The client responsible for discussing diagnostic testing therefore may be the patient, their relative/s and/or carer/s. Thus, the process and outcomes of diagnostic testing may concern the patient and others (Citation17,Citation18).

There is no consensus on how genetic counseling should be facilitated in diagnostic testing for ALS/FTD (Citation2). Guidelines for diagnostic testing of other adult-onset neurodegenerative diseases have been developed (Citation19) but additional challenges may arise in genetic counseling for ALS/FTD due to clinical and genetic heterogeneity, resulting in greater uncertainty for families (Citation2). Neurology followed by clinical genetics teams most commonly facilitates diagnostic testing, but this differs depending on local resources and guidelines (Citation20). Despite the potential benefits of genetic counseling and testing for the patient and family, many HPs who specialize outside genetics do not feel confident engaging in genetic testing and counseling discussions and lack resources to direct them (Citation21). Access to genetic counseling and testing is considered a fundamental right of people living with ALS (Citation22) yet, it is not consistently offered. ALS clinicians have indicated that they would be more likely to offer testing if guidelines were available (Citation23). There is little data on the offer or uptake of testing and counseling in patients with FTD (Citation2,Citation11).

The aim of this study was to investigate the extent of consensus on the ideal components of genetic counseling for ALS/FTD diagnostic genetic testing amongst various stakeholders using an online, modified Delphi survey. We hope that results will inform practice standards for HPs offering genetic counseling for ALS/FTD, generate discussion regarding the implementation of genetic counseling in practice, and better support individuals with ALS/FTD and their families. Although diagnostic testing can also occur in asymptomatic relatives of ALS/FTD patients (for example, when a person with ALS/FTD is unavailable to be tested), these situations have not been considered in detail in this study as they require a modified predictive/presymptomatic testing genetic counseling protocol (Citation24).

Materials and methods

This study was approved by the University of Technology Sydney (UTS) Human Research Ethics Committee (ETH20-5122/ETH21-5883). The Delphi is a structured, iterative, multi-round survey method that aims to (as objectively as possible) facilitate group consensus from a diverse range of experts on a particular topic (Citation25,Citation26). Each round builds on the previous results, allowing participants to reconsider their views based on the input of others (Citation26). As motor neurone disease (MND) is the preferred term for ALS in some locations, all study information included both terms.

Recruitment

We recruited a diverse range of participants from one of three expert subgroups with experience in ALS, FTD, genetic testing and counseling (). All identified experts were forwarded an invitation email. Those interested were emailed an information sheet and demographic/eligibility survey. The survey gathered relevant demographic data and confirmed consent and availability to participate. If no response was received upon forwarding these emails, potential participants were emailed again once.

Table 1 Expert definitions and recruitment.

Patient and family member participants were required to complete five additional survey questions to ensure informed consent. Participants were eligible for this study if they did not have an enduring medical guardian/power of attorney who made healthcare decisions on their behalf and correctly answered four yes/no questions about the study based on the content of the participant information sheet. This strategy has been used in a recent study on stroke survivors (Citation27) and was used in the qualitative study from which consumers were purposively recruited (unpublished).

Data collection

All survey data were collected between January-May 2021 and managed using REDCap (Research Electronic Data Capture) tools hosted at UTS (Citation28,Citation29). Participants’ unique survey links allowed them to save and return to it at any time. Each round was open for three weeks, with three weeks allocated between rounds for data analysis and development of the next survey (Citation26). A maximum of three rounds were planned. Non-completers were forwarded email reminders 7, 14, and 21 days after the initial invitation for that round. Those who had not completed the survey 48 hours after closing were not eligible to complete the next round.

The survey components for both rounds are listed in supplementary table 1. Participants were asked to rate the importance of certain items using a five-point Likert scale based on their expertise rather than any possible limits to service access in their region. They were also asked to consider their responses for all client types (patient/family member/carer). Free-text boxes were available to elaborate on responses, add new items or suggest changes to the wording. Participants could choose to select their answer for all situations where diagnostic testing is arranged, or they could respond differently depending on whether an individual was likely to have familial or sporadic disease. Some items in round one also had the option to select one or more discrete-time categories, but this was removed in round two due to several comments suggesting this was difficult to generalize. To ensure that consensus was not forced, all questions had the option to select ‘I don’t know’. In round two, the survey included a summary of the results and changes made from round one, including the percentage agreement stratified between the three expert groups. A supporting information document was available in both rounds and included further instructions, key definitions, and a complete list of the items developed (supplementary files 1 and 2).

Twenty items were generated for round one (supplementary table 2), informed by the results of the primary author’s systematic and scoping literature reviews (Citation2,Citation20) and the preliminary outcomes of a qualitative study about experiences of diagnostic testing for ALS/FTD amongst patients and their family members (unpublished). Consultation and piloting took place with representatives from the target groups before dissemination to ensure functionality and clarity (Citation26). At round two, no items were removed or added. Instead, four items were merged with others, resulting in 16 updated items for review (supplementary table 2). Updated items were developed in discussion with all coauthors accounting for the lack of consensus to the discrete-time categories, the number of times the suggestion was made, and the relevance to how the suggested change affected the wording/meaning. A planned round three was not required as all items reached consensus. Minor changes to item wording were considered following round two and are detailed in the results and discussion.

Data analysis

Survey responses from each of the three participant groups were assessed and summarized after each round. Quantitative data were reported using descriptive statistics only. Consensus was defined as ≥ 75% agreement (Citation30). Discrete variables (differences between time of discussion and case characteristics) were reported as counts and percentages. Continuous variables (the Likert scale) were reported as mean, median, and range scores and percentages. Consensus for the Likert scale questions was considered if ≥75% of participants scored the question within the top 2 (strongly agree/agree) or bottom 2 (strongly disagree/disagree). Free text responses were analyzed and used to illustrate conflicts or confusion over the items and inform changes to the item’s wording in the subsequent round.

Results

Ninety-one possible participants were purposively identified and directly approached. An additional 30 were approached after snowball sampling. Although 52 expressed interest in the study, only 47 completed the demographics and eligibility survey within the required timeframe. One genetic HP did not fulfill the inclusion criteria and was excluded. In total, 46 participants were eligible to participate in round one (). No HPs or ALS/FTD association staff (from the consumer group) had personally undergone genetic counseling for ALS/FTD genes.

Table 2 Study participant demographics.

Outcomes from round one

Forty-six participants (100%) completed round one (supplementary table 2). In total, 16 of the 20 items achieved ≥75% consensus agreement that they were important. As there was minimal agreement to the timing question within and between groups, comments about timing were subsequently incorporated into relevant items in round two, and the timing question was removed. Three hundred and seventy unique free-text responses were also provided across the 20 items and in the final comments box (mean 17.62 per item, 8.04 per participant).

Outcomes from round two

Forty-four participants completed round two (95.65% completion rate: 96% Genetics HPs, 100% HPs outside genetics and 90.91% consumers). A consensus agreement of at least 80% was reached for every item across all participant groups ( and Citation4; supplementary table 2). One hundred twenty-seven unique free-text responses were provided across the 16 items and in the final comments box (mean 7.47 per item, 2.89 per participant). A summary of the additional changes to consider is outlined with the final consensus items in and . demonstrates how one item evolved throughout the Delphi process.

Figure 1 Visual outline demonstrating the development of one of the consensus items.

Figure 1 Visual outline demonstrating the development of one of the consensus items.

Table 3 Approaches to practice items presented for review in round two, subsequent results and considerations.

Table 4 Discussion and exploration items presented for review in round two, subsequent results and considerations.

Unresolved issues raised by participants

In both rounds, the free-text comments included suggestions for changes to the wording or content and further justifications to the quantitative responses provided. Fewer suggestions for changes to wording or content were made in round two, summarized briefly in and Citation4, and in detail in supplementary table 2.

Participants across all expert groups also flagged challenges related to the items being applied in clinical practice. Some cited financial cost as a barrier; others reported difficulties accessing adequate clinicians or time due to resource limitations. Participants also commented about difficulties generalizing these items to all clients as their needs could vary due to patient and family circumstances, disease progression (i.e., the patient’s cognitive capacity and concurrent medical needs), the pretest likelihood that a pathogenic variant will be detected (i.e., those with likely sporadic vs likely familial disease), and the subsequent genetic testing results (i.e., whether a pathogenic variant was detected and the resulting residual likelihood of familial disease). Some participants were also unsure that exploring and assessing the client’s access to support was a role for the genetic counseling provider but agreed it was a necessary part of ALS/FTD care.

Discussion

This study aimed to investigate the extent of consensus amongst HP and consumer experts on the ideal components of genetic counseling for diagnostic genetic testing in ALS and FTD. Over two Delphi survey rounds, items were developed that covered the genetic counseling goals of interpretation, education, counseling and support (Citation12–14). At least 80% consensus was reached within and between expert groups on each of the 16 items presented in round two, demonstrating high endorsement that these 16 items are important for genetic counseling as part of the diagnostic testing process. Participants across all expert groups emphasized the need to tailor all genetic counseling and testing discussions to the client’s current circumstances, highlighting the need to be flexible and client-centered. This message was incorporated in several of the final consensus items, highlighting areas where what is specifically said or provided (and when) could be flexible (e.g., exploring and addressing family communication) and where more rigidity was required (e.g., discussing the voluntary nature of proceeding with testing). Some items were not unique to genetic counseling practice (e.g., exploring access to support) and were important for general ALS/FTD care and management. These consensus items could form a practice standard or core set of principles for HPs providing genetic counseling regarding ALS/FTD diagnostic genetic testing, both before testing, during the decision to undergo testing, when discussing results and facilitating family communication. In saying this, although experts were instructed to respond based on their opinion regarding best practice, several commented that operationalizing these items in routine clinical practice would be difficult. Therefore, the items developed and the issues raised have implications for both clinical practice and research.

Delivery of information in a collaborative, compassionate and client-centered manner is an important genetic counseling outcome (Citation31). This sentiment is echoed in the Huntington’s disease diagnostic testing and counseling approach (Citation19), where a flexible practice tailored to the client’s unique circumstances is recommended. In the context of diagnostic testing for ALS/FTD, clients will likely receive genetic counseling at the same time as other disease-related stressors such as a new diagnosis or coping with the symptoms associated with these progressive conditions. Therefore, genetic counseling regarding diagnostic testing may not be experienced in isolation from other aspects of healthcare. Exploring and assessing the client’s access to support is considered an important part of care, regardless of whether this is part of the genetic counseling consultation or another aspect of multidisciplinary care (Citation32,Citation33).

Many participants noted that the way genetic counseling is provided is difficult to standardize, and a one size fits all approach to both clients and health systems is unlikely to work. Alternative ways to deliver genetic counseling must be considered to improve efficiency and overcome resource barriers, allowing more clients to benefit from genetic counseling (Citation34). The global shortage of genetics HPs, as well as the increased availability of testing, means that HPs from outside disciplines provide some or all aspects of genetic counseling (Citation20,Citation35). Several HP participants commented that neurology and clinical genetics team members work together to provide genetic counseling in their practice. One form of this is ‘mainstreaming’, where HPs specializing outside of genetics initiate genetics discussions, and genetics HPs become involved in interpreting and discussing results and implications if required. Mainstreaming can result in more efficient access to results and their implications, such as targeted treatments or predictive testing (Citation21). Another means to access genetic counseling is through private testing laboratories that have genetic counseling as an included service. However, this could result in a conflict of interest, given genetic testing doesn’t always align with the client and health provider’s needs (Citation36). Additional innovative ways to increase efficiency include utilizing technology or creating standardized support or information resources to automate parts of the genetic counseling process, allowing more time to focus on client-specific issues and questions (Citation2,Citation20,Citation34,Citation37). The development of resources may also benefit clients who wish to seek information or support but not actively engage in a formal genetic counseling discussion (Citation2). Geographical barriers could also be addressed through telephone or telehealth consultations (Citation20,Citation38,Citation39). Regardless of how genetic counseling is provided, and by whom, the results demonstrate that all HPs who provide genetic counseling regarding diagnostic testing should be equipped with adequate knowledge about genetic testing and its implications, the communication skills to discuss and explore the issues that may arise, and the time to provide care that is client-centered. Genetic counselors are HPs who can provide this as part of multidisciplinary care in some countries (Citation40).

The items developed reached a high level of consensus amongst HP and consumer experts. They could be considered a standard of practice for the various HPs who provide some or all aspects of genetic counseling regarding ALS/FTD diagnostic testing. The items developed are adaptable to all kinds of diagnostic testing provided in ALS/FTD, such as single-gene testing, multigene panel testing, whole exome or genome testing, and in varied clinical and research testing settings where results are returned to the client and their family. Once implemented in practice, these standards would need to be formally evaluated by HPs and consumers. Additional issues in the genetic counseling and testing process that were not the focus of the study were mentioned by participants and present as an area of future research interest (e.g., the best approach to testing, the terminology used for sporadic/simplex/singleton cases, reanalysis and variant interpretation) (Citation2,Citation41).

Strengths and limitations

A strength of this study was the high response rate and engagement from expert participants, with multiple comments made in each round and only two participants not proceeding with round two. The Delphi consensus approach allowed us to involve all relevant and interested participants from several different expert groups (Citation42). Unfortunately, more varied participant perspectives may have been missing for two reasons. Firstly, recruitment occurred when the COVID-19 pandemic was affecting health systems differently. We speculate that there may have been greater HP expert involvement from some parts of the world (e.g., the United Kingdom) should recruitment have occurred at a different time. Secondly, the consumer group was not representative of all genetic counseling consumers as only one patient and five family members were recruited. In addition, consumers were recruited from Australia only and had greater experience with ALS than FTD and familial compared with sporadic disease. The consumer group was combined to include both representatives of support associations and patients and family members. There may have been benefits of splitting the groups, but the sample size was not large enough. The study was set up to rate item importance but not prioritize them. Prioritizing may have been helpful to guide a minimum standard and may be another area of future research.

Conclusion

A high level of consensus was demonstrated amongst HP and consumer experts regarding the ideal components of genetic counseling regarding diagnostic testing in ALS/FTD. Genetic counseling should include the provision of counseling, education and support in a client-centered way to support individuals with ALS/FTD and their families throughout the diagnostic testing process. Given various health systems and resource limitations, innovative and tailored approaches may be beneficial in implementing genetic counseling as part of routine care. These consensus items are adaptable to varied clinical situations and may inform a standard of genetic counseling practice for the various health professionals who facilitate diagnostic genetic testing and counseling discussions in ALS/FTD. This area of work is timely, given the demand for genetic testing is likely to increase as more genotype-driven clinical trials become available in ALS and FTD.

Supplemental material

Supplemental Material

Download PDF (677.2 KB)

Supplemental Material

Download PDF (210.6 KB)

Supplemental Material

Download PDF (518 KB)

Supplemental Material

Download PDF (217.8 KB)

Supplemental Material

Download PDF (172.4 KB)

Acknowledgements

The authors would like to thank all study participants and those involved in the consultation and piloting of the surveys. We would also like to thank Dr Emma Power, speech pathologist and academic at the University of Technology Sydney, who provided guidance on conducting research with individuals with cognitive and communication impairments.

Declaration of interest

The authors have no competing interests to declare.

References

  • Benatar M, Polak M, Kaplan S, Glass J. Preventing familial amyotrophic lateral sclerosis: is a clinical trial feasible? J Neurol Sci. 2006;251:3–9.
  • Crook A, Jacobs C, Newton-John T, Richardson E, McEwen A. Patient and relative experiences and decision-making about genetic testing and counseling for familial ALS and FTD: a systematic scoping review. Alzheimer Dis Assoc Disord. 2021;35:374–85.
  • Roggenbuck J, Fong JC. Genetic testing for amyotrophic lateral sclerosis and frontotemporal dementia: impact on clinical management. Clin Lab Med. 2020;40:271–87.
  • Turner MR, Al-Chalabi A, Chio A, Hardiman O, Kiernan MC, Rohrer JD, et al. Genetic screening in sporadic ALS and FTD. J Neurol Neurosurg Psychiatry. 2017;88:1042–4.
  • Shepheard SR, Project MinE, Parker MD, Cooper-Knock J, Verber NS, Tuddenham L, Heath P, et al. Value of systematic genetic screening of patients with amyotrophic lateral sclerosis. J Neurol Neurosurg Psychiatry. 2021;92:510–18.
  • Blauwendraat C, Wilke C, Simón-Sánchez J, Jansen IE, Reifschneider A, Capell A, et al. The wide genetic landscape of clinical frontotemporal dementia: systematic combined sequencing of 121 consecutive subjects. Genet Med. 2018;20:240–9.
  • Brown CA, Lally C, Kupelian V, Flanders WD. Estimated prevalence and incidence of amyotrophic lateral sclerosis and SOD1 and C9orf72 genetic variants. Neuroepidemiology 2021;55:342–53.
  • Müller K, Oh KW, Nordin A, Panthi S, Kim SH, Nordin F, et al. De novo mutations in SOD1 are a cause of ALS. J Neurol Neurosurg Psychiatry. 2022;93:201–6.
  • Miller T, Cudkowicz M, Shaw PJ, Andersen PM, Atassi N, Bucelli RC, et al. Phase 1-2 trial of antisense oligonucleotide Tofersen for SOD1 ALS. N Engl J Med. 2020;383:109–19.
  • ClinicalTrials.gov. A Study of BIIB067 When Initiated in Clinically Presymptomatic Adults With a Confirmed Superoxide Dismutase 1 Mutation (ATLAS). In: (US) NLoM, editor. Bethesda (MD)2021.
  • Amador MM, Gargiulo M, Boucher C, Herson A, Staraci S, Salachas F, et al. Who and why? requests for presymptomatic genetic testing for amyotrophic lateral sclerosis/frontotemporal dementia vs Huntington disease. Neurol Genet. 2021;7:e538.
  • Resta R, National Society of Genetic Counselors' Definition Task Force, Biesecker BB, Bennett RL, Blum S, Estabrooks Hahn S, Strecker MN, et al. A new definition of genetic counseling: National Society of Genetic Counselors' Task Force report. J Genet Couns. 2006;15:77–83.
  • Human Genetics Society of Australasia H. Guideline: Process of Genetic Counseling. Australia; 2012 2012. Contract No.: 2012GL02.
  • Ad Hoc Committee on Genetic Counseling ASoHG. Genetic counseling. Am J Hum Gen 1975;27:240–2.
  • Cairns LM, Rankin J, Hamad A, Cooper N, Merrifield K, Jain V, et al. Genetic testing in motor neuron disease and frontotemporal dementia: a 5-year multicentre evaluation. J Med Genet. 2021;jmedgenet-2021-107776.
  • Mantero V, Tarlarini C, Aliprandi A, Lauria G, Rigamonti A, Abate L, et al. Genetic counseling dilemmas for a patient with sporadic amyotrophic lateral sclerosis, frontotemporal degeneration & Parkinson's disease. J Genet Couns. 2017;26:442–6.
  • Rolf B, Blue EE, Bucks S, Dorschner MO, Jayadev S. Genetic counseling for early onset and familial dementia: patient perspectives on exome sequencing. J Genet Couns 2021;30: 793–802.
  • Mendes Á, Metcalfe A, Paneque M, Sousa L, Clarke AJ, Sequeiros J. Communication of information about genetic risks: putting families at the center. Fam Process. 2018;57:836–46.
  • Craufurd D, Working Group on Genetic Counselling and Testing of the European Huntington's Disease Network (EHDN), MacLeod R, Frontali M, Quarrell O, Bijlsma EK, Davis M, et al. Diagnostic genetic testing for Huntington's disease. Pract Neurol. 2015;15:80–4.
  • Crook A, Jacobs C, Newton-John T, O’Shea R, McEwen A. Genetic counseling and testing practices for late-onset neurodegenerative disease: a systematic review. J Neurol. 2022;269:676–92.
  • White S, Jacobs C, Phillips J. Mainstreaming genetics and genomics: a systematic review of the barriers and facilitators for nurses and physicians in secondary and tertiary care. Genet Med. 2020;22:1149–55.
  • International Alliance of ALS/MND Associations T. Fundamental rights for people living with ALS/MND 2021 [updated April 2021. Available from: https://www.als-mnd.org/support-for-pals-cals/advocacy/pals-and-cals-rights/.
  • Klepek H, Nagaraja H, Goutman SA, Quick A, Kolb SJ, Roggenbuck J. Lack of consensus in ALS genetic testing practices and divergent views between ALS clinicians and patients. Amyotroph Lateral Scler Frontotemporal Degener. 2019;20:216–21.
  • Goldman J, Xie S, Green D, Naini A, Mansukhani MM, Marder K. Predictive testing for neurodegenerative diseases in the age of next-generation sequencing. J Genet Couns 2021;30:553–62. https://doi.org/10.1002/jgc4.1342
  • Chia-Chien H, Brian AS. The Delphi Technique: making sense of consensus. Practical Assessment, Research & Evaluation 2007;12:1–8.
  • Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32:1008–15.
  • McGrath M, Lever S, McCluskey A, Power E. Developing interventions to address sexuality after stroke: findings from a four-panel modified Delphi study. J Rehabil Med. 2019;51:352–60.
  • Harris PA, REDCap Consortium, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.
  • Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap): a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81.
  • Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67:401–9.
  • Redlinger-Grosse K, MacFarlane IM, Cragun D, Zierhut H. A Delphi study to prioritize genetic counseling outcomes: What matters most. J Genet Couns 2021;30:676–92.
  • Weisser FB, Bristowe K, Jackson D. Experiences of burden, needs, rewards and resilience in family caregivers of people living with Motor Neurone Disease/Amyotrophic Lateral Sclerosis: a secondary thematic analysis of qualitative interviews. Palliat Med. 2015;29:737–45.
  • Gentry MT, the LEFFTDS Consortium, Lapid MI, Syrjanen J, Calvert K, Hughes S, Brushaber D, et al. Quality of life and caregiver burden in familial frontotemporal lobar degeneration: analyses of symptomatic and asymptomatic individuals within the LEFFTDS cohort. Alzheimer's & Dementia. 2020;16:1115–24.
  • Stoll K, Kubendran S, Cohen SA. The past, present and future of service delivery in genetic counseling: keeping up in the era of precision medicine. Am J Med Genet C Semin Med Genet. 2018;178:24–37.
  • Ormond KE, Laurino MY, Barlow‐Stewart K, Wessels TM, Macaulay S, Austin J, et al. Genetic counseling globally: where are we now? Am J Med Genet C Semin Med Genet. 2018;178:98–107.
  • Stoll KA, Mackison A, Allyse MA, Michie M. Conflicts of interest in genetic counseling: acknowledging and accepting. Genet Med. 2017;19:864–6.
  • Hawkins Virani AKH, Creighton SM, Hayden MR. Developing a comprehensive, effective patient-friendly website to enhance decision making in predictive testing for Huntington disease. Genet Med. 2013;15:466–72.
  • Fanos JH, Gronka S, Wuu J, Stanislaw C, Andersen PM, Benatar M. Impact of presymptomatic genetic testing for familial amyotrophic lateral sclerosis. Genet Med. 2011;13:342–8.
  • Hawkins AK, Creighton S, Ho A, McManus B, Hayden MR. Providing predictive testing for Huntington disease via telehealth: results of a pilot study in British Columbia, Canada. Clin Genet. 2013;84:60–4.
  • Salmon K, Anoja N, Breiner A, Chum M, Dionne A, Dupré N, et al. Genetic testing for amyotrophic lateral sclerosis in Canada – an assessment of current practices. Amyotroph Lateral Scler Frontotemporal Degener. 2021;1–8.
  • Roggenbuck J, Rich KA, Vicini L, Palettas M, Schroeder J, Zaleski C, et al. Amyotrophic lateral sclerosis genetic access program: paving the way for genetic characterization of ALS in the clinic. Neurol Genet. 2021;7:e615.
  • Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003;41:376–82.