4,360
Views
18
CrossRef citations to date
0
Altmetric
Review Article

Critical laboratory values in hemostasis: toward consensus

, , , &
Pages 455-461 | Received 26 Oct 2016, Accepted 29 Dec 2016, Published online: 10 Feb 2017

Abstract

The term “critical values” can be defined to entail laboratory test results that significantly lie outside the normal (reference) range and necessitate immediate reporting to safeguard patient health, as well as those displaying a highly and clinically significant variation compared to previous data. The identification and effective communication of “highly pathological” values has engaged the minds of many clinicians, health care and laboratory professionals for decades, since these activities are vital to good laboratory practice. This is especially true in hemostasis, where a timely and efficient communication of critical values strongly impacts patient management. Due to the heterogeneity of available data, this paper is hence aimed to analyze the state of the art and provide an expert opinion about the parameters, measurement units and alert limits pertaining to critical values in hemostasis, thus providing a basic document for future consultation that assists laboratory professionals and clinicians alike.

    KEY MESSAGES

  • Critical values are laboratory test results significantly lying outside the normal (reference) range and necessitating immediate reporting to safeguard patient health.

  • A broad heterogeneity exists about critical values in hemostasis worldwide.

  • We provide here an expert opinion about the parameters, measurement units and alert limits pertaining to critical values in hemostasis.

Introduction

Laboratory diagnostics plays a crucial role in clinical decision making and managed care of many hemostasis disturbances (Citation1). Total quality in the testing process entails a kaleidoscope of issues, beginning with the appropriateness of test ordering and concluding with the timely and efficient communication of test results to the physicians in charge of the patient (Citation2). Experience acquired throughout the relatively long history of diagnostics testing supports the notion that the majority of diagnostic errors occur in the steps preceding the analysis (i.e. the preanalytical phase) or in those afterwards (i.e. the postanalytical phase), which substantially include transmission of test results and their interpretation (Citation3).

The identification and effective communication of so-called “highly pathological” values has engaged the minds of many clinicians, health care and laboratory professionals for decades, since these activities are vital to good laboratory practice (Citation4). Transmission of critical laboratory values is also included among the list of quality indicators developed by the Working Group on Laboratory Errors and Patient Safety (WG-LEPS) of the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) (Citation5). Despite many efforts having been made to improving laboratory effectiveness and standardization, questions remain around the harmonization of critical values in hemostasis testing.

Definitions

A number of definitions, some specific and others diverse have been developed to outline the concept of “highly pathological” values. The first reliable definition was provided by George D. Lundberg nearly 50 years ago (Citation6), and this has been accepted and echoed by several health care and scientific organizations thereafter. The Joint Commission (JC), an independent and not-for-profit organization aiming to improve patient safety and quality of health care, provides two different definitions of critical values (Citation7). Briefly, “critical test results” are those results always necessitating an immediate communication, even if normal (i.e. within the reference range), whereas “critical values” are those lying significantly outside the normal (reference) range and needing immediate communication to ensure the safeguarding of patient health. This latter definition has been endorsed, with minor changes, by the Clinical and Laboratory Standards Institute (CLSI) (Citation8) and by the Royal College of Pathologists of Australasia (RCPA) – Australasian Association of Clinical Biochemists (AACB) Working Party for High Risk Results (Citation9).

Critical values and hemostasis disturbances

Although few doubts remain about the validity of the definition of critical values, the interpretation provided by the JC of “critical test results” is perhaps more problematic and questionable. Indeed, the vast majority of test results in hemostasis and other areas of laboratory diagnostics are expected to be “normal”, meaning most of them will fall within the limits of the reference range. With the exception of point of care (bedside) testing, routine and specialized hemostasis laboratories are physically separated from the clinical wards, sometimes very distant and not directly interfaced by a laboratory information system (Citation10), thus making it impossible for laboratories to cross check every single laboratory result against the patient’s clinical status. As paradigmatic examples, a normal platelet count (i.e. 250 × 109/L) is commonly observed in daily practice and does not increase the degree of alertness of laboratory professionals. However, what if the day previously the platelet count of the same patient was 600 × 109/L? After excluding preanalytical errors, this would represent a greater than 50% decrease in circulating platelets, thus potentially reflecting the presence of life-threatening conditions such as heparin-induced thrombocytopenia (HIT) (Citation11) or disseminated intravascular coagulation (DIC) (Citation12). Therefore, despite being within the reference range, this must be considered a critical value. Acquired hemophilia (Citation13) and over dosage of unfractioned heparin (UFH) (Citation14) represent other examples of critical test results, both reflecting potential causes of a substantially prolonged value of the activated partial thromboplastin time (APTT) (i.e. APTT ratio frequently over 3.0). The laboratory professional may in such cases be persuaded to contact the clinical teams as soon as possible, since the management of these conditions requires the establishment of a timely and appropriate clinical or therapeutic management. Alternatively, inherited deficiency of factor (F) XII or pre-kallikrein are rather frequent, but clinically meaningless, conditions causing highly elevated APTTs (Citation15). FXII and kallikrein do not actively participate in physiologically meaningful hemostasis, so that individuals with severe deficiency of these proteins are unlikely to develop greater bleeding risk than individuals with normal values. In such cases, the longitudinal comparison of patient’s data would cause laboratories to consider a 3-fold prolongation as a critical test result in a patient whose APTT has always been in the normal range, as well as for a clinically meaningless finding in a totally asymptomatic patient whose APTT value has been high since birth or childhood. Such examples are useful to remind us that “critical values are not only those significantly lying outside the normal (reference) range and necessitating immediate reporting for safeguarding patient’s health,” but also “all those displaying a highly and clinically significant variation over previous data.” As specifically regards hemostasis, both scenarios may translate into an imminent risk of severe bleeding or thrombosis.

The epidemiology of critical values in laboratory and hemostasis testing

In dealing with critical values, an interesting aspect is to establish their real impact in daily laboratory practice, which has been addressed in the recent past by surveys of practice. Dighe et al carried out an interesting analysis at a large US academic medical center, aimed to establish critical value reporting by analyte, laboratory area, clinical condition, and time of day (Citation16). Overall, critical test values represented nearly 0.25% of total results, 31.4% of which were in the domain of laboratory hematology, thereby including hemostasis testing. Predictably, potassium was the most frequent test needing urgent notification (21.2% of all cases), whereas APTT (14.6%) and platelet count (8.3%) were ranked second and third in the list, respectively. Critical values of prothrombin time (PT) were 8th on the list (4.8%). Interestingly, the distribution of critical values calls versus the time of the day revealed a rather consistent pattern, with no significant variations for inpatients and for those admitted to the emergency department (ED) throughout the different hours of the day. Guzmán et al carried out a retrospective survey in a University Hospital of Chile (Citation17), and reported that notification of critical potassium values was the most frequent occurrence (19%), APTT was ranked fourth (10%) and PT fifth (4%). Yang et al carried out a similar analysis in a large tertiary teaching hospital in China (Citation18), observing an overall incidence rate of critical values of 0.96%. Interestingly, communication of critical values for APTT was ranked first (18.3%), followed by PT (15.2%), potassium (14.8%) and platelet count (11.4%). Another important aspect emerging from this study is that the leading diagnoses in inpatients with critical values for the platelet count were platelet diseases, leukemias, liver cirrhosis, gastrointestinal bleeding, and cancer. Unfortunately, no information was provided for causes explaining critical results of other hemostasis parameters. In a subsequent study, Piva et al analyzed data of critical values reporting at an Italian large academic medical center (Citation19) and also found that potassium was the most frequent analysis needing urgent notification (49%), whereas PT (5.5%) and platelet count (4.5%) were ranked fifth and sixth on the list, respectively. Most notably, critical values reporting was associated with modification of clinical management in up to 98% of patients, institution of additional investigations in up to 70% of patients, and closer clinical monitoring in up to 26% of cases, respectively. As specifically regards hemostasis testing, Doering et al recently reported the data of a 5-year retrospective study in five US healthcare facilities (Citation20) and found that reporting of critical values for sodium (51.7%) and potassium (18.1%) had the highest frequency, whereas notification of critical values for PT and APTT had an overall frequency of 7.1% and 3.5%, respectively. A recent survey endorsed by the College of American Pathologists (CAP) in 98 laboratories revealed that critical values reporting for the PT/International Normalized Ratio (INR) involved values comprised between 2.6–5.0 in 57% of all cases, whereas it occurred in 43% of cases for higher values (Citation21).

Overall, from data obtained in these interesting surveys, it can be concluded that reporting of critical values of hemostasis testing (i.e. platelet count, APTT and PT) is a rather frequent occurrence in clinical laboratory practice.

Overview on current practices

Like other areas of diagnostic testing, the practical implementation of critical values reporting in hemostasis testing entails a number of aspects, which can be briefly summarized in three leading domains, pertaining to the type of parameters, their measurement unit and the relative alert thresholds.

At variance with other areas of laboratory medicine and beside platelet count, hemostasis testing has some peculiarities that ultimately contribute to make standardization rather challenging. This especially refers to the peculiar sample matrix (plasma anticoagulated with buffered sodium citrate) and to the high dependence of test results on reagents, instruments and potentially assay standards (e.g. reference pooled normal plasma). Indeed, the adoption of harmonized means of reporting (e.g. ratios for both APTT and PT and the INR for the PT) has greatly improved the process towards standardization but has not allowed resolution of all such problems (Citation22). This is clearly reflected by the dramatic heterogeneity of parameters included in the panel of critical test results and the relative alert limits available in the current scientific literature. An historical survey published by the CAP in 2007 showed that the frequency of hemostasis tests within the local list of critical parameters was rather heterogeneous, with platelet count being included in 96.4% of laboratories, APTT in 94.4%, PT in 90.7%, fibrinogen in 64.8%, but also D-dimer in 25.3% of laboratories (Citation23). In another survey published by the North American Specialized Coagulation Laboratory Association (NASCOLA), the frequency of hemostasis tests within the local list of critical parameters was 89% for APTT, 73% for PT (16% in seconds and 57% in INR), 70% for fibrinogen and only 8% for D-dimer (Citation24). Notably, a survey disseminated by the UK Association of Clinical Biochemists (ACB) reported interesting information about critical values reporting, but was only limited to biochemical analytes (Citation25). Campbell et al recently published a comprehensive literature analysis about the laboratory parameters with most frequently published adult- and non–age-specific alert thresholds (Citation26). Overall, potassium was the most frequently included analyte (present in 62% documents), platelet count was placed sixth in the list (37%), APTT was tenth overall (30%), whereas PT (25%) and fibrinogen (22%) were 14th and 15th, respectively.

Summary of available recommendations

Likewise, the data about the different parameters included in the list, the alert values used for the different analytes are also dramatically varied. summarizes the current recommendations of some scientific organizations along with mean or median limits calculated from large national surveys (Citation8,Citation23,Citation24,Citation26–29). The first aspect that emerges from comparing information is the poor consistency regarding the list of values included in the different documents. Despite APTT always being present, many documents do not include references for the other parameters. Notably, three documents also provide indications about critical values of D-dimer. The second important aspect is the acceptable consensus that has been reached for the measurement units of some parameters (e.g. APTT is always reported in seconds and platelet count in L), whereas for other analytes the situation is quite confusing (e.g. PT is reported either in seconds or as INR). Interestingly, despite current recommendations strongly supporting the reporting of results of hemostasis testing in harmonized measurement units (Citation22), in no case are the thresholds of both the APTT and PT reported as ratios. The third and probably more challenging issue is the broad variability of threshold values. The upper limit of the listed APTT critical values ranges between 75–100 s (i.e. 25% variation), whereas the lower limit of the platelet count is comprised between 20–40 × 109/L (i.e. 2-fold variation). Notably, only one document includes the concept that dynamic variation of some hemostasis tests may also be seen as critical. Specifically, according to Campbell et al., a >50% decrease of the platelet count compared to a previous result or a continual decrease over three consecutive blood collections with total drop >25% should be regarded as critical for diagnosing either HIT or DIC (Citation26).

Table 1. Essential elements of critical laboratory values in hemostasis testing as for current literature.

Expert opinion

Given the heterogeneity of the currently available literature data (Citation30), some expert guidance may be useful to help harmonize current practices across the world. Regarding the panel of putative analytes to be included in the list, we suggest that APTT and PT or INR (both upper threshold), fibrinogen (Clauss method; lower threshold) and platelet count (upper and lower threshold) should be included. Unlike these tests, the prevalence of increased D-dimer values is so high in conditions other than venous thromboembolism or DIC and especially in elderly patients and in those admitted to the ED (Citation31) that the routine reporting of diagnostic values may be demanding but also relatively meaningless, wherein this test should always be ordered in critical patients (Citation32,Citation33). Another consideration that makes it reasonable to avoid including D-dimer in a critical alert test list is the current lack of standardization (Citation34) and results reporting for this analyte (Citation35), wherein any potential recommendation would be difficult to transfer to local practice. As regards test results reporting, in agreement with current recommendations (Citation22), we strongly support the use of harmonized measured units, which are ratio for both the APTT and the PT, along with the INR for the PT for patients on vitamin K antagonists. The values of fibrinogen and platelet count should instead be reported by using the relative SI units (i.e. g/L and 109/L, respectively). This is since test results such as APTT and PT are strongly influenced by test reagent and instrument, which in some ways can be harmonized as assay ratios, typically meaning the ratio of the patient test result over that of the midpoint of the normal range test result. For those laboratories not routinely using the ratio or the INR for expressing results of APTT and PT, the use of test results expression in seconds may still be considered a viable option. Notably, quite often no previous data to which the actual values can be compared are lacking in some populations. For example, a threshold of fibrinogen <1.0 g/L may be occasionally too low and this may need to re-evaluate the limits according to clinical history. Notably, the grade of alertness for the abnormal values should be based on the severity of the observations. More specifically, we believe that values >10 for both PT (INR and ratio) and APTT (i.e. >314 s), <0.5 g/L for fibrinogen and lower than the analytical sensitivity of the hematological analyzer (i.e. usually around 2–5 × 109/L) for the platelet count are immediately life-threatening and should hence require a much greater degree of alertness, so requiring faster (virtually instant) communication. Likewise, higher alertness and immediate communication would be required when more than one of these critical values is identified in the same patient, or when the dynamic change over time is dramatically large, as in the case of a worsening DIC.

Conclusions

The determination of alert thresholds then remains the most challenging and controversial issue. A general consensus of the authors from the published literature has hence been reached for using the limits reported in , despite it needing by necessity, potential adjustments according to local availability of reagents and instrumentation of the different hemostasis laboratories. We have also introduced the concept of dynamic variation of these parameters according to biological and analytical variability (i.e. reference change value; RCV), which may help detect critical variation regardless of the results being within or outside the reference range (Citation36). The most frequent causes generating these critical values are listed in (Citation37,Citation38). Notably, before communicating the critical values, the laboratory should accurately rule out preanalytical issues that may have affected sample quality. This consideration especially refers to the possibility that the coagulation sample has been collected in an inappropriate sample matrix such as serum or EDTA-anticoagulated plasma, in both of which the clotting times of both PT and APTT may be dramatically prolonged (Citation39). Although hemoglobin is not a hemostasis test, this parameter is critical to hemostasis management in multiple setting such as operation room and intensive care units. According to recent recommendations based on the red blood cell transfusion thresholds, <70 g/L (SI units) may be used as critical value threshold (Citation40).

Table 2. Summary of expert opinion, opposed to consensus opinion about critical hemostasis values parameters and relative limits.

Table 3. Most frequent causes of critical test results in hemostasis.

Standardization of critical values in laboratory medicine and hemostasis is still an unmet target, as highlighted by a recent survey of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) (Citation41). Obviously, our report has a major limitation due to the fact that it only reflects our expert opinion, and we do not intend to supplant the function and consideration of relevant scientific societies or international organizations, assuming that definitive recommendations will be released on this topic. We hence advise that international scientific organizations such as the International Society of Clinical Chemistry and Laboratory Medicine (IFCC) and the International Society of Thrombosis and Hemostasis (ISTH) should be embarked in a landmark effort to generate consensus guidance on this important issue. In the interim, we hope that our report provides a basic document for consultation that assists laboratory professionals and clinicians alike in managing unexpected results of hemostasis tests. The definition of multiple limits for the many different clinical conditions that may be encountered in routine practice is clearly unfeasible and probably misleading, since the laboratory is frequently unaware of the specific therapy used by the single patient. In this respect, we would like to reinforce the current CLSI recommendations, affirming that each organization should locally define its own list of laboratory test results needing urgent clinical review and that no list is universally mandated or applies to every health care setting (Citation8).

Disclosure statement

The authors report no conflicts of interest. The authors alone are responsible for the content and writing of this article.

References

  • Plebani M, Favaloro EJ, Lippi G. Patient safety and quality in laboratory and hemostasis testing: a renewed loop? Semin Thromb Hemost. 2012;38:553–8.
  • Lippi G, Favaloro EJ, Plebani M. Quality in hemostasis and thrombosis – part IV. Semin Thromb Hemost. 2015;41:263.
  • Adcock DM, Favaloro EJ, Lippi G. Critical pre-examination variables in the hemostasis laboratory and their quality indicators. Clin Biochem. 2016;49:1315–20.
  • Piva E, Plebani M. From “panic” to “critical”: which path toward harmonization? Clin Chem Lab Med. 2013;51:2069–71.
  • Sciacovelli L, Aita A, Padoan A, Pelloso M, Antonelli G, Piva E, et al. Performance criteria and quality indicators for the post-analytical phase. Clin Chem Lab Med. 2016;54:1169–76.
  • Lundberg G. When to panic over an abnormal value. Med Lab Obs. 1972;4:47–54.
  • Joint Commission. 2016 National Patient Safety Goals 2016. [cited 2016 Oct 21]. Available from: https://www.jointcommission.org/hap_2016_npsgs/
  • Clinical and Laboratory Standards Institute (CLSI). Management of Critical- and Significant-Risk Results. 1st ed. CLSI guideline GP47. Clinical and Laboratory Standards Institute, 950 West Valley Road, Suite 2500, Wayne, PA, USA, 2015.
  • Campbell C, Caldwell G, Coates P, Flatman R, Georgiou A, Horvath AR, et al. Consensus statement for the management and communication of high risk laboratory results. Clin Biochem Rev. 2015;36:97–105.
  • Lippi G, Plebani M, Favaloro EJ. The changing face of hemostasis testing in modern laboratories: consolidation, automation, and beyond. Semin Thromb Hemost. 2015;41:294–9.
  • Pasalic L, Favaloro EJ. The new and the old of heparin-induced thrombocytopenia. Clin Chem Lab Med. 2015;53:149–52.
  • Favaloro EJ. Laboratory testing in disseminated intravascular coagulation. Semin Thromb Hemost. 2010;36:458–67.
  • Tiede A, Werwitzke S, Scharf RE. Laboratory diagnosis of acquired hemophilia A: limitations, consequences, and challenges. Semin Thromb Hemost. 2014;40:803–11.
  • Marlar RA, Clement B, Gausman J. Activated partial thromboplastin time monitoring of unfractionated heparin therapy: issues and recommendations. Semin Thromb Hemost. 2016. [Epub ahead of print]. doi: 10.1055/s-0036-1581128
  • Danese E, Montagnana M, Lippi G. Factor XII in hemostasis and thrombosis: active player or (innocent) bystander? Semin Thromb Hemost. 2016;42:682–8.
  • Dighe AS, Rao A, Coakley AB, Lewandrowski KB. Analysis of laboratory critical value reporting at a large academic medical center. Am J Clin Pathol. 2006;125:758–64.
  • Guzmán DAM, Solari SS, Lagos LM, Poggi MH, Sánchez PT, Madrid QA, et al. Laboratory alert value reporting by the clinical laboratory at an academic medical network. Rev Med Chil. 2009;137:1137–44.
  • Yang D, Zhou Y, Yang C. Analysis of laboratory repeat critical values at a large tertiary teaching hospital in China. PLoS One. 2013;8:e59518.
  • Piva E, Pelloso M, Penello L, Plebani M. Laboratory critical values: automated notification supports effective clinical decision making. Clin Biochem. 2014;47:1163–8.
  • Doering TA, Plapp F, Crawford JM. Establishing an evidence base for critical laboratory value thresholds. Am J Clin Pathol. 2014;142:617–28.
  • Howanitz PJ, Darcy TP, Meier FA, Bashleben CP. Assessing clinical laboratory quality: a College of American Pathologists Q-Probes Study of Prothrombin Time INR Structures, Processes, and Outcomes in 98 Laboratories. Arch Pathol Lab Med. 2015;139:1108–14.
  • Tripodi A, Lippi G, Plebani M. How to report results of prothrombin and activated partial thromboplastin times. Clin Chem Lab Med. 2016;54:215–22.
  • Wagar EA, Friedberg RC, Souers R, Stankovic AK. Critical values comparison: a College of American Pathologists Q-Probes survey of 163 clinical laboratories. Arch Pathol Lab Med. 2007;131:1769–75.
  • Pai M, Moffat KA, Plumhoff E, Hayward CP. Critical values in the coagulation laboratory: results of a survey of the North American Specialized Coagulation Laboratory Association. Am J Clin Pathol. 2011;136:836–41.
  • Tillman J, Barth JH. ACB National Audit Group. A survey of laboratory ‘critical (alert) limits’ in the UK. Ann Clin Biochem. 2003;40:181–4.
  • Campbell CA, Georgiou A, Westbrook JI, Horvath AR. What alert thresholds should be used to identify critical risk results: a systematic review of the evidence. Clin Chem. 2016;62:1445–57.
  • Thomas L. Critical limits of laboratory results for urgent clinician notification. eJIFCC. 2003;14:1–8.
  • Piva E, Sciacovelli L, Laposata M, Plebani M. Assessment of critical values policies in Italian institutions: comparison with the US situation. Clin Chem Lab Med. 2010;48:461–8.
  • Kopcinovic LM, Trifunović J, Pavosevic T, Nikolac N. Croatian survey on critical results reporting. Biochem Med (Zagreb). 2015;25:193–202.
  • Lippi G, Mattiuzzi C. Critical laboratory values communication: summary recommendations from available guidelines. Ann Transl Med. 2016;4:400.
  • Lippi G, Bonfanti L, Saccenti C, Cervellin G. Causes of elevated D-dimer in patients admitted to a large urban emergency department. Eur J Intern Med. 2014;25:45–8.
  • Lippi G, Cervellin G, Casagranda I, Morelli B, Testa S, Tripodi A. D-dimer testing for suspected venous thromboembolism in the emergency department. Consensus document of AcEMC, CISMEL, SIBioC, and SIMeL. Clin Chem Lab Med. 2014;52:621–8.
  • Kristoffersen AH, Ajzner E, Rogic D, Sozmen EY, Carraro P, Faria AP, et al. Is D-dimer used according to clinical algorithms in the diagnostic work-up of patients with suspicion of venous thromboembolism? A study in six European countries. Thromb Res. 2016;142:1–7.
  • Longstaff C, Adcock D, Olson JD, Jennings I, Kitchen S, Mutch N, et al. Harmonisation of D-dimer – a call for action. Thromb Res. 2016;137:219–20.
  • Lippi G, Tripodi A, Simundic AM, Favaloro EJ. International survey on D-dimer test reporting: a call for standardization. Semin Thromb Hemost. 2015;41:287–93.
  • Ricós C, Cava F, García-Lario JV, Hernández A, Iglesias N, Jiménez CV, et al. The reference change value: a proposal to interpret laboratory reports in serial testing based on biological variation. Scand J Clin Lab Invest. 2004;64:175–84.
  • Lippi G, Salvagno GL, Adcock DM, Gelati M, Guidi GC, Favaloro EJ. Right or wrong sample received for coagulation testing? Tentative algorithms for detection of an incorrect type of sample. Int J Lab Hematol. 2010;32:132–8.
  • Ajzner É, Rogic D, Meijer P, Kristoffersen AH, Carraro P, Sozmen E, et al. An international study of how laboratories handle and evaluate patient samples after detecting an unexpected APTT prolongation. Clin Chem Lab Med. 2015;53:1593–603.
  • Kristoffersen AH, Thue G, Ajzner E, Claes N, Horvath AR, Leonetti R, Kallion K, et al. Interpretation and management of INR results: a case history based survey in 13 countries. Thromb Res. 2012;130:309–15.
  • Tobian AA, Heddle NM, Wiegmann TL, Carson JL. Red blood cell transfusion: 2016 clinical practice guidelines from AABB. Transfusion. 2016;56:2627–30.
  • Lam Q, Ajzner E, Campbell CA, Young A. Critical risk results – an update on international initiatives. Ejifcc. 2016;27:66–76.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.