280
Views
30
CrossRef citations to date
0
Altmetric
Review

Tools that assess functional decline: systematic literature review update

&
Pages 485-494 | Published online: 30 Apr 2013

Abstract

Background

Screening for risk of functional decline in the elderly is increasingly important in ambulatory health care settings, to ensure that appropriate services are provided to reduce the risk of downstream decline. These screening tools should have sound psychometric properties and clinical utility.

Design

An updated systematic literature review for (1) new screening tools published since the last review, conducted in 2007 and published in 2008, and (2) recent research into psychometric properties of the five tools identified in the previous review.

Methods

A comprehensive review of multiple databases using the search terms from the Sutton et al review was conducted. The reference lists of included articles were hand-searched for additional articles, and the literature was evaluated with the appropriate critical appraisal tool. Included screening tools should be designed for, or applicable to, hospital emergency departments.

Results

Two relevant new tools were identified (the Simplified PROFUNCTION index and Brief Risk Identification for Geriatric Health Tool). Six additional papers testing psychometric properties of four of the five previously reported screening tools were also found.

Conclusion

Seven relevant screening tools are available with similar validity and reliability estimates. They consider similar constructs and have convincing evidence of applicability to a range of older populations, or different cultures. Identification of Seniors at Risk, is the most frequently reported screening tool. The wider unanswered question is how, why, and where these functional decline screening tools are used; how valid the findings are on ill, stressed, older people in emergency departments; and how the findings are acted upon in terms of community intervention to slow functional decline.

Background

Systematic literature reviews are a good method of presenting the current evidence to busy clinicians in a condensed summary; however, they need to be regularly updated to ensure access to the latest evidence. The systematic review conducted by Sutton et al published in 2008Citation1 is the first we know of that reported on screening tools to identify older individuals at risk of functional decline, specific to use in a hospital emergency department.

As the general population increases in age, there is a need for a valid and reliable tool that can quickly and accurately screen for functional decline. Functional decline is a term used to reflect the loss of an individual’s ability to independently and safely perform activities of daily living (ADLs) (usually at home, in the community).Citation2,Citation3 Basic ADLs encompass everyday tasks (bathing, dressing, feeding, continence, transferring, and toileting)Citation2 and instrumental ADLs address higher-level tasks (shopping, driving, and banking).Citation3 Functional decline has been associated with increased rates of mortality, health service use and institutionalization, and higher health care costs.Citation4Citation6 There is currently no gold standard measure of the attributes or timing of functional decline, as it generally occurs insidiously across a number of domains over time.Citation7 Functional decline has been variously described, including loss of independence in ADLs,Citation8Citation10 confusion and loss of morale, increasing frequency of falls and use of polypharmacy,Citation8 need for permanent institutionalization or permanent care, increased rates of hospitalization, prolonged hospital stays and/or frequent presentations to emergency departments,Citation6,Citation8Citation10 consumption of higher health care costs,Citation11 and avoidable mortality.Citation9,Citation10

The aim of the Sutton et alCitation1 systematic review was to compare the diagnostic accuracy and clinical utility of the then-available screening tools for functional decline, which could be relevant to older adults presenting to hospital emergency departments for crisis health management. That review identified five tools: the Hospital Admission Risk Profile (HARP),Citation12 the Identification of Seniors At Risk (ISAR),Citation13 the Triage Risk Screening Tool (TRST),Citation14 a tool developed by Inouye et al,Citation6 and the Score Hospitalier d’Evaluation du Risque de Perte d’Autonomie (SHERPA).Citation15

This systematic review aims to update the information presented by Sutton and colleaguesCitation1, thus providing clinicians with a synthesis of the most current evidence base for current screening tools for functional decline.

Methods

Updated search approach

The previous reviewCitation1 conducted library database searches that sought studies from 1990 to November 2007 and limited to English studies only. The updated systematic review reported in this paper therefore sought studies published from November 2007 to October 2012, limited to English studies only.

Search strategy

Type of studies

Any peer reviewed article was included if it reported on:

  • the development and psychometric testing of a new tool for assessing functional decline in ambulatory older adults;

  • functional decline tools tested in emergency departments or suitable for this use;

  • subsequent testing of the psychometric properties of the five previously reported functional decline tools;

  • the subsequent use of one or more of the five functional decline tools reported on in Sutton et al.Citation1

Type of participants

Study participants must have been ≥65 years old and presented to a hospital for treatment of an acute condition.

Types of exposure

Screening tools designed specifically to identify older people at risk of functional decline or reduced functional status at time of presentation to hospital were included in the report.

Types of comparator

Any other screening tool(s) that identified older people at risk of functional decline or reduced functional status were included in the report.

Type of outcomes

Prediction of change in functional status.

Search terms

The search terms covered older populations, screening tools to assess mental and physical functional decline and/or loss, loss of quality of life, and care and hospitalization. The full search strategy can be obtained from the authors on request.

Literature sources

Databases searched were AgeLine, CINAHL, Health Source: Nursing/Academic Edition, PsycARTICLES, Psychology and Behavioral Sciences Collection, PsycINFO, AMED, MEDLINE, EMBASE, Cochrane Library, Wiley Online Library. The reference lists of the included articles were hand searched and any texts potentially matching the inclusion criteria were retrieved.

Study selection

Potentially relevant studies were imported into EndNote reference manager software (Thomson Reuters, New York, NY, USA) and screened for duplicates. Titles and abstracts were screened for relevance to the review questions, and finally full texts were acquired and screened for adherence to inclusion/ exclusion criteria. Any disagreements or uncertainties regarding inclusion were resolved via discussion between the authors.

Critical appraisal

Relevant articles were critically evaluated using critical appraisal tools appropriate for the study design. The quality assessment of diagnostic accuracy studies (QUADAS) critical appraisal tool,Citation16 which is a validated tool specifically developed to appraise studies assessing the accuracy of diagnostic tools for systematic reviews, was used to appraise the articles on the development of a new tool (See for QUADAS scores). Articles reporting on the tools reviewed by Sutton et alCitation1 were appraised using the Critical Appraisal Skills Programme (CASP) critical appraisal tool for cohort studiesCitation17 (see for CASP scores).

Table 1 Psychometric properties of new tools found in this search

Table 2 Assessment items reported in the various tools reviewed in this paper

Data extraction

The data was extracted into a custom designed spread sheet based on the information extracted by Sutton et al.Citation1 This paper reports two separate sets of data:

  • Part one: new tools published since Sutton et al’sCitation1 2008 report to detect functional decline in elderly patients who present to a hospital.

  • Part two: subsequent use of the functional decline screening tools identified by Sutton et al.Citation1

Results

Search findings

The search returned 601 articles. Eight articles were included in this review (see for the Preferred Reporting Items for Systematic Reviews and Meta-Analyses [PRISMA] diagram of search results).

Figure 1 PRISMA diagram of search results.

Abbreviation: PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
Figure 1 PRISMA diagram of search results.

Part one: new tools identified in the search

Two additional tools to the five identified by Sutton et alCitation1 were found:

  • Simplified PROFUNCTION index developed by Bernabeu- Wittel et al.Citation18

  • Brief Risk Identification for Geriatric Health Tool (BRIGHT) developed by Boyd et al.Citation9

The Simplified PROFUNCTION index and BRIGHT were assessed using the QUADAS critical appraisal tool. Both screening tools scored moderately for diagnostic accuracy and predictive reliability: the Simplified PROFUNCTION index scored 9/14 and BRIGHT scored 8/14. Both achieved lower scores than those reported for the tools assessed by Sutton et alCitation1 (these tools ranging between 10/14 to 12/14 on the QUADAS critical appraisal tool). The psychometric properties and QUADAS scores of the new instruments are outlined in .

Development of the new tools

The PROFUNCTION index and the Simplified PROFUNCTION index were developed by Bernabeu-Wittel et alCitation19 to assess functional decline in polypathological patients (chronic disease sufferers with multiple pathologies), as the authors believed that the current functional decline assessment tools were not sufficiently specific for this population. The PROFUNCTION index is scored from 0–31 while the Simplified PROFUNCTION index is scored from 0–7. The Simplified PROFUNCTION index, in which all items have an even weighting, was created in the same manner as the PROFUNCTION index, in which items had unequal weightings, and had minimal prognostic differences amongst the original score items. The Simplified PROFUNCTION index obtained similar goodness of fit and discrimination values as the longer version; as such, Bernabeu-Wittel et alCitation18 suggest using the simplified version, as it is easier to perform. In light of this, only the results from the Simplified PROFUNCTION index are reported here. The tool’s generalizability is limited to polypathological patients and the tool, to date, has only been tested in one development study in Spain.Citation18

The predictive validity of the Simplified PROFUNCTION indexCitation18 was found to be good when compared to the TRST.Citation14 The stability of the final model of the Simplified PROFUNCTION indexCitation18 was tested with alternate methods (forward and bidirectional selection techniques) to determine whether the resulting model would differ from the original PROFUNCTION index. They found good reliability. The clinical utility of the Simplified PROFUNCTION index was not discussed other than a recommendation to use the simplified version over the original version.

BRIGHT was developed by Boyd et alCitation9 to identify older patients with functional and physical impairments presenting to the emergency department. BRIGHT has a scoring range of 0–11 (each item is equally weighted) with higher scores negatively correlating to impairment levels.Citation9 BRIGHT was compared with the current standard (inter-Residential Assessment Instrument [interRAI] Minimum Data Set for Home Care Version 2.0 [MDS-HC])Citation19Citation21 as approved by the New Zealand government in functional testing for older adults. There has been no comparison between the BRIGHT instrument and any other functional decline assessment tool. However, as the interRAI tool had not been validated at the time of the Boyd et alCitation9 study, it provided limited validation evidence for the BRIGHT instrument. At this point in time, BRIGHT has only been tested in New Zealand and included Māori and Pasifika elders; however, the cohort reflected predominantly Caucasian participants.Citation9 The predictive validity of BRIGHT compared to the New Zealand reference tool was found to be good, when a cut off score of 3–4 is used. Boyd et alCitation9 state that BRIGHT has good reliability, however, they do not report supporting statistical evidence.

BRIGHT was originally designed to be either patient self-administered or administered with the aid of a caregiver; however, Boyd et alCitation9 found that only 25% of the sample was able to complete the questionnaire without some form of assistance from the research or nursing staff. They did find that BRIGHT requires no special training for health care staff and takes little time to complete. According to Boyd et al,Citation9 BRIGHT was designed to be part of a two-stage assessment process; BRIGHT was to be used initially, to quickly identify older adults at risk of functional decline, and then a more intensive tool, in this case the interRAI home care version, used by Boyd et alCitation9 as the validation tool, to establish the level of aid/care that was necessary at the time of discharge and to aid in the design of a home care program.

Part two: subsequent use of tools identified in Sutton et al1

The literature search identified six papersCitation11,Citation22Citation26 which reported on one or more of the functional decline screening instruments reported by Sutton et alCitation1 (HARP was reported in two of the six papers,Citation22,Citation25 ISAR in all six,Citation11,Citation22Citation26 SHERPA in one,Citation25 and TRST in twoCitation11,Citation26). No further reports were found on the Inouye instrument. lists the assessment items in each screening tool, highlighting the overlap and gaps between these tools.

Braes et alCitation11 conducted a longitudinal comparative study that tested the predictive validity of the TRST and the ISAR. They found the TRST and the ISAR to be comparable regarding their diagnostic characteristics, with a small advantage for the TRST over the ISAR (see for psychometric and population data). Based on this, Braes et alCitation11 concluded that both the ISAR and TRST are good screening instruments for functional decline after hospitalization, however, they do add one caveat: the specificity of both tools was low, leading to approximately 50% false positive scores.

Table 3 Psychometric properties of tools used since Sutton et alCitation1

de Saint-Hubert et alCitation25 conducted a prospective cohort study in order to compare the respective performances of the HARP, ISAR, and SHERPA. They found no statistical difference between HARP and ISAR (P = 0.12), no significant statistical difference between SHERPA and HARP (P = 0.08), but a significant statistical difference between SHERPA and ISAR (P = 0.001) (see ). They concluded that the SHERPA was the most useful tool for identification of patients at low level risk of functional decline.

Graf et alCitation26 examined a historical cohort to evaluate the performances of ISAR and TRST to predict unplanned readmission after emergency department presentation (see ). The authors concluded that while both tools predicted unplanned hospital readmissions moderately well, they would be better applied to identify patients who could safely be discharged home, and who did not require a more comprehensive geriatric evaluation.

Hoogerduijn et alCitation22 conducted a prospective cohort study comparing the performance of ISAR and HARP (see ). They concluded that while the instruments tested were strong in both predicting who was at risk of functional decline and who was not at risk, the ISAR showed the best ability to predict functional decline, and was the easier tool to administer.

Salvi et al reported two studies.Citation23,Citation24 In 2009,Citation23 these authors conducted a prospective observational cohort study evaluating the predictive validity of ISAR. With a cutoff of 2, the ISAR was positive for 70.5% of patients who had high cognitive impairment, disability, and comorbidities, which was reflected in longer lengths of hospital stay, frailty, and older age. We calculated sensitivity and specificity from raw scores reported in the paper (see ).

In 2012, Salvi et alCitation24 conducted a second prospective observational cohort study to test the validity of the ISAR tool as an indicator of patients in need of a comprehensive geriatric assessment. The authors found that the ISAR was highly correlated with frailty. Using a cutoff score of 3, they showed ISAR had good sensitivity and specificity (see ), thus allowing for strict selection of frail geriatric patients in an emergency department. The authors concluded that ISAR is a useful screening tool for frailty and identifies those at risk of adverse outcomes after an acute emergency department visit. They also found that the ISAR tool can be used to more effectively select those patients that will benefit from geriatric interventions in the community.

Discussion

This is the first comprehensive review of functional decline screening tools in 5 years. We have identified that functional decline in elderly patients presenting to an emergency department can now be measured with eight instruments. While not all of the instruments have been tested in an emergency department, their clinical utility and predictive validity suggests that they can appropriately be used in this setting. Since the Sutton et alCitation1 review, two new instruments have been developed, which are specific to select patient populations (polypathological older people [Simplified PROFUNCTION], and New Zealand’s [BRIGHT]).

Of the five instruments reported in Sutton et al,Citation1 six subsequent papers have examined four of the tools. No further research has been conducted on the Inouye tool.

The ISAR instrument is the most commonly reported screening tool since the Sutton review (ie, since 2008). It appears to be the most useful tool for assessing functional decline in elderly patients presenting to an emergency department because it is quick to administer, does not require specialized training for its administrators, and is efficient. It has good predictive capacity in terms of area under the curve and sensitivity (using cut off points at scores of 2 and 3), however specificity is less convincing.

The tools all assess similar constructs, albeit presented in questions using different wording. ADLs are most commonly assessed, although using different ways (validated tools such as Lawton and Brody’s instrumental ADLCitation27 and Katz et al’s ADLCitation28) or using purpose-built questions. The intent of functional decline screening in emergency departments is to gain a snapshot of a patient in a short timeframe, regarding their risk of declining in ADL performance in the next few months. The ability to accurately assess the potential for functional decline in a setting such as an emergency department is an important step in reducing unnecessary hospital readmissions and assisting in maintaining functional independence in the home for older people. In light of this, it is not surprising that the ISAR is the most frequently reported tool, as this is consistently cited as the easiest tool to administer of all those discussed in this paper.

The application of any functional decline screening tool in an emergency department should be carefully considered. Older people presenting to emergency departments are generally sick and distressed, and the emergency department itself is a fast-paced, high-energy environment which may not be conducive to accurate screening. The eight instruments all contained two types of elements: immutable (eg, education, age, living arrangements, and previous mobility state) as well as mutable elements that may well be influenced by the older person’s current health state and distress (such as their recollections regarding their ability to manage ADLs, and their cognition). It is probable that poor cognition scores, suspected delirium, poor balance, and depressive feelings, which are often associated with acute illness,Citation12 could be abnormally present (ie, not a true reflection of how the older person usually is if they were well). Assessing these elements in a busy emergency department with a sick, distressed individual will affect the accuracy of the assessment. This brings the validity of administration of any functional decline screening tool in an emergency department into question.

However, for many older people, the only time they come to the notice of health professionals is when they are in a health crisis. Therefore, considering them for their capacity to decline functionally over the coming months is essential when the opportunity arises.Citation9,Citation11 Thus, a balance needs to be struck between assessing capacity in a less than ideal situation (emergency department) and coming to a wrong conclusion (such as not identifying someone who has the capacity for functional decline, or wrongly identifying someone as having the capacity to decline), compared with not assessing them at all, and allowing functional decline to occur without any attempt at screening. The opportunity for older people to be screened in less stressful environments (such as their doctor’s rooms or a community clinic) depends on their regular community health contacts. It would seem that there are opportunities to screen older people more accurately, using any of the tools described in this review, when they are well. However, this requires awareness by community-based health care providers of the need for functional decline assessment as part of aging and regular health checks.

Conclusion

There are seven documented instruments, with generally similar validity and reliability estimates, to assess older people for functional decline. They contain similar elements and have convincing evidence of applicability to a range of older populations and cultures. To date, the ISAR is the most frequently used, perhaps due to the small number of questions. However, the bigger issues are how, why, and where any of these functional decline screening tools are used; how valid the findings are on ill, stressed older people in emergency departments; and how the findings are acted upon in terms of community intervention to slow functional decline.

Acknowledgments

The authors wish to thank Dr Julie Luker for technical aid.

Disclosure

The authors report no conflicts of interest in this work.

References

  • SuttonMGrimmer-SomersKJeffriesLScreening tools to identify hospitalised elderly patients at risk of functional decline: a systematic reviewInt J Clin Pract200862121900190919166437
  • CovinskyKEJusticeACRosenthalGEPalmerRMLandefeldCSMeasuring prognosis and case mix in hospitalized elders. The importance of functional statusJ Gen Intern Med19971242032089127223
  • MehtaKMYaffeKCovinskyKECognitive impairment, depressive symptoms, and functional decline in older peopleJ Am Geriatr So200250610451050
  • CovinskyKEPierluissiEJohnstonCBHospitalization-associated disability: “She was probably able to ambulate, but i’m not sure”JAMA2011306161782179322028354
  • FortinskyRHCovinskyKEPalmerRMLandefeldCSEffects of functional status changes before and during hospitalization on nursing home admission of older adultsJ Gerontol A Biol Sci Med Sci19995410M521M52610568535
  • InouyeSKWagnerDRAcamporaDA predictive index for functional decline in hospitalized elderly medical patientsJ Gen Intern Med19938126456528120679
  • GrimmerKBeatonKHendryKMossJIdentifying functional decline: a methodological challengePatient Relat Outcome Measu2013
  • BrandCMartin-KhanMWrightODevelopment of quality indicators for monitoring outcomes of frail elderly hospitalised in acute care health settings: study protocolBMC Health Serv Res20111128122014061
  • BoydMKoziol-McLainJYatesKEmergency Department case-finding for high-risk older adults: the Brief Risk Identification for Geriatric Health Tool (BRIGHT)Acad Emerg Med200815759860618691210
  • BuurmanBMHoogerduijnJGvan GemertEAde HaanRJSchuurmansMJde RooijSEClinical characteristics and outcomes of hospitalized older patients with distinct risk profiles for functional decline: a prospective cohort studyPLoS One201271e2962122238628
  • BraesTFlamaingJSterckxWPredicting the risk of functional decline in older patients admitted to the hospital: a comparison of three screening instrumentsAge Ageing200938560060319556324
  • SagerMAFrankeTInouyeSKFunctional outcomes of acute medical illness and hospitalization in older personsArch Intern Med199615666456528629876
  • McCuskerJBellavanceFCardinSTrépanierSVerdonJArdmanODetection of older people at increased risk of adverse health outcomes after an emergency visit: the ISAR screening toolJ Am Geriatr Soc199947101229123710522957
  • HusteyFMMionLCConnorJTEmermanCLCampbellJPalmerRMA brief risk stratification tool to predict functional decline in older adults discharged from emergency departmentsJ Am Geriatr Soc20075581269127417661968
  • CornettePSwineCMalhommeBGilletJBMeertPD’HooreWEarly evaluation of the risk of functional decline following hospitalization of older patients: development of a predictive toolEur J Public Health200616220320816076854
  • WhitingPRutjesAWReitsmaJBBossuytPMKleijnenJThe development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviewsBMC Med Res Methodol200332514606960
  • InternationalCCritical Appraisal Skills Program Making Sense of Evidence [webpage on the Internet]OxfordCritical Appraisal Skills Program2012 Available from: http://www.casp-uk.net/wp-content/uploads/2011/11/CASP_Cohort_Appraisal_Checklist_14oct10.pdfAccessed Apr 2012
  • Bernabeu-WittelMOllero-BaturoneMRuiz-CanteroAFunctional decline over 1-year follow-up in a multicenter cohort of polypathological patients: a new approach to functional prognosticationInternational Journal of Gerontology2012626874
  • CarpenterGITeareGFSteelKA new assessment for elders admitted to acute care: reliability of the MDS-ACAging (Milano)200113431633011695501
  • LandiFTuaEOnderGSILVERNET-HC Study Group of BergamoMinimum data set for home care: a valid instrument to assess frail older people living in the communityMed Care200038121184119011186297
  • HirdesJPLjunggrenGMorrisJNReliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information systemBMC Health Serv Res2008827719115991
  • HoogerduijnJGSchuurmansMJKorevaarJCBuurmanBMde RooijSEIdentification of older hospitalised patients at risk for functional decline, a study to compare the predictive values of three screening instrumentsJ Clin Nurs2010199–101219122520345834
  • SalviFMorichiVGrilliAPredictive validity of the Identification of Seniors At Risk (ISAR) screening tool in elderly patients presenting to two Italian Emergency DepartmentsAging Clin Exp Res2009211697519225272
  • SalviFMorichiVGrilliAScreening for frailty in elderly emergency department patients by using the identification of seniors at risk (ISAR)J Nutr Health Aging201216431331822499448
  • de Saint-HubertMJamartJBolandBSwineCCornettePComparison of three tools predicting functional decline after hospitalization of older patientsJ Am Geriatr Soc20105851003100520722840
  • GrafCEGiannelliSVHerrmannFRIdentification of older patients at risk of unplanned readmission after discharge from the emergency department – comparison of two screening toolsSwiss Med Wkly2012141w1332722252274
  • LawtonMBrodyEAssessment of older people: self-maintaining and instrumental activities of daily livingGerontologist1969931791865349366
  • KatzSFordABMoskowitzRWJacksonBAJaffeMWStudies of illness in the aged: The index of ADL: a standardized measure of biological and psychosocial functionJAMA196318591491914044222