2,177
Views
44
CrossRef citations to date
0
Altmetric
Research Articles

Development and psychometric characteristics of the SCI-QOL Bladder Management Difficulties and Bowel Management Difficulties item banks and short forms and the SCI-QOL Bladder Complications scale

, , , &

Abstract

Objective

To describe the development and psychometric properties of the Spinal Cord Injury – Quality of Life (SCI-QOL) Bladder Management Difficulties and Bowel Management Difficulties item banks and Bladder Complications scale.

Design

Using a mixed-methods design, a pool of items assessing bladder and bowel-related concerns were developed using focus groups with individuals with spinal cord injury (SCI) and SCI clinicians, cognitive interviews, and item response theory (IRT) analytic approaches, including tests of model fit and differential item functioning.

Setting

Thirty-eight bladder items and 52 bowel items were tested at the University of Michigan, Kessler Foundation Research Center, the Rehabilitation Institute of Chicago, the University of Washington, Craig Hospital, and the James J. Peters VA Medical Center, Bronx, NY.

Participants

Seven hundred fifty-seven adults with traumatic SCI.

Results

The final item banks demonstrated unidimensionality (Bladder Management Difficulties CFI = 0.965; RMSEA = 0.093; Bowel Management Difficulties CFI = 0.955; RMSEA = 0.078) and acceptable fit to a graded response IRT model. The final calibrated Bladder Management Difficulties bank includes 15 items, and the final Bowel Management Difficulties item bank consists of 26 items. Additionally, 5 items related to urinary tract infections (UTI) did not fit with the larger Bladder Management Difficulties item bank but performed relatively well independently (CFI = 0.992, RMSEA = 0.050) and were thus retained as a separate scale.

Conclusion

The SCI-QOL Bladder Management Difficulties and Bowel Management Difficulties item banks are psychometrically robust and are available as computer adaptive tests or short forms. The SCI-QOL Bladder Complications scale is a brief, fixed-length outcomes instrument for individuals with a UTI.

Introduction

Individuals with spinal cord injury (SCI) are living longer and surviving at 70–92% of average life expectancy.Citation1,Citation2 As living with a disability becomes a life-long process for many persons with SCI, different sets of problems are likely to occur at different stages in life. Given the complexity of the issues involved in managing SCI across the years, the need for lifelong follow up is important in order to better understand and promote physical, psychological, and social well-being after SCI.Citation3 These factors provide a clear rationale for the current interest in quality of life (QOL) of individuals with SCI. QOL can be clearly influenced by the need for neurogenic bladder and bowel management, its disruptions to lifestyle routines, and the potential occurrence of related complications.

Effects of neurogenic bladder and bowel on quality of life

The vast majority of those with SCI and neurologic impairment also have associated bladder and bowel dysfunction making this aspect of their care relevant to providers, researchers, individuals with SCI and their families and caregivers.Citation4 In contrast, very few studies have focused on the impact of neurogenic bladder and bowel on QOL or behavioral factors associated with bladder and bowel dysfunction. Qualitative findings from a study conducted by Tate et al.Citation5 include many testimonials of the negative effects of bladder and bowel dysfunction on QOL. These testimonials refer to difficulties in finding accessible bathrooms for performing intermittent catheterization or bowel management, feelings of embarrassment, consequences to personal relationships, marriage, sexuality, and intimacy, and obstacles to maintaining regular employment.

Although the scientific literature is limited on the impact of neurogenic bladder and bowel on people's lives, the few clinical studies on this topic confirm statements made by SCI participants from the study above. For women with tetraplegia, bladder management is particularly challenging as noted by Walsh et al.Citation6 Anecdotal clinical evidence also suggests that persons with SCI often have difficulty maintaining social relationships due to fear of accidents.Citation7,Citation8 The importance of coping mechanisms and lifestyle changes that can affect QOL for those with neurogenic bowel is highlighted in a 2004 article by Rockwood.Citation9 The author suggests that psychological mechanisms such as coping play an important role in QOL following fecal incontinence, as it contributes to the overall measure of incontinence severity. Specific psychosocial modules of assessment are needed to provide a more complete evaluation of the impact of bowel dysfunction on QOL.

Bladder and bowel dysfunction and related medical complications

Bladder dysfunction refers mostly to voiding problems and abnormalities in bladder function.Citation10 The signs and symptoms of bladder dysfunction are variable and can change.Citation11 Although population-specific QOL instruments have been developed for SCI, urological issues are not always well reflected in the scores due to the broad nature of questions. The role that patients take in their own health care is key when assessing bladder management issues after SCI.Citation12 The need is great for a patient reported outcome (PRO) measure which assesses urological symptoms and consequences from a subjective perspective.Citation13,Citation14 Measures like the Qualiveen,Citation15 which offers specific questions for SCI and has strong psychometric properties, tend to focus on feelings related to bladder dysfunction.Citation16

Neurogenic bowel dysfunction is usually characterized by lower gastrointestinal (GI) symptoms such as loss of voluntary control over bowel movements, difficulty with evacuation, and incontinence. These symptoms represent major physical and psychological problems for individuals with SCI, as changes in bowel motility and sphincter control coupled with impaired mobility and hand dexterity make bowel management a major life-limiting problem. Thus, it is not surprising that improving bowel function alone is rated as one of the highest priorities among individuals with SCI.Citation17,Citation18

Medical complications from neurogenic bladder and bowel can be severe and include presence of constipation, incontinence, urinary tract infections (UTIs), fecal impaction, pain, pressure ulcers secondary to leakage, renal failure, and bladder and kidney stones.Citation19 Severe UTIs are one of the most frequent reasons for re-hospitalizations after SCI.Citation20Citation22

It is well established that neurogenic bowel dysfunction significantly impacts the QOL and health of persons with SCI.Citation23Citation25 In addition to fecal incontinence, constipation is a particularly common and bothersome GI complaint in persons with SCI.Citation26Citation28 Patients with SCI and chronic constipation report a variety of symptoms including straining, a sensation of incomplete evacuation, reduced stool frequency, a sensation of anorectal blockage and the need for ‘manual maneuvers.’Citation29 GI issues also have been reported to worsen with time.Citation23,Citation24,Citation30 Moreover, abdominal or rectal pain occurring from distension and constipation has been known to trigger autonomic dysreflexia,Citation24,Citation30 and up to 25% of individuals with SCI require at least one re-hospitalization due to GI tract issues.Citation30 Despite the high frequency of complications, there are very few controlled studies related to bowel management. The lack of specific measures that assess PROs in relation to bowel dysfunction is one of the reasons for the paucity of such studies. A few measures are currently available including the Patient Assessment of Constipation Symptom questionnaire (PAC-SYM) and the Patient Assessment of Constipation Quality of Life (PAC-QOL), more specifically assessing QOL in relation to symptoms.Citation31,Citation32 Neurogenic bowel dysfunction (NBD) can be assessed by a score as proposed by Krogh et al. (2006) which includes items on fecal incontinence, constipation, obstructed defecation and impact and QOL.Citation33 The NBD score was found to be significantly associated with impact on QOL. Finally, the Revised Faecal Incontinence Scale (RFIS) scale may be used to assess fecal incontinence and monitor patient outcomes, though only one item is devoted to the effects of incontinence on QOL.Citation34

Urological complications have been reported to account for much of the SCI associated morbidity and as much as 15% of the SCI associated mortality.Citation35 These complications often lead to social problems, which may in turn decrease QOL. Restoration and maintenance of the patient's QOL should remain among the main targets of the treatment.Citation36

Evidence is mixed regarding methods of bladder management being associated with complications.Citation37Citation39 A systematic review of urological follow-up after SCI was conducted to investigate various methods of screening for bladder complications with the ultimate goal of creating practice guidelines.Citation40 Based on this review, only routine renal ultrasound could be recommended as part of screening. While more sophisticated urodynamic evaluations seem important to consider, evidence is lacking.

A 2011 study using SCI Model Systems data by Pelletier-Cameron et al. found that the use of an indwelling catheter was associated with more medical complications, including pressure ulcers and re-hospitalizations.Citation41 Pannek and Kullik suggest that a treatment regimen leading to favorable urodynamic outcome and continence was associated with better QOL.Citation42 When considering medical factors, older age seems to be suggestive of a higher number of complications. The more chronic the lesion and the older the patient becomes, the less attention the patient receives in the community and the more he/she is likely to develop complications.Citation43

Unlike bladder management, there are no clearly distinct bowel management methods. Instead, adequate bowel management strategies consist of a combination of dietary, pharmacological and manual methods of producing a controlled bowel evacuation. Recommendations such as a high-fiber diet and adequate hydration, prescribed treatments of oral laxatives and stool softeners or rectal suppositories, and manual methods, such as digital rectal stimulation for manual evacuation or flushing enemas, are used depending on each person's functional ability and health needs. This lack of uniformity in bowel management programs and the lack of tools to measure change in bowel function is perhaps a methodological reason for difficulties in conducting research in this area. Hence, the need for patient reported measures with respect to bowel management.

Behaviors and environmental support factors associated with complications

Many with SCI consider their bowel management to be a very arduous process since it may necessitate help from a caregiver, can take as long as one hour or more to achieve, and can be accompanied by autonomic dysreflexia, bleeding hemorrhoids and rectal pain.Citation26,Citation44 Furthermore, despite best efforts there often remains the increased risk of an unwanted or unplanned bowel evacuation. Bowel management often requires a combination of time, expense, and quality of caregiver support.Citation45 Clinical experience suggests that for those with SCI who have less upper extremity physical function, the availability of and quality of caregivers are critical factors in predicting ability to maintain health and prevent complications. Health adherence behaviors and environmental support based on relationships such as caregiving and patient provider relations are important to consider when examining modifiable factors that may influence bladder and bowel complications after SCI.

Important issues affecting bowel and bladder management behaviors include depression, anxiety and fear of incontinence, which can significantly limit an individual's ability to engage in activities outside the home.Citation17 Other concerns include increased stress and withdrawal, lack of independence, and difficulties with sexuality and intimacy.Citation17,Citation46 From an environmental support perspective, the implementation of a bladder and/or bowel management program poses additional challenges to the individual with SCI, as this often requires assistance from family, friends or caregivers; special equipment; use of accessible environments; medications; and dietary changes. Such programs can be time consuming and difficult to perform, some requiring exposure to unpleasant and embarrassing events, thus at times generating further stress within already overtaxed relationships and/or role reversals among partners or other family members.Citation47 Research has shown that spouses who provide care for persons with SCI report feeling significantly more physical and emotional stress, burnout, fatigue, anger and resentment in comparison to non-caregiving spouses.Citation48,Citation49 Sexuality and intimacy are often affected by these bowel and bladder problems.Citation4 The experience of increased stress on the part of both caregivers and persons with SCI may in turn make it more difficult to do what is necessary to prevent complications by interfering with healthy behaviors critical to successful bladder and bowel management, such as following a proper diet and adhering to prescribed treatments.Citation7

In their review of bowel management in SCI, Steins and colleagues make an important recommendation relevant for our proposed research (and one that equally applies to bladder management): ‘It is crucial to remember that the patient must take a leadership role in building a bowel program that incorporates a life-compatible bowel care schedule. Our job is to educate him or her about altered physiology after SCI and to empower him or her to construct a bowel care regimen that he/she can live with’ (p. S86).Citation44 In order to achieve ‘life-compatible’ bowel care, a better understanding of the environment, behavior and personal characteristics is needed.

Methods

The Institutional Review Boards at each of the 6 sites reviewed and approved this study. The first study activity was to develop and refine pools of items related to bladder and bowel issues that affect health-related quality of life (HRQOL). Next, bladder and bowel items were administered to a large, stratified sample of individuals with traumatic SCI. Items were administered in interview format and a computerized data collection platform was used to capture data in real time. Psychometric analyses included confirmatory factor analyses (CFA), graded response modelCitation50 item response theory (IRT) analyses, and tests of differential item functioning (DIF).Citation51 Each of these steps is described in detail in the introductoryCitation52 and methodsCitation53 papers in this issue, and is also outlined briefly in the section below.

Development of bladder and bowel item pools

To develop the bladder and bowel item pools, candidate items from initial pilot work were identified. These items were obtained via individual, semi-structured interviews and focus groups with individuals with SCI and SCI clinicians (see Tulsky et al.Citation54 for a full description). The interview data informed the development of a set of 26 preliminary items related to bladder and/or bowel related concerns. Relevant concepts or phrases were then drawn from the focus group transcripts and converted into 135 additional ‘new’ items. For example, from quotes like ‘I get a UTI every couple of months’ and ‘I had [UTIs] for 3 months ongoing’ we drafted the items, ‘I had a urinary tract infection’ and ‘I had a urinary tract infection that would not go away.’

One-hundred and sixty-one preliminary items underwent Expert Item Review (EIR),Citation55 a method in which several project co-investigators reviewed each item for issues such as relevance and clarity and made suggestions for item revisions and deletions. Based on EIR feedback, 52 bladder items and 72 bowel items were retained. These items then underwent an additional phase of review and modification in which the items were arranged on a hierarchy, from items indicating the lowest degree of bladder or bowel-related problems to the highest degree. Team members removed redundant items where there was oversaturation in the middle range of the item hierarchies, and suggested new items to fill gaps in content coverage. During this phase of review, 5 bladder items were removed.

These refined sets of SCI-QOL bladder and bowel items were evaluated by individuals with SCI during structured, debriefing cognitive interviews (CI).Citation56 CI participants were first asked to respond to each item, then describe the process they used to state their answer, and report whether they perceived anything to be confusing, unclear, or derogatory, or whether they thought any items should be reworded. Three bladder items and 10 bowel items were modified, and 9 bladder items and 3 bowel items were deleted based on CI feedback. Notably, 6 bowel items and 2 bladder items were added based on topics suggested by CI participants. For example, participants felt that the item pool lacked content related to the inconvenience associated with bowel accidents (e.g. ‘My clothing was soiled due to a bowel accident’; ‘I spent a lot of time taking care of a bowel accident’). After this phase, the final 38 bladder and 58 bowel items were reviewed for translatability (for method, please see Eremenco et al.),Citation57 and reading level (using the Lexile framework).Citation58 Slight modifications were made to 1 bladder item and 3 bowel items after the translatability and cultural review. For example, the item ‘I was troubled by constipation’ was changed to ‘I was bothered by constipation,’ since translation of the word ‘troubled’ could be ambiguous in this context. All items were written at the 5th grade reading level.

Calibration study participants and data collection procedures

As a part of a large-scale multi-site item calibration study (sites included the Kessler Foundation, University of Michigan, Rehabilitation Institute of Chicago, University of Washington, Craig Hospital and the James J. Peters VA Medical Center), we administered the 38 bladder items and 58 bowel items along with other item pools reflecting other physical-medical subdomains to a sample of people with SCI.

The calibration sample included 757 individuals with traumatic SCI. Inclusion criteria were 18 years of age and older, ability to read and understand English, and had a documented SCI of traumatic etiology. The sample was stratified by level of injury (paraplegia, tetraplegia), completeness of injury (neurologically complete, incomplete), and time since injury (<1 year, 1–3 years, and >3 years) to ensure heterogeneity of the final sample. Each participant's diagnosis was confirmed by medical record review; neurologic level was documented by their most recent American Spinal Injury Association Impairment Scale (AIS) rating.Citation59 All items were presented in a structured interview to participants in person or over the phone. Additional detail on the field testing methodology for this study is presented in Tulsky et al.Citation53

Data analyses

IRT is a family of mathematical models that are used to scale a pool of test items along a single underlying metric. In this way, the score on any subset of items in this calibrated ‘item bank’ is directly comparable to either the full bank score or to the score on any other subset of items. IRT scaling is a prerequisite to the development of computer adaptive tests (CAT). Analysis of the field testing data involved assessment of construct unidimensionality, use of a graded-response IRT model to calibrate items, and examination of local item dependence (LID) and DIF. We used CFA to determine if our items conformed to a unidimensional model. The following indicators of model fit were used: Comparative Fit Index (CFI) >0.90, Root Mean Square Error of Approximation (RMSEA) <0.08, good support of the model; CFI > 0.95, RMSEA < 0.06, excellent support of the model. Analyses were performed iteratively to reduce the item pools and obtain the best-fitting item parameters that would best allow estimation of a participant's standing on the traits related to bladder and bowel, respectively. We examined LID to ensure that residual correlations between items did not exceed |0.20| (i.e. to ensure that items were measuring unique aspects of the construct and were not simply restatements of one another). DIF analyses were conducted to ensure that the final items were free from measurement bias—that is, that the probability of a participant receiving a certain score was based only on their level of the underlying trait (e.g. Bladder Management Difficulties) and was not affected by characteristics such as sex or level of injury. Specifically, DIF analyses flag items that perform differently (when matched on the underlying trait) among different subgroups of individuals in an unanticipated or unexplained way.

With each successive analytic iteration, we identified poorly fitting items by examining item fit to a graded response IRT model, DIF, LID (i.e. removal of items with residual correlations >|0.20|), and significant loadings on the single factor (i.e. removal of items with values <0.30). With each iteration we removed problematic items from the pools and repeated the analytic steps. Once an acceptable solution was reached with CFA statistics that supported a unidimensional model, and all items showing misfit to the model or DIF were removed, the final IRT parameters were utilized to develop CAT algorithms for the final item banks. The CATs were programmed on the Assessment CenterSM Citation60 website (http://www.assessmentcenter.net) and were administered directly from there. The item parameters were also used to select items for fixed-length short forms, which can either be administered directly through the Assessment Center website or downloaded as a PDF from the Assessment CenterSM website. Additional detail on the methodology and analysis plan may be found in Tulsky et al. within this special issue.Citation53

Test-retest reliability

As part of a larger study, test-retest reliability was assessed in a second sample of community-dwelling adults with traumatic SCI who had been injured at least 4 months prior, and discharged from inpatient rehabilitation at least 4 weeks prior to the first assessment. Participants completed all measures again at 1–2 weeks post baseline.

Results

Participant characteristics

Bladder Management Difficulties and Bowel Management Difficulties items and other item pools related to physical-medical health were administered to a sample of 757 individuals with SCI. Demographic and injury characteristics are summarized in . Additional detail on the SCI-QOL calibration sample, as well as on the sample used to compute test-retest reliability, may be found in Tulsky et al. (this issue).Citation53

Table 1. SCI-QOL participant characteristics

Data analysis—bladder management difficulties

Preliminary analysis and item removal

Data analysis was initiated on a pool of 38 general ‘Bladder’ items related to both bladder management and bladder complications. Following the first round of preliminary analyses and CFA, 10 items were removed for the following reasons (some items were removed for multiple reasons): low item-total correlations (7 items), bimodal distribution (5 items), sparse (<5 respondents) categories (2 items), misfit (significant χ2 test, 1 item), LID (1 item). Analyses were re-run and an additional two items were removed due to very low item-total correlations (i.e. <0.3 and <0.2, respectively). After these preliminary iterations, fit statistics had not yet reached acceptable levels (CFI = 0.893, RMSEA = 0.089) so the item bank content was re-reviewed and the remaining items were ‘binned’ into 2 discrete sets of item subdomains. One set related to issues surrounding bladder management and the other to bladder-related medical complications such as urinary tract infections (UTIs). The investigative team binned a 19-item set related to bladder management difficulties and re-ran the analyses with just those items, then binned the additional 8 items (including one item that had previously been deleted due to LID) into a second subset of items that were related to bladder complications. The analysis for the 8 items related to bladder complications is reported in its own section later in the manuscript. For the bladder management difficulties set of items, 4 additional items were removed at this stage as follows: 2 items removed for poor/emotional wording (‘I felt inadequate because of my bladder program’ and ‘I was disappointed I depended on others for help with my bladder program’) and 2 items that didn't fit well with the others psychometrically (low item-total correlations). The following results are based on the final 15-item set. For the 15 items, internal consistency was α = 0.91 and item/total correlations ranged from 0.38 to 0.78. In terms of test-retest reliability, Pearson's r was 0.77 (n = 245, P < 0.01) and the intraclass correlation coefficient (ICC) (2,1) was 0.76 (n = 245; 95% CI = 0.70 to 0.81). All of the items had more than 50% of the sample selecting category of ‘1’ (Never or Not at all). No items had sparse data (i.e. <5 responses) in any category. Two items had a category inversion with the average raw score for which persons selecting category ‘5’ (Always/Very much) were lower than the average for person selecting category ‘4’ (Often/Quite a bit). No additional items were removed.

Dimensionality

Using CFA, a unidimensional model was confirmed (CFI = 0.965; RMSEA = 0.093). R2 values for 11 of the items were greater than 0.40 and 4 items were less than 0.40. In terms of local dependence, no item pairs were identified (i.e. residual correlations > |0.20|). Eigenvalue ratio (first to second) was 8.5.

IRT parameter, estimation, and model fit

Slopes (discrimination parameters) ranged from 1.05 to 4.21; thresholds (difficulty parameters) ranged from 0.10 to 3.23 (see ).

Table 2. Bladder Management Difficulties items and IRT parameters

The measurement precision in the theta range between 0.3 and 2.4 is roughly equivalent to a classical reliability of 0.95 or better ().

Figure 1. Bladder Management Difficulties item bank information and precision.

Figure 1. Bladder Management Difficulties item bank information and precision.

The IRTFITCitation61 macro program was used to examine S-X2 model fit statistics. All but one item (rToiletBL_80, ‘I felt my bladder management was under control’, P < 0.01) had adequate or better model fit statistics (P > 0.05), with marginal reliability equal to 0.84.

Differential item functioning

The lordif Citation62 program was used to examine DIF for six categories: age (≤49 n = 494 vs. ≥50 n = 251), sex (male n = 599 vs. female n = 158), education (some college and lower n = 543 vs. college degree and above n = 212), diagnosis (tetraplegia n = 416 vs. paraplegia n = 307), injury severity (incomplete n = 383 vs. complete n = 340), and time post injury (<1 year n = 218 vs. >1 year n = 539). Items were flagged for possible DIF when the probability associated with the χ2 test was <0.01 and the effect size measures (McFadden's pseudo R2) >0.02, which is a small but non-negligible effect. Overall, 4 items were flagged for DIF in at least one category based on the χ2 test; however, when the effect size measures were examined, the DIF was negligible and all 19 items were retained in the final, calibrated item bank.

Data analysis—bowel management difficulties

Preliminary analysis and item removal

Analyses began with the full pool of 58 items related to neurogenic bowel and its management. Following the first round of preliminary and CFA analyses, 16 items were removed for the following reasons (reasons for removal are not mutually exclusive): low item-total correlation (5 items), poor or ambiguous wording (5 items), bimodal distribution (4 items), LID (4 items), sparse category (<5 responses, 2 items), low slope (i.e. inability to discriminate between individuals at different levels of the underlying trait, 2 items), redundant with a better-performing item (2 items). Analyses were then re-run on the pool of 36 remaining items, and an additional 5 items were removed due to the following: LID (2 items), misfit (χ2 P < 0.05, 1 item), low item-total correlation (2 items). Analyses were repeated on the pool of 31 items, and an additional 4 items were removed (χ2 P < 0.05, 3 items; LID, 2 items; sparse categories, 1 item). Following analysis of this pool of 27 items, one final item was removed due to LID with two other items.

Following the above analyses, a final set of 26 items were retained. Internal consistency was α = 0.95 and item/total correlations ranged from 0.32 to 0.79. In terms of test-retest reliability, Pearson's r was 0.74 (n = 245; P < 0.01) and the ICC (2,1) was 0.74 (n = 245; 95% CI = 0.68 to 0.79). All of the items had more than 50% of the sample selecting category of ‘1’ (Never/Not at all). No items had sparse data (i.e. <5 responses) in any category. Two items had a category inversion with the average raw score for persons selecting category ‘5’ (Always/Very much) were lower than the average for person selecting category ‘4’ (Often/Quite a bit). No additional items were removed.

Dimensionality

Using CFA, a unidimensasional model was observed (CFI = 0.955; RMSEA = 0.078). R2 values for 22 of the items were greater than 0.40 and 4 items were less than 0.40. Eigenvalue ratio (first to second) was 9.8. In terms of local dependence, 1 item pair was identified with a residual correlation >|0.20| (rToiletBO_44, ‘Bowel care interfered with my sleep’ with rToiletBO_67, ‘My bowel program took 3 to 6 hours’; r = 0.226). Since the items appear to be measuring 2 separate constructs, the research team decided to retain both items.

IRT parameter estimation and model fit

Slopes ranged from 0.92 to 4.90; thresholds ranged from –0.01 to 3.68 (see ).

Table 3. Bowel Management Difficulties items and IRT parameters

The measurement precision in the theta range between –0.3 and 2.5 is roughly equivalent to a classical reliability of 0.95 or better ().

Figure 2. Bowel Management Difficulties item bank information and precision.

Figure 2. Bowel Management Difficulties item bank information and precision.

All items had adequate or better S-X2 model fit statistics (P > 0.05), with marginal reliability equal to 0.89.

Differential item functioning

DIF is an indication of item bias against one subgroup. In our analyses seven items were flagged for DIF in at least one category based on the χ2 test; however, when the effect size measures were examined, the DIF was negligible and all 26 items were retained in the final, calibrated item bank.

Data analysis—bladder complications

Preliminary analysis and item removal

As described above, 8 items related to secondary bladder complications (i.e. UTIs and kidney stones) had been removed from the Bladder Management Difficulties and these 8 items were analyzed as an individual bank using CFA and IRT methods. Prior to analyzing the 8 items, the research team removed two items that exhibited sparse responses in some categories and had low item-total correlations, signifying that they were unrelated to other items in the construct. Additionally, because 61% of the sample (n = 460) reported no UTIs as a complication, the research team decided against including the entire sample in the remaining analyses. Only 297 people responded more frequently than ‘Never’ to item rToiletBL_50, ‘I had a urinary tract infection’ and it was this subsample of participants that was retained for the analyses on the bladder complication items. Demographic characteristics of this subsample of 297 people may be found in . The item ‘I had a urinary tract infection’ was thus used as a screening item and was not included in the calibration analyses that included the 5 remaining items and the following results are based on this final 5-item set. Internal consistency was α = 0.72 and item/total correlations ranged from 0.38 to 0.60. In terms of test-retest reliability, Pearson's r was 0.70 (n = 245; P < 0.01 and the ICC (2,1) was 0.69 (n = 245; 95% CI = 0.61 to 0.76). All of the items had more than 40% of the sample selecting category of ‘1’ (Never/Not at all). No items had sparse data and there were no category inversions. No additional items were removed.

Dimensionality

The 5-item set demonstrated excellent fit to a unidimensional model (CFI = 0.955; RMSEA = 0.050). R2 values for 2 of the items were greater than 0.40 and 3 items were less than 0.40 (i.e. rToiletBL_28 = 0.355, rToiletBL_74 = 0.237, and rToiletBL_Com3 = 0.399). No items demonstrated LID. Eigenvalue ratio (first to second) was 3.8.

IRT parameter estimation and model fit

Given the reduced sample size, the 5 Bladder Complications items were calibrated using a constrained graded response model with a single (fixed) slope parameter. The slope for all items was 1.51; thresholds ranged from –0.33 to 3.33 (see ).

Table 4. Bladder complications (scale) items and IRT parameters

The measurement precision at all theta levels was less than classical reliability of 0.90. All items had adequate or better S-X2 model fit statistics (P > 0.05), with marginal reliability equal to 0.684.

Differential item functioning

With the subset of individuals (n = 297), DIF analysis could not be performed on the Bladder Complications items.

Short form selection and mode of administration

Bladder management difficulties and bowel management difficulties

Once the SCI-QOL Bladder Management Difficulties and Bowel Management Difficulties item banks were finalized, all items and parameters were programmed into the Assessment CenterSM Citation60 platform (www.assessmentcenter.net) and the banks can be administered as CATs or short forms (SF). The CAT administration parameters may be modified through Assessment CenterSM, for example to reduce the standard error of score estimates, for example to maximize reliability or to reduce test burden. Fixed-length SF versions of each bank were also developed (described below). Finally, end users also have the option of selecting individual items for administration. With psychometric assistance, additional (custom) SFs can also be developed. The options for administration are described in more detail below.

The SCI-QOL utilizes the same default CAT discontinue criteria as the Patient Reported Outcomes Measurement Information System (PROMIS); the CAT minimum number of items to administer is four and the maximum is 12 with a maximum standard error of 0.3. In the default settings, therefore, the CAT will always administer at least 4 items, then will discontinue when the standard error drops below 0.3 or after the 12th item is administered.

Alternatively, the user could change the ‘discontinue criteria’ of the CAT so that it will include a larger minimum number of items to increase scoring precision, or a smaller maximum number of items to limit respondent burden. For example, administering a minimum of 8 items would result in a lengthier test, but a more reliable score would be obtained.

Short forms versus CATs

In some cases, it is neither possible nor practical to administer items via CAT (e.g. when computer equipment and/or internet connection are not available). To address this need, the Bladder Management Difficulties, Bowel Management Difficulties and other SCI-QOL item banks are also available as short forms. The project investigators utilized psychometric and clinical input to develop a fixed, 8-item SF version of the Bladder Management Difficulties item bank (Bladder Management Difficulties SF 8a; component items are identified by bold text in ) and a 9-item short form version of the Bowel Management Difficulties item bank (Bowel Management Difficulties SF 9a; included items are identified by bold text in ). The SFs were developed by selecting the most informative items throughout the range of item ‘difficulty’ (i.e. amount of the underlying trait represented by the specific item). SF scores are directly comparable to those on the CAT or full item bank given the single underlying metric. The correlations of the CATs with various stopping rules and SFs to the full bank are provided in .

Table 5. Bladder Management Difficulties and Bowel Management Difficulties: accuracy of variable- and fixed-length CATs and short forms: correlations with full-bank score

SFs are available for administration directly within Assessment Center, or may be downloaded in portable document format (PDF) for administration, either by paper and pencil or by an alternate electronic data capture platform or system. End users may also develop additional, custom short forms, which could then be scored on the same underlying metric.

For each IRT-calibrated bank, we compared the reliability of the full bank, fixed-length SF (8 items for Bladder and 9 for Bowel), and variable-length CAT with the default minimum of 4 items as well as with a minimum of 8 items in an effort to determine the degree of measurement precision and error associated with each method of administration. The mean, standard deviation, range, and standard error ranges for the various administration options are presented in .

Table 6. Bladder Management Difficulties and Bowel Management Difficulties: breadth of coverage for variable length CAT, fixed length CAT, 8-item short form, and full item bank

Additionally, reliability curves for the full banks, SFs, variable length CATs (minimum of 4 items) and fixed-length CATs (8 or 9 items) may be found in (Bladder) and 4 (Bowel).

Figure 3. Bladder Management Difficulties: measurement reliability by T-score and assessment method.

Figure 3. Bladder Management Difficulties: measurement reliability by T-score and assessment method.

Figure 4. Bowel Management Difficulties: Measurement reliability by T-score and assessment method.

Figure 4. Bowel Management Difficulties: Measurement reliability by T-score and assessment method.

Scoring

All SCI-QOL scores were standardized on a T-metric, with a mean of 50 and a standard deviation of 10. For all Bladder and Bowel items, scoring was based on the SCI-QOL calibration data and the mean of 50 reflects the mean of an SCI population. However, a higher score does not necessarily mean better outcomes. With these CATs or SFs related to bladder and bowel difficulties, higher T scores suggest greater number of difficulties or complications. This approach was different from the other item banks that are derived from PROMIS where the score had been transformed to the PROMIS general population metric. CAT administrations of the SCI-QOL Bladder Management Difficulties and Bowel Management Difficulties item banks are scored automatically by Assessment CenterSM. Short forms, whether administered via Assessment CenterSM, paper and pencil, or another data capture platform, must be scored manually. An individual must complete all 8 component items in order to receive a raw score, which is a simple sum of response scores for the individual component items. Raw score to T-score conversion tables for the Bladder Management Difficulties SF8a and the Bowel Management Difficulties SF9a are provided in Tables and , respectively.

Table 7. T-score conversion table for SCI-QOL Bladder Management Difficulties SF8a

Table 8. T-score conversion table for SCI-QOL Bowel Management Difficulties SF9a

Bladder complications

Due to the reduced sample size, constrained slope parameter, and lower than desired level of reliability, the investigators decided to make the Bladder Complications items available as an experimental fixed-length scale rather than as a CAT-administered item bank. Scoring of the scale () is based on applying the IRT parameters to the calibration sample data and converting raw scores to standard scores on a T-metric. Note that participants must complete all 5 component items to receive a score. The Bladder Complications scale may be administered directly through the Assessment CenterSM platform or may be downloaded as a PDF file.

Table 9. T-score conversion table for SCI-QOL Bladder Complications scale

Discussion

Issues related to bladder and bowel management as well as bladder complications are extremely salient to individuals with SCI. Bladder and bowel management complications can have a profound impact on one's quality of life in many ways. Our qualitative data (e.g. based upon the interviews and focus groups) highlighted the importance of this topic resulting in the development of large pools of bladder-related (k = 38) and bowel-related items (k = 52). Following our field tests, we removed several bladder items in our pool that measured secondary bladder complications and retained the items focusing solely on bladder management issues. The final SCI-QOL Bladder Management Difficulties item bank contains 15 IRT-calibrated items that could be administered as a CAT or SF. The additional items that focused on secondary bladder complications appear to have important, clinically relevant information, but only pertained to a subset of our sample (those who had experienced a UTI), which seemed to occur in only 40% of our sample. These deserve further study to identify performance issues related to sample characteristics. Because this is such an important complication after SCI, we also retained a small set of 5 items related to UTIs that can be administered as a fixed short form. Participants also spoke passionately about bowel management issues and we developed a large pool of items (k = 52), of which 26 items were retained in the final IRT-calibrated item bank. The SCI-QOL Bladder Management Difficulties and Bowel Management Difficulties item banks are accessible in Assessment CenterSM and can be administered as a CAT so that researchers and clinicians can administer only the most precise and informative items based upon an individual's responses, thus reducing patient burden. This may be clinically useful in symptom monitoring and self-management in post-acute care settings. These item banks can also be administered as a fixed length SF (conversion tables provided; Tables and ). A SCI-QOL Bladder Complications SF has been created with 5-items and is appropriate to administer if an individual responds positively to a screening items for a UTI.

To the best of our knowledge, this is the first time that a patient-centered, modern measurement theory derived approach has been used to develop a patient-reported outcome measure about bladder and bowel management (and bladder complications), specifically designed for individuals with SCI. Our formative development work using focus groups and interviews strengthened our understanding the salience of bladder and bowel management issues and their impact on all aspects of quality of life. These constructs, in the context of SCI, are extremely important to this population.

Conclusion

To date, the assessment of patient health status in clinical practice has varied, being largely dependent on random communications between clinicians and their patients in a given episode of care. Often, there are no standardized measures being used to assess health status and complications. This lack of appropriate measures is especially problematic for patients with more severe comorbidities and functional disabilities, as in the case of SCI. The SCI-QOL builds upon the National Institute of Health (NIH) roadmap initiative and offers item banks specifically developed to assess bladder and bowel dysfunction after SCI. It provides clinicians with information about symptoms experienced by SCI patients, and provides the tools to monitor the effect of treatment and therapies to address management complications in these two key areas of care. The current article presents the development, item selection, and testing of these scales. It provides initial evidence of the reliability and validity of these items banks to be used by clinicians and researchers. This information can be used reliably to design treatment plans, and may improve communication about neurogenic bowel and bladder.

Disclaimer statements

Contributors All authors have contributed significantly to the design, analysis and writing of this manuscript. The contents represent original work and have not been published elsewhere. No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit upon the authors or upon any organization with which the authors are associated.

Funding This study was supported by National Institutes of Health grant number 5R01HD054659 (Eunice Kennedy Shriver National Institute of Child Health and Human Development/National Center on Medical Rehabilitation Research and the National Institute on Neurological Disorders and Stroke).

Conflicts of interest No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit upon the authors or upon any organization with which the authors are associated.

All SCI-QOL items and parameters are Copyright © 2015 David Tulsky and the Kessler Foundation. All rights reserved. All items are freely available to the public via the Assessment Center platform (www.assessmentcenter.net). There are currently no plans for Dr. Tulsky or Kessler Foundation to profit from the use of the copyrighted material.

Ethics approval The Institutional Review Board at each site reviewed and approved this project.

References

  • Yeo J, Walsh J, Rutkowski S, Soden R, Craven M, Middleton J. Mortality following spinal cord injury. Spinal Cord 1998;36(5):329–36.
  • DeVivo M, Chen Y. Trends in new injuries, prevalent cases, and aging with spinal cord injury. Arch Phys Med Rehabil 2011;92(3):332–8.
  • Ku JH. The management of neurogenic bladder and quality of life in spinal cord injury. BJU Int 2006;98(4):739–45.
  • Benevento BT, Sipski ML. Neurogenic bladder, neurogenic bowel, and sexual dysfunction in people with spinal cord injury. Phys Ther 2002;82(6):601–12.
  • Tate D, Duggan C. Stress and coping over the life course: a perspective on women with spinal cord injury. Ann Arbor, Michigan: University of Michigan; 2006. Final report, project #H133G020060.
  • Walsh K, Troxel SA, Stone AR. An assessment of the use of a continent catheterizable stoma in female tetraplegics. BJU Int 2004;94(4):595–7.
  • Hicken BL, Putzke JD, Richards JS. Bladder management and quality of life after spinal cord injury. Am J Phys Med Rehabil 2001;80(12):916–22.
  • Vaidyanathan S, Soni BM, Singh G, Oo T, Hughes PL. Barriers to implementing intermittent catheterisation in spinal cord injury patients in Northwest Regional Spinal Injuries Centre, Southport, UK. Scientific World J 2011;11:77–85.
  • Rockwood TH. Incontinence severity and QOL scales for fecal incontinence. Gastroenterol. 2004;126:S106–S13.
  • Consortium for Spinal Cord Medicine. Bladder management for adults with spinal cord injury: A Clinical Practice Guideline for Health Care Providers. Washington, DC: Paralyzed Veterans of America; 2006.
  • Wyndaele J, Kovindha A, Madersbacher H, Radziszewski P, Ruffion A, Schurch B, et al. Neurologic urinary incontinence. Neurourol Urodyn 2010;29(1):159–64.
  • Lenherr SM, Cameron AP. Voiding dysfunction and upper tract deterioration after spinal cord injury. Curr Bladder Dysfunct Rep 2013;8(4):289–96.
  • Renwick R, Nourhaghighi N, Manns PJ, Rudman DL. Quality of life for people with physical disabilities: a new instrument. Int J Rehabil Res 2003;26(4):279–87.
  • Welk B, Morrow S, Madarasz W, Baverstock R, Macnab J, Sequeira K. The validity and reliability of the neurogenic bladder symptom score (NBSS). J Urol 2014;192(2):452–7.
  • Bonniaud V, Bryant D, Parratte B, Guyatt G. Development and validation of the short form of a urinary quality of life questionnaire: SF-Qualiveen. J Urol 2008;180(6):2592–8.
  • Costa P, Perrouin-Verbe B, Colvez A, Didier JP, Marquis P, Marrel A, et al. Quality of life in spinal cord injury patients with urinary difficulties—development and validation of qualiveen. Eur Urol 2001;39(1):107–13.
  • Glickman S, Kamm M. Bowel dysfunction in spinal-cord-injury patients. Lancet 1996;347(9016):1651–3.
  • Anderson KD. Targeting recovery: priorities of the spinal cord-injured population. J Neurotrauma 2004;21(10):1371–83.
  • Krassioukov A, Eng JJ, Claxton G, Sakakibara BM, Shum S, SCIRE Research Team. Neurogenic bowel management after spinal cord injury: a systematic review of the evidence. Spinal Cord 2010;48(10):718–33.
  • Cardenas DD, Hoffman JM, Kirshblum S, McKinley W. Etiology and incidence of rehospitalization after traumatic spinal cord injury: a multicenter analysis. Arch Phys Med Rehabil 2004;85(11):1757–63.
  • DeVivo MJ, Farris V. Causes and costs of unplanned hospitalizations among persons with spinal cord injury. Top Spinal Cord Inj Rehabil 2011;16(4):53–61.
  • Davidoff G, Schultz J, Lieb T, Andrews K, Wardner J, Hayes C, et al. Rehospitalization after initial rehabilitation for acute spinal cord injury: incidence and risk factors. Arch Phys Med Rehabil 1990;71(2):121–4.
  • Faaborg PM, Christensen P, Finnerup N, Laurberg S, Krogh K. The pattern of colorectal dysfunction changes with time since spinal cord injury. Spinal Cord 2008;46(3):234–8.
  • Finnerup NB, Faaborg P, Krogh K, Jensen TS. Abdominal pain in long-term spinal cord injury. Spinal Cord. 2008;46(3):198–203.
  • Del Popolo G, Mosiello G, Pilati C, Lamartina M, Battaglino F, Buffa P, et al. Treatment of neurogenic bowel dysfunction using transanal irrigation: a multicenter Italian study. Spinal Cord. 2008;46(7):517–22.
  • Goetz LL, Nelson AL, Guihan M, Bosshart HT, Harrow JJ, Gerhart KD, et al. Provider adherence to implementation of clinical practice guidelines for neurogenic bowel in adults with spinal cord injury. J Spinal Cord Med. 2005;28(5):394–406.
  • Keshavarzian A, Barnes W, Bruninga K, Nemchausky B, Mermall H, Bushnell D. Delayed colonic transit in spinal cord-injured patients measured by indium-111 Amberlite scintigraphy. Am J Gastroenterol 1995;90(8):1295–300.
  • Menardo G, Bausano G, Corazziari E, Fazio A, Marangi A, Genta V, et al. Large-bowel transit in paraplegic patients. Dis Colon Rectum 1987;30(12):924–8.
  • Haas U, Geng V, Evers G, Knecht H. Bowel management in patients with spinal cord injury–a multicentre study of the German speaking society of paraplegia (DMGP). Spinal Cord 2005;43(12):724–30.
  • Stone JM, Nino-Murcia M, Wolfe VA, Perkash I. Chronic gastrointestinal problems in spinal cord injury patients: a prospective analysis. Am J Gastroenterol 1990;85(9):1114–9.
  • Frank L, Kleinman L, Farup C, Taylor L, Miner P. Psychometric validation of a constipation symptom assessment questionnaire. Scand J Gastroenterol 1999;34(9):870–7.
  • Marquis P, De La Loge C, Dubois D, McDermott A, Chassany O. Development and validation of the patient assessment of constipation quality of life questionnaire. Scand J Gastroenterol 2005;40(5):540–51.
  • Krogh K, Christensen P, Sabroe S, Laurberg S. Neurogenic bowel dysfunction score. Spinal Cord 2006;44(10):625–31.
  • Sansoni J, Hawthorne G, Marosszeky N, Moore K, Fleming G, Owen E. Technical manual and instructions for the revised incontinence and patient satisfaction tools. New South Wales, Australia: Centre for Health Service Development, University of Wollongong; 2011.
  • Akkoc Y, Ersöz M, Yıldız N, Erhan B, Alaca R, Gök H, et al. Effects of different bladder management methods on the quality of life in patients with traumatic spinal cord injury. Spinal Cord 2013;51(3):226–31.
  • Stöhrer M, Blok B, Castro-Diaz D, Chartier-Kastler E, Del Popolo G, Kramer G, et al. EAU guidelines on neurogenic lower urinary tract dysfunction. Eur Urol 2009;56(1):81–8.
  • Feifer A, Corcos J. Contemporary role of suprapubic cystostomy in treatment of neuropathic bladder dysfunction in spinal cord injured patients. Neurourol Urodyn 2008;27(6):475–9.
  • Sekar P, Wallace DD, Waites KB, DeVivo MJ, Lloyd LK, Stover SL, et al. Comparison of long-term renal function after spinal cord injury using different urinary management methods. Arch Phys Med Rehabil 1997;78(9):992–7.
  • Böthig R, Hirschfeld S, Thietje R. Quality of life and urological morbidity in tetraplegics with artificial ventilation managed with suprapubic or intermittent catheterisation. Spinal Cord 2012;50(3):247–51.
  • Cameron AP, Rodriguez GM, Schomer KG. Systematic Review of urological followup after spinal cord injury. J Urol 2012;187(2):391–7.
  • Cameron AP, Wallner LP, Forchheimer MB, Clemens JQ, Dunn RL, Rodriguez G, et al. Medical and psychosocial complications associated with method of bladder management after traumatic spinal cord injury. Arch Phys Med Rehabil 2011;92(3):449–56.
  • Pannek J, Kullik B. Does optimizing bladder management equal optimizing quality of life? Correlation between health-related quality of life and urodynamic parameters in patients with spinal cord lesions. Urology 2009;74(2):263–6.
  • El-Masri WS, Chong T, Kyriakider AE, Wang D. Long-term follow-up study of outcomes of bladder management in spinal cord injury patients under the care of the Midlands centre for spinal injuries in sswestry. Spinal Cord 2012;50(1):14–21.
  • Stiens SA, Bergman SB, Goetz LL. Neurogenic bowel dysfunction after spinal cord injury: clinical evaluation and rehabilitative management. Arch Phys Med Rehabil 1997;78(3, Supplement 1):S86–S102.
  • Berkowitz M, Harvey C, Greene CG, Wilson SE. The economic consequences of traumatic spinal cord injury. New York, NY: Demos Medical Publishing; 1992.
  • Oh S, Shin H, Paik N, Yoo T, Ku J. Depressive symptoms of patients using clean intermittent catheterization for neurogenic bladder secondary to spinal cord injury. Spinal Cord 2006;44(12):757–62.
  • Borzyskowski T, Cox A, Edwards M, Owen A. Neuropathic bladder and intermittent catheterization: social and psychological impact on families. Dev Med Child Neurol 2004;46(3):160–7.
  • Weitzenkamp DA, Gerhart KA, Charlifue SW, Whiteneck GG, Savic G. Spouses of spinal cord injury survivors: the added impact of caregiving. Arch Phys Med Rehabil 1997;78(8):822–7.
  • Kolakowsky-Hayner SA, Kishore R. Caregiver functioning after traumatic injury. NeuroRehabilitation 1999;13(1):27–33.
  • Samejima F, van der Liden W, Hambleton R. The graded response model. Handbook of modern item response theory. New York: Springer; 1996. p. 85–100.
  • Lai JS. Differential item functioning (DIF). In: Cella D, (ed.) Item reponse theory modeling at CORE. Chicago, IL: Northwestern University; 2002. p. 28–44.
  • Tulsky DS, Kisala PA, Victorson D, Tate DG, Heinemann AW, Charlifue S, et al. Overview of the Spinal Cord Injury – Quality of Life (SCI-QOL) measurement system. J Spinal Cord Med 2015;38(3):257–69.
  • Tulsky DS, Kisala PA, Victorson D, Choi SW, Gershon R, Heinemann AW, et al. Methodology for the development and calibration of the SCI-QOL item banks. J Spinal Cord Med 2015;38(3):270–87.
  • Tulsky DS, Kisala PA, Victorson D, Tate D, Heinemann AW, Amtmann D, et al. Developing a contemporary patient-reported outcomes measure for spinal cord injury. Arch Phys Med Rehabil 2011;92(10 Suppl):S44–51.
  • Cella D, Nowinski C, Peterman A, Victorson D, Miller D, Lai J-S, et al. The neurology quality-of-life measurement initiative. Arch Phys Med Rehabil 2011;92(10, Supplement):S28–S36.
  • Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Thousand Oaks, CA: Sage Publications; 2005.
  • Eremenco SL, Cella D, Arnold BJ. A comprehensive method for the translation and cross-cultural validation of health status questionnaires. Eval Health Prof 2005;28(2):212–32.
  • MetaMetrics. The LEXILE framework for reading. Durham, NC: MetaMetrics Inc; 1995.
  • Kirshblum SC, Burns SP, Biering-Sørensen F, Donovan W, Graves DE, Jha A, et al. International standards for neurological classification of spinal cord injury (Revised 2011). J Spinal Cord Med 2011;34(6):535–46.
  • Gershon R, Rothrock NE, Hanrahan RT, Jansky LJ, Harniss M, Riley W. The development of a clinical outcomes survey research application: assessment center. Qual Life Res 2010;19(5):677–85.
  • Bjorner JB, Smith K, Stone C, Sun X. IRTFIT: A Macro for Item Fit and Local Dependence Tests under IRT Models 2007.
  • Choi SW, Gibbons LE, Crane PK. lordif: an R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and monte carlo simulations. J Stat Softw 2011;39(8):1–30.