903
Views
131
CrossRef citations to date
0
Altmetric
Original Research

Actigraphy-based sleep estimation in adolescents and adults: a comparison with polysomnography using two scoring algorithms

, , , , , , & show all
Pages 13-20 | Published online: 18 Jan 2018

Abstract

Objectives

Actigraphy is widely used to estimate sleep–wake time, despite limited information regarding the comparability of different devices and algorithms. We compared estimates of sleep–wake times determined by two wrist actigraphs (GT3X+ versus Actiwatch Spectrum [AWS]) to in-home polysomnography (PSG), using two algorithms (Sadeh and Cole–Kripke) for the GT3X+ recordings.

Subjects and methods

Participants included a sample of 35 healthy volunteers (13 school children and 22 adults, 46% male) from Boston, MA, USA. Twenty-two adults wore the GT3X+ and AWS simultaneously for at least five consecutive days and nights. In addition, actigraphy and PSG were concurrently measured in 12 of these adults and another 13 children over a single night. We used intraclass correlation coefficients (ICCs), epoch-by-epoch comparisons, paired t-tests, and Bland–Altman plots to determine the level of agreement between actigraphy and PSG, and differences between devices and algorithms.

Results

Each actigraph showed comparable accuracy (0.81–0.86) for sleep–wake estimation compared to PSG. When analyzing data from the GT3X+, the Cole–Kripke algorithm was more sensitive (0.88–0.96) to detect sleep, but less specific (0.35–0.64) to detect wake than the Sadeh algorithm (sensitivity: 0.82–0.91, specificity: 0.47–0.68). Total sleep time measured using the GT3X+ with both algorithms was similar to that obtained by PSG (ICC=0.64–0.88). In contrast, agreement between the GT3X+ and PSG wake after sleep onset was poor (ICC=0.00–0.10). In adults, the GT3X+ using the Cole–Kripke algorithm provided data comparable to the AWS (mean bias=3.7±19.7 minutes for total sleep time and 8.0±14.2 minutes for wake after sleep onset).

Conclusion

The two actigraphs provided comparable and accurate data compared to PSG, although both poorly identified wake episodes (i.e., had low specificity). Use of actigraphy scoring algorithm influenced the mean bias and level of agreement in sleep–wake times estimates. The GT3X+, when analyzed by the Cole–Kripke, but not the Sadeh algorithm, provided comparable data to the AWS.

Introduction

Actigraphy is increasingly used to provide objective measurements of sleep.Citation1Citation3 A PubMed search done in April 2017 revealed 2,503 scientific publications that include actigraphy and sleep. Nonetheless, there are limited data that directly assess agreement with polysomnography (PSG), and evaluate the extent to which findings change as a result of the use of different actigraphs and alternative scoring algorithms and the variation across age groups. Such data are timely, given the active use of actigraphs in large population-based initiatives, including the UK Biobank. Understanding the comparability of data across studies is important in interpreting and generalizing findings.

The most commonly used algorithms for sleep–wake scoring in children, adolescents, and adults have been developed by Sadeh et alCitation4 and Cole et alCitation5. Sadeh’s (S) algorithm was originally validated on a healthy sample of adolescents and young adults (age range 10–25 years), whereas Cole–Kripke’s (CK) algorithm was validated in an adult sample (age range 35–65 years). Few studies have validated these two scoring algorithms against the gold standard of PSG; these studies were limited by not assessing both children and adults concurrently,Citation6Citation9 studying patients referred for PSG,Citation7Citation9 using only a single actigraph,Citation6,Citation8,Citation9 and not synchronizing clock times for PSG and actigraphy.Citation8

In particular, little research is available that addresses the validity of a newer actigraph, the GT3X+ (ActiGraph; ActiGraph, Pensacola, FL, USA), compared to the “gold standard” PSG. The GT3X+ is in use in large-scale epidemiologic studies, such as the National Health and Nutrition Examination Survey, the Transdisciplinary Research on Energetics initiative, and a prebirth cohort study, Project Viva. Little information is available regarding how the GT3X+ device performs in comparison to a device commonly used in sleep research, the Actiwatch Spectrum (AWS; Philips/Respironics, Murrysville, PA, USA).Citation10Citation12 To the best of our knowledge, no study has yet validated the GT3X+ for sleep in school children and young teens (age 10–14 years). It is very important to conduct actigraphy validation studies in pediatric populations, given the significant sleep problems that children suffer from and the emerging data from small-as well as large-scale research studies.Citation2

Accordingly, in this study, our aims were to: 1) assess the accuracy of sleep–wake estimation of the GT3X+ actigraph in children in addition to adults; 2) examine the validity of GT3X+ with the CK scoring algorithm; and 3) evaluate the agreement between sleep parameters from concurrently used GT3X+ and AWS wrist actigraph devices.

Subjects and methods

Study sample

Participants consisted of healthy volunteers, 22 adults and 13 children (age 10–14 years). We identified volunteers through local advertisement at gyms, workplaces, and schools. Exclusion criteria included self-reported severe untreated diagnosed sleep disorder (e.g., untreated severe sleep apnea), serious or acute illness, use of sedating medications, and disabilities that might interfere or restrict mobility. This study was conducted in accordance with “The Code of Ethics of the World Medical Association” (Declaration of Helsinki), and the Institutional Review Board of Brigham and Women’s Hospital approved the study. All participants, or legal guardians of the children under the legal age, provided written informed consent for this study. In addition, we obtained assent from children under 14 years of age.

Actigraphy and sleep diary

We asked all adults and children to wear a GT3X+ device on the nondominant wrist for at least 5 days. Participants completed a diary using a smartphone app before going to bed and upon awakening each morning, in which they noted time in bed, time out of bed, nocturnal awakenings, and any naps taken. The app was programmed with diary questions similar to those used for the consensus sleep diary by Ginger. io (California Medical P.C., San Francisco, CA, USA).Citation13 All logs and participants’ answers were sent to a secure web-based dashboard. Electronic sleep diaries have been shown to provide valid information on sleep patterns.Citation14 To compare the GT3X+ with the AWS, adults also wore an AWS concurrently on the nondominant wrist. The type of device worn nearer to the wrist was randomly determined. Children only wore the GT3X+ to minimize burden.

Activity counts for the GT3X+ were collected in 1-minute epochs, whereas data for the AWS were collected in 30-s epochs, reflecting the default modes of these devices. We analyzed GT3X+ data using ActiLife 6 software (Version 6.13.1, ActiGraph). The software provides the S and CK algorithms to score sleep, and we applied each independently to derive sleep–wake estimates from the GT3X+ devices. The S algorithm was originally validated in adolescents and young adults wearing an AMA-32 actigraph (Ambulatory Monitoring, Inc., Ardsley, NY, USA), whereas the CK algorithm was validated in adults wearing a Motionlogger Actigraph (Ambulatory Monitoring, Inc.). In order to match the output of the more sensitive GT3X+ device with the Motionlogger Actigraph and AMA-32, the ActiGraph company adapted the original S and CK algorithms to the ActiGraph devices by performing a side-by-side test using devices from both companies worn together (D Judge, ActiGraph, personal communication, April, 2016). For the CK algorithm, the epoch data were adjusted through scaling the count values by 100 and setting scaled values over 300 to 300. For the S algorithm, the company changed the original scoring algorithm threshold for “probability of sleep” from ≥0 counts to ≥−4 counts. We scored the AWS data using Respironics Actiware 5 (Version 5.59, Philips/Respironics), which is the only algorithm provided by this device for analysis. The algorithm has three threshold settings. We used a medium threshold of 40 counts per epoch for wake detection with the AWS. The medium-threshold setting is thought to give the best compromise between detecting sleep and wake in terms of sensitivity and specificity compared to PSG.Citation10 We manually identified the night-time sleep period based on the self-completed Ginger.io smartphone app sleep diaries and observation of a sharp decrease/increase in activity.

Polysomnography

For a single night during the actigraphy recording period, 12 of the 22 enrolled adults and all 13 children underwent an unattended overnight PSG at their homes (Somté; Compumedics, Abbotsford, Australia), collecting the following channels for sleep staging: electroencephalogram (Fz-Cz, C4-M1, Oz-Cz), bilateral electrooculograms, and submental electromyogram. The Compumedics system has been proven to be feasible for children in an unattended setting.Citation15 Trained research staff went to the homes 1–3 hours before usual bedtime to place all sensors. PSG and actigraphs were precisely synchronized by initializing all devices on the same computer. PSG studies were scored manually by a registered polysomnologist, blinded to the actigraphy and all other data, using established criteria for sleep staging in 30-s epochs.Citation16 We identified “lights off” and “lights on” from information recorded by the participant using the Ginger.io smartphone app diary. The PSG was considered satisfactory if there were at least 5 hours of electroencephalogram that could be staged for sleep and sleep efficiency exceeded 80%.

Data analysis

We performed two sets of analyses to assess the agreement between actigraphy and PSG: an analysis of sleep summary statistics derived from data across the sleep period and an epoch-by-epoch analysis. The PSG to actigraphy comparison was based on a single concurrent night of monitoring. Total sleep time (TST) was calculated as the number of minutes scored as sleep between “lights off” and “lights on”. Wake after sleep onset (WASO) was defined as the number of minutes scored as WASO during the sleep period, and sleep efficiency (SE) as the ratio of TST to the total time between “lights off” and “lights on” and reported as percentage. Paired t-tests or Wilcoxon rank-sum tests were used to evaluate differences in sleep variables between each device, specific for each algorithm, and PSG. We calculated the mean differences between actigraphy settings and PSG and its corresponding 95% CI. Agreement between PSG and actigraphy was also examined using intraclass correlation coefficients (ICCs). The Bland–Altman concordance technique was applied to examine degree of agreement between the two actigraphy devices, GT3X+ and AWS, for TST and WASO. For the epoch-by-epoch analysis, we calculated accuracy, sensitivity, and specificity. In order to match the 30-s PSG sleep epochs with the 1-minute actigraphy epochs from the GT3X+, we converted the 1-minute GT3X+ epochs to 30-s epochs by dividing into half the GT3X+ epochs. PSG data were reduced to binary form (0=wakefulness and 1=any sleep state). Accuracy was defined as the total number of epochs of sleep defined by PSG that were correctly classified by actigraphy divided by the total number of scored epochs (true sleep categorized by actigraphy/total scored epochs). Sensitivity represents the proportion of epochs identified by PSG that were correctly classified as sleep by actigraphy (true sleep categorized by actigraphy/sleep categorized by PSG), whereas specificity is the proportion of epochs identified correctly as wake by the actigraph (true wake categorized by actigraphy/wake categorized by PSG). We performed separate analyses for children and adults. Analyses were conducted using SAS 9.4 (SAS Institute, Inc., Cary, NC, USA).

Results

Descriptive characteristics of the study sample are shown in . Participants were 22 adults (mean age of 32.3±11.4 years) and 13 children (mean age of 13.0±1.4 years). The sample consisted of 19 females and 16 males, and 46% were non-Hispanic white participants. Participants provided a mean of 7.3±1.5 nights of valid actigraphy data. Of the initial 25 overnight PSG studies, 13 adolescent studies and nine adult studies were satisfactory, but three adult studies failed (two with general technical failure and one with misplaced leads). A failure rate of about 10% has been described for in-home PSG.Citation17

Table 1 Descriptive characteristics of the study population

Agreement between sleep summary statistics using the actigraphs and PSG

Mean values, mean differences, and ICCs for sleep variables comparing PSG with actigraphy for the sample of children and adults are presented in and . In adults, average TST by PSG was 435.6±36.9 minutes. Compared to this, the GT3X+ analyzed using the CK algorithm overestimated TST by an average of 14 minutes, whereas the GT3X+ analyzed using the S algorithm underestimated sleep by an average of 14 minutes. In children, the corresponding average TST by PSG was 483.4±62.8 minutes. The GT3X+ analyzed using the CK algorithm and the GT3X+ analyzed using the S algorithm underestimated TST by an average of 18 and 49 minutes, respectively. The ICC for TST between the GT3X+ with the CK algorithm and PSG was 0.81 in adults and 0.88 in children. The ICC for TST between PSG and the GT3X+ using the S algorithm was somewhat lower (ICC=0.64 in adults and ICC=0.79 in children).

Table 2 mean ± SD/median (interquartile range) values for PSG and actigraphy of total sleep time, wake after sleep onset, and sleep efficiency

Table 3 Mean differences and intraclass correlation coefficients between PSG and actigraphy

The mean PSG WASO was 36.9±23.6 minutes in adults and 18.1±14.6 minutes in children. For average WASO derived from GT3X+, the S algorithm overestimated wake by 21 minutes (57%) in adults and by 59 minutes (327%) in children, resulting in a 4.5% (adults) and 11.6% (children) lower SE.

The CK algorithm underestimated wake by 1 minute (4%) in adults and overestimated wake by 31 minutes (63%) in children. This resulted in a 1.3% higher (adults) and 5.8% lower (children) SE, respectively. However, there was little overall agreement between the GT3X+ and PSG for WASO (CK: ICC=0.00 in children and ICC=0.10 in adults; S: ICC=0.00 in children and ICC=0.00 in adults) or for SE (CK: ICC=0.00 in children and ICC=0.33 in adults; S: ICC=0.00 in children and ICC=0.13 in adults).

Compared to PSG, TST, WASO, and SE derived from AWS differed by 9 minutes, 7 minutes, and 2%, respectively. The ICCs between PSG and AWS were high for TST (ICC=0.84) and low for WASO (ICC=0.00) and SE (0.18).

Device agreement analysis

We constructed Bland–Altman plots to visualize the level of agreement between GT3X+ and AWS for TST and WASO in 22 adults. The mean biases were estimated at −81.9±19.7 minutes (TST) and 34.2±18.0 minutes (WASO) for the S algorithm and 3.7±19.7 minutes (TST) and 8.0±14.2 minutes (WASO) for the CK algorithm, compared to the AWS ().

Figure 1 Bland–Altman plots of GT3X+ and AWS in 22 adults for (A) total sleep time: GT3X+: CK versus AWS, (B) WASO: GT3X+: CK versus AWS, (C) total sleep time: GT3X+: Sadeh versus AWS, and (D) WASO: GT3X+: Sadeh versus AWS. The dotted line indicates the mean of the differences or bias, and the dashed lines indicate the lower and upper 95% limits of agreement.

Abbreviations: AWS, Actiwatch Spectrum; CK, Cole–Kripke; WASO, wake after sleep onset.
Figure 1 Bland–Altman plots of GT3X+ and AWS in 22 adults for (A) total sleep time: GT3X+: CK versus AWS, (B) WASO: GT3X+: CK versus AWS, (C) total sleep time: GT3X+: Sadeh versus AWS, and (D) WASO: GT3X+: Sadeh versus AWS. The dotted line indicates the mean of the differences or bias, and the dashed lines indicate the lower and upper 95% limits of agreement.

Epoch-by-epoch agreement analysis

Sensitivity, specificity, and accuracy of epoch-by-epoch comparisons between the actigraphy and PSG data in the adolescent and adult samples are shown in . Overall sensitivity (i.e., ability to accurately identify sleep) was high for all actigraphs and algorithms, ranging from 0.82 to 0.88 in children and from 0.91 to 0.96 in adults. However, specificity values (i.e., ability to accurately identify wake) were moderate to low, ranging from 0.64 to 0.68 in children and from 0.34 to 0.47 in adults. The GT3X+ with the CK algorithm was not only more sensitive (0.96 in adults, 0.88 in children), but also less specific (0.35 in adults, 0.64 in children), compared to the GT3X+ with the S algorithm.

Table 4 Sensitivity, specificity, and accuracy of epoch-by-epoch comparisons with PSG

Discussion

Although the GT3X+ and similar actigraph devices are increasingly used across a range of research, there is a paucity of research that addresses the comparability of information from these devices to other actigraphs, or validity as compared to PSG. Specifically, the validity of the GT3X+ in children using the CK algorithm has not yet been examined. To address this gap, we evaluated the accuracy of the wrist-placed GT3X+ to detect sleep–wake epochs and summary statistics compared to overnight concurrent PSG, using both the S and CK sleep algorithms in healthy children and adults. We also examined the agreement between the GT3X+ and AWS over at least five nights of monitoring in adults. Each actigraphy device had comparable moderate to high accuracy compared to PSG. Consistent with previous studies, the specificity for both actigraphs and algorithms to detect wakefulness within sleep periods was moderate to low.Citation1 Overall, the CK algorithm was more sensitive, but less specific than the S algorithm. For both algorithms, sleep misclassification was higher in children, whereas wake misclassification was higher in adults. Both the S and CK algorithms overestimated wake and underestimated sleep in children. A different picture emerged for the CK algorithm and the AWS in adults: as compared to PSG, sleep was slightly overestimated and wake underestimated. When used with the CK algorithm, the GT3X+ presented data comparable to the AWS in adults.

So far, only two previous studies have investigated the performance of the wrist-placed GT3X+ compared to PSG and to our knowledge, ours is the first study in school children and young teens.Citation10,Citation12 Cellini et al compared the GT3X+ with the S algorithm against PSG-recorded naps in 30 healthy young adults and found that the GT3X+ overestimated SE (by 14.5%) and TST (by 8.8 minutes) and underestimated WASO (by 5.9 minutes). In contrast, we found that the S algorithm underestimated sleep and overestimated wake both in children and adults. This is likely explained by the fact that Cellini et al recorded naps and not overnight sleep.Citation10 Naps and overnight sleep differ in length, and the amount of deep sleep and rapid eye movement sleep, which can be associated with different movements.Citation18

Slater et al evaluated the GT3X+ with the S algorithm in 108 young adults and compared it to an overnight PSG.Citation12 The authors reported similar values for TST and SE (mean differences of <1 minutes and <2%, respectively), whereas WASO was systematically overestimated by about 16 minutes, resulting in a high sensitivity of 0.90 and a moderate specificity of 0.60. Our results are in line with these findings by showing a significant overestimation of WASO using the GT3X+ with the S algorithm in both children and adults.

To the best of our knowledge, ours is the first study also to evaluate the GT3X+ with the CK scoring algorithm against PSG. Overall, there was stronger agreement with PSG using the CK algorithm, but the specificity in detecting wakefulness was better for the S algorithm. These results are consistent with four other studies that evaluated various actigraph models produced by Ambulatory Monitoring, Inc. Meltzer et al examined the S and CK scoring algorithms in 115 youths, aged 3–18 years, wearing the Motionlogger Sleep Watch compared to PSG. The researchers found that the S algorithms underestimated TST and SE by clinically meaningful amounts (23.6 minutes and 4.4%, respectively), whereas the corresponding differences for the CK algorithm were only 2.4 minutes and 0.4%.Citation7 The authors reported high sensitivities of 0.89 and 0.92 and moderate specificities of 0.73 and 0.65 for the S and CK algorithms, respectively. Kim et al also compared both the S and CK algorithms with PSG using the Action-W actigraph in patients with sleep apnea. The intraclass correlation analysis for TST estimated by PSG and actigraphy revealed that the CK algorithm performed better than the S algorithm (CK, ICC=0.39 and S, ICC=0.27).Citation8 However, their ICCs for TST were much lower than ours. These studies, including ours, show that the CK algorithm is more accurate not only in adults but also in children, which is striking since the CK was originally validated in an adult sample. Kim et al also performed a subgroup analysis revealing that actigraphy was more reliable in patients with less severe sleep apnea.Citation8 Several other studies have shown that actigraphy misclassifies sleep and wake in patients with sleep apnea, in particular, tending to underestimate sleep.Citation9,Citation19,Citation20 de Souza et al assessed the Mini Motionlogger Actigraphy in 21 healthy volunteers and also reported a slightly higher sensitivity (0.97 versus 0.99) and lower specificity (0.44 versus 0.34) for the S compared to the CK algorithm, when assessing epoch-by-epoch agreement data with PSG in 21 adult volunteers.Citation6 In an earlier study, Johnson et al found high agreement for TST estimation when comparing the S versus CK algorithms (i.e., ICC of 0.98) with the Octagonal Sleep Watch 2.01 in a sample of 181 adolescents participating in the Cleveland TeenZzz Study.Citation9 There is always a trade-off between sensitivity and specificity, and further analysis in exploring the effect of sleep algorithm thresholds might, therefore, be useful.

We also evaluated the agreement between sleep parameters from concurrently used GT3X+ and AWS devices over 1 week of recording. In adults, the GT3X+ with the CK algorithm provided data that was comparable to the ASW with average differences in sleep and wake time of 5 minutes. In contrast, larger differences were observed between the GT3X+ analyzed with the S and the AWS (23 minutes for TST and 28 minutes for WASO). Of note, the difference in WASO between the two devices increased with increasing WASO, meaning that the comparability decreases with more wake.

Our study has a number of significant strengths, including inclusion of both children and adults, performance of a side-by-side comparison of two devices with PSG, use of rigorous statistical testing, and assessments conducted under free-living conditions. We assessed agreement using both summary variables and epoch-by-epoch measurements. However, the study also has several limitations. Our sample size was small (13 children and nine adults for aims 1 and 2, and 22 adults for aim 3) and we only performed a single night of PSG. But PSG was performed on the same night as actigraphy, directly informing on sleep–wake agreement. We used an alternative electroencephalography montage, equally acceptable for use, which often results in “cleaner” electroencephalography signals.Citation21 The sample consisted of healthy volunteers, and therefore, the results cannot be generalized to patients with sleep disorders or other comorbidities. Future research should, therefore, repeat this validation study in populations with sleep disorders such as obstructive sleep apnea or insomnia.

Conclusion

In conclusion, our study suggests that the GT3X+, a device of increasing use in a wide variety of research settings in children and adults, is a valid device to estimate TST, WASO, and SE in school children and adults. However, the poor specificity suggests that actigraphy should be used more cautiously in studies where periods of wake detection are important. For example, evaluation of wake time will be underestimated, which can reduce clinical utility in disorders such as insomnia, where there is interest in identifying wake periods. For both the S and CK algorithms, sensitivity tended to be higher in adults, while specificity tended to be higher in children. When analyzing data from the GT3X+, the CK algorithm tended to be more sensitive (0.88–0.96) to detect sleep, but less specific (0.35–0.64) to detect wake than the S algorithm (sensitivity: 0.82–0.91, specificity: 0.47–0.68). The GT3X+ data analyzed using the CK algorithm provided comparable sleep/wake estimation compared to the AWS, suggesting that information derived from each device provides similar data in healthy adults.

Acknowledgments

This work was supported by a Year 4 Within-Center Developmental Award and a Year 5 Cross-Center Developmental Award from the National Cancer Institute Centers for Trans-disciplinary Research on Energetics and Cancer (TREC; U54CA155626, MQ, PI; EMT, Co-I, SR, Co-I). MQ was supported by a scholarship from the Max Kade Foundation (NY) and from the Tuebinger Program for the Advancement of Women in Science. We thank Ginger.io (California Medical P.C., San Francisco, CA, USA) for providing us their Ginger.io smartphone app.

Disclosure

SR has received grant support from Jazz Pharmaceuticals, outside the submitted work. The other authors report no conflicts of interest in this work.

References

  • SadehAThe role and validity of actigraphy in sleep medicine: an updateSleep Med Rev201115425926721237680
  • MeltzerLJMontgomery-DownsHEInsanaSPWalshCMUse of actigraphy for assessment in pediatric sleep researchSleep Med Rev201216546347522424706
  • AmyWHawleyMDRosemarySCHSarahNBActigraphy and Sleep/Wake DiariesOxfordOxford University Press2013
  • SadehASharkeyKMCarskadonMAActivity-based sleep-wake identification: an empirical test of methodological issuesSleep19941732012077939118
  • ColeRJKripkeDFGruenWMullaneyDJGillinJCAutomatic sleep/wake identification from wrist activitySleep19921554614691455130
  • de SouzaLBenedito-SilvaAAPiresMLPoyaresDTufikSCalilHMFurther validation of actigraphy for sleep studiesSleep2003261818512627737
  • MeltzerLJWalshCMTraylorJWestinAMDirect comparison of two new actigraphs and polysomnography in children and adolescentsSleep201235115916622215930
  • KimMJLeeGHKimCSComparison of three actigraphic algorithms used to evaluate sleep in patients with obstructive sleep apneaSleep Breath201317129730422447172
  • JohnsonLKirchnerHLRosenCLSleep estimation using wrist actigraphy in adolescents with and without sleep disordered breathing: a comparison of three data modesSleep200730789990517682661
  • CelliniNBumanMPMcDevittEARickerAAMednickSCDirect comparison of two actigraphy devices with polysomnographically recorded naps in healthy young adultsChronobiol Int201330569169823721120
  • ZinkhanMBergerKHenseSAgreement of different methods for assessing sleep characteristics: a comparison of two actigraphs, wrist and hip placement, and self-report with polysomnographySleep Med20141591107111425018025
  • SlaterJABotsisTWalshJKingSStrakerLMEastwoodPRAssessing sleep using hip and wrist actigraphySleep Biol Rhythms2015132172180
  • CarneyCEBuysseDJAncoli-IsraelSThe consensus sleep diary: standardizing prospective sleep self-monitoringSleep201235228730222294820
  • MullerSHemmiMHWilhelmFHBarrRGSchneiderSParental report of infant sleep behavior by electronic versus paper-and-pencil diaries, and their relationship to actigraphic sleep measurementJ Sleep Res201120459860521707809
  • GoodwinJLEnrightPLKaemingkKLFeasibility of using unattended polysomnography in children for research–report of the Tucson Children’s Assessment of Sleep Apnea study (TuCASA)Sleep200124893794411766164
  • BerryRBBrooksRGamaldoCEThe American Academy of Sleep MedicineThe AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, Version 2.2Darien, ILAmerican Academy of Sleep Medicine2015
  • TanHLKheirandish-GozalLGozalDPediatric home sleep apnea testing: slowly getting there!Chest201514861382139526270608
  • KawadaTSuzukiHShimizuTKatsumataMAgreement in regard to total sleep time during a nap obtained via a sleep polygraph and accelerometer: a comparison of different sensitivity thresholds of the accelerometerInt J Behav Med201219339840121744139
  • ElbazMRoueGMLofasoFQuera SalvaMAUtility of actigraphy in the diagnosis of obstructive sleep apneaSleep200225552753112150319
  • HednerJPillarGPittmanSDZouDGroteLWhiteDPA novel adaptive wrist actigraphy algorithm for sleep-wake assessment in sleep apnea patientsSleep20042781560156615683148
  • DuceBRegoCMilosavljevicJHukinsCThe AASM recommended and acceptable EEG montages are comparable for the staging of sleep and scoring of EEG arousalsJ Clin Sleep Med201410780380925024660