STUDY OBJECTIVES: The program provides a unique opportunity to compare a large number of scorers with varied levels of experience to determine sleep stage scoring agreement. The objective is to examine areas of disagreement to inform future revisions of the AASM Manual for the Scoring of Sleep and Associated Events. METHODS: The sample included 9 record fragments, 1,800 epochs and more than 3,200,000 scoring decisions. More than 2,500 scorers, most with 3 or more years of experience, participated. The analysis determined agreement with the score chosen by the majority of scorers. RESULTS: Sleep stage agreement averaged 82.6%. Agreement was highest for stage R sleep with stages N2 and W approaching the same level. Scoring agreement for stage N3 sleep was 67.4% and was lowest for stage N1 at 63.0%. Scorers had particular difficulty with the last epoch of stage W before sleep onset, the first epoch of stage N2 after stage N1 and the first epoch of stage R after stage N2. Discrimination between stages N2 and N3 was particularly difficult for scorers. CONCLUSIONS: These findings suggest that with current rules, inter-scorer agreement in a large group is approximately 83%, a level similar to that reported for agreement between expert scorers. Agreement in the scoring of stages N1 and N3 sleep was low. Modifications to the scoring rules to improve scoring during sleep stage transitions may result in improvement.
STUDY OBJECTIVES: The program provides a unique opportunity to compare a large number of scorers with varied levels of experience to determine sleep stage scoring agreement. The objective is to examine areas of disagreement to inform future revisions of the AASM Manual for the Scoring of Sleep and Associated Events. METHODS: The sample included 9 record fragments, 1,800 epochs and more than 3,200,000 scoring decisions. More than 2,500 scorers, most with 3 or more years of experience, participated. The analysis determined agreement with the score chosen by the majority of scorers. RESULTS: Sleep stage agreement averaged 82.6%. Agreement was highest for stage R sleep with stages N2 and W approaching the same level. Scoring agreement for stage N3 sleep was 67.4% and was lowest for stage N1 at 63.0%. Scorers had particular difficulty with the last epoch of stage W before sleep onset, the first epoch of stage N2 after stage N1 and the first epoch of stage R after stage N2. Discrimination between stages N2 and N3 was particularly difficult for scorers. CONCLUSIONS: These findings suggest that with current rules, inter-scorer agreement in a large group is approximately 83%, a level similar to that reported for agreement between expert scorers. Agreement in the scoring of stages N1 and N3 sleep was low. Modifications to the scoring rules to improve scoring during sleep stage transitions may result in improvement.
Authors: Michael H Silber; Sonia Ancoli-Israel; Michael H Bonnet; Sudhansu Chokroverty; Madeleine M Grigg-Damberger; Max Hirshkowitz; Sheldon Kapen; Sharon A Keenan; Meir H Kryger; Thomas Penzel; Mark R Pressman; Conrad Iber Journal: J Clin Sleep Med Date: 2007-03-15 Impact factor: 4.062
Authors: Warren R Ruehland; Fergal J O'Donoghue; Robert J Pierce; Andrew T Thornton; Parmjit Singh; Janet M Copland; Bronwyn Stevens; Peter D Rochford Journal: Sleep Date: 2011-01-01 Impact factor: 5.849
Authors: Doris Moser; Peter Anderer; Georg Gruber; Silvia Parapatics; Erna Loretz; Marion Boeck; Gerhard Kloesch; Esther Heller; Andrea Schmidt; Heidi Danker-Hopfe; Bernd Saletu; Josef Zeitlhofer; Georg Dorffner Journal: Sleep Date: 2009-02 Impact factor: 5.849
Authors: Heidi Danker-Hopfe; Peter Anderer; Josef Zeitlhofer; Marion Boeck; Hans Dorn; Georg Gruber; Esther Heller; Erna Loretz; Doris Moser; Silvia Parapatics; Bernd Saletu; Andrea Schmidt; Georg Dorffner Journal: J Sleep Res Date: 2009-03 Impact factor: 3.981
Authors: Alexander J Boe; Lori L McGee Koch; Megan K O'Brien; Nicholas Shawen; John A Rogers; Richard L Lieber; Kathryn J Reid; Phyllis C Zee; Arun Jayaraman Journal: NPJ Digit Med Date: 2019-12-20
Authors: Patrick H Finan; Jessica M Richards; Charlene E Gamaldo; Dingfen Han; Jeannie Marie Leoutsakos; Rachel Salas; Michael R Irwin; Michael T Smith Journal: J Clin Sleep Med Date: 2016-11-15 Impact factor: 4.062
Authors: Xiaozhe Zhang; Xiaosong Dong; Jan W Kantelhardt; Jing Li; Long Zhao; Carmen Garcia; Martin Glos; Thomas Penzel; Fang Han Journal: Sleep Breath Date: 2014-05-07 Impact factor: 2.816