OBJECTIVES: To evaluate the reliability of an expert team assessing exposure to carcinogens in the offshore petroleum industry and to study how the information provided influenced the agreement among raters. METHODS: Eight experts individually assessed the likelihood of exposure for combinations of 17 carcinogens, 27 job categories and four time periods (1970-1979, 1980-1989, 1990-1999 and 2000-2005). Each rater assessed 1836 combinations based on summary documents on carcinogenic agents, which included descriptions of sources of exposure and products, descriptions of work processes carried out within the different job categories, and monitoring data. Inter-rater agreement was calculated using Cohen's kappa index and single and average score intraclass correlation coefficients (ICC) (ICC(2,1) and ICC(2,8), respectively). Differences in inter-rater agreement for time periods, raters, International Agency for Research on Cancer groups and the amount of information provided were consequently studied. RESULTS: Overall, 18% of the combinations were denoted as possible exposure, and 14% scored probable exposure. Stratified by the 17 carcinogenic agents, the probable exposure prevalence ranged from 3.8% for refractory ceramic fibres to 30% for crude oil. Overall mean kappa was 0.42 (ICC(2,1) = 0.62 and ICC(2,8) = 0.93). Providing limited quantitative measurement data was associated with less agreement than for equally well described carcinogens without sampling data. CONCLUSION: The overall kappa and single-score ICC indicate that the raters agree on exposure estimates well above the chance level. The levels of inter-rater agreement were higher than in other comparable studies. The average score ICC indicates reliable mean estimates and implies that sufficient raters were involved. The raters seemed to have enough documentation on which to base their estimates, but provision of limited monitoring data leads to more incongruence among raters. Having real exposure data, with the inherent variability of such data, apparently makes estimating exposure in a rigid semiquantitative manner more difficult.
OBJECTIVES: To evaluate the reliability of an expert team assessing exposure to carcinogens in the offshore petroleum industry and to study how the information provided influenced the agreement among raters. METHODS: Eight experts individually assessed the likelihood of exposure for combinations of 17 carcinogens, 27 job categories and four time periods (1970-1979, 1980-1989, 1990-1999 and 2000-2005). Each rater assessed 1836 combinations based on summary documents on carcinogenic agents, which included descriptions of sources of exposure and products, descriptions of work processes carried out within the different job categories, and monitoring data. Inter-rater agreement was calculated using Cohen's kappa index and single and average score intraclass correlation coefficients (ICC) (ICC(2,1) and ICC(2,8), respectively). Differences in inter-rater agreement for time periods, raters, International Agency for Research on Cancer groups and the amount of information provided were consequently studied. RESULTS: Overall, 18% of the combinations were denoted as possible exposure, and 14% scored probable exposure. Stratified by the 17 carcinogenic agents, the probable exposure prevalence ranged from 3.8% for refractory ceramic fibres to 30% for crude oil. Overall mean kappa was 0.42 (ICC(2,1) = 0.62 and ICC(2,8) = 0.93). Providing limited quantitative measurement data was associated with less agreement than for equally well described carcinogens without sampling data. CONCLUSION: The overall kappa and single-score ICC indicate that the raters agree on exposure estimates well above the chance level. The levels of inter-rater agreement were higher than in other comparable studies. The average score ICC indicates reliable mean estimates and implies that sufficient raters were involved. The raters seemed to have enough documentation on which to base their estimates, but provision of limited monitoring data leads to more incongruence among raters. Having real exposure data, with the inherent variability of such data, apparently makes estimating exposure in a rigid semiquantitative manner more difficult.
Authors: K Teschke; A F Olshan; J L Daniels; A J De Roos; C G Parks; M Schulz; T L Vaughan Journal: Occup Environ Med Date: 2002-09 Impact factor: 4.402
Authors: Melissa C Friesen; David C Wheeler; Roel Vermeulen; Sarah J Locke; Dennis D Zaebst; Stella Koutros; Anjoeka Pronk; Joanne S Colt; Dalsu Baris; Margaret R Karagas; Nuria Malats; Molly Schwenn; Alison Johnson; Karla R Armenti; Nathanial Rothman; Patricia A Stewart; Manolis Kogevinas; Debra T Silverman Journal: Ann Occup Hyg Date: 2016-01-04
Authors: Melissa C Friesen; Joseph B Coble; Hormuzd A Katki; Bu-Tian Ji; Shouzheng Xue; Wei Lu; Patricia A Stewart Journal: Ann Occup Hyg Date: 2011-04-21
Authors: Melissa C Friesen; Anjoeka Pronk; David C Wheeler; Yu-Cheng Chen; Sarah J Locke; Dennis D Zaebst; Molly Schwenn; Alison Johnson; Richard Waddell; Dalsu Baris; Joanne S Colt; Debra T Silverman; Patricia A Stewart; Hormuzd A Katki Journal: Ann Occup Hyg Date: 2012-11-25
Authors: Jean-François Sauvé; Joemy M Ramsay; Sarah J Locke; Pamela J Dopart; Pabitra R Josse; Dennis D Zaebst; Paul S Albert; Kenneth P Cantor; Dalsu Baris; Brian P Jackson; Margaret R Karagas; Gm Monawar Hosain; Molly Schwenn; Alison Johnson; Mark P Purdue; Stella Koutros; Debra T Silverman; Melissa C Friesen Journal: Occup Environ Med Date: 2019-07-15 Impact factor: 4.402
Authors: Anjoeka Pronk; Patricia A Stewart; Joseph B Coble; Hormuzd A Katki; David C Wheeler; Joanne S Colt; Dalsu Baris; Molly Schwenn; Margaret R Karagas; Alison Johnson; Richard Waddell; Castine Verrill; Sai Cherala; Debra T Silverman; Melissa C Friesen Journal: Occup Environ Med Date: 2012-07-27 Impact factor: 4.402
Authors: Fei Chih Liu; Marit Bragelien Veierød; Kristina Kjærheim; Trude Eid Robsahm; Reza Ghiasvand; H Dean Hosgood; Sven Ove Samuelsen; Magne Bråtveit; Jorunn Kirkeleit; Nathaniel Rothman; Qing Lan; Debra T Silverman; Melissa C Friesen; Ronnie Babigumira; Nita Shala; Tom K Grimsrud; Jo Steinson Stenehjem Journal: BMJ Open Date: 2022-01-24 Impact factor: 2.692
Authors: Jo S Stenehjem; Ronnie Babigumira; H Dean Hosgood; Marit B Veierød; Sven Ove Samuelsen; Magne Bråtveit; Jorunn Kirkeleit; Nathaniel Rothman; Qing Lan; Debra T Silverman; Melissa C Friesen; Trude E Robsahm; Kristina Kjærheim; Bettina K Andreassen; Nita K Shala; Fei-Chih Liu; Leif-Åge Strand; Tom K Grimsrud Journal: Int J Epidemiol Date: 2021-05-17 Impact factor: 7.196