Thomas Rémen1, Lesley Richardson1, Corinne Pilorget2,3, Gilles Palmer4, Jack Siemiatycki1, Jérôme Lavoué1. 1. Health Innovation and Evaluation Hub Department, University of Montreal Hospital Research Center (CRCHUM), Rue Saint-Denis, Montréal, QC, Canada. 2. The French Public Health Agency, rue du Val d'Osne Saint-Maurice, France. 3. UMRESTTE (UMR T), Université Claude Bernard Lyon, avenue Rockefeller, Lyon, France. 4. French Center for Research and Development in Medical Informatics (CREDIM), ISPED, Université de Bordeaux, Rue Léo Saignat, Bordeaux, France.
Abstract
Introduction: Job coding into a standard occupation or industry classification is commonly performed in occupational epidemiology and occupational health. Sometimes, it is necessary to code jobs into multiple classifications or to convert job codes from one classification to another. We developed a generic tool, called CAPS-Canada (http://www.caps-canada.ca/), that combines a computer-assisted coding tool covering seven International, Canadian and US occupation and industry classifications and an assistant facilitating crosswalks from one classification to another. The objectives of this paper are to present the different functions of the CAPS-Canada tool and to assess their contribution through an inter-rater reliability study. Method: The crosswalk assistant was built based on a database of >30,000 jobs coded during a previous project. We evaluated to what extent it would allow automatic translation between pairs of classifications. The influence of CAPS-Canada on agreement between coders was assessed through an inter-rater reliability study comparing three approaches: manual coding, coding with CAPS-Canada without the crosswalk assistant, and coding with the complete tool. The material for this trial consisted of a random sample of 1000 jobs extracted from a case-control study and divided into three subgroups of equivalent size. Results: Across the classification systems, the crosswalk assistant would provide useful information for 83-99% of jobs (median 95%) in a population similar to ours. Eighteen to eighty-one percent of jobs (median 56%) could be entirely automatically recoded. Based on our sample of 1000 jobs, inter-rater reliability in occupation coding ranged from 35.7 to 66.5% (median 53.7%) depending on the combination of classification/resolution. Compared with manual coding, the use of CAPS-Canada substantially improved inter-rater reliability. Conclusion: CAPS-Canada is an attractive alternative to manual coding and is particularly relevant for coding a job into multiple classifications or for recoding jobs into other classifications.
Introduction: Job coding into a standard occupation or industry classification is commonly performed in occupational epidemiology and occupational health. Sometimes, it is necessary to code jobs into multiple classifications or to convert job codes from one classification to another. We developed a generic tool, called CAPS-Canada (http://www.caps-canada.ca/), that combines a computer-assisted coding tool covering seven International, Canadian and US occupation and industry classifications and an assistant facilitating crosswalks from one classification to another. The objectives of this paper are to present the different functions of the CAPS-Canada tool and to assess their contribution through an inter-rater reliability study. Method: The crosswalk assistant was built based on a database of >30,000 jobs coded during a previous project. We evaluated to what extent it would allow automatic translation between pairs of classifications. The influence of CAPS-Canada on agreement between coders was assessed through an inter-rater reliability study comparing three approaches: manual coding, coding with CAPS-Canada without the crosswalk assistant, and coding with the complete tool. The material for this trial consisted of a random sample of 1000 jobs extracted from a case-control study and divided into three subgroups of equivalent size. Results: Across the classification systems, the crosswalk assistant would provide useful information for 83-99% of jobs (median 95%) in a population similar to ours. Eighteen to eighty-one percent of jobs (median 56%) could be entirely automatically recoded. Based on our sample of 1000 jobs, inter-rater reliability in occupation coding ranged from 35.7 to 66.5% (median 53.7%) depending on the combination of classification/resolution. Compared with manual coding, the use of CAPS-Canada substantially improved inter-rater reliability. Conclusion: CAPS-Canada is an attractive alternative to manual coding and is particularly relevant for coding a job into multiple classifications or for recoding jobs into other classifications.
Authors: K Teschke; A F Olshan; J L Daniels; A J De Roos; C G Parks; M Schulz; T L Vaughan Journal: Occup Environ Med Date: 2002-09 Impact factor: 4.402
Authors: Tom Koeman; Nadine S M Offermans; Yvette Christopher-de Vries; Pauline Slottje; Piet A Van Den Brandt; R Alexandra Goldbohm; Hans Kromhout; Roel Vermeulen Journal: Ann Occup Hyg Date: 2012-07-17
Authors: Sara De Matteis; Deborah Jarvis; Heather Young; Alan Young; Naomi Allen; James Potts; Andrew Darnton; Lesley Rushton; Paul Cullinan Journal: Scand J Work Environ Health Date: 2016-12-14 Impact factor: 5.024