Michael D Linderman1, Sabrina A Suckiel2, Nathan Thompson3, David J Weiss3,4, J Scott Roberts5, Robert C Green6,7,8,9. 1. Department of Computer Science, Middlebury College, Middlebury, Vermont, USA. 2. The Institute for Genomic Health, Icahn School of Medicine at Mount Sinai, New York, New York, USA. 3. Assessment Systems Corporation, Minneapolis, Minnesota, USA. 4. Department of Psychology, University of Minnesota, Minneapolis, Minnesota, USA. 5. Department of Health Behavior & Health Education, University of Michigan School of Public Health, Ann Arbor, Michigan, USA. 6. Division of Genetics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA. 7. Harvard Medical School, Boston, Massachusetts, USA. 8. The Broad Institute of MIT and Harvard, Cambridge, Massachusetts, USA. 9. Ariadne Labs, Boston, Massachusetts, USA.
Abstract
BACKGROUND: Genomic testing is increasingly employed in clinical, research, educational, and commercial contexts. Genomic literacy is a prerequisite for the effective application of genomic testing, creating a corresponding need for validated tools to assess genomics knowledge. We sought to develop a reliable measure of genomics knowledge that incorporates modern genomic technologies and is informative for individuals with diverse backgrounds, including those with clinical/life sciences training. METHODS: We developed the GKnowM Genomics Knowledge Scale to assess the knowledge needed to make an informed decision for genomic testing, appropriately apply genomic technologies and participate in civic decision-making. We administered the 30-item draft measure to a calibration cohort (n = 1,234) and subsequent participants to create a combined validation cohort (n = 2,405). We performed a multistage psychometric calibration and validation using classical test theory and item response theory (IRT) and conducted a post-hoc simulation study to evaluate the suitability of a computerized adaptive testing (CAT) implementation. RESULTS: Based on exploratory factor analysis, we removed 4 of the 30 draft items. The resulting 26-item GKnowM measure has a single dominant factor. The scale internal consistency is α = 0.85, and the IRT 3-PL model demonstrated good overall and item fit. Validity is demonstrated with significant correlation (r = 0.61) with an existing genomics knowledge measure and significantly higher scores for individuals with adequate health literacy and healthcare providers (HCPs), including HCPs who work with genomic testing. The item bank is well suited to CAT, achieving high accuracy (r = 0.97 with the full measure) while administering a mean of 13.5 items. CONCLUSION: GKnowM is an updated, broadly relevant, rigorously validated 26-item measure for assessing genomics knowledge that we anticipate will be useful for assessing population genomic literacy and evaluating the effectiveness of genomics educational interventions.
BACKGROUND: Genomic testing is increasingly employed in clinical, research, educational, and commercial contexts. Genomic literacy is a prerequisite for the effective application of genomic testing, creating a corresponding need for validated tools to assess genomics knowledge. We sought to develop a reliable measure of genomics knowledge that incorporates modern genomic technologies and is informative for individuals with diverse backgrounds, including those with clinical/life sciences training. METHODS: We developed the GKnowM Genomics Knowledge Scale to assess the knowledge needed to make an informed decision for genomic testing, appropriately apply genomic technologies and participate in civic decision-making. We administered the 30-item draft measure to a calibration cohort (n = 1,234) and subsequent participants to create a combined validation cohort (n = 2,405). We performed a multistage psychometric calibration and validation using classical test theory and item response theory (IRT) and conducted a post-hoc simulation study to evaluate the suitability of a computerized adaptive testing (CAT) implementation. RESULTS: Based on exploratory factor analysis, we removed 4 of the 30 draft items. The resulting 26-item GKnowM measure has a single dominant factor. The scale internal consistency is α = 0.85, and the IRT 3-PL model demonstrated good overall and item fit. Validity is demonstrated with significant correlation (r = 0.61) with an existing genomics knowledge measure and significantly higher scores for individuals with adequate health literacy and healthcare providers (HCPs), including HCPs who work with genomic testing. The item bank is well suited to CAT, achieving high accuracy (r = 0.97 with the full measure) while administering a mean of 13.5 items. CONCLUSION: GKnowM is an updated, broadly relevant, rigorously validated 26-item measure for assessing genomics knowledge that we anticipate will be useful for assessing population genomic literacy and evaluating the effectiveness of genomics educational interventions.
Authors: Jill Oliver Robinson; Thomas M Carroll; Lindsay Z Feuerman; Denise L Perry; Lily Hoffman-Andrews; Rebecca C Walsh; Kurt D Christensen; Robert C Green; Amy L McGuire Journal: J Empir Res Hum Res Ethics Date: 2016-02-28 Impact factor: 1.742
Authors: S E Gollust; E S Gordon; C Zayac; G Griffin; M F Christman; R E Pyeritz; L Wawak; B A Bernhardt Journal: Public Health Genomics Date: 2011-06-03 Impact factor: 2.000
Authors: Madeleine P Ball; Jason R Bobe; Michael F Chou; Tom Clegg; Preston W Estep; Jeantine E Lunshof; Ward Vandewege; Alexander Zaranek; George M Church Journal: Genome Med Date: 2014-02-28 Impact factor: 11.117
Authors: Michelle M Langer; Myra I Roche; Noel T Brewer; Jonathan S Berg; Cynthia M Khan; Cristina Leos; Elizabeth Moore; Michelle Brown; Christine Rini Journal: MDM Policy Pract Date: 2017-02-01