Otto S Lin1, Danielle La Selva2, Jae-Myung Cha2,3, Michael Gluck2, Andrew Ross2, Michael Chiorean2, Richard A Kozarek2. 1. Digestive Disease Institute, Virginia Mason Medical Center, 1100 Ninth Avenue, Seattle, WA, 98101, USA. Otto.Lin@vmmc.org. 2. Digestive Disease Institute, Virginia Mason Medical Center, 1100 Ninth Avenue, Seattle, WA, 98101, USA. 3. Gastroenterology Division, Kyung Hee University School of Medicine, Seoul, Korea.
Abstract
BACKGROUND: Endoscopic documentation software can generate research data on large numbers of subjects automatically. There are increasing numbers of published studies based on endoscopic databases such as the Clinical Outcomes Research Initiative. However, no study has yet validated such data. We compared colonoscopic findings reported by an endoscopic documentation software (Provation) against manually collected medical records data from two similar patient cohorts in the same endoscopy unit. METHODS: In November 2011, our unit switched from dictation-based text documentation to the Provation system. As a quality control initiative, we collected data on 9614 patients who had undergone colonoscopies from January 2010 to November 2011, using manual electronic chart review. We compared these data against those generated by Provation on 7091 similar patients who underwent colonoscopy from November 2011 to March 2013. RESULTS: Age, sex and procedural indication distribution were similar between the Manual and Provation cohorts, as were the large (≥1 cm) polyp (7.6 vs. 8.1%; p = 0.25) and advanced neoplasia (8.3 vs. 8.2%; p = 0.80) prevalences. However, there were significant differences in the polyp (46.9 vs. 49.8%) and adenoma prevalences (31.3 vs. 26.8%; p < 0.001). Furthermore, the Manual cohort had a higher prevalence of diverticulosis and hemorrhoids, and a lower colonoscopy completion rate. Stratification by indication resulted in additional discrepancies between the two cohorts for screening and surveillance patients. There were also differences in the anatomic (right vs. left colon) distribution of large polyps. CONCLUSIONS: There were significant discrepancies between data from Provation and manually collected medical records data. Although the two cohorts were enrolled during slightly different time periods, they came from the same endoscopy unit, had the same endoscopists and indications, and demonstrated similar demographics, making it unlikely for there to be true differences between the cohorts independent of documentation method. Thus, caution is advised when using endoscopic data for research.
BACKGROUND: Endoscopic documentation software can generate research data on large numbers of subjects automatically. There are increasing numbers of published studies based on endoscopic databases such as the Clinical Outcomes Research Initiative. However, no study has yet validated such data. We compared colonoscopic findings reported by an endoscopic documentation software (Provation) against manually collected medical records data from two similar patient cohorts in the same endoscopy unit. METHODS: In November 2011, our unit switched from dictation-based text documentation to the Provation system. As a quality control initiative, we collected data on 9614 patients who had undergone colonoscopies from January 2010 to November 2011, using manual electronic chart review. We compared these data against those generated by Provation on 7091 similar patients who underwent colonoscopy from November 2011 to March 2013. RESULTS: Age, sex and procedural indication distribution were similar between the Manual and Provation cohorts, as were the large (≥1 cm) polyp (7.6 vs. 8.1%; p = 0.25) and advanced neoplasia (8.3 vs. 8.2%; p = 0.80) prevalences. However, there were significant differences in the polyp (46.9 vs. 49.8%) and adenoma prevalences (31.3 vs. 26.8%; p < 0.001). Furthermore, the Manual cohort had a higher prevalence of diverticulosis and hemorrhoids, and a lower colonoscopy completion rate. Stratification by indication resulted in additional discrepancies between the two cohorts for screening and surveillance patients. There were also differences in the anatomic (right vs. left colon) distribution of large polyps. CONCLUSIONS: There were significant discrepancies between data from Provation and manually collected medical records data. Although the two cohorts were enrolled during slightly different time periods, they came from the same endoscopy unit, had the same endoscopists and indications, and demonstrated similar demographics, making it unlikely for there to be true differences between the cohorts independent of documentation method. Thus, caution is advised when using endoscopic data for research.
Authors: J N Katz; J Barrett; M H Liang; A M Bacon; H Kaplan; R I Kieval; S M Lindsey; W N Roberts; D M Sheff; R T Spencer; A L Weaver; J A Baron Journal: Arthritis Rheum Date: 1997-09
Authors: Anna P Schenck; Carrie N Klabunde; Joan L Warren; Sharon Peacock; William W Davis; Sarah T Hawley; Michael Pignone; David F Ransohoff Journal: Cancer Epidemiol Biomarkers Prev Date: 2007-10 Impact factor: 4.254
Authors: M Delvaux; L Y Korman; J R Armengol-Miro; M Crespi; O Cass; F Hagenmüller; F M Zwiebel Journal: Int J Med Inform Date: 1998-02 Impact factor: 4.046
Authors: Nancy N Baxter; Meredith A Goldwasser; Lawrence F Paszat; Refik Saskin; David R Urbach; Linda Rabeneck Journal: Ann Intern Med Date: 2008-12-15 Impact factor: 25.391