RATIONALE AND OBJECTIVES: The Lung Image Database Consortium (LIDC) is developing a publicly available database of thoracic computed tomography (CT) scans as a medical imaging research resource to promote the development of computer-aided detection or characterization of pulmonary nodules. To obtain the best estimate of the location and spatial extent of lung nodules, expert thoracic radiologists reviewed and annotated each scan. Because a consensus panel approach was neither feasible nor desirable, a unique two-phase, multicenter data collection process was developed to allow multiple radiologists at different centers to asynchronously review and annotate each CT scan. This data collection process was also intended to capture the variability among readers. MATERIALS AND METHODS: Four radiologists reviewed each scan using the following process. In the first or "blinded" phase, each radiologist reviewed the CT scan independently. In the second or "unblinded" review phase, results from all four blinded reviews were compiled and presented to each radiologist for a second review, allowing the radiologists to review their own annotations together with the annotations of the other radiologists. The results of each radiologist's unblinded review were compiled to form the final unblinded review. An XML-based message system was developed to communicate the results of each reading. RESULTS: This two-phase data collection process was designed, tested, and implemented across the LIDC. More than 500 CT scans have been read and annotated using this method by four expert readers; these scans either are currently publicly available at http://ncia.nci.nih.gov or will be in the near future. CONCLUSIONS: A unique data collection process was developed, tested, and implemented that allowed multiple readers at distributed sites to asynchronously review CT scans multiple times. This process captured the opinions of each reader regarding the location and spatial extent of lung nodules.
RATIONALE AND OBJECTIVES: The Lung Image Database Consortium (LIDC) is developing a publicly available database of thoracic computed tomography (CT) scans as a medical imaging research resource to promote the development of computer-aided detection or characterization of pulmonary nodules. To obtain the best estimate of the location and spatial extent of lung nodules, expert thoracic radiologists reviewed and annotated each scan. Because a consensus panel approach was neither feasible nor desirable, a unique two-phase, multicenter data collection process was developed to allow multiple radiologists at different centers to asynchronously review and annotate each CT scan. This data collection process was also intended to capture the variability among readers. MATERIALS AND METHODS: Four radiologists reviewed each scan using the following process. In the first or "blinded" phase, each radiologist reviewed the CT scan independently. In the second or "unblinded" review phase, results from all four blinded reviews were compiled and presented to each radiologist for a second review, allowing the radiologists to review their own annotations together with the annotations of the other radiologists. The results of each radiologist's unblinded review were compiled to form the final unblinded review. An XML-based message system was developed to communicate the results of each reading. RESULTS: This two-phase data collection process was designed, tested, and implemented across the LIDC. More than 500 CT scans have been read and annotated using this method by four expert readers; these scans either are currently publicly available at http://ncia.nci.nih.gov or will be in the near future. CONCLUSIONS: A unique data collection process was developed, tested, and implemented that allowed multiple readers at distributed sites to asynchronously review CT scans multiple times. This process captured the opinions of each reader regarding the location and spatial extent of lung nodules.
Authors: Sumit K Shah; Michael F McNitt-Gray; Sarah R Rogers; Jonathan G Goldin; Robert D Suh; James W Sayre; Iva Petkovska; Hyun J Kim; Denise R Aberle Journal: Acad Radiol Date: 2005-10 Impact factor: 3.173
Authors: Joseph K Leader; Thomas E Warfel; Carl R Fuhrman; Sara K Golla; Joel L Weissfeld; Ricardo S Avila; Wesly D Turner; Bin Zheng Journal: AJR Am J Roentgenol Date: 2005-10 Impact factor: 3.959
Authors: Lawrence R Goodman; Meltem Gulsun; Lacey Washington; Paul G Nagy; Kelly L Piacsek Journal: AJR Am J Roentgenol Date: 2006-04 Impact factor: 3.959
Authors: Lien N Tran; Matthew S Brown; Jonathan G Goldin; Xiaohong Yan; Richard C Pais; Michael F McNitt-Gray; David Gjertson; Sarah R Rogers; Denise R Aberle Journal: Acad Radiol Date: 2004-12 Impact factor: 3.173
Authors: Stephen J Swensen; James R Jett; Thomas E Hartman; David E Midthun; Sumithra J Mandrekar; Shauna L Hillman; Anne-Marie Sykes; Gregory L Aughenbaugh; Aaron O Bungum; Katie L Allen Journal: Radiology Date: 2005-02-04 Impact factor: 11.105
Authors: K D Hopper; C J Kasales; M A Van Slyke; T A Schwartz; T R TenHave; J A Jozefiak Journal: AJR Am J Roentgenol Date: 1996-10 Impact factor: 3.959
Authors: Lori E Dodd; Robert F Wagner; Samuel G Armato; Michael F McNitt-Gray; Sergey Beiden; Heang-Ping Chan; David Gur; Geoffrey McLennan; Charles E Metz; Nicholas Petrick; Berkman Sahiner; Jim Sayre Journal: Acad Radiol Date: 2004-04 Impact factor: 3.173
Authors: Jeremy J Erasmus; Gregory W Gladish; Lyle Broemeling; Bradley S Sabloff; Mylene T Truong; Roy S Herbst; Reginald F Munden Journal: J Clin Oncol Date: 2003-07-01 Impact factor: 44.544
Authors: Luca Bogoni; Jane P Ko; Jeffrey Alpert; Vikram Anand; John Fantauzzi; Charles H Florin; Chi Wan Koo; Derek Mason; William Rom; Maria Shiau; Marcos Salganicoff; David P Naidich Journal: J Digit Imaging Date: 2012-12 Impact factor: 4.056
Authors: Kingshuk Roy Choudhury; David S Paik; Chin A Yi; Sandy Napel; Justus Roos; Geoffrey D Rubin Journal: Med Phys Date: 2010-04 Impact factor: 4.071
Authors: Jayashree Kalpathy-Cramer; John Blake Freymann; Justin Stephen Kirby; Paul Eugene Kinahan; Fred William Prior Journal: Transl Oncol Date: 2014-02-01 Impact factor: 4.243
Authors: Charles R Meyer; Samuel G Armato; Charles P Fenimore; Geoffrey McLennan; Luc M Bidaut; Daniel P Barboriak; Marios A Gavrielides; Edward F Jackson; Michael F McNitt-Gray; Paul E Kinahan; Nicholas Petrick; Binsheng Zhao Journal: Transl Oncol Date: 2009-12 Impact factor: 4.243
Authors: Michael F McNitt-Gray; Luc M Bidaut; Samuel G Armato; Charles R Meyer; Marios A Gavrielides; Charles Fenimore; Geoffrey McLennan; Nicholas Petrick; Binsheng Zhao; Anthony P Reeves; Reinhard Beichel; Hyun-Jung Grace Kim; Lisa Kinnard Journal: Transl Oncol Date: 2009-12 Impact factor: 4.243