BACKGROUND: Testing stimulates learning, improves long-term retention, and promotes technical performance. No purpose-orientated test of competence in the theoretical aspects of VATS lobectomy has previously been presented. The purpose of this study was, therefore, to develop and gather validity evidence for a theoretical test on VATS lobectomy consisting of multiple-choice questions. METHODS: Four European VATS lobectomy experts were interviewed to explore their views on important theoretical VATS lobectomy knowledge (step 1). This information was used to construct the test items in compliance with existing guidelines for multiple-choice questions (step 2). The experts rated the relevance of the items to confirm content validity in a modified Delphi approach (step 3). Finally, the test was administered to physicians, who were categorised into different experience levels based on their experience in VATS procedures overall and in VATS lobectomies specifically. Their answers were used to achieve construct validity (step 4). RESULTS: Initially, 81 items were constructed and two Delphi iterations reduced the test to 50 items. Item analysis led to the exclusion of 19 items and the mean discrimination index of the 31 final items was 0.26. Cronbach's alpha for internal consistency was 0.75. The mean item difficulty was calculated to 0.63. According to performed VATS procedures, significantly different test performances were detected when comparing the group performances (p = 0.002) and the experts performed significantly better than the novices (p < 0.001) and intermediates (p = 0.01). In the category of performed VATS lobectomies, significant group performances were also found. In this category, the experts were also significantly better than the novices (p < 0.001), the trainees (p = 0.002), and the intermediates (p = 0.01). CONCLUSIONS: This study led to the development of a theoretical test on VATS lobectomy consisting of multiple-choice questions. Both content and construct validity evidence were established.
BACKGROUND: Testing stimulates learning, improves long-term retention, and promotes technical performance. No purpose-orientated test of competence in the theoretical aspects of VATS lobectomy has previously been presented. The purpose of this study was, therefore, to develop and gather validity evidence for a theoretical test on VATS lobectomy consisting of multiple-choice questions. METHODS: Four European VATS lobectomy experts were interviewed to explore their views on important theoretical VATS lobectomy knowledge (step 1). This information was used to construct the test items in compliance with existing guidelines for multiple-choice questions (step 2). The experts rated the relevance of the items to confirm content validity in a modified Delphi approach (step 3). Finally, the test was administered to physicians, who were categorised into different experience levels based on their experience in VATS procedures overall and in VATS lobectomies specifically. Their answers were used to achieve construct validity (step 4). RESULTS: Initially, 81 items were constructed and two Delphi iterations reduced the test to 50 items. Item analysis led to the exclusion of 19 items and the mean discrimination index of the 31 final items was 0.26. Cronbach's alpha for internal consistency was 0.75. The mean item difficulty was calculated to 0.63. According to performed VATS procedures, significantly different test performances were detected when comparing the group performances (p = 0.002) and the experts performed significantly better than the novices (p < 0.001) and intermediates (p = 0.01). In the category of performed VATS lobectomies, significant group performances were also found. In this category, the experts were also significantly better than the novices (p < 0.001), the trainees (p = 0.002), and the intermediates (p = 0.01). CONCLUSIONS: This study led to the development of a theoretical test on VATS lobectomy consisting of multiple-choice questions. Both content and construct validity evidence were established.
Authors: Lars Konge; Per Lehnert; Henrik Jessen Hansen; René Horsleben Petersen; Charlotte Ringsted Journal: Surg Endosc Date: 2011-12-17 Impact factor: 4.584
Authors: Daniel J Boffa; Sidharta Gangadharan; Michael Kent; Faraz Kerendi; Mark Onaitis; Edward Verrier; Eric Roselli Journal: Interact Cardiovasc Thorac Surg Date: 2012-03-01
Authors: Johanna Margareta Bjurström; Lars Konge; Per Lehnert; Charlotte Loumann Krogh; Henrik Jessen Hansen; René Horsleben Petersen; Charlotte Ringsted Journal: Simul Healthc Date: 2013-10 Impact factor: 1.929
Authors: Frank C Detterbeck; Sandra Zelman Lewis; Rebecca Diekemper; Doreen Addrizzo-Harris; W Michael Alberts Journal: Chest Date: 2013-05 Impact factor: 9.410
Authors: Rebecca P Petersen; DuyKhanh Pham; William R Burfeind; Steven I Hanish; Eric M Toloza; David H Harpole; Thomas A D'Amico Journal: Ann Thorac Surg Date: 2007-04 Impact factor: 4.330
Authors: Niels Kvorning Ternov; T Vestergaard; L Rosenkrantz Hölmich; K Karmisholt; A L Wagenblast; H Klyver; M Hald; L Schøllhammer; L Konge; A H Chakera Journal: Arch Dermatol Res Date: 2020-06-28 Impact factor: 3.017
Authors: Mads Forslund Jacobsen; Lars Konge; Morten la Cour; Lars Holm; Hadi Kjaerbo; Birgitte Moldow; George M Saleh; Ann Sofia Skou Thomsen Journal: Acta Ophthalmol Date: 2020-04-18 Impact factor: 3.761