C Hoffmann1, R C Macefield1, N Wilson1, J M Blazeby1,2, K N L Avery1, S Potter1,3, A G K McNair1,4. 1. National Institute for Health Research Bristol Biomedical Research Centre, Bristol Centre for Surgical Research, Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK. 2. Division of Surgery, University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK. 3. Bristol Breast Care Centre, North Bristol NHS Trust, Bristol, UK. 4. Department of Gastrointestinal Surgery, North Bristol NHS Trust, Bristol, UK.
Abstract
AIM: Early phase studies are essential to evaluate new technologies prior to randomized evaluation. Evaluation is limited, however, by inconsistent measurement and reporting of outcomes. This study examines outcome reporting in studies of innovative colorectal cancer surgery. METHODS: Systematic searches identified studies of invasive procedures treating primary colorectal adenocarcinoma. Included were a random sample of studies which authors reported as 'new' or 'modified'. Outcomes were extracted verbatim and categorized using an existing framework of 32 domains relevant to early phase studies. Outcomes were classified as 'measured' (where there was an explicit statement to that effect or evidence that data collection had occurred) or 'mentioned but not measured' (where outcomes were discussed but data collection was not evident). Patterns of identified outcomes are described. RESULTS: Of 8373 records, 816 were potentially eligible. Full-text review of a random sample of 218 studies identified 51 for inclusion of which 34 (66%) were 'new' and 17 (33%) were 'modified'. Some 2073 outcomes were identified, and all mapped to domains. 'Anticipated disadvantages' were most frequently identified [660 (32%) outcomes identified across 50 (98%) studies]. No domain was represented in all studies. Under half (944, 46%) of outcomes were 'measured'. 'Surgeon's/operator's experience of the innovation' was more frequently 'mentioned but not measured' [207 (18%) outcomes across 46 (90%) studies] than 'measured' [17 (2%) outcomes, 11 (22%) studies]. CONCLUSION: There is outcome reporting heterogeneity in studies of early phase colorectal cancer surgery. The adoption of core outcome sets may help to resolve these inconsistencies and enable efficient evaluation of surgical innovations.
AIM: Early phase studies are essential to evaluate new technologies prior to randomized evaluation. Evaluation is limited, however, by inconsistent measurement and reporting of outcomes. This study examines outcome reporting in studies of innovative colorectal cancer surgery. METHODS: Systematic searches identified studies of invasive procedures treating primary colorectal adenocarcinoma. Included were a random sample of studies which authors reported as 'new' or 'modified'. Outcomes were extracted verbatim and categorized using an existing framework of 32 domains relevant to early phase studies. Outcomes were classified as 'measured' (where there was an explicit statement to that effect or evidence that data collection had occurred) or 'mentioned but not measured' (where outcomes were discussed but data collection was not evident). Patterns of identified outcomes are described. RESULTS: Of 8373 records, 816 were potentially eligible. Full-text review of a random sample of 218 studies identified 51 for inclusion of which 34 (66%) were 'new' and 17 (33%) were 'modified'. Some 2073 outcomes were identified, and all mapped to domains. 'Anticipated disadvantages' were most frequently identified [660 (32%) outcomes identified across 50 (98%) studies]. No domain was represented in all studies. Under half (944, 46%) of outcomes were 'measured'. 'Surgeon's/operator's experience of the innovation' was more frequently 'mentioned but not measured' [207 (18%) outcomes across 46 (90%) studies] than 'measured' [17 (2%) outcomes, 11 (22%) studies]. CONCLUSION: There is outcome reporting heterogeneity in studies of early phase colorectal cancer surgery. The adoption of core outcome sets may help to resolve these inconsistencies and enable efficient evaluation of surgical innovations.
Authors: Christin Hoffmann; Sina Hossaini; Sian Cousins; Natalie Blencowe; Angus G K McNair; Jane M Blazeby; Kerry N L Avery; Shelley Potter; Rhiannon Macefield Journal: Int J Surg Protoc Date: 2021-11-12
Authors: Nicholas Wilson; Rhiannon C Macefield; Christin Hoffmann; Matthew J Edmondson; Rachael L Miller; Emily N Kirkham; Natalie S Blencowe; Angus G K McNair; Barry G Main; Jane M Blazeby; Kerry N L Avery; Shelley Potter Journal: BMJ Open Date: 2022-04-29 Impact factor: 3.006
Authors: Christin Hoffmann; Matthew Kobetic; Natasha Alford; Natalie Blencowe; Jozel Ramirez; Rhiannon Macefield; Jane M Blazeby; Kerry N L Avery; Shelley Potter Journal: JMIR Res Protoc Date: 2022-09-08