Beth A Davison1, Stephen A Harrison2, Gad Cotter3, Naim Alkhouri4, Arun Sanyal5, Christopher Edwards3, Jerry R Colca6, Julie Iwashita6, Gary G Koch7, Howard C Dittrich6. 1. Momentum Research, Inc., Durham, NC, USA. Electronic address: bethdavison@momentum-research.com. 2. Hepatology, Radcliffe Department of Medicine, University of Oxford, UK. 3. Momentum Research, Inc., Durham, NC, USA. 4. Texas Liver Institute, San Antonio, TX, USA. 5. Virginia Commonwealth University School of Medicine, Richmond, Virginia, USA. 6. Cirius Therapeutics, Inc., San Diego, CA, USA. 7. University of North Carolina, Chapel Hill, NC, USA.
Abstract
BACKGROUND & AIMS: Liver biopsies are a critical component of pivotal studies in non-alcoholic steatohepatitis (NASH), constituting inclusion criteria, risk stratification factors and endpoints. We evaluated the reliability of NASH Clinical Research Network scoring of liver biopsies in a NASH clinical trial. METHODS: Digitized slides of 678 biopsies from 339 patients with paired biopsies randomized into the EMMINENCE study - examining a novel insulin sensitizer (MSDC-0602K) in NASH - were read independently by 3 hepatopathologists blinded to treatment code and scored using the NASH CRN histological scoring system. Various endpoints were computed from these scores. RESULTS: Inter-reader linearly weighted kappas were 0.609, 0.484, 0.328, and 0.517 for steatosis, fibrosis, lobular inflammation, and ballooning, respectively. Inter-reader unweighted kappas were 0.400 for the diagnosis of NASH, 0.396 for NASH resolution without worsening fibrosis, and 0.366 for fibrosis improvement without worsening NASH. In the current study, 46.3% of the patients included in the study based on 1 hepatopathologist's qualifying reading were deemed not to meet the study's histologic inclusion criteria by at least 1 of the 3 hepatopathologists. The MSDC-0602K treatment effect was lowest for those histologic features with lower inter-reader reliability. Simulations show that the lack of reliability of endpoints and inclusion criteria can drastically reduce study power - from >90% in a well-powered study to as low as 40%. CONCLUSIONS: The reliability of hepatopathologists' liver biopsy evaluation using currently accepted criteria is suboptimal. This lack of reliability may affect NASH pivotal studies by introducing patients who do not meet NASH study entry criteria, misclassifying fibrosis subgroups, and attenuating apparent treatment effects. LAY SUMMARY: Since liver biopsy analysis plays such an important role in clinical studies of non-alcoholic steatohepatitis, it is important to understand the reliability of hepato-pathologist readings. We examined both inter- and intra-reader variability in a large data set of paired liver biopsies from a clinical trial. We found very poor inter-reader and modest intra-reader variability. This result has important implications for entry criteria, fibrosis stratification, and the ability to measure a treatment effect in clinical trials.
BACKGROUND & AIMS: Liver biopsies are a critical component of pivotal studies in non-alcoholic steatohepatitis (NASH), constituting inclusion criteria, risk stratification factors and endpoints. We evaluated the reliability of NASH Clinical Research Network scoring of liver biopsies in a NASH clinical trial. METHODS: Digitized slides of 678 biopsies from 339 patients with paired biopsies randomized into the EMMINENCE study - examining a novel insulin sensitizer (MSDC-0602K) in NASH - were read independently by 3 hepatopathologists blinded to treatment code and scored using the NASH CRN histological scoring system. Various endpoints were computed from these scores. RESULTS: Inter-reader linearly weighted kappas were 0.609, 0.484, 0.328, and 0.517 for steatosis, fibrosis, lobular inflammation, and ballooning, respectively. Inter-reader unweighted kappas were 0.400 for the diagnosis of NASH, 0.396 for NASH resolution without worsening fibrosis, and 0.366 for fibrosis improvement without worsening NASH. In the current study, 46.3% of the patients included in the study based on 1 hepatopathologist's qualifying reading were deemed not to meet the study's histologic inclusion criteria by at least 1 of the 3 hepatopathologists. The MSDC-0602K treatment effect was lowest for those histologic features with lower inter-reader reliability. Simulations show that the lack of reliability of endpoints and inclusion criteria can drastically reduce study power - from >90% in a well-powered study to as low as 40%. CONCLUSIONS: The reliability of hepatopathologists' liver biopsy evaluation using currently accepted criteria is suboptimal. This lack of reliability may affect NASH pivotal studies by introducing patients who do not meet NASH study entry criteria, misclassifying fibrosis subgroups, and attenuating apparent treatment effects. LAY SUMMARY: Since liver biopsy analysis plays such an important role in clinical studies of non-alcoholic steatohepatitis, it is important to understand the reliability of hepato-pathologist readings. We examined both inter- and intra-reader variability in a large data set of paired liver biopsies from a clinical trial. We found very poor inter-reader and modest intra-reader variability. This result has important implications for entry criteria, fibrosis stratification, and the ability to measure a treatment effect in clinical trials.
Authors: Samer Gawrieh; Kathryn E Harlow; Francis Pike; Katherine P Yates; Laura A Wilson; Oscar W Cummings; William M Rosenberg; Naga Chalasani; Jean P Molleston Journal: J Pediatr Date: 2021-08-13 Impact factor: 4.406
Authors: Beth A Davison; Christopher Edwards; Rohit Loomba; Stephen A Harrison; Gad Cotter; Naim Alkhouri; Gary G Koch; Howard C Dittrich Journal: JGH Open Date: 2021-06-01