Zhe He1, Patrick Ryan2, Julia Hoxha3, Shuang Wang4, Simona Carini5, Ida Sim5, Chunhua Weng6. 1. Department of Biomedical Informatics, Columbia University, New York, NY 10032, USA. Electronic address: zh2132@columbia.edu. 2. Department of Biomedical Informatics, Columbia University, New York, NY 10032, USA; Janssen Research and Development, Titusville, NJ 08560, USA; Observational Health Data Sciences and Informatics, New York, NY 10032, USA. 3. Department of Biomedical Informatics, Columbia University, New York, NY 10032, USA. 4. Department of Biostatistics, Columbia University, New York, NY 10032, USA. 5. Department of Medicine, University of California, San Francisco, CA 94143, USA. 6. Department of Biomedical Informatics, Columbia University, New York, NY 10032, USA; Observational Health Data Sciences and Informatics, New York, NY 10032, USA.
Abstract
OBJECTIVE: To develop a multivariate method for quantifying the population representativeness across related clinical studies and a computational method for identifying and characterizing underrepresented subgroups in clinical studies. METHODS: We extended a published metric named Generalizability Index for Study Traits (GIST) to include multiple study traits for quantifying the population representativeness of a set of related studies by assuming the independence and equal importance among all study traits. On this basis, we compared the effectiveness of GIST and multivariate GIST (mGIST) qualitatively. We further developed an algorithm called "Multivariate Underrepresented Subgroup Identification" (MAGIC) for constructing optimal combinations of distinct value intervals of multiple traits to define underrepresented subgroups in a set of related studies. Using Type 2 diabetes mellitus (T2DM) as an example, we identified and extracted frequently used quantitative eligibility criteria variables in a set of clinical studies. We profiled the T2DM target population using the National Health and Nutrition Examination Survey (NHANES) data. RESULTS: According to the mGIST scores for four example variables, i.e., age, HbA1c, BMI, and gender, the included observational T2DM studies had superior population representativeness than the interventional T2DM studies. For the interventional T2DM studies, Phase I trials had better population representativeness than Phase III trials. People at least 65years old with HbA1c value between 5.7% and 7.2% were particularly underrepresented in the included T2DM trials. These results confirmed well-known knowledge and demonstrated the effectiveness of our methods in population representativeness assessment. CONCLUSIONS: mGIST is effective at quantifying population representativeness of related clinical studies using multiple numeric study traits. MAGIC identifies underrepresented subgroups in clinical studies. Both data-driven methods can be used to improve the transparency of design bias in participation selection at the research community level.
OBJECTIVE: To develop a multivariate method for quantifying the population representativeness across related clinical studies and a computational method for identifying and characterizing underrepresented subgroups in clinical studies. METHODS: We extended a published metric named Generalizability Index for Study Traits (GIST) to include multiple study traits for quantifying the population representativeness of a set of related studies by assuming the independence and equal importance among all study traits. On this basis, we compared the effectiveness of GIST and multivariate GIST (mGIST) qualitatively. We further developed an algorithm called "Multivariate Underrepresented Subgroup Identification" (MAGIC) for constructing optimal combinations of distinct value intervals of multiple traits to define underrepresented subgroups in a set of related studies. Using Type 2 diabetes mellitus (T2DM) as an example, we identified and extracted frequently used quantitative eligibility criteria variables in a set of clinical studies. We profiled the T2DM target population using the National Health and Nutrition Examination Survey (NHANES) data. RESULTS: According to the mGIST scores for four example variables, i.e., age, HbA1c, BMI, and gender, the included observational T2DM studies had superior population representativeness than the interventional T2DM studies. For the interventional T2DM studies, Phase I trials had better population representativeness than Phase III trials. People at least 65years old with HbA1c value between 5.7% and 7.2% were particularly underrepresented in the included T2DM trials. These results confirmed well-known knowledge and demonstrated the effectiveness of our methods in population representativeness assessment. CONCLUSIONS: mGIST is effective at quantifying population representativeness of related clinical studies using multiple numeric study traits. MAGIC identifies underrepresented subgroups in clinical studies. Both data-driven methods can be used to improve the transparency of design bias in participation selection at the research community level.
Authors: Carlos Blanco; Mark Olfson; Renee D Goodwin; Elizabeth Ogburn; Michael R Liebowitz; Edward V Nunes; Deborah S Hasin Journal: J Clin Psychiatry Date: 2008-08 Impact factor: 4.384
Authors: Zhe He; Arturo Gonzalez-Izquierdo; Spiros Denaxas; Andrei Sura; Yi Guo; William R Hogan; Elizabeth Shenkman; Jiang Bian Journal: AMIA Annu Symp Proc Date: 2018-04-16
Authors: Selen Bozkurt; Eli M Cahan; Martin G Seneviratne; Ran Sun; Juan A Lossio-Ventura; John P A Ioannidis; Tina Hernandez-Boussard Journal: J Am Med Inform Assoc Date: 2020-12-09 Impact factor: 4.497
Authors: Anando Sen; Patrick B Ryan; Andrew Goldstein; Shreya Chakrabarti; Shuang Wang; Eileen Koski; Chunhua Weng Journal: Ann N Y Acad Sci Date: 2016-09-06 Impact factor: 5.691
Authors: Zhe He; Jiang Bian; Henry J Carretta; Jiwon Lee; William R Hogan; Elizabeth Shenkman; Neil Charness Journal: J Med Internet Res Date: 2018-04-12 Impact factor: 5.428
Authors: María B Arriaga; Gustavo Amorim; Artur T L Queiroz; Moreno M S Rodrigues; Mariana Araújo-Pereira; Betania M F Nogueira; Alexandra Brito Souza; Michael S Rocha; Aline Benjamin; Adriana S R Moreira; Jamile G de Oliveira; Marina C Figueiredo; Megan M Turner; Kleydson Alves; Betina Durovni; José R Lapa-E-Silva; Afrânio L Kritski; Solange Cavalcante; Valeria C Rolla; Marcelo Cordeiro-Santos; Timothy R Sterling; Bruno B Andrade Journal: Int J Infect Dis Date: 2020-11-14 Impact factor: 3.623