Marlies Wakkee1. 1. Department of Dermatology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Dr Molewaterplein 40, 3015 GD, PO Box 2040, Rotterdam, 3000, CA, the Netherlands.
Early detection of melanoma or, even better, preventing melanoma by educating and stimulating sun‐protective behaviour, are still essential steps to reducing its global burden. However, evidence is insufficient to demonstrate the benefit of population‐based screening by total body skin examination.
Potentially, focusing the screening on high‐risk individuals may be cost effective. Clinical implementation of polygenic risk scores (PRSs) is increasingly mentioned to facilitate this identification of high‐risk individuals (i.e. genetic risk stratification).Although nowadays multiple PRSs for melanoma exist, external validation of the predictive performance of a PRS in an independent population is often absent. However, reproducibility is mentioned as an important issue in last year’s published PRS Reporting Standards (PRS‐RS).
Therefore, the paper by Steinberg et al.,
in this issue, is an important study that evaluates three melanoma PRSs in addition to basic clinical characteristics derived from meta‐analysis in two independent large cohorts.The predictive performance of a model can be tested by the discriminant accuracy or area under the receiver operating characteristic curve (AUCROC). This determines if people who get a melanoma have a higher risk prediction than those who do not. Steinberg et al. showed that in both the UK Biobank (UKB) and Melbourne Collaborative Cohort Study (MCCS) discriminant ability increased from 0·03 to 0·10 by adding a PRS to age and sex, i.e. an integrated risk model.
However, the overall AUCROC was still moderate at 0·69, suggesting that for population‐based screening, the tested integrated risk models are not useful. The inclusion of single‐nucleotide polymorphisms beyond those that meet stringent genome‐wide association study significance levels or adding traditional melanoma risk factors may be considered to boost future predictive performance.Most PRS studies present relative risks of melanoma. However, the authors of this study calculated the PRS‐based sex‐ and age‐specific 10‐year absolute risk of melanoma. Absolute risk scores provide more interpretable results and can even motivate behavioural changes. Using these absolute risk scores, the authors were also able to test the model’s calibration, which compares the agreement between the expected and observed number of melanoma cases. Overall, they found that the model underpredicted incidence of melanoma, that is, fewer melanomas, compared with expected incidence. This would lead to falsely excluding high‐risk patients. By adding the PRS to the risk model, estimations were closer to the observed number of cases in the UKB, but not in the MCCS sample. Different local healthcare systems and risk exposures per population are important reasons for misleading model outcomes.
These findings emphasize the need to calibrate model performance in different settings.In this study, Steinberg et al. show that implementation of PRSs in practice is still a considerable challenge, but they point us in the right direction.
Authors: Hannah Wand; Samuel A Lambert; Cecelia Tamburro; Michael A Iacocca; Jack W O'Sullivan; Catherine Sillari; Iftikhar J Kullo; Robb Rowley; Jacqueline S Dron; Deanna Brockman; Eric Venner; Mark I McCarthy; Antonis C Antoniou; Douglas F Easton; Robert A Hegele; Amit V Khera; Nilanjan Chatterjee; Charles Kooperberg; Karen Edwards; Katherine Vlessis; Kim Kinnear; John N Danesh; Helen Parkinson; Erin M Ramos; Megan C Roberts; Kelly E Ormond; Muin J Khoury; A Cecile J W Janssens; Katrina A B Goddard; Peter Kraft; Jaqueline A L MacArthur; Michael Inouye; Genevieve L Wojcik Journal: Nature Date: 2021-03-10 Impact factor: 69.504
Authors: Ben Van Calster; David J McLernon; Maarten van Smeden; Laure Wynants; Ewout W Steyerberg Journal: BMC Med Date: 2019-12-16 Impact factor: 8.775
Authors: Julia Steinberg; Mark M Iles; Jin Yee Lee; Xiaochuan Wang; Matthew H Law; Amelia K Smit; Tu Nguyen-Dumont; Graham G Giles; Melissa C Southey; Roger L Milne; Graham J Mann; D Timothy Bishop; Robert J MacInnis; Anne E Cust Journal: Br J Dermatol Date: 2022-03-31 Impact factor: 11.113
Authors: Kirsten Bibbins-Domingo; David C Grossman; Susan J Curry; Karina W Davidson; Mark Ebell; John W Epling; Francisco A R García; Matthew W Gillman; Alex R Kemper; Alex H Krist; Ann E Kurth; C Seth Landefeld; Carol M Mangione; William R Phillips; Maureen G Phipps; Michael P Pignone; Albert L Siu Journal: JAMA Date: 2016-07-26 Impact factor: 56.272