Geoffrey Warhurst1, Graham Dunn2, Paul Chadwick3, Bronagh Blackwood4, Daniel McAuley4, Gavin D Perkins5, Ronan McMullan6, Simon Gates5, Andrew Bentley7, Duncan Young8, Gordon L Carlson1, Paul Dark1. 1. Infection, Injury and Inflammation Research Group, Salford Royal NHS Foundation Trust, Manchester Academic Health Sciences Centre (MAHSC), University of Manchester, Salford, UK. 2. Centre for Biostatistics, Institute of Population Health, Faculty of Medical and Human Sciences, Manchester Academic Health Sciences Centre (MAHSC), University of Manchester, Salford, UK. 3. Microbiology Department, Salford Royal NHS Foundation Trust, Manchester Academic Health Sciences Centre (MAHSC), University of Manchester, Salford, UK. 4. Centre for Infection and Immunity, Queen's University Belfast, Belfast, UK. 5. Clinical Trials Unit, Medical School, Warwick University, Coventry, UK. 6. Medical Microbiology, Royal Victoria Hospital, Belfast, UK. 7. Institue of Inflammation and Repair, Faculty of Medical and Human Sciences, Manchester Academic Health Sciences Centre (MAHSC), University of Manchester, Salford, UK. 8. Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, Oxford, UK.
Abstract
BACKGROUND: There is growing interest in the potential utility of real-time polymerase chain reaction (PCR) in diagnosing bloodstream infection by detecting pathogen deoxyribonucleic acid (DNA) in blood samples within a few hours. SeptiFast (Roche Diagnostics GmBH, Mannheim, Germany) is a multipathogen probe-based system targeting ribosomal DNA sequences of bacteria and fungi. It detects and identifies the commonest pathogens causing bloodstream infection. As background to this study, we report a systematic review of Phase III diagnostic accuracy studies of SeptiFast, which reveals uncertainty about its likely clinical utility based on widespread evidence of deficiencies in study design and reporting with a high risk of bias. OBJECTIVE: Determine the accuracy of SeptiFast real-time PCR for the detection of health-care-associated bloodstream infection, against standard microbiological culture. DESIGN: Prospective multicentre Phase III clinical diagnostic accuracy study using the standards for the reporting of diagnostic accuracy studies criteria. SETTING: Critical care departments within NHS hospitals in the north-west of England. PARTICIPANTS: Adult patients requiring blood culture (BC) when developing new signs of systemic inflammation. MAIN OUTCOME MEASURES: SeptiFast real-time PCR results at species/genus level compared with microbiological culture in association with independent adjudication of infection. Metrics of diagnostic accuracy were derived including sensitivity, specificity, likelihood ratios and predictive values, with their 95% confidence intervals (CIs). Latent class analysis was used to explore the diagnostic performance of culture as a reference standard. RESULTS: Of 1006 new patient episodes of systemic inflammation in 853 patients, 922 (92%) met the inclusion criteria and provided sufficient information for analysis. Index test assay failure occurred on 69 (7%) occasions. Adult patients had been exposed to a median of 8 days (interquartile range 4-16 days) of hospital care, had high levels of organ support activities and recent antibiotic exposure. SeptiFast real-time PCR, when compared with culture-proven bloodstream infection at species/genus level, had better specificity (85.8%, 95% CI 83.3% to 88.1%) than sensitivity (50%, 95% CI 39.1% to 60.8%). When compared with pooled diagnostic metrics derived from our systematic review, our clinical study revealed lower test accuracy of SeptiFast real-time PCR, mainly as a result of low diagnostic sensitivity. There was a low prevalence of BC-proven pathogens in these patients (9.2%, 95% CI 7.4% to 11.2%) such that the post-test probabilities of both a positive (26.3%, 95% CI 19.8% to 33.7%) and a negative SeptiFast test (5.6%, 95% CI 4.1% to 7.4%) indicate the potential limitations of this technology in the diagnosis of bloodstream infection. However, latent class analysis indicates that BC has a low sensitivity, questioning its relevance as a reference test in this setting. Using this analysis approach, the sensitivity of the SeptiFast test was low but also appeared significantly better than BC. Blood samples identified as positive by either culture or SeptiFast real-time PCR were associated with a high probability (> 95%) of infection, indicating higher diagnostic rule-in utility than was apparent using conventional analyses of diagnostic accuracy. CONCLUSION: SeptiFast real-time PCR on blood samples may have rapid rule-in utility for the diagnosis of health-care-associated bloodstream infection but the lack of sensitivity is a significant limiting factor. Innovations aimed at improved diagnostic sensitivity of real-time PCR in this setting are urgently required. Future work recommendations include technology developments to improve the efficiency of pathogen DNA extraction and the capacity to detect a much broader range of pathogens and drug resistance genes and the application of new statistical approaches able to more reliably assess test performance in situation where the reference standard (e.g. blood culture in the setting of high antimicrobial use) is prone to error. STUDY REGISTRATION: The systematic review is registered as PROSPERO CRD42011001289. FUNDING: The National Institute for Health Research Health Technology Assessment programme. Professor Daniel McAuley and Professor Gavin D Perkins contributed to the systematic review through their funded roles as codirectors of the Intensive Care Foundation (UK).
BACKGROUND: There is growing interest in the potential utility of real-time polymerase chain reaction (PCR) in diagnosing bloodstream infection by detecting pathogen deoxyribonucleic acid (DNA) in blood samples within a few hours. SeptiFast (Roche Diagnostics GmBH, Mannheim, Germany) is a multipathogen probe-based system targeting ribosomal DNA sequences of bacteria and fungi. It detects and identifies the commonest pathogens causing bloodstream infection. As background to this study, we report a systematic review of Phase III diagnostic accuracy studies of SeptiFast, which reveals uncertainty about its likely clinical utility based on widespread evidence of deficiencies in study design and reporting with a high risk of bias. OBJECTIVE: Determine the accuracy of SeptiFast real-time PCR for the detection of health-care-associated bloodstream infection, against standard microbiological culture. DESIGN: Prospective multicentre Phase III clinical diagnostic accuracy study using the standards for the reporting of diagnostic accuracy studies criteria. SETTING: Critical care departments within NHS hospitals in the north-west of England. PARTICIPANTS: Adult patients requiring blood culture (BC) when developing new signs of systemic inflammation. MAIN OUTCOME MEASURES: SeptiFast real-time PCR results at species/genus level compared with microbiological culture in association with independent adjudication of infection. Metrics of diagnostic accuracy were derived including sensitivity, specificity, likelihood ratios and predictive values, with their 95% confidence intervals (CIs). Latent class analysis was used to explore the diagnostic performance of culture as a reference standard. RESULTS: Of 1006 new patient episodes of systemic inflammation in 853 patients, 922 (92%) met the inclusion criteria and provided sufficient information for analysis. Index test assay failure occurred on 69 (7%) occasions. Adult patients had been exposed to a median of 8 days (interquartile range 4-16 days) of hospital care, had high levels of organ support activities and recent antibiotic exposure. SeptiFast real-time PCR, when compared with culture-proven bloodstream infection at species/genus level, had better specificity (85.8%, 95% CI 83.3% to 88.1%) than sensitivity (50%, 95% CI 39.1% to 60.8%). When compared with pooled diagnostic metrics derived from our systematic review, our clinical study revealed lower test accuracy of SeptiFast real-time PCR, mainly as a result of low diagnostic sensitivity. There was a low prevalence of BC-proven pathogens in these patients (9.2%, 95% CI 7.4% to 11.2%) such that the post-test probabilities of both a positive (26.3%, 95% CI 19.8% to 33.7%) and a negative SeptiFast test (5.6%, 95% CI 4.1% to 7.4%) indicate the potential limitations of this technology in the diagnosis of bloodstream infection. However, latent class analysis indicates that BC has a low sensitivity, questioning its relevance as a reference test in this setting. Using this analysis approach, the sensitivity of the SeptiFast test was low but also appeared significantly better than BC. Blood samples identified as positive by either culture or SeptiFast real-time PCR were associated with a high probability (> 95%) of infection, indicating higher diagnostic rule-in utility than was apparent using conventional analyses of diagnostic accuracy. CONCLUSION: SeptiFast real-time PCR on blood samples may have rapid rule-in utility for the diagnosis of health-care-associated bloodstream infection but the lack of sensitivity is a significant limiting factor. Innovations aimed at improved diagnostic sensitivity of real-time PCR in this setting are urgently required. Future work recommendations include technology developments to improve the efficiency of pathogen DNA extraction and the capacity to detect a much broader range of pathogens and drug resistance genes and the application of new statistical approaches able to more reliably assess test performance in situation where the reference standard (e.g. blood culture in the setting of high antimicrobial use) is prone to error. STUDY REGISTRATION: The systematic review is registered as PROSPERO CRD42011001289. FUNDING: The National Institute for Health Research Health Technology Assessment programme. Professor Daniel McAuley and Professor Gavin D Perkins contributed to the systematic review through their funded roles as codirectors of the Intensive Care Foundation (UK).
Authors: Jethro A Herberg; Myrsini Kaforou; Victoria J Wright; Hannah Shailes; Hariklia Eleftherohorinou; Clive J Hoggart; Miriam Cebey-López; Michael J Carter; Victoria A Janes; Stuart Gormley; Chisato Shimizu; Adriana H Tremoulet; Anouk M Barendregt; Antonio Salas; John Kanegaye; Andrew J Pollard; Saul N Faust; Sanjay Patel; Taco Kuijpers; Federico Martinón-Torres; Jane C Burns; Lachlan J M Coin; Michael Levin Journal: JAMA Date: 2016 Aug 23-30 Impact factor: 56.272
Authors: Alex van Belkum; Carey-Ann D Burnham; John W A Rossen; Frederic Mallard; Olivier Rochas; William Michael Dunne Journal: Nat Rev Microbiol Date: 2020-02-13 Impact factor: 60.633
Authors: Mariana Brait; Evgeny Izumchenko; Luciane T Kagohara; Samuel Long; Piotr T Wysocki; Brian Faherty; Elana J Fertig; Tin Oo Khor; Elizabeth Bruckheimer; Gilson Baia; Daniel Ciznadija; Ido Sloma; Ido Ben-Zvi; Keren Paz; David Sidransky Journal: Br J Cancer Date: 2017-01-24 Impact factor: 7.640
Authors: Kirsten van de Groep; Martine P Bos; Paul H M Savelkoul; Anna Rubenjan; Christel Gazenbeek; Willem J G Melchers; Tom van der Poll; Nicole P Juffermans; David S Y Ong; Marc J M Bonten; Olaf L Cremer Journal: Eur J Clin Microbiol Infect Dis Date: 2018-04-26 Impact factor: 3.267