Simultaneous detection of eleven sexually transmitted agents using multiplexed PCR coupled with MALDI-TOF analysis.

PURPOSE: Sexually transmitted infections (STIs), representing a major global health problem, are caused by different microbes, including bacteria, viruses, and protozoa. Unfortunately, infections of different sexually transmitted pathogens often present similar clinical symptoms, so it is almost impossible to distinguish them clinically. Therefore, the aim of the current study was to develop a sensitive, multitarget, and high-throughput method that can detect various agents responsible for STIs.
METHODS: We developed and tested a 23-plex PCR coupled with matrix-assisted laser desorption ionization-time of flight (MALDI-TOF) mass spectrometry (MS) assay (sexually transmitted infection-mass spectrometry, STI-MS) that simultaneously targets 11 different agents, including 8 most common clinical pathogens related to STIs (HSV-1, HSV-2, Neisseria gonorrhoeae , Chlamydia trachomatis, Treponema pallidum, Trichomonas vaginalis, Mycoplasma genitalium, and Haemophilus ducreyi) and 3 controversial microorganisms as pathogens (Mycoplasma hominis, Ureaplasma urealyticum, and Ureaplasma parvum).
RESULTS: The results showed that the STI-MS approach can accurately detect the expected agents, without cross-reaction with other organisms. The limit of detection of each STI-MS assay was ranged from 1.739 to 10.009 copies/reaction, using probit analyses. The verification rate for each target organism of the STI-MS ranged from a minimum of 89.3% to a maximum of 100%, using conventional assays and ultrasensitive digital PCR to confirm the STI-MS-positive results. To further evaluate the clinical performance of this assay, 241 clinical specimens (124 urethral/cervical swabs and 117 urine) were tested in parallel using the STI-MS assay and monoplex real-time PCR for each agent. The overall validation parameters of STI-MS were extremely high including sensitivity (from 85.7% to 100%), specificity (from 92.3% to 100%), PPV (from 50% to 100%), and NPV (from 99.1% to 100%) for each target.
CONCLUSION: STI-MS is a useful high-throughput screening tool for detecting mixed infections of STIs and has great potential for application in large-scale epidemiological programs for specific microorganisms of STI.

Introduction

Sexually transmitted infections (STIs) are a significant contributor to the global burden in public health and medical care. STIs can cause severe fetal and neonatal death, ectopic pregnancy, infertility, and genital neoplasia. Despite leading to such severe complications, clinical and public health practice sometimes underestimates the importance of diagnosing STIs, and moreover, for scientific research, STIs remain a neglected field.1 Many STIs are often asymptomatic during the early infection stages, which increase the risk of unrecognized transmission.2,3 The World Health Organization (WHO) estimated that approximately 357 million new infections of curable STIs occurred each year throughout the world (http://www.who.int/mediacentre/factsheets/fs110/en/). STIs are caused by different microbes, including bacteria, viruses, and protozoa. Unfortunately, infections of different sexually transmitted pathogens often present similar clinical symptoms, so it is almost impossible to distinguish them clinically.3 Therefore, it is important to develop a sensitive, multitarget, and high-throughput method that can detect various agents responsible for STIs. In addition, rapid and accurate identification is critical for preventing onward transmission, offering immediate intervention, adopting early treatment, and reducing patient management costs.4,5

Conventional diagnostic algorithms for STIs include cell culture, microscopic examination, enzyme immunoassay, and other serological investigation techniques.6–8 The diagnosis of STIs by culture or serology remains a challenge.9 Especially for herpes simplex virus and Treponema pallidum detection, cell culture shows low-sensitivity and long turnaround time, making this assay clinically useless.10,11 However, over the past two decades, molecular testing has been widely used to detect pathogens associated with STIs. Compared with traditional methods, molecular tests, such as PCR, real-time PCR, multiplex PCR, and microarray, have rapid turnaround times and superior sensitivities.3,7,12 Several commercial kits or systems based on nucleic acid amplification have been developed to detect pathogens responsible for STIs,13–16 but these systems still have disadvantages, such as high cost, low sample throughput, and the limited number of pathogens that can be detected in a single test reaction.3

In this study, the MassARRAY System (Agena Bioscience, Inc., San Diego, CA, USA), a detection platform combining endpoint multiplex-PCR with matrix-assisted laser desorption ionization-time of flight mass spectrometry (MALDI-TOF MS), was utilized to develop a sexually transmitted infection assay (STI-MS) that can simultaneously detect and identify common clinical pathogens implicated in STIs, including herpes simplex virus types 1 and 2 (HSV-1 and HSV-2), Neisseria gonorrhoeae, Chlamydia trachomatis, Treponema pallidum, Trichomonas vaginalis, Mycoplasma genitalium, and Haemophilus ducreyi. Three controversial microorganisms (Mycoplasma hominis, Ureaplasma urealyticum, and Ureaplasma parvum), still not conclusive evidence whether these agents should be considered pathogens, were also included in the panel in our study. The system comes with some considerable benefits of multiplexing and high throughput, and it has been applied successfully in detecting and confirming various kinds of microbes.17–24 For each microorganisms included in the STI-MS assay, two different genes were selected as targets. If either of the genes were detected, the corresponding organisms were positive. Such a strategy can avoid false-negative results, thus making our method more sensitive and comprehensive. The performance of the STI-MS was evaluated using clinical specimens from patients with sexually transmitted infections. All STI-MS results were confirmed by real-time PCR and nested PCR. Discordant results were arbitrated by an ultrasensitive digital PCR method.

Materials and methods

Clinical specimens

The initial evaluation of the STI-MS assay included 176 archived DNA samples from anal swabs that were obtained from men who have sex with men (MSM) attending a local clinic, who tested positive for HIV, or had any susceptible symptoms of STIs. Details about the recruitment method, sample collection, and data collection have been previously described.25 To further evaluate the clinical performance of this assay, 241 clinical specimens (124 urethral/cervical swabs and 117 urine) were collected from Shenzhen Center for Chronic Disease Control. DNA extraction from clinical specimens was performed in the MagNA Pure LC 2.0 Instrument using MagNA Pure LC DNA Isolation Kit 1 (Roche Diagnostics, Mannheim, Germany).

Design of the STI-MS method

Candidate assay targets of highly conserved genomic regions for the eleven agents of interest were identified and chosen on the basis of published validation data, reporting used successfully as PCR targets. To avoid the false-negative results, two targets of each agent were used in the STI-MS method. Human β-globin (HBB) gene was selected for internal control. Therefore, we developed a 23-plex method to identify eight etiological agents related to the STIs and other three controversial organisms in this study. The NCBI GenBank database (http://www.ncbi.nlm.nih.gov/genbank/) was used to download all available full and partial nucleic acid sequences for each target. Primer pairs of multiplex PCR and extension probes were designed using Assay Design 4.1 software (Agena Bioscience, Inc., San Diego, CA, USA), and their specificity was confirmed by primer and nucleotide blast tools (NCBI, https://www.ncbi.nlm.nih.gov/tools/primer-blast/). Every PCR primer included a 5ʹ universal 10-mer tag (5ʹ-ACGTTGGATG-3ʹ) to increase the molecular weight. PCR primers and extension probes were obtained from Tsingke Biotechnology (Beijing, China). The final targeting regions and the primers/probes of the STI-MS assay were listed in in the supplementary material.

Initial multiplex PCR and SAP reaction

Each 5 μL multiplex PCR reaction was composed of 2 μL DNA template, 0.5 μL PCR buffer, 0.4 μL MgCl2 (Agena Bioscience, Inc.), 0.1 μL mM dNTP (dATP, dUTP, dCTP, dGTP) (Promega, Madison, WI, USA), 1 μL primer mix, 0.2 μL DNA polymerase enzyme (Roche Molecular Systems Inc., Pleasanton, CA, USA), 0.2 μL uracil-DNA glycosylase (ShineGene Molecular Biotechnology, Shanghai, China), and 0.6 μL H2O. Multiplex PCR amplification was performed in a ProFlex PCR system (Applied Biosciences, Foster City, CA, USA) using 384-well PCR plates. The following thermocycler program was used for PCR: 45°C for 2 mins; 94°C for 4 mins; an initial denaturation at 95°C for 2 mins; 45 cycles at 95°C for 30 s, 56.5°C for 30 s, and 72°C for 1 min; and a final step of 72°C for 5 mins. After the PCR amplification, 0.3 U shrimp alkaline phosphatase (SAP) was added and incubated at 37°C for 40 mins, and then 85°C for 5 mins to remove the residual dNTPs.

Single-base extension reaction and mass spectrometry

The single-base extension (SBE) reaction was performed with the iPLEX Pro Reagent kit (Agena Bioscience, Inc.) in a total reaction volume of 9 μL. For the SBE reaction, 0.619 μL H2O, 0.2 μL terminator mix, 0.2 μL iPLEX Pro buffer, 0.94 μL extension probe cocktail, and 0.041 μL ThermoSequenase enzyme were mixed with the products of SAP treatment, using the thermocycling conditions: 94°C for 30 s; 40 cycles at 94°C for 5 s with 5 cycles of 52°C for 5 s and 80°C for 5 s; and a final 72°C for 3 mins. During the SBE reaction, the probe is extended by one mass-modified nucleotide depending on the nucleotide position of interest. The products of the SBE reaction were desalted by rotation with a cationic ion exchange resin (Agena Bioscience, Inc.) for 60 mins. The purified product was spotted onto a 384-spot SpectroChip II (Agena Bioscience, Inc.) using the Nanodispenser RS 1000 equipment (Agena Bioscience, Inc.) and then scanned using the mass spectrometry of MassARRAY system. The results were analyzed by Typer software version 4.1 (Agena Bioscience, Inc.).

Confirmation of positive STI-MS results

To further confirm the positive results obtained by STI-MS assay, the same nucleic acid extracts used for STI-MS analysis were also analyzed either with real-time PCR or nested PCR. All positive specimens were first analyzed using real-time PCR targeting species-specific genes. Real-time PCR was performed using a simplex real-time PCR developed or adapted for the following organisms: HSV-1 and HSV-2, C. trachomatis, T. pallidum, N. gonorrhoeae, M. genitalium, M. hominis, U. urealyticum, and U. parvum. Specimens with a cycle threshold (Ct) value above 38 were considered negative. Any samples that were not confirmed by the initial round of real-time PCR analysis were retested with nested PCR. The primers employed for the nested PCR with sequencing were designed in-house and selected according to the previously published literature.26–28 A negative control was included for each PCR run to ensure the purity of the reagent. A specimen was considered positive for a given result if either of the two assays for that result were positive. and provide details about the primers and probes used in this study for real-time PCR and nested PCR-based confirmation.

Resolution of discordant results

Digital PCR (dPCR) was performed for the arbitration of discrepant results between the STI-MS assay and confirmatory tests. Digital PCR amplifications were carried out on a microchip using a QuantStudio® 3D Digital PCR System (Applied Biosciences, Foster City, CA, USA). A final reaction volume of 14.5 μL was prepared, containing 7.25 μL QuantStudio® 3D Digital PCR Master Mix, 0.29 μL (10 μM) of probe, 0.1305 μL (100 μM) of each primer, 1.699 μL H2O and 5 μL of DNA template. According to the manufacturer’s instructions, a 14.5 μL reaction mixture was immediately loaded on the QuantStudio® 3D dPCR chip using QuantStudio® 3D Digital PCR chip loader. The chip was then placed on the ProFlex PCR system for PCR amplification using the following cycling conditions: initial hold at 96°C for 10 mins; 39 cycles at 58°C for 2 mins, and 98°C for 30 s; and 60°C for 2 mins. Following amplification, the chips were inserted into the chip reader for imaging, and the data were analyzed using the cloud-based QuantStudio® 3D AnalysisSuite software. For each digital PCR run, at least one positive and negative control was included.

Statistical analysis

Differences between the concordance rates among single infection and multiple infection specimens were compared using the χ2 test. Statistical analysis was carried out using SPSS software version 17.0 (SPSS Inc., Chicago, IL, USA). A p-value <0.05 was considered significant. Comparison of diagnostic performance between the STI-MS assay and monoplex real-time PCR was assessed by measuring sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) using the VassarStats website (https://vassarstats.net/).

Ethical approval

All experiments were performed according to the ethical standards of the national research committee and with the 1964 Helsinki declaration. Scientific approval to conduct this study was obtained from the Institutional Review Boards of the Institute of Pathogen Biology. Written informed consent was obtained from every participant before the interview and testing.

Results

The STI-MS method

In this study, we developed and tested a 23-plex method that targets eleven different etiological agents simultaneously and can identify the most common pathogens related to STIs, using HBB as an internal control. After nucleic acid extraction of samples, the first step of STI-MS assay was multiplex PCR using specific primers and probes that amplify highly conserved regions of the microbial genome. The second step of STI-MS assay involved the detection of specific products by using a MALDI-TOF mass spectrometer system, in which the mass of each product was measured. The microorganism(s) in the specimen were determined by observing the base composition of the observed. To avoid false-negative results, two targets of each agent were used in the STI-MS assay. The results of the nucleotide BLASTN analysis showed that all tested primers and probes worked well. Our results revealed that the developed STI-MS method had satisfactory analytical specificity and multiplex detection capacity for target organisms.

Analytical specificity and sensitivity

The specificity and detection power of the assay were evaluated using nucleic acid extracted from 303 confirmed clinical isolates and samples (Table 1). Positive clinical samples and isolates of H. ducreyi were not obtained, and positive plasmids with target genes were used to validate the specificity in this study. The results showed that the STI-MS approach can accurately identify the targeted agents, and positive results were not obtained from the negative controls (– in the supplementary material). To further evaluate the detection specificity and cross-reactivity, 65 genetically or clinically nonspecific pathogens were tested using the same assay procedure used for the STI detection. All assay results were negative and nonspecific positive reactions were not observed.

Table 1

Sequencing confirmed clinical samples and isolates used for validating specificity

Organisms	No. of clinical samples	No. of isolates	Total
Target strains used to test the specificity N=303
Herpes simplex virus types 1	19	2	21
Herpes simplex virus types 2	23	0	23
Chlamydia trachomatis	30	0	30
Treponema pallidum	16	0	16
Neisseria gonorrhoeae	18	26	44
Trichomonas vaginalis	18	0	18
Mycoplasma hominis	35	0	35
Ureaplasma urealyticum	41	0	41
Mycoplasma genitalium	27	0	27
Ureaplasma parvum	48	0	48
Haemophilus ducreyi	0	0	0
Other species used to test the specificity N=65
Human Immunodeficiency Virus	15	1	16
Human papillomavirus types 6	2	0	2
Human papillomavirus types 11	2	0	2
Human papillomavirus types 16	3	0	3
Human papillomavirus types 18	3	0	3
Human papillomavirus types 31	2	0	2
Human papillomavirus types 33	3	0	3
Human papillomavirus types 45	1	0	1
Human papillomavirus types 52	2	0	2
Human papillomavirus types 58	2	0	2
Neisseria lactamica	0	4	4
Neisseria polysaccharea	0	5	5
Neisseria meningitidis	0	2	2
Moraxella catarrhalis	3	1	4
Klebsiella pneumoniae	3	1	4
Mycoplasma pneumoniae	2	1	3
Pseudomonas aeroginosa	2	1	3
Staphylococcus aureus	3	1	4

The analytical sensitivity (limit of detection) of the STI-MS assay developed in this study was determined by testing serial dilutions of positive standards ranging from 100 to 1 copies/μL plasmids carrying the target genes of each agent. A regression probit analysis was carried out using SPSS Statistics 17.0.0 to calculate the limit of detection (LOD) of each assay that could be measured with 95% probability. Probit analysis on four runs with 3 replicate dilutions of 5 different plasmid concentrations gave LODs ranging from 1.739 to 10.009 copies/reaction (Table 2).

Table 2

Limit of detection of each target gene using regression probit analysis

Target pathogen	Target	No. of replicates (%) for positive standards, copies/reactions					Limit of detection, copies/reactions
100	50	10	5	1
Herpes simplex virus types 1	gD	12/12 (100)	12/12 (100)	12/12 (100)	10/12 (83)	6/12 (50)	7.079
gG	12/12 (100)	12/12 (100)	12/12 (100)	6/12 (50)	0/12 (0)	7.215
Herpes simplex virus types 2	gD	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	9/12 (75)	5.692
gG	12/12 (100)	12/12 (100)	12/12 (100)	10/12 (83)	5/12 (42)	6.927
Chlamydia trachomatis	cryptic plasmid	12/12 (100)	12/12 (100)	12/12 (100)	12/12 (100)	7/12 (58)	3.230
omp1	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	9/12 (75)	5.692
Treponema pallidum	polA	12/12 (100)	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	1.739
tpp47	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	7/12 (58)	5.732
Neisseria gonorrhoeae	opa	12/12 (100)	12/12 (100)	12/12 (100)	7/12 (58)	6/12 (50)	10.009
porA	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	5/12 (42)	5.630
Trichomonas vaginalis	beta-tubulin	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	6/12 (50)	5.688
repeated DNA target	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	9/12 (75)	5.692
Mycoplasma hominis	gap	12/12 (100)	12/12 (100)	12/12 (100)	4/12 (33)	0/12 (0)	7.961
YidC	12/12 (100)	12/12 (100)	12/12 (100)	9/12 (75)	7/12 (58)	8.428
Ureaplasma urealyticum	ureA	12/12 (100)	12/12 (100)	12/12 (100)	10/12 (83)	5/12 (42)	6.927
ureC	12/12 (100)	12/12 (100)	12/12 (100)	12/12 (100)	6/12 (50)	3.369
Mycoplasma genitalium	16S rRNA IR	12/12 (100)	12/12 (100)	12/12 (100)	11/12 (92)	8/12 (67)	5.744
magB	12/12 (100)	12/12 (100)	12/12 (100)	10/12 (83)	4/12 (33)	6.762
Ureaplasma parvum	rpmA	12/12 (100)	12/12 (100)	12/12 (100)	10/12 (83)	6/12 (50)	7.079
ureD	12/12 (100)	12/12 (100)	12/12 (100)	10/12 (83)	2/12 (17)	6.381
Haemophilus ducreyi	16S rRNA IR	12/12 (100)	12/12 (100)	12/12 (100)	6/12 (50)	0/12 (0)	7.215
recD	12/12 (100)	12/12 (100)	12/12 (100)	10/12 (83)	2/12 (17)	6.381

Evaluation of the performance on archived DNA samples

To evaluate the performance of the simultaneous detection system in clinical samples, we screened a total of 176 anal swabs obtained from MSM using the developed STI-MS assay. Among the 176 archived DNA samples, 121 (68.8%) were positive by the STI-MS method for at least one microorganism. Etiological agents were not detected in 55/176 (31.3%) samples. Our method allowed for the diagnosis of bacterial organisms in 97/176 (55.1%) specimens, viral organisms in 7/176 (4.0%) specimens, and bacterial–viral combinations in 17/176 (9.7%) specimens. Sixty-seven of the 121 (55.4%) specimens were also identified as mixed agent combination for STI-MS assay target organisms. Furthermore, from the multiple combination samples, 33 tested samples (49.3% of the total 67) were identified as dual-combinations with 2 of the 11 microorganisms, and 22 analyzed samples (32.8% of the total 67) were found to be detected with 3 agents, while more than 3 organisms belonging to the STI-MS assay were detected in 12 surveyed samples.

For all positive specimens by the STI-MS method, the results were confirmed using related confirmatory tests. In the 54 samples found positive for single microorganism by STI-MS, 32 (59.3%) samples were also positive for single organism by an initial real-time PCR assay that targeted species-specific genes. However, for multiple agent combination specimens, 30 (44.8% of the total 67) of the positive specimens showed results concordant with the STI-MS assay. The discordant specimens were further verified by nested PCR and bidirectional sequencing. Combining the results of the two confirmatory tests, the concordance rate was 70.4% (38/54) for single organism and 64.2% (43/67) for multiple agent combination. Forty STI-MS-positive specimens were not confirmed by either real-time PCR or nested PCR.

For further analysis of the 40 specimens that yielded discrepant results with the developed STI-MS assay and the confirmatory tests, ultrasensitive digital PCR was performed. Among these 40 STI-MS-positive and confirmatory test-negative samples, 31 (77.5%) were confirmed as positive by a digital PCR assay, whereas 9 (22.5%) remained unverified after the resolution of the discordant results, including 4 single organism samples and 5 multiple agent combination samples (Table 3). The results of the confirmatory tests and arbitration testing revealed that all retested specimens that were verified as positive by either of the tests were indeed accurate positive, irrespective of their classification as negative by either assay. The arbitration testing results are illustrated in and – in the supplemental material. Table 4 shows the performance of the STI-MS assay as well as the resolution of the discordant results after arbitration testing. The overall verification rate was 92.6% (50/54) for single organism, whereas this rate was 92.5% (62/67) for multiple agent combination. The difference was not significant among these two rates (P>0.05 by χ2 test). The verification rates for each target organism of the STI-MS assay ranged from a minimum of 89.3% (25/28) for N. gonorrhoeae to a maximum of 100% (2/2) for U. parvum, 100% (2/2) for T. pallidum, and 100% (31/31) for M. genitalium. Among the 176 specimens tested, the majority of the screened samples detected were positive for U. urealyticum (n=55; 31.3%), followed by C. trachomatis (n=43; 24.4%) and M. hominis (n=38; 21.6%). T. vaginalis and H. ducreyi were not detected in our study. Most of the samples with multiple combinations included U. urealyticum and M. hominis (35.8%, 24/67). The most frequent types of multiple combinations detected in the surveyed samples were U. urealyticum, C. trachomatis, and M. hominis (n=6). The numbers of tested specimens with multiple combinations are shown in .

Table 3

Samples with discordant results by the STI-MS method after arbitration testing

Sample ID	STI-MS results	Confirmed results
M32	UU	Negative
M33	MH	Negative
M34	CT	Negative
M35	NG	Negative
M36	UU, NG	UU
M37	UU, MH, HSV1	UU, MH
M38	MH, HSV1,HSV2	HSV1, HSV2
M39	UU, CT, MH, NG	UU, CT, MH
M40	TP, UU, CT, MG, MH, NG, HSV2	TP, UU, CT, MG, MH, NG

Abbreviations: UU, Ureaplasma urealyticum; MH, Mycoplasma hominis; CT, Chlamydia trachomatis; NG, Neisseria gonorrhoeae; TP, Treponema pallidum; HSV1, Herpes simplex virus types 1; HSV2, Herpes simplex virus types 2; MG, Mycoplasma genitalium.

Table 4

Results of confirmatory tests of positive samples by the STI-MS assay and resolution of discordant results following arbitration testing

Target pathogen	No. (%) of positive samples by STI-MS	No. of samples confirmed by confirmatory tests/No. of positive samples by STI-MS	Verification rate (%) of confirmatory tests	No. of discordant samples confirmed by arbitration testing	No. of overall confirmed samples	Overall verification rate (%)
Herpes simplex virus types 1	19 (10.8)	12/19	63.2	6	18	94.7
Herpes simplex virus types 2	14 (8.0)	8/14	57.1	5	13	92.9
Chlamydia trachomatis	44 (25)	37/44	84.1	6	43	97.7
Treponema pallidum	2 (1.1)	2/2	100	0	2	100
Neisseria gonorrhoeae	28 (15.9)	21/28	75	4	25	89.3
Trichomonas vaginalis	NA	NA	NA	NA	NA	NA
Mycoplasma hominis	40 (22.7)	35/40	87.5	3	38	95
Ureaplasma urealyticum	56 (31.8)	50/56	89.3	5	55	98.2
Mycoplasma genitalium	31 (17.6)	24/31	77.4	7	31	100
Ureaplasma parvum	2 (1.1)	2/2	100	0	2	100
Haemophilus ducreyi	NA	NA	NA	NA	NA	NA
Totala	121 (68.8)	81/121	66.9	31	112	92.6

Note: aThe total number of clinical samples is 176.

Abbreviation: NA, not available.

Performance characteristics of the STI-MS assay compared to the monoplex real-time PCR

To further evaluate the clinical performance of this assay, 241 clinical specimens (124 urethral/cervical swabs and 117 urine) were tested in parallel using the STI-MS assay and monoplex real-time PCR for each agent. The primers and probes used in the monoplex real-time PCR were listed in in the supplementary material. The performance characteristics (sensitivity, specificity, PPV, and NPV) of each microorganism for the different specimen types were calculated and listed in Table 5. Overall, there was very good sensitivity (ranging from 85.7% to 100%), specificity (ranging from 92.3% to 100%), and NPV (ranging from 99.1% to 100%) for each of the evaluated targets. Because the STI-MS has a lower LOD than real-time PCR, the results showed a more expanded PPV ranging from 50% to 100% in terms of different agents and specimen types (Table 5).

Table 5

Clinical performance of the STI-MS assay for organism identification compared to that of monoplex real-time PCR

Target organism	Sample types	No. of samples with the following result					Sensitivity (%) (95% CI)	Specificity (%) (95% CI)	PPV (%) (95% CI) c	NPV (%) (95% CI) c
TP	FP	FN	TN	Total
Herpes simplex virus types 1	Urine	1	0	0	116	117	100 (5.5–100)	100 (96.0–100)	100 (5.5–100)	100 (96.0–100)
Swabs a	1	1	0	122	124	100 (5.5–100)	99.2 (94.9–100)	50 (2.7–97.3)	100 (96.2–100)
Herpes simplex virus types 2	Urine	1	1	0	115	117	100 (5.5–100)	99.2 (94.6–100)	50 (2.7–97.3)	100 (96.0–100)
Swabs a	1	1	0	122	124	100 (5.5–100)	99.2 (94.9–100)	50 (2.7–97.3)	100 (96.2–100)
Chlamydia trachomatis	Urine	3	0	0	114	117	100 (3.1–100)	100 (96.0–100)	100 (31.0–100)	100 (96.0–100)
	Swabs a	12	2	0	110	124	100 (69.9–100)	98.2 (93.1–99.7)	85.7 (56.2–97.5)	100 (95.8–100)
Treponema pallidum	Urine	0	0	1	116	117	0 (0–94.5)	100 (96.0–100)	NA	99.1 (94.6–100)
	Swabs a	0	0	1	123	124	0 (0–94.5)	100 (96.2–100)	NA	99.2 (95.0–100)
Neisseria gonorrhoeae	Urine	6	3	1	107	117	85.7 (42.0–99.3)	97.3 (91.6–99.3)	66.7 (31.0–91.0)	99.1 (94.2–100)
	Swabs a	2	1	0	121	124	100 (19.8–100)	99.2 (94.8–100)	66.7 (12.5–98.2)	100 (96.2–100)
Trichomonas vaginalis	Urine	0	0	0	117	117	NA	100 (96.0–100)	NA	100 (96.0–100)
	Swabs a	1	0	0	123	124	100 (5.5–100)	100 (96.2–100)	100 (5.5–100)	100 (96.2–100)
Mycoplasma hominis	Urine	5	0	0	112	117	100 (46.3–100)	100 (95.9–100)	100 (46.3–100)	100 (95.9–100)
	Swabs a	14	2	0	108	124	100 (73.2–100)	98.2 (93.0–99.7)	87.5 (60.4–97.8)	100 (95.7–100)
Ureaplasma urealyticum	Urine	8	6	0	103	117	100 (59.8–100)	94.5 (87.9–97.7)	57.1 (29.6–81.2)	100 (95.5–100)
	Swabs a	11	6	0	107	124	100 (67.9–100)	94.7 (88.3–97.8)	64.7 (38.6–84.7)	100 (95.7–100)
Mycoplasma genitalium	Urine	2	2	0	113	117	100 (19.8–100)	98.3 (93.2–99.7)	50 (9.2–90.8)	100 (96.0–100)
	Swabs a	2	0	0	122	124	100 (19.8–100)	100 (96.2–100)	100 (19.8–100)	100 (96.2–100)
Ureaplasma parvum	Urine	2	1	0	114	117	100 (19.8–100)	99.1 (94.5–100)	66.7 (12.5–98.2)	100 (96.0–100)
	Swabs a	46	6	0	72	124	100 (90.4–100)	92.3 (83.4–96.8)	88.5 (75.9–95.2)	100 (93.7–100)
Haemophilus ducreyi	Urine	0	0	0	117	117	NA	100 (96.0–100)	NA	100 (96.0–100)
	Swabs a	0	0	0	124	124	NA	100 (96.3–100)	NA	100 (96.3–100)

Note: aUrethral/cervical swab.

Abbreviations: TP, true positive; FP, false positive; FN, false negative; TN, true negative; CI, confidence interval; PPV, positive predictive value; NPV, negative predictive value; NA, not available.

Discussion

This work details the design and development of an STI-MS assay that can be used on clinical samples to screen for eleven sexually transmitted microorganisms.

STIs comprise a number of fatal and often serious infections, and yet such infections often pose challenges in identifying the causative organisms. Rapid and accurate identification of sexually transmitted infections can reduce onward transmission and improve treatment efficacy. Many pathogens responsible for STIs are identified by cell culture, microscopic examination, or antigen detection methods.7 PCR-based approaches have been shown to be more sensitive at detecting pathogens in clinical samples than traditional diagnostic tests (ie, culture, microscopy and antigen detection) if samples are collected at the appropriate time during infection.3,29 Considering the wide range of etiological agents that can cause STIs and the similarity of the clinical presentations of infection produced by different pathogens, the multiplex molecular diagnostic tools seem to be an optimal method for rapid diagnosis.2,12,30 Therefore, we utilized multiplex PCR and MALDI-TOF MS incorporated into an STI-MS assay, which might be helpful for better understanding the phenomenon of mixed infections in clinical specimens.

Because of the severity and complexity of STIs, feasible and effective screening approaches are essential for timely implementation of effective infection control measures to prevent further transmission. Additionally, increases in antimicrobial drug resistance in N. gonorrhoeae and M. genitalium remain an important concern.1 Large-scale epidemiological studies and surveillance programs are needed to determine optimal prevention strategies and to reduce the global burden of STIs.

Routine screening for pathogens associated with STIs on an annual basis is recommended for all pregnant women, all sexually active females <25 years of age, and at-risk MSM.5,31 To date, nucleic acid amplification tests (NAATs) are accepted worldwide as an important method for screening causative agents of STIs with several approved commercial molecular panels available.32–35 In addition, several emerging nucleic acid amplification platforms combined with fully and partially automated instrumentation are available for targeting multiple microorganisms in a single test reaction.12,14,30,36,37 However, these platforms are low throughput or have a high cost per sample, preventing rapid screening of large numbers of specimens. Compared to other diagnostic strategies, STI-MS using MALDI-TOF MS technologies are generally more reliable and can be more easily automated. The STI-MS assay simultaneously detects the nucleic acid from 1 protozoan, 2 viral, and 8 bacterial organisms and analyzes approximately 760 clinical samples within 1 working day. Because of the high sample throughput of this method, the cost of detecting 11 pathogens using STI-MS is less than $4, not including the cost of the nucleic acid extraction. Therefore, the STI-MS method has great potential to be applied in large-scale epidemiological programs for specific microorganisms of STI and provides important information for public health interventions and disease control and eradication.

One of the main challenges in the design and establishment of these assays was limiting the potential for cross-reactions with other organisms, particularly commensal species. Examples of these tested sites include adequate numbers of commonly Neisseria meningitidis and other commensal Neisseria species, which can cause cross-reaction in the screening assays due to their high degree of nucleic acid homology with N. gonorrhoeae.38 Among the targets used to identify C. trachomatis, a cryptic plasmid has been the most widely used for NAATs.39–41 However, it was subsequently shown that sequence variation of cryptic plasmids has been detected in several countries.42–44 This demonstrates that false-negative results may occur when a cryptic plasmid is used alone as the target for detection of C. trachomatis particularly when screening clinical samples from this region. Previously, several commercial NAATs used a single target on the pathogens associated with sexually transmitted infections, which led to the emergence of a false-negative diagnostic result, and the infection went untreated and was transmitted between individuals without knowledge before being recognized.45 To overcome these potential problems, the STI-MS assay uses two targets of each pathogen to increase the sensitivity and specificity and to reduce false-negative results. The results of this study have shown that the STI-MS method was useful for detecting several microorganisms simultaneously with high specificity and accuracy.

Another aspect that could affect the performance of the assays is the quality of the sample in terms of etiological load and number of copies containing pathogens. In our study, 40 positive specimens using the developed STI-MS assay were not confirmed by confirmatory tests. One possible cause for the higher number of discrepancies in the clinical specimens for causative agents of STIs may be due to target pathogens with a low concentration, as reported by Van et al in an evaluation of BD MAX assay.37 Digital PCR has been successfully applied in the field of pathogen detection46,47 and is particularly suited to the low-level detection of nucleic acid even with a highly complex background.47,48 In the arbitration stage, ultrasensitive digital PCR was performed to resolve discordant results. Thirty-one (77.5%) specimens were confirmed as positive after arbitration testing. To significantly shorten the detection time, ultrasensitive diagnosis methods for STIs are required to detect extremely small amounts of microorganisms directly without culturing the specimen. Based on sensitivity testing, LOD of the STI-MS assay can reach a minimum of 1.739 copies per reaction. Moreover, it was subsequently verified that this method also has a high sensitivity in the evaluation of clinical samples. Thus, when target pathogens with a low concentration in clinical specimens, the STI-MS assay substantially increased our ability to detect potential pathogens and increased the likelihood that an accurate diagnosis will not be missed.

MSM are at risk of acquiring protozoan, viral, and bacterial STIs from both male and female partners. Most of the previous studies have shown the prevalence of STI ranges from 2.6% to 23.7%,49 while our study indicates that the detection rate of agents was 68.8% (121/176) among MSM, which was higher than the data in other studies. We speculate that the difference was caused by the improved coverage of screening using this method. Coinfections are frequently encountered among MSM and present a difficult diagnostic challenge for clinical microbiology laboratories. In our study, 55.4% (67/121) specimens were identified as mixed agent combinations, and most of those with multiple combinations included U. urealyticum and M. hominis (35.8%, 24/67). These findings are consistent with those recently reported in a study using a commercial detection kit.35 As the high detection rates of U. urealyticum and M. hominis might have been caused by infection and commensalism, their roles as pathogens are controversial.50 However, an earlier study suggested that U. urealyticum and M. hominis combination may be associated with an increased drug resistance.51 The detection of STIs using the STI-MS approach might be helpful for the timely discovery of mixed agent combinations, and clinicians could prescribe appropriate antibiotics for patients according to the results of identified pathogens.

However, some limitations exist for the STI-MS assay as we mentioned in the previous studies.18,22 First, when the load of the organism is too low, the STI-MS assay may fail to detect the target pathogen because the volume of specimen used in the initial PCR was 2 μL. Second, the high cost of the equipment and the large footprint of the system limit the application range of the mass spectrometer platform in clinical laboratories. Third, with nearly 8 hours of turnaround time, the STI-MS assay is not suitable for the detection of a small number of samples. Additionally, as anal swabs using in the evaluate stage were archived DNA samples, the limited sample volume prevented us from testing in parallel, using the STI-MS assay and monoplex real-time PCR for each agent. Therefore, additional testing on different sample types (including anal swabs) will be required in the future to evaluate comprehensively the performance of the STI-MS assay. Finally, as positive clinical samples and isolates of H. ducreyi are not available, the specificity of H. ducreyi was determined by analysis of plasmids containing the respective target sequences.

Given its rapidity, sensitivity, and specificity, STI-MS is a useful high-throughput screening tool for detecting mixed infections of STIs and has great potential in large-scale STI epidemiological programs.