| Literature DB >> 34943454 |
Serge Tonen-Wolyec1,2, Raphaël Dupont3, Natalio Awaida3, Salomon Batina-Agasa2, Marie-Pierre Hayette4, Laurent Bélec5.
Abstract
Due to their ease-of-use, lateral flow assay SARS-CoV-2 antigen-detecting rapid diagnostic tests could be suitable candidates for antigen-detecting rapid diagnostic self-test (Ag-RDST). We evaluated the practicability of the Ag-RDST BIOSYNEX Antigen Self-Test COVID-19 Ag+ (Biosynex Swiss SA, Freiburg, Switzerland), using self-collected nasal secretions from the turbinate medium (NMT), in 106 prospectively included adult volunteers living in Paris, France. The majority of the participants correctly understood the instructions for use (94.4%; 95% confidence interval (CI): 88.3-97.4), showing a great ability to perform the entire self-test procedure to obtain a valid and interpretable result (100%; 95% CI: 96.5-100), and demonstrated the ability to correctly interpret test results (96.2%; 95% CI: 94.2-97.5) with a high level of general satisfaction. About one in eight participants (# 15%) needed verbal help to perform or interpret the test, and only 3.8% of test results were misinterpreted. By reference to multiplex real-time RT-PCR, the Ag-RDST showed 90.9% and 100% sensitivity and specificity, respectively, and high agreement (98.1%), reliability (0.94), and accuracy (90.9%) to detect SARS-CoV-2 antigen. Taken together, our study demonstrates the high usability and accuracy of BIOSYNEX Antigen Self-Test COVID-19 Ag+ for supervised self-collected NMT sampling in an unselected adult population living in France.Entities:
Keywords: COVID-19; France; N nucleocapsid protein; SARS-CoV-2; antigen; general public; nasal mid-turbinate secretions; rapid diagnostic test; self-test
Year: 2021 PMID: 34943454 PMCID: PMC8700066 DOI: 10.3390/diagnostics11122217
Source DB: PubMed Journal: Diagnostics (Basel) ISSN: 2075-4418
Figure 1Recruitment of study participants.
Figure 2Panel of 7 BIOSYNEX Antigen Self-Test COVID-19 Ag+ (Biosynex Swiss SA) cassettes, including 3 positive tests (strong positive: n°1; weak positive: n°4; and positive: n°7), 2 negative tests (n°2 and n°5) and 2 invalid tests (n°3 and n°6). Each participant drew and interpreted five of the seven tests and the results were recorded by the observer.
Demographic characteristics and medical history of the 106 study participants.
| Variable | Items | Number (%) |
|---|---|---|
| Sex | ||
| Male | 38 (35.8) | |
| Female | 68 (64.2) | |
| Age (years) | ||
| 18–20 | 4 (3.7) | |
| 21–59 | 96 (90.6) | |
| ≥60 | 6 (5.7) | |
| Educational level | ||
| No diploma | 17 (16.1) | |
| College level | 40 (37.7) | |
| High school level | 22 (20.7) | |
| Post-graduate level | 27 (25.5) | |
| Previous use of other | ||
| self-tests (not for COVID-19) | ||
| Yes | 13 (12.3) | |
| No | 93 (87.7) | |
| Asymptomatic for COVID-19 | ||
| Yes | 76 (71.7) | |
| Contact case | 10 (9.4) | |
| Symptomatic for COVID-19 # | ||
| Yes | 30 (28.3) | |
| Day from the onset | ||
| 0–1 | 7 (6.6) | |
| 2–4 | 20 (18.8) | |
| 5–7 | 3 (2.9) | |
| >7 | 0 (0.0) | |
# Participants who reported having at least one of the following major symptoms associated or not with minor symptoms were considered to have a COVID-19 symptom: fever, fatigue, dry cough, anosmia, and dyspnea. Minor symptoms were: pain, nasal congestion, runny nose, sore throat or diarrhea.
Analytical results of the evaluation questionnaire concerning the ability of the 106 study participants to understand the instruction for use of the BIOSYNEX Antigen Self-Test COVID-19 Ag+ (Biosynex Swiss SA).
| Comprehension of Labeling Checklist * | Participants’ Responses | ||
|---|---|---|---|
| True | False | Do Not Know | |
| Q1: “The same swab is used to take both nostrils one after the other” | 106 (100) | 0 (0.0) | 0 (0.0) |
| Q2: “The nasal swab is inserted into one nostril until silk resistance is reached (approximately 3 cm)” | 104 (98.2) | 0 (0.0) | 2 (1.8) |
| Q3: “The nasal swab must touch the walls of the nostril” | 100 (94.3) | 1 (0.9) | 5 (4.7) |
| Q4: “The swab has to be turned 6 times in the tube filled with diluent (during at least 10 s)” | 106 (100) | 0 (0.0) | 0 (0.0) |
| Q5: “The swab should be properly wrung out in the tube to let a maximum of nasal sample” | 100 (94.3) | 1 (0.9) | 5 (4.7) |
| Q6: “A nipple must be placed on the tube before depositing the 4 drops of solution in the well “S”” | 104 (98.2) | 1 (0.9) | 1 (0.9) |
| Q7: “Lack of band by test results is interpreted as a negative test” | 1 (0.9) | 102 (96.2) | 3 (2.8) |
| Q8: “Lack of control band by test results should be interpreted as an invalid test” | 101 (95.3) | 2 (1.8) | 3 (2.8) |
| Q9: “Having symptoms of fever, cough and aches, the negativity of BIOSYNEX Antigen Self-test COVID-19 Ag+ confirm the lack of COVID-19 infection” | 2 (1.8) | 103 (97.2) | 1 (0.9) |
| Q10: “If the test is positive, it means that I have to see the doctor and additional tests will be required to confirm the diagnosis” | 106 (100) | 0 (0.0) | 0 (0.0) |
| Q11: “The BIOSYNEX Antigen Self-test COVID-19 Ag+ detects the presence of the virus” | 104 (98.2) | 0 (0.0) | 2 (1.8) |
| Labeling index for understanding (% [95% CI]) £ | 96.8 [91.5–98.8] | ||
| Correct understanding of the instruction for use (n; % [95% CI]) # | 100; 94.3 [88.3–97.3] | ||
* Overall, 76 (71.7%) participants preferred to use the paper-based instruction whereas 30 (28.3%) participants used the video-based instruction; £ The labeling index for understanding was defined as the mean of the correct answers for each question; # The participants who correctly answered all 11 questions were considered to have correctly understood the instructions for use. CI: Confidence interval; COVID-19: Coronavirus disease 2019; Q: Question.
Analytical results of the manipulation observation concerning the ability of Table, 106 study participants to correctly use each step of the BIOSYNEX Antigen Self-Test COVID-19 Ag+ (Biosynex Swiss SA) autonomously or with verbal help.
| Usability Checklist µ | Successful Manipulation | Need for Verbal Help | |
|---|---|---|---|
| Yes | No | Yes | |
|
Did the participant open the box? | 106 (100) | - | - |
|
Did the participant read the instructions for use (written part and drawn part)? | 106 (100) | - | - |
|
Did the participant wash his hands? | 104 (98.2) | 2 (1.8) | 1 (0.9) |
|
Did the participant easily identify the different components of the kit? | 106 (100) | - | - |
|
Did the participant properly remove the test cassette from the aluminum pouch? | 105 (99.1) | 1 (0.9) | - |
|
Did the participant open the lid and place the tube on the rack correctly? | 104 (98.2) | 2 (1.8) | 2 (1.8) |
|
Did the participant introduce his nasal swab correctly in both nostrils? | 106 (100) | - | 8 (7.5) |
|
Did the participant turn the swab 6 times in the tube? | 101 (95.3) | 5 (4.7) | 3 (2.8) |
|
Did the participant wait for 1 min after turning the swab? | 104 (98.2) | 2 (1.8) | 1 (0.9) |
|
Did the participant properly wring out the tightness of the swab? | 104 (98.2) | 2 (1.8) | 6 (5.7) |
|
Did the participant correctly add the nipple to the tube? | 106 (100) | - | - |
|
Did the participant correctly deposit 4 drops into the “S” well of the test cassette? | 106 (100) | - | - |
|
Did the participant observe the correct time after deposition of the sample drops into the “S” well of the cassette? | 106 (100) | - | - |
|
Did the participant obtain an interpretable result at the end of the process? # | 106 (100) | - | 3 (2.8) |
| Usability index (% [95% CI]) £ | 99.1 [94.9–99.8] | ||
| Correct use without difficulties, errors, or helps (n; % [95% CI]) | 92; 86.8 [79.1–92.0] | ||
| Correct use with help (n; % [95% CI]) | 14; 13.2 [8.0–20.9] | ||
| Average time of manipulation (minutes [SD]) | 8.1 [1.3] | ||
µ A total of 30 (28.3%) participants used the video-based instruction for use; among them the usability index was estimated to 100% without any difficulties, errors, or help; # The result was considered interpretable when a control strip was readable after the migration time recommended by the manufacturer; in the present series, 21 (27.3%) participants had a positive self-test result; £ The usability index was defined as the mean of the correct answers for each question. CI: Confidence interval; SD: Standard deviation.
Figure 3Stacked columns showing the ability of participants to read and interpret (correctly or incorrectly) the 530 results of the BIOSYNEX Antigen Self-Test COVID-19 Ag+ (Biosynex Swiss SA) obtained from successive random selection of a panel of 7 standardized tests, including three positive, two negative, and two invalid test results.
Items and results of the satisfaction questionnaire and concerning the instruction notice (sub-study 1), the performing of the BIOSYNEX Antigen Self-Test COVID-19 Ag+ (Biosynex Swiss SA) (sub-study 2), and the interpretation of test results.
| Satisfaction Questionnaire | Post-Test Satisfaction |
|---|---|
| How did you find the understandability of instructions for use of self-test? | |
| Very easy | 61 (57.5) |
| Rather easy | 39 (36.8) |
| Rather difficult | 6 (5.7) |
| Very difficult | 0 (0) |
| How did you find the overall implementation of the self-test kit? | |
| Very easy | 53 (50.0) |
| Rather easy | 43 (40.6) |
| Rather difficult | 9 (8.5) |
| Very difficult | 1 (0.9) |
| How did you find the sample collection with nasal swabbing in both nostrils? | |
| Very easy | 37 (34.9) |
| Rather easy | 59 (55.7) |
| Rather difficult | 8 (7.7) |
| Very difficult | 2 (1.8) |
| How did you find the use of the component of the self-test kit and the sample deposition into the “S” well of the test cassette? | |
| Very easy | 53 (50.0) |
| Rather easy | 44 (41.4) |
| Rather difficult | 8 (7.7) |
| Very difficult | 1 (0.9) |
| How did you find the reading of strips after migration? | |
| Very easy | 89 (83.9) |
| Rather easy | 12 (11.4) |
| Rather difficult | 5 (4.7) |
| Very difficult | 0 (0) |
| How did you find the interpretation of self-test results? | |
| Very easy | 95 (89.6) |
| Rather easy | 11 (10.4) |
| Rather difficult | 0 (0) |
| Very difficult | 0 (0) |
| How did you find the video on YouTube to help with performing the self-test? ( | |
| Very easy | 24 (80.0) |
| Rather easy | 6 (20.0) |
| Rather difficult | 0 (0) |
| Very difficult | 0 (0) |
| How did you find the overall handling of the self-test component? | |
| Very easy | 80 (75.5) |
| Rather easy | 17 (16.0) |
| Rather difficult | 9 (8.5) |
| Very difficult | 0 (0) |
| How did you find your ability to surmount the difficulties encountered? | |
| Very easy | 100 (94.4) |
| Rather easy | 6 (5.6) |
| Rather difficult | 0 (0) |
| Very difficult | 0 (0) |
| You have just performed the nasal COVID-19 self-test, do you repeat it if necessary? | |
| Yes | 83 (78.3) |
| No | 23 (21.7) |
| You just took the COVID-19 nasal self-test; would you recommend it to someone else? | |
| Yes | 99 (93.4) |
| No | 7 (6.6) |
Analytical performance of the BIOSYNEX Antigen Self-Test COVID-19 Ag+ for the qualitative detection of the N protein of SARS-CoV-2 using 106 prospectively collected nasopharyngeal swab samples by reference rRT-PCR#.
| BIOSYNEX COVID-19 Ag BSS § | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mean Genes | N | TN | FN | TP | FP | Sensitivity | Specificity | Agreement a | Concordance b | Youden’s J Index c | ||
| PCR | Symptomatic | 23.1 | 16 | 0 | 1 | 15 | 0 | 93.8 | 100 | 96.7 | 0.93 | 93.8 |
| Negative | 14 | 14 | 0 | 0 | 0 | |||||||
| Asymptomatic | 28.2 | 6 | 0 | 1 | 5 | 0 | 83.3 | 100 | 98.7 | 0.91 | 83.3 | |
| Negative | 70 | 70 | 0 | 0 | 0 | |||||||
| Whole study population | 26.2 | 22 | 0 | 2 | 20 | 0 | 90.9 | 100 | 98.1 | 0.94 | 90.9 | |
| Negative | 84 | 84 | 0 | 0 | 0 | |||||||
§ Nasopharyngeal samples in one nostril were collected with a flocked swab for each volunteer participant by trained healthcare personnel (nurses or biologists), while the swab contained in the BIOSYNEX Antigen Self-Test COVID-19 Ag+ kit was further used for nasal secretions self-sampling by the participant himself. Molecular testing as well COVID-19 antigen detection were carried out on fresh samples; a Agreement = TP + TN/TP + FP + TN + FN, expressed in percentage; b The Cohen’s κ coefficient calculation was used to estimate the concordance [35] and interpreted according the Landis and Koch scale [36], as follows: < 0 as indicating no agreement, 0–0.20 as slight, 0.21–0.40 as fair, 0.41–0.60 as moderate, 0.61–0.80 as substantial, and 0.81–1 as almost perfect concordance; c The accuracy of the test BIOSYNEX COVID-19 Ag BSS to correctly diagnose SARS-CoV-2 infection was estimated by Youden’s J index (J = sensitivity + specificity − 1) [37]; µ 95% confidence intervals in brackets were calculated by using the Wilson score bounds; # The CE IVD-marked BIOSYNEX AmpliQuick® SARS-CoV-2 (Biosynex, Strasbourg, France) constituted the reference multiplex rRT-PCR for SARS-CoV-2 RNA detection. This assay detects two target genes of SARS-CoV-2 (E and RdRP genes); * Mean genes Ct = mean of Ct for E gene and Ct for RdRP gene. Ct: Cycle threshold; FN: False negative; FP: False positive; NA: Not attributable; rRT-PCR: real-time reverse transcription-polymerase chain reaction; TP: True positive; TN: True negative.