Literature DB >> 32436853

Comment on "Web-Based Measure of Life Events Using Computerized Life Events and Assessment Record (CLEAR): Preliminary Cross-Sectional Study of Reliability, Validity, and Association With Depression": Validity and Methodological Issues.

Jamal Rahmani1, Roya Karimi2, Farideh Mohtasham3, Siamak Sabour2,4.   

Abstract

Entities:  

Keywords:  diagnostic test; methodological issues; validity

Year:  2020        PMID: 32436853      PMCID: PMC7273232          DOI: 10.2196/14505

Source DB:  PubMed          Journal:  JMIR Ment Health        ISSN: 2368-7959


× No keyword cloud information.
We were interested in the article titled, “Web-Based Measure of Life Events Using Computerized Life Events and Assessment Record (CLEAR): Preliminary Cross-Sectional Study of Reliability, Validity, and Association With Depression” published in JMIR Mental Health [1]. One of the aims of the abovementioned study was to assess the validity of Computerized Life Events and Assessment Record (CLEAR), considering the Life Events and Difficulties Schedule (LEDS) and the List of Threatening Experiences Questionnaire (LTE-Q) as gold standards among 328 participants (126 students; 202 matched midlife sample: 127 unaffected controls, 75 recurrent depression cases). The authors concluded that CLEAR has acceptable validity and great potential for effective use in research and clinical practice. However, there are some methodological issues in this conclusion that are mentioned below. First, there are some measures that can be applied to the assessment of the validity of a test including sensitivity, specificity, positive predictive value, negative predictive value, positive likelihood ratio (LR+; ranging from 1 to infinity; the higher the LR+, the more accurate is the test), negative likelihood ratio (LR–; ranging from 0 to 1; the lower the LR–, the more accurate is the test), and odds ratio (ratio of true to false results) [2-5]. According to the results, sensitivity of CLEAR was 59.1% and 43.1% compared to LEDS and LTE-Q, respectively, as gold standards. Likewise, specificity of CLEAR was 65.4% and 78.6%, respectively, compared to the abovementioned gold standards. It is good to know that sensitivity is an important measure in public health aspects instead of clinical fields. Likewise, the positive predictive value and negative predictive value are among measures that are more appropriate for advice about the validity of a diagnostic test for clinical purposes [3-5]. Therefore, we suggest applying predictive values, likelihood ratios, odds ratio, and diagnostic accuracy to decide the validity of CLEAR. Moreover, according to the data of study, LR+, LR–, odds ratio, and diagnostic accuracy of CLEAR will be 1.6, 0.6, 2.6, and 62%, respectively, compared to LEDS (Tables 1 and 2) and 1.9, 0.7, 2.6, and 60%, respectively compared to LTE-Q (Tables 3 and 4). Therefore, there is a high level of uncertainty for decisions based on these values, and there is insufficient evidence to conclude that the validity of the CLEAR test is acceptable.
Table 1

Two by two table of Computerized Life Events and Assessment Record compared to Life Events and Difficulties Schedule as the gold standard.

CLEARaLEDSb (gold standard)
PositiveNegativeTotal
Positive593594
Negative4165106
Total100100200

aCLEAR: Computerized Life Events and Assessment Record.

bLEDS: Life Events and Difficulties Schedule.

Table 2

Assessing the validity of Computerized Life Events and Assessment Record compared to Life Events and Difficulties Schedule as the gold standard.

ParameterEstimate
Sensitivity (%)59
Specificity (%)65
Positive predictive value (%)63
Negative predictive value (%)61
Diagnostic accuracy (%)62
Likelihood ratio of a positive test1.6
Likelihood ratio of a negative test0.6
Diagnostic odds2.6
Table 3

Two by two table of Computerized Life Events and Assessment Record compared to List of Threatening Experiences Questionnaire as the gold standard.

CLEARaLTE-Qb (gold standard)
PositiveNegativeTotal
Positive432265
Negative5778135
Total100100200

aCLEAR: Computerized Life Events and Assessment Record.

bLTE-Q: List of Threatening Experiences Questionnaire.

Table 4

Assessing the validity of Computerized Life Events and Assessment Record compared to List of Threatening Experiences Questionnaire as the gold standard.

ParameterEstimate
Sensitivity (%)43
Specificity (%)78
Positive predictive value (%)66
Negative predictive value (%)58
Diagnostic accuracy (%)60
Likelihood ratio of a positive test1.9
Likelihood ratio of a negative test0.7
Diagnostic odds2.6
Two by two table of Computerized Life Events and Assessment Record compared to Life Events and Difficulties Schedule as the gold standard. aCLEAR: Computerized Life Events and Assessment Record. bLEDS: Life Events and Difficulties Schedule. Assessing the validity of Computerized Life Events and Assessment Record compared to Life Events and Difficulties Schedule as the gold standard. Two by two table of Computerized Life Events and Assessment Record compared to List of Threatening Experiences Questionnaire as the gold standard. aCLEAR: Computerized Life Events and Assessment Record. bLTE-Q: List of Threatening Experiences Questionnaire. Assessing the validity of Computerized Life Events and Assessment Record compared to List of Threatening Experiences Questionnaire as the gold standard.
  4 in total

1.  Validity and reliability of the new Canadian Nutrition Screening Tool in the 'real-world' hospital setting: Methodological issues.

Authors:  S Sabour
Journal:  Eur J Clin Nutr       Date:  2015-04-29       Impact factor: 4.016

2.  The validity and reliability of a signal impact assessment tool: statistical issue to avoid misinterpretation.

Authors:  Siamak Sabour; Fariba Ghassemi
Journal:  Pharmacoepidemiol Drug Saf       Date:  2016-10       Impact factor: 2.890

3.  Validity and reliability of the 13C-methionine breath test for the detection of moderate hyperhomocysteinemia in Mexican adults; statistical issues in validity and reliability analysis.

Authors:  Siamak Sabour
Journal:  Clin Chem Lab Med       Date:  2014-12       Impact factor: 3.694

4.  Web-Based Measure of Life Events Using Computerized Life Events and Assessment Record (CLEAR): Preliminary Cross-Sectional Study of Reliability, Validity, and Association With Depression.

Authors:  Antonia Bifulco; Ruth Spence; Stephen Nunn; Lisa Kagan; Deborah Bailey-Rodriguez; Georgina M Hosang; Matthew Taylor; Helen L Fisher
Journal:  JMIR Ment Health       Date:  2019-01-08
  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.