| Literature DB >> 35144957 |
Claudia Bull1,2, Helena Teede3,4, Lane Carrandi3,2, Azure Rigney5, Sally Cusack5, Emily Callander3,2.
Abstract
INTRODUCTION: Woman-centred care is the right of every woman receiving maternity care, irrespective of where care is being received and who is providing care. This protocol describes a planned systematic review that will identify, describe and critically appraise the psychometric properties of maternity patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs). The woman-centricity of PROM and PREM development and content validation (ie, the extent to which women were involved in these processes) will also be assessed. This information will be used to develop a maternity PROMs and PREMs database to support service and system performance measurement, and value-based maternity care initiatives. METHODS AND ANALYSIS: This study will be guided by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guideline for systematic reviews of outcome measurement instruments. Studies identified via MEDLINE, CINAHL Plus, PsycINFO and EMBASE describing the development, content validation and/or psychometric evaluation of PROMs and PREMs specifically designed for maternity populations throughout pregnancy, childbirth and postnatal periods will be considered if published from 2010 onward, in English, and available in full text. The COSMIN risk of bias checklist will be used to evaluate the quality of studies reporting on the development, content validation and/or psychometric evaluation of PROMs and PREMs. COSMIN criteria for good content validity will be used to assess the woman-centricity of PROM and PREM development and content validation studies. COSMIN standards of good psychometric properties will be used to evaluate the validity and reliability of the identified instruments. ETHICS AND DISSEMINATION: Ethical permission for this research is not required. The findings of this research will be submitted for publication in an international, peer-reviewed journal. Abstracts for national and international conference presentations will also be submitted. The proposed maternity PROMs and PREMs database will be freely accessible online, and developed with consumer input to ensure its usefulness to a range of maternity care stakeholders. PROSPERO REGISTRATION NUMBER: CRD42021288854. © Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.Entities:
Keywords: health services administration & management; obstetrics; quality in health care
Mesh:
Year: 2022 PMID: 35144957 PMCID: PMC8845328 DOI: 10.1136/bmjopen-2021-058952
Source DB: PubMed Journal: BMJ Open ISSN: 2044-6055 Impact factor: 2.692
Systematic review eligibility criteria for studies reporting on maternity PROMs and PREMs
| PROM studies will be included if: | PREM studies will be included if: |
|
Published from 2010 onward, representing contemporary instruments (however, if articles refer to earlier papers describing developmental and psychometric evaluation evidence pre-dating 2010, we will include these to provide a holistic representation of instrument quality) Published in English Available in full text Described the development, content validation and/or psychometric evaluation of PROMs relevant to all women across the pregnancy, childbirth and postpartum continuum |
Published from 2010 onward, representing contemporary instruments (however, if articles refer to earlier papers describing developmental and psychometric evaluation evidence pre-dating 2010, we will include these to provide a holistic representation of instrument quality) Published in English Available in full text Described the development, content validation and/or psychometric evaluation of PREMs relevant to all women receiving maternity care |
|
|
|
|
Published before 2010 (except as specified above) Published in languages other than English Not available in full text Presented literature reviews, meta-reviews, protocols, theses or quality improvement activities The included instruments were not clearly PROMs (eg, BEPS Included PROMs were used as outcome measures (eg, in an RCT) but did not contribute to their development, content validation and/or psychometric evaluation Described proxy-reported PROMs (ie, not self-reported by women) Described the development, content validation and/or psychometric evaluation of: Generic PROMs (eg, PROMIS PROMs originally developed in contexts other than maternity (eg, Postnatal DS Quality of life instruments/utility measures (eg, LADY-X PROMs for specific maternal subpopulations (eg, PGQ Screening tools (eg, Edinburgh Postnatal Depression Scale Core outcome sets |
Published before 2010 (except as specified above) Published in languages other than English Not available in full text Presented literature reviews, meta-reviews, protocols, theses or quality improvement activities The included instruments that were not clearly PREMs Included PREMs were used as outcome measures (eg, in a cross-sectional study) but did not contribute to their development, content validation and/ or psychometric evaluation Described proxy-reported PREMs (ie, not self-reported by women) Described the development, content validation and/or psychometric evaluation of: Satisfaction or expectation measures (eg, the BSS PREMs originally developed in a context other than maternity (eg, inpatient or outpatient settings) PREMs for specific maternal subpopulations (eg, women receiving abortion care |
*When there is ambiguity between satisfaction measures and PREMs, we will consider: (1) the instruments’ response scale (noting that agreement-based scales are more common in satisfaction measures, whereas frequency-based scales are more common in PREMs), (2) whether questions were expectation based (aligning with satisfaction) and (3) whether the original intent behind instrument development was to measure satisfaction or experiences.37
BEPS, Body Experience during Pregnancy Scale; BSS, Birth Satisfaction Scale; DS, Demoralisation Scale; LADY-X, Labor and Delivery Index; MGI, Mother Generated Index; PGQ, Pelvic Girdle Questionnaire; PREM, patient-reported experience measure; PROM, patient-reported outcome measure; PROMIS, Patient-Reported Outcomes Measurement Information System; RCT, randomised controlled trial.
Elements of the COSMIN risk of bias checklist28 for assessing study design relative to PROM and PREM development, content validation and psychometric evaluation studies
| Measurement property | Number of criteria |
|
| |
| PROM/PREM development | 35 |
| Content validity | 31 |
|
| |
| Structural validity | 4 |
| Internal consistency | 5 |
| Cross-cultural validity/measurement in variance | 4 |
|
| |
| Reliability | 8 |
| Measurement error | 6 |
| Criterion validity | 3 |
| Hypotheses testing for construct validity | 7 |
| Responsiveness | 13 |
COSMIN, COnsensus-based Standards for the selection of health Measurement INstruments; PREM, Patient-reported experience measure; PROM, Patient-reported outcome measure.
COSMIN updated criteria for good measurement properties28
| Measurement property | Rating | Criteria |
| Structural validity | + | CTT CFA: CFI or TLI (or comparable measure) >0.95, OR RMSEA <0.06 OR SMSR <0.08; AND/OR EFA or PCA: KMO ≥0.70, AND significant Bartlett’s Test of Sphericity (p<0.05), AND dimensional (total) variance explained ≥50% or dimensional (total) variance explained <50% but justified by the authors No violation of unidimensionality: CFI or TLI (or comparable measure) >0.95, OR RMSEA <0.06, OR SMSR <0.08; AND No violation of local independence: residual correlations among the items after controlling for the dominant factor <0.20 OR No violation of monotonicity: adequate looking graphs, OR item scalability >0.30; AND Adequate model fit: IRT: |
| ? | CTT Not all information for + reported Model fit not reported | |
| − |
Criteria for + not achieved Criteria for + not achieved | |
| Internal consistency | + | Evidence of sufficient structural validity achieved (+ or ? for ‘structural validity’); AND |
| ? | Evidence of sufficient structural validity not achieved | |
| − | Evidence of sufficient structural validity not achieved (− or ? for ‘structural validity’); AND | |
| Reliability | + | ICC or weighted Kappa ≥0.70 |
| ? | ICC or weighted Kappa not reported | |
| − | ICC or weighted Kappa <0.70 | |
| Measurement error | + | SDC or LoA < MIC |
| ? | MIC not defined | |
| − | SDC or LoA > MIC | |
| Cross-cultural validity/ measurement invariance | + | No important differences found between group factors (such as age, gender and language) in multiple group factor analysis; OR |
| ? | No multiple group factor analysis performed; OR | |
| − | Important differences between group factor analysis identified; OR | |
| Criterion validity | + | Correlation with gold standard instrument ≥0.70*; OR |
| ? | Not all information for + reported | |
| − | Correlation with gold standard instrument <0.70*; OR | |
| Responsiveness | + | AUC ≥0.70 |
| ? | AUC not reported | |
| − | AUC <0.70 |
*Correlation with a gold standard will only occur if a short-form instrument is being compared against its long-form counterpart.
AUC, area under the curve; CFA, confirmatory factor analysis; CFI, Comparative Fit Index; COSMIN, COnsensus-based Standards for the selection of health Measurement INstruments; CTT, classical test theory; DIF, differential item functioning; EFA, exploratory factor analysis; ICC, Intraclass Correlation Coefficient; IRT, item response theory; KMO, Kaiser-Meyer-Olkin; LoA, limits of agreement; MIC, minimally important change; PCA, principal components analysis; RMSEA, root mean square error of approximation; SDC, smallest detectable change; SMSR, standardised root mean residuals; TLI, Tucker-Lewis Index.