Luk Bruyneel1, Baoyue Li, Allison Squires, Sara Spotbeen, Bart Meuleman, Emmanuel Lesaffre, Walter Sermeus. 1. *Department of Public Health and Primary Care, Katholieke Universiteit Leuven, Kapucijnenvoer, Leuven, Belgium †Department of Biostatistics, Erasmus University Rotterdam, Rotterdam, the Netherlands ‡College of Nursing, New York University, New York, NY §Department of Sociology, Katholieke Universiteit Leuven, Leuven, Belgium.
Abstract
BACKGROUND: Recent methodological advancements should catalyze the evaluation of measurement invariance across groups, which is required for conducting meaningful cross-group comparisons. OBJECTIVE: The aim of this study was to apply a state-of-the-art statistical method for comparing latent mean scores and evaluating measurement invariance across managers' and frontline workers' ratings of the organization of hospital care. METHODS: On the 87 nursing units in a single institution, French-speaking and Dutch-speaking nursing unit managers' and staff nurses' ratings of their work environment were measured using the multidimensional 32-item practice environment scale of the nursing work index (PES-NWI). Measurement invariance and latent mean scores were evaluated in the form of a Bayesian 2-level multiple indicators multiple causes model with covariates at the individual nurse and nursing unit level. Role (manager, staff nurse) and language (French, Dutch) are of primary interest. RESULTS: Language group membership accounted for 7 of 11 PES-NWI items showing measurement noninvariance. Cross-group comparisons also showed that covariates at both within-level and between-level had significant effects on PES-NWI latent mean scores. Most notably, nursing unit managers, when compared with staff nurses, hold more positive views of several PES-NWI dimensions. CONCLUSIONS: Using a widely used instrument for measuring nurses' work environment, this study shows that precautions for the potential threat of measurement noninvariance are necessary in all stages of a study that relies on survey data to compare groups, particularly in multilingual settings. A Bayesian multilevel multiple indicators multiple causes approach can accommodate for detecting all possible instances of noninvariance for multiple covariates of interest at the within-level and between-level jointly.
BACKGROUND: Recent methodological advancements should catalyze the evaluation of measurement invariance across groups, which is required for conducting meaningful cross-group comparisons. OBJECTIVE: The aim of this study was to apply a state-of-the-art statistical method for comparing latent mean scores and evaluating measurement invariance across managers' and frontline workers' ratings of the organization of hospital care. METHODS: On the 87 nursing units in a single institution, French-speaking and Dutch-speaking nursing unit managers' and staff nurses' ratings of their work environment were measured using the multidimensional 32-item practice environment scale of the nursing work index (PES-NWI). Measurement invariance and latent mean scores were evaluated in the form of a Bayesian 2-level multiple indicators multiple causes model with covariates at the individual nurse and nursing unit level. Role (manager, staff nurse) and language (French, Dutch) are of primary interest. RESULTS: Language group membership accounted for 7 of 11 PES-NWI items showing measurement noninvariance. Cross-group comparisons also showed that covariates at both within-level and between-level had significant effects on PES-NWI latent mean scores. Most notably, nursing unit managers, when compared with staff nurses, hold more positive views of several PES-NWI dimensions. CONCLUSIONS: Using a widely used instrument for measuring nurses' work environment, this study shows that precautions for the potential threat of measurement noninvariance are necessary in all stages of a study that relies on survey data to compare groups, particularly in multilingual settings. A Bayesian multilevel multiple indicators multiple causes approach can accommodate for detecting all possible instances of noninvariance for multiple covariates of interest at the within-level and between-level jointly.
Authors: Luk Bruyneel; Baoyue Li; Dietmar Ausserhofer; Emmanuel Lesaffre; Irina Dumitrescu; Herbert L Smith; Douglas M Sloane; Linda H Aiken; Walter Sermeus Journal: Med Care Res Rev Date: 2015-06-10 Impact factor: 3.929