BACKGROUND: The Omaha System is a standardized interface terminology that is used extensively by public health nurses in community settings to document interventions and client outcomes. Researchers using Omaha System data to analyze the effectiveness of interventions have typically calculated p-values to determine whether significant client changes occurred between admission and discharge. However, p-values are highly dependent on sample size, making it difficult to distinguish statistically significant changes from clinically meaningful changes. Effect sizes can help identify practical differences but have not yet been applied to Omaha System data. METHODS: We compared p-values and effect sizes (Cohen's d) for mean differences between admission and discharge for 13 client problems documented in the electronic health records of 1,016 young low-income parents. Client problems were documented anywhere from 6 (Health Care Supervision) to 906 (Caretaking/parenting) times. RESULTS: On a scale from 1 to 5, the mean change needed to yield a large effect size (Cohen's d ≥ 0.80) was approximately 0.60 (range = 0.50 - 1.03) regardless of p-value or sample size (i.e., the number of times a client problem was documented in the electronic health record). CONCLUSIONS: Researchers using the Omaha System should report effect sizes to help readers determine which differences are practical and meaningful. Such disclosures will allow for increased recognition of effective interventions.
BACKGROUND: The Omaha System is a standardized interface terminology that is used extensively by public health nurses in community settings to document interventions and client outcomes. Researchers using Omaha System data to analyze the effectiveness of interventions have typically calculated p-values to determine whether significant client changes occurred between admission and discharge. However, p-values are highly dependent on sample size, making it difficult to distinguish statistically significant changes from clinically meaningful changes. Effect sizes can help identify practical differences but have not yet been applied to Omaha System data. METHODS: We compared p-values and effect sizes (Cohen's d) for mean differences between admission and discharge for 13 client problems documented in the electronic health records of 1,016 young low-income parents. Client problems were documented anywhere from 6 (Health Care Supervision) to 906 (Caretaking/parenting) times. RESULTS: On a scale from 1 to 5, the mean change needed to yield a large effect size (Cohen's d ≥ 0.80) was approximately 0.60 (range = 0.50 - 1.03) regardless of p-value or sample size (i.e., the number of times a client problem was documented in the electronic health record). CONCLUSIONS: Researchers using the Omaha System should report effect sizes to help readers determine which differences are practical and meaningful. Such disclosures will allow for increased recognition of effective interventions.
Keywords:
Nursing informatics; methods; public health nursing
Authors: Karen A Monsen; Jayne A Fulkerson; Amy B Lytton; Lila L Taft; Linda D Schwichtenberg; Karen S Martin Journal: Matern Child Health J Date: 2009-06-04
Authors: Tamara G R Macieira; Tania C M Chianca; Madison B Smith; Yingwei Yao; Jiang Bian; Diana J Wilkie; Karen Dunn Lopez; Gail M Keenan Journal: J Am Med Inform Assoc Date: 2019-11-01 Impact factor: 4.497
Authors: Tamara G R Macieira; Madison B Smith; Nicolle Davis; Yingwei Yao; Diana J Wilkie; Karen Dunn Lopez; Gail Keenan Journal: AMIA Annu Symp Proc Date: 2018-04-16
Authors: Brian J Douthit; Rachel L Walden; Kenrick Cato; Cynthia P Coviak; Christopher Cruz; Fabio D'Agostino; Thompson Forbes; Grace Gao; Theresa A Kapetanovic; Mikyoung A Lee; Lisiane Pruinelli; Mary A Schultz; Ann Wieben; Alvin D Jeffery Journal: Appl Clin Inform Date: 2022-02-09 Impact factor: 2.342
Authors: Paula Kopschina Feltes; Erik Fj de Vries; Luis E Juarez-Orozco; Ewelina Kurtys; Rudi Ajo Dierckx; Cristina M Moriguchi-Jeckel; Janine Doorduin Journal: J Cereb Blood Flow Metab Date: 2017-12-22 Impact factor: 6.200