PURPOSE: To discuss the utility of and value of the use of logic models for program evaluation of community-based programs and more specifically, the integration of logic models and factor analysis to develop and revise a survey as part of an effective evaluation plan. PRINCIPAL RESULTS: Diverse stakeholders with varying outlooks used a logic model as a framework to reach agreement on a plan for a state-wide evaluation. This evaluation plan utilized a survey of sixth grade students, administered before and after exposure to a year-long abstinence education program. Components of the logic model were linked to specific survey questions. Exploratory factor analysis was then used to assess whether and how the questions in the survey fit with the constructs of the model; confirmatory factor analysis was used to test the hypothesis that the factors identified in the exploratory analysis were consistently represented in the survey. MAJOR CONCLUSIONS: A logic model is a tool that engages stakeholders to link evaluation instruments more closely to specific program objectives. Thus, stakeholders can more closely assess the extent to which project outcomes have been achieved. In addition, use of factor analysis in the evaluation process can help the stakeholders better understand whether evaluation instruments such as a survey adequately assess program effectiveness. Lastly, a logic model process can help to achieve consensus among diverse stakeholders, by allowing them to focus on objectives that are concrete, measurable, and mutually acceptable. Copyright (c) 2009 Elsevier Ltd. All rights reserved.
PURPOSE: To discuss the utility of and value of the use of logic models for program evaluation of community-based programs and more specifically, the integration of logic models and factor analysis to develop and revise a survey as part of an effective evaluation plan. PRINCIPAL RESULTS: Diverse stakeholders with varying outlooks used a logic model as a framework to reach agreement on a plan for a state-wide evaluation. This evaluation plan utilized a survey of sixth grade students, administered before and after exposure to a year-long abstinence education program. Components of the logic model were linked to specific survey questions. Exploratory factor analysis was then used to assess whether and how the questions in the survey fit with the constructs of the model; confirmatory factor analysis was used to test the hypothesis that the factors identified in the exploratory analysis were consistently represented in the survey. MAJOR CONCLUSIONS: A logic model is a tool that engages stakeholders to link evaluation instruments more closely to specific program objectives. Thus, stakeholders can more closely assess the extent to which project outcomes have been achieved. In addition, use of factor analysis in the evaluation process can help the stakeholders better understand whether evaluation instruments such as a survey adequately assess program effectiveness. Lastly, a logic model process can help to achieve consensus among diverse stakeholders, by allowing them to focus on objectives that are concrete, measurable, and mutually acceptable. Copyright (c) 2009 Elsevier Ltd. All rights reserved.
Authors: Kelsey M Gurganus; Amir L Butt; Christin M Kirchenbauer; Chelsie Melkvik; Jamie Piatt; Jessica Hawkins; Stephanie U'Ren; Young Onuorah Journal: Community Ment Health J Date: 2014-12-24
Authors: Patricia J Lucas; Jenny Ingram; Niamh M Redmond; Christie Cabral; Sophie L Turnbull; Alastair D Hay Journal: BMC Med Res Methodol Date: 2017-12-28 Impact factor: 4.615