Niall McCrae1, Sube Banerjee. 1. King's College London, Section of Mental Health and Ageing, Institute of Psychiatry, London, UK. n.mccrae@iop.kcl.ac.uk
Abstract
BACKGROUND: This paper describes an evaluation of a redevelopment program in a mental health service for older people, stimulated by U.K. Department of Health policy. IQCOL (Improving Quality of Care for Older People in Lambeth) was a two-year program to modernize and expand an inner-city service, with objectives to improve access, embed new functions, and tune the service towards the needs of the local community. The program evaluation aimed to contribute to knowledge on service planning and methodology for evaluating complex interventions. METHODS: The study evaluated the progress and outcomes of this multifaceted program. The realist model of evaluation was followed, with a dual emphasis on utility and generalizability. With an iterative approach, the pragmatic, longitudinal design comprised a combination of qualitative and quantitative methods to explain the process of change and to measure achievement of objectives. RESULTS: A high level of participation in evaluation activities was achieved. The workforce generally responded well to the program. However, progress in one team was hindered by understaffing and resistance to change, emphasizing that while localized provision may be desirable, team viability requires adequate resources and professional support. Improved access was indicated by a 13% increase of referrals. Data suggested earlier referral of dementia cases. Carer support was implemented, but assertive outreach was impeded by professional boundary issues. Ethnicity data showed that the service was responding to demographic trends. Positive views towards the program were associated with team resources and recent professional training. CONCLUSIONS: This case study demonstrates how whole system change can be achieved if sufficient attention is given to the needs of staff implementing the program. The evaluation emphasizes the importance of context in producing generalizable evidence on service development, and contributes useful methodological insights.
BACKGROUND: This paper describes an evaluation of a redevelopment program in a mental health service for older people, stimulated by U.K. Department of Health policy. IQCOL (Improving Quality of Care for Older People in Lambeth) was a two-year program to modernize and expand an inner-city service, with objectives to improve access, embed new functions, and tune the service towards the needs of the local community. The program evaluation aimed to contribute to knowledge on service planning and methodology for evaluating complex interventions. METHODS: The study evaluated the progress and outcomes of this multifaceted program. The realist model of evaluation was followed, with a dual emphasis on utility and generalizability. With an iterative approach, the pragmatic, longitudinal design comprised a combination of qualitative and quantitative methods to explain the process of change and to measure achievement of objectives. RESULTS: A high level of participation in evaluation activities was achieved. The workforce generally responded well to the program. However, progress in one team was hindered by understaffing and resistance to change, emphasizing that while localized provision may be desirable, team viability requires adequate resources and professional support. Improved access was indicated by a 13% increase of referrals. Data suggested earlier referral of dementia cases. Carer support was implemented, but assertive outreach was impeded by professional boundary issues. Ethnicity data showed that the service was responding to demographic trends. Positive views towards the program were associated with team resources and recent professional training. CONCLUSIONS: This case study demonstrates how whole system change can be achieved if sufficient attention is given to the needs of staff implementing the program. The evaluation emphasizes the importance of context in producing generalizable evidence on service development, and contributes useful methodological insights.