| Literature DB >> 26202068 |
Kirsten Brubakk1, Gunn E Vist2, Geir Bukholm3, Paul Barach4, Ole Tjomsland5.
Abstract
BACKGROUND: The increased international focus on improving patient outcomes, safety and quality of care has led stakeholders, policy makers and healthcare provider organizations to adopt standardized processes for evaluating healthcare organizations. Accreditation and certification have been proposed as interventions to support patient safety and high quality healthcare. Guidelines recommend accreditation but are cautious about the evidence, judged as inconclusive. The push for accreditation continues despite sparse evidence to support its efficiency or effectiveness.Entities:
Mesh:
Year: 2015 PMID: 26202068 PMCID: PMC4511980 DOI: 10.1186/s12913-015-0933-x
Source DB: PubMed Journal: BMC Health Serv Res ISSN: 1472-6963 Impact factor: 2.655
Excluded studies
| Reference (country) | Reason cited for exclusion | Aim of study |
|---|---|---|
| Al Awa | No control group | Determine if patient safety and quality care indicators improve post accreditation |
| Al Awa | No control group | Evaluate nursing perception of care/safety after accreditation |
| Al Tehewy | Not in hospital (health units) | Determine the effects of accreditation of non-governmental organizations |
| Chen | Measured outcome at only one point | Identify association between JCAHO accreditation and quality of care for acute myocardial infection |
| Chuang | Did not measure effect | Propose an integrated research model |
| du Bois | Review not linked to accreditation | Evaluate the impact of different physician and hospital characteristics on outcome in ovarian cancer patients |
| Gokenbach | No control group | Identify the effects of Magnet accreditation on one hospital |
| Lichtman | Did not measure effects of accreditation | Determine whether hospitals certified had better outcome within the first year of accreditation than non accredited hospitals |
| Lichtman | Measured outcome at only one point | Identify outcomes after ischemic stroke for hospitals with and without TJC certification |
| Menachemi | Not in hospital | Identify quality outcome in accredited and non-accredited ambulatory surgical centers |
| V Phua | Did not evaluate effects of accreditation | Assess compliance to sepsis bundles in intensive care units in Asia |
| Al-Awa | Compares survey results in accredited hospital to international results | Perform an unbiased assessment of the impact of accreditation on patient safety culture |
| Alkenizan & Shaw 2012 [ | Review, Qualitative assessment of attitude, did not measure effect | Review the literature of the attitude of healthcare professionals towards accreditation |
| Bohmer | No controls | Identify to which extent pain management standards was implemented in hospitals after accreditation |
| Schmaltz | Compared the difference in development of accredited vs. non accredited hospitals, not the effects of accreditation | Examine the association between Joint Commission accreditation status and both absolute measures and trends in hospital performance |
| Nguyen | Compared the difference in development of accredited vs. non accredited hospitals, not the effects of accreditation | Analyze the peri-operative outcomes of bariatric surgery performed at accredited vs. non accredited centres |
Excluded studies after full text assessment presenting aim of study and reason for exclusion
Fig. 1Flowchart. Flowchart of study selection process. Database searched January 18, 2013
Included systematic reviews
| Reference | Search date | Aim of review | Study design included | Number of included studies | Main conclusion stated by authors | Studies that match our inclusion criteria |
|---|---|---|---|---|---|---|
| Flodgren | May 2011 | Evaluate the effectiveness of external inspection of compliance with standards in improving healthcare organizations behavior, healthcare professionals behavior and patient outcomes | RCT, CCT, ITS, CBA | Two in total, 1 RCT, 1 ITS | No firm conclusion were drawn due to paucity of high-quality controlled evaluations | Salmon |
| Matrix Knowledge group 2010 [ | August 2010 | Produce a general overview of results obtained and methodologies used to assess impact of accreditation | Studies containing an element of comparison | 56 in total, 40 studies with quantitative design of which 1 study presented empirical data | Most studies suggest that accreditation/certification has an impact on the organization or on the professional practice. The impact on health outcomes or improvement in these outcomes was not demonstrated. | Salmon |
| Alkhenizan & Shaw 2011 [ | June 2009 | Evaluate the impact of accreditation programs on the quality of healthcare services | Clinical trials, observational studies and qualitative studies | 26 in total, 10 studied accreditation of hospitals of which 1 had a hospital control group | Accreditation improves the process of care provided by healthcare services | Salmon |
A synthesis of the three included systematic reviews
AMSTAR, assessing methodological quality of systematic reviews
| Study | Alkhenzian | Matrix group 2010 | Flodgren | Brubakk |
|---|---|---|---|---|
| AMSTAR question | Yes, No, Can’t answer, Not applicable | |||
| 1. Was an ‘a priori’ design provided? | Yes | Yes | Yes | Yes |
| 2. Was there duplicate study selection and data extraction? | No | No | Yes | Yes |
| 3. Was a comprehensive literature search performed? | Yes | Yes | Yes | Yes |
| 4. Was the status of publication (i.e. grey literature) used in the inclusion criterion? | No | Yes | No | No |
| 5. Was a list of studies (included and excluded) provided? | Yes, although only for the included | Yes, although only for the included | Yes, both included and excluded studies | Yes, both included and excluded studies |
| 6. Were the characteristics of the included studies provided? | Yes | Yes | Yes | Yes |
| 7. Was the scientific quality of the included studies assessed and documented? | Yes | Yes, No | Yes | Yes |
| 8. Was the scientific quality of the included studies used appropriately in formulating conclusions? | No | Can’t answer | Yes | Yes |
| 9. Were the methods used to combine the findings of studies appropriate? | Not applicable (N/A) | Yes | Not applicable (N/A) | Not applicable (N/A) |
| 10. Was the likelihood of publication bias assessed? | No | No | Yes | Yes |
| 11. Was the conflict of interest stated? | No | No | Yes | Yes |
AMSTAR. Assessing Methodological Quality of Systematic Review, quality assessment of included systematic reviews categorized by yes, no, cannot answer, not applicable
Risk of bias assessment of study by Salmon et al. [18]a
| Domain | Support for judgement | Review author’s judgement |
|---|---|---|
| Selection bias | ||
| Random sequence generation | They state stratified randomisation, but give no information about the procedure | Unclear |
| Allocation concealment | Not mentioned | Unclear |
| Performance bias | ||
| Blinding of participants and personnel | Not mentioned and appears impossible/not possible to blind hospitals | Unclear |
| Detection bias | ||
| Blinding of outcome assessor | Not mentioned | Unclear |
| Attrition bias | ||
| Incomplete outcome date | The largest hospital did not complete the study. Follow- up time was shortened because controls wanted to receive the intervention | High risk |
| Reporting bias | ||
| Selective reporting | Outcome selection conducted by participants and accreditor. Many outcomes/ indicators were dropped from the follow- up measurement | High risk |
| Other bias | ||
| Other sources of bias | This was a cluster randomized trial, adjustment for clustering in analysis of results were not mentioned | Unclear |
aThe risk of bias assessment as described in the Cochrane Handbook for randomized controlled trails [20]
Risk of bias assessment of the included primary study by Salmon el at [18]
SOURCE: Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011