| Literature DB >> 35168297 |
Charlotte Huggett1,2, Patricia Gooding1,2, Gillian Haddock1,2, Jody Quigley1,3, Daniel Pratt1,2.
Abstract
It is well established that there is a fundamental need to develop a robust therapeutic alliance to achieve positive outcomes in psychotherapy. However, little is known as to how this applies to psychotherapies which reduce suicidal experiences. The current narrative review summarizes the literature which investigates the relationship between the therapeutic alliance in psychotherapy and a range of suicidal experiences prior to, during and following psychotherapy. Systematic searches of MEDLINE, PsycINFO, Web of Science, EMBASE and British Nursing Index were conducted. The search returned 6472 studies, of which 19 studies were eligible for the present review. Findings failed to demonstrate a clear link between suicidal experiences prior to or during psychotherapy and the subsequent development and maintenance of the therapeutic alliance during psychotherapy. However, a robust therapeutic alliance reported early on in psychotherapy was related to a subsequent reduction in suicidal ideation and attempts. Study heterogeneity, varied sample sizes and inconsistent reporting may limit the generalizability of review findings. Several recommendations are made for future psychotherapy research studies. Training and supervision of therapists should not only highlight the importance of developing and maintaining the therapeutic alliance in psychotherapy when working with people with suicidal experiences but also attune to client perceptions of relationships and concerns about discussing suicidal experiences during therapy.Entities:
Keywords: Therapeutic alliance; psychotherapy; suicide; systematic review
Mesh:
Year: 2022 PMID: 35168297 PMCID: PMC9546023 DOI: 10.1002/cpp.2726
Source DB: PubMed Journal: Clin Psychol Psychother ISSN: 1063-3995
FIGURE 1A diagram to illustrate the direction of the three types of relationship under investigation between the therapeutic alliance and suicidal experiences
FIGURE 2PRISMA diagram
Included study characteristics in date order from oldest to most recent, participant age and ethnicity, details of psychotherapy delivery, format and context and therapist qualifications and supervision
| Study characteristics | Participants | Psychotherapy delivery, format and context | Therapists | |||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Study number and reference | Country | Design | Sample population and study setting | Therapy arm sample size | Mean age | Ethnicity and Gender | Psychotherapy type and session length | Length and setting of psychotherapy | N and qualifications | Supervision |
| 1. Shearin and Linehan ( | USA | Cohort/longitudinal | People with a diagnosis of BPD and parasuicidal behaviour in the community | 4 | Not reported | Not reported; 100% female |
| Up to 31 sessions over 7 months at an outpatient university research clinic | 4 psychology and nursing graduate students | Supervision provided to ensure adherence to DBT protocol, but no further details reported |
| 2. Turner ( | USA | Two‐armed RCT; active control | People with a diagnosis of BPD in the community |
|
|
79.17% female |
| Up to 84 individual sessions over 12 months at a community mental health outpatient clinic |
4 therapists; background in client‐centred, psychodynamic and family systems conducted both therapies
| Weekly group supervisions (one for each therapeutic modality). Reviewed therapy audio recordings to monitor treatment fidelity |
|
|
|
| ||||||||
| 3. Goldman and Gregory ( | USA | Two‐armed RCT; TAU control | Diagnosis of BPD; clinical settings—non‐specific | 15 | 27.40 | 85.70% Caucasian; 90% female |
| Up to 52 sessions over 12 months | 5 therapists; 1 expert therapist, 4 third‐year trainee psychiatrists | Weekly group supervision. Biweekly individual supervision was used to review audio recordings to monitor treatment fidelity |
| 4. Hirsh et al. ( | Canada | Two‐armed RCT; active control | People with a diagnosis of BPD and experience of suicidal behaviour and NSSI outpatient |
|
| Not reported; 100% female |
| Sessions delivered weekly over 1 year at two teaching hospitals |
25 therapists
3 psychiatrists, 4 PhD level psychologists, 5 master's level clinicians and 1 nurse |
|
|
|
| Not reported |
|
8 psychiatrists, 1 PhD level psychologist, 1 master's level clinician and 2 nurses |
| |||||
| 5. Bryan et al. ( | USA | Cohort/longitudinal |
Military Primary care clinic | 497 | 37.14 | 54.10% Caucasian; 57.7% female |
| Up to 8 sessions at a primary care clinic | 22 therapists; 8 clinical psychologists (6 trainers and 2 externship trainees), 9 predoctoral clinical psychology interns and 5 social worker interns | Interns were trained under the supervision of clinical psychologists to deliver CBT. No further details on supervision reported |
| 6. Perry et al. ( | Canada | Cohort/longitudinal | People with diagnoses of anxiety, depression and/or PD outpatient—psychiatry | 53 | 30.90 | Not reported; 77% female |
| Up to 339 sessions over a median of 4.19 years at an outpatient clinic | 22 therapists; psychiatrists, psychologists, social workers and advanced practice nurses; 20 were also psychoanalysts | No supervision groups or specific therapy manual used |
| 7. Tsai et al. ( | Canada | Cohort/longitudinal | People with a diagnosis of depression who were outpatient/in the community | 80 | 47.82 | 76.10% Caucasian; 73% female |
| Up to 10 sessions over 10 weeks at an outpatient community mental health service/hospital | 2 therapists; 1 clinical psychologist and 1 psychiatrist | Not reported |
| 8. Bedics et al. ( | USA | Two‐armed RCT; active control | People with a diagnosis of BPD and experience of suicidal behaviour and NSSI in the community |
|
|
|
| Sessions delivered over 1 year at university outpatient clinic and community practice |
37 therapists
|
|
|
|
|
|
| |||||||
| 9. Gysin‐Maillart et al. ( | Switzerland | Two‐armed RCT; TAU control | People who had recently attempted suicide who are attending a psychiatry outpatient department | 60 | 36.50 | Not reported; 60% female |
| 3 sessions (4 if necessary) delivered weekly at an outpatient department | 4 therapists; 1 psychiatrist and 3 clinical psychologists (2 of whom were experienced in clinical suicide prevention) | Regular supervision to review therapy video recordings to ensure therapy fidelity |
| 10. Gysin‐Maillart et al. ( | Switzerland | RCT; TAU control | People who had recently attempted suicide who are attending a psychiatry outpatient department | 60 | 36.50 | Not reported; 60% female |
| 3 sessions (4 if necessary) delivered weekly at an outpatient department | 4 therapists; 1 psychiatrist and 3 clinical psychologists (2 of whom were experienced in clinical suicide prevention) | Regular supervision to review therapy video recordings to ensure therapy fidelity |
| 11. Plöderl et al. ( | Austria | Cohort/longitudinal | People who had attempted suicide and/or had suicidal ideation and were admitted to an inpatient ward | 633 | 39.19 | Not reported; 51% female |
| Up to 15 weekly sessions over 3 weeks on the inpatient ward and up to 5 further follow‐up sessions over 6 months delivered at a clinic or via telephone | 7 therapists; psychiatrists, psychotherapists/psychologists | Not reported |
| 12. Rufino and Ellis ( | USA | Cohort/Longitudinal | People with diagnoses related to mood, anxiety and/or PD and suicidal thoughts and admitted to an inpatient ward | 434 | 33.44 | 91.00% Caucasian; 53.5% female |
| Sessions delivered on an inpatient ward | Not reported | Not reported |
| 13. Ibrahim et al. ( | USA | Two‐armed RCT; active control | People who were experiencing depression and suicidal thoughts recruited from a mix of clinical and non‐clinical settings |
|
|
|
| 16 weekly sessions over 16 weeks delivered at a university research lab/intervention clinic | 17 therapists; all at least master's level | Not reported |
|
|
Individual | |||||||||
| 14. Haddock et al. ( | UK | Two‐armed RCT; TAU control | People with experiencing of suicidal thoughts and/or behaviours and admitted to an inpatient ward | 24 | 33.88 | 91.67% Caucasian; 58% female |
| 20 sessions delivered over 6 months on an inpatient ward and followed up in the community | 2 therapists; both clinical psychologists who met the British Association for Behavioural and Cognitive Psychotherapies minimum standards for CBT accreditation | Weekly supervision |
| 15. Johnson et al. ( | USA | Two‐armed RCT; active control | Veterans who had recently attempted suicide and recently discharged from an inpatient ward |
|
| 70.90% Caucasian; 11.9% female |
|
| 2 therapists facilitated both group therapies; 1 clinical psychologist and 1 social worker | Observation and spot checks by the principal investigator ensured adherence and fidelity to suicide‐focused assessment group therapy |
|
|
|
Group sessions |
| |||||||
| 16. Ryberg et al. ( | Norway | Two‐armed RCT; active control | People with ongoing suicidal ideation, intent, and behaviour in both inpatient and outpatient settings |
|
| Not reported; 53% female |
|
| 43 therapists; |
|
|
|
|
|
|
|
| |||||
| 17. Stratton et al. ( | Canada | Two‐armed RCT; waitlist control | People with diagnosis of BPD; suicidal behaviour and NSSI in an outpatient setting | 43 | 27.29 | Not reported; 83.3% female |
| 20 weekly sessions delivered at a teaching hospital | 5 therapists; 2 PhD, 3 MSW | Weekly group supervision |
| 18. Huggett et al. ( | UK | Two‐armed RCT; TAU control | People with non‐affective psychosis‐related diagnoses; suicidal ideation and/or behaviour in both inpatient and outpatient settings | 64 | 36.83 | 88% Caucasian; 43.75% female |
| Up to 24 sessions delivered over 6 months in outpatient and inpatient settings | 8 individuals who were clinical psychologists, mental health nurses and a social worker and met the British Association of Behavioural and Cognitive Psychotherapies minimum standards for CBT accreditation | Weekly group supervision, monthly individual supervision, and regular peer supervision to ensure and monitor therapy fidelity |
| 19. Ibrahim et al. ( | USA | Two‐armed RCT; active control | People who were experiencing depression and suicidal thoughts recruited from a mix of clinical and non‐clinical settings | 118 | 14.96 | 28.7% Caucasian; 81.7% female |
| Up to 16 weekly sessions over 16 weeks delivered at a university research lab/intervention clinic | 17 therapists; all at least master's level | Weekly supervision, which included live supervision and review of therapy tapes |
|
Individual | ||||||||||
Length of sessions not reported.
Setting not reported.
Number of sessions not reported.
Used the same RCT sample.
Details of the therapeutic alliance, suicidal ideation and suicide attempt measures used in included studies
| Therapeutic alliance measure | Suicidal experiences measures | ||||
|---|---|---|---|---|---|
| Study number and reference | Client rated | Therapist rated | Observer rated | Suicidal ideation measure | Suicide attempt measure |
| 1. Shearin and Linehan ( |
Structural Analysis of Social Behaviour INTREX form (Benjamin, Rated session by session, weekly, Sessions 1–31 (early–mid therapy) |
Structural Analysis of Social Behaviour INTREX form (Benjamin, Rated session by session, weekly, Sessions 1–31 (early–mid therapy) | N/A | Measured using a daily diary card | Measured using a daily diary card |
| 2. Turner ( |
Helping Relationship Questionnaire (Haq; Luborsky, Rated at 6 months (mid‐therapy) | N/A | N/A | Beck Suicidal Ideation Scale (Beck et al., | Target behaviour ratings—frequency of parasuicide |
| 3. Goldman and Gregory ( | N/A | N/A |
Working Alliance Inventory Observer Short form (WAI‐O‐S; Tichenor & Hill, Rated at baseline, 3, 6 9 and 12 months (early, mid and end of therapy) | N/A |
The Lifetime Parasuicide Count (Linehan & Comtois, Measured at baseline, 3, 6, 9 and 12 months (pre‐, mid‐ and end of therapy) |
| 4. Hirsh et al. ( |
Working Alliance Inventory (WAI; Horvath & Greenberg, Rated at baseline, 4, 8 and 12 months (early, mid and end of therapy) | N/A | N/A | N/A |
Suicide Attempt Self‐Injury Interview (Linehan et al., Measured at baseline, 4, 8 and 12 months (pre‐, mid‐ and end of therapy) |
| 5. Bryan et al. ( |
The Therapeutic Bond Scale (CelestHealth Solutions, Rated after session 1 (early in therapy) | N/A | N/A |
1 item from the Behavioral Health Measure‐20 (Kopta & Lowry, Measured session‐by‐session | N/A |
| 6. Perry et al. ( |
The Psychosocial Treatment Interview (PTI; Steketee et al., Measured every 6 months (early, mid and end of therapy) | N/A |
Therapeutic Alliance Analogue Scales (Brysk, Rated 3 sessions around 1 months and 6 months (early in therapy) |
Longitudinal Interval Follow‐up Evaluation (Keller et al., Adapted for the Study of Personality (Perry, | N/A |
| 7. Tsai et al. ( |
WAI (Horvath & Greenberg, Rated after Sessions 1 and 5 (early and mid‐therapy) | N/A | N/A | Number of participants with recurring or current ideation at baseline | Number of participants who had previously attempted suicide at baseline |
| 8. Bedics et al. ( |
California Psychotherapy Alliance Scale (Gaston, Rated after Session 1 and at 4, 8 and 12 months (early, mid and end of therapy) |
California Psychotherapy Alliance Scale (Gaston, Rated after Session 1 and at 4, 8 and 12 months (early, mid and end of therapy) | N/A | N/A |
Suicide Attempt Self‐Injury Interview (Linehan et al., Measured at baseline, 4, 8 and 12 months (pre‐, mid‐ and end of therapy) |
| 9. Gysin‐Maillart et al. ( |
Penn Haq–German version (Bassler et al., Rated after Sessions 1 and 3 (early and end of therapy) | N/A | N/A |
Beck Scale for Suicidal Ideation (BSS) German version (Beck & Steer, Measured at baseline, 6, 12, 18 and 24 months (pre‐therapy and follow‐up time points) | Demographic question and hospital records |
| 10. Gysin‐Maillart et al. ( |
Penn Haq–German version (Bassler et al., Rated after Sessions 1 and 3 (early and end of therapy) | N/A | N/A |
BSS German version (Beck & Steer, Measured at baseline, 6 and 12 months (pre‐therapy and follow‐up time points) |
BSS German version (Beck & Steer, Measured at baseline, 6 and 12 months (pre‐therapy and follow‐up time points) |
| 11. Plöderl et al. ( |
WAI–Short Revised German Translation (Wilmers et al., Rated at intake and discharge from the inpatient ward (early and towards the end of therapy) | N/A | N/A |
BSS (Beck & Steer, Measured at intake and discharge from the inpatient ward (early and towards the end of therapy) |
BSS (Beck & Steer, Measured at intake and discharge from the inpatient ward (early and towards the end of therapy) |
| 12. Rufino and Ellis ( |
WAI (Horvath & Greenberg, Rated at admission, every 2 weeks and prior to discharge (early, mid and end of therapy) | N/A | N/A |
Columbia Suicide Severity Rating Scale (Posner et al., Suicide Cognitions Scale (Bryan et al., Measured at admission, every 2 weeks and prior to discharge (early, mid and end of therapy) | Frequency of prior suicide attempts measured at admission to the inpatient ward (early in therapy) |
| 13. Ibrahim et al. ( |
Therapeutic Alliance Quality Scale (Riemer et al., Rated session by session on a weekly basis, between Sessions 1 and 16 (early, mid and end of therapy) | N/A | N/A |
Suicidal Ideation Questionnaire–Junior weekly (Reynolds & Mazza, Measured at baseline (pre‐therapy) | Suicide attempt history measured at baseline (pre‐therapy) |
| 14. Haddock et al. ( |
WAI (Horvath & Greenberg, Rated at Session 4 and end of therapy (early and end of therapy) |
WAI (Horvath & Greenberg, Rated at Session 4 and end of therapy (early and end of therapy) | N/A |
BSS (Beck et al., Measured at baseline, 6 week and 6 months (pre‐therapy, early therapy, and end of therapy) | Frequency of suicide attempts collected by a review of clinical records between randomization and 6 months (start to end of therapy) |
| 15. Johnson et al. ( |
WAI‐S (Hatcher & Gillaspy, Rated at 1 and 3 months (early and end of therapy) | N/A | N/A |
BSS (Beck et al., Measured at baseline, 1 month and 3 months (pre‐therapy, early therapy, and end of therapy) |
Suicide Attempt and Self‐Injury Count (Linehan & Comtois, Measured at baseline, 1 month and 3 months (pre‐therapy, early therapy and end of therapy) |
| 16. Ryberg et al. ( |
WAI‐S (Hatcher & Gillaspy, Rated after 3 weeks of therapy (early in therapy) | N/A | N/A |
BSS (Beck et al., Measured at baseline, 6 and 12 months (pre‐therapy and follow‐up time points) | N/A |
| 17. Stratton et al. ( |
Group Session Rating Scale (GSRS; Duncan & Miller, Rated at baseline, 5, 10, 15 and 20 weeks and 3 months post‐intervention (pre‐therapy early, mid and end of therapy and follow up) | N/A | N/A | N/A |
Lifetime Suicide Attempt and Self‐Injury Interview (Linehan & Comtois, Measured at baseline, 5, 10, 15 and 20 weeks and 3 months post‐intervention (pre‐therapy early, mid and end of therapy and follow‐up) |
| 18. Huggett et al. ( |
WAI‐SR (Hatcher & Gillaspy, Rated at Session 4 (early in therapy) |
WAI‐SR (Hatcher et al., Measured at Session 4 (early in therapy) | N/A |
Adult Suicidal Ideation Questionnaire (ASIQ; Reynolds, Measured at baseline and end of therapy (pre‐therapy and end of therapy) | Self‐reported frequency of Suicide Attempts over the previous 6 months measured at baseline and end of therapy (pre‐therapy and end of therapy) |
| 19. Ibrahim et al. ( |
Therapeutic Alliance Quality Scale (Riemer et al., Rated at Session 4 (early in therapy) | N/A | N/A |
Suicidal Ideation Questionnaire–Junior weekly (Reynolds & Mazza, Measured at 16 weeks (end of therapy) | N/A |
Used the same RCT sample.
Details of analyses used and statistics produced in included studies which examined suicidal experiences pre‐therapy as a predictor of the therapeutic alliance
| Suicidal experiences pre‐therapy as a predictor of the therapeutic alliance | ||||
|---|---|---|---|---|
| Study number and reference | Suicidal ideation pre‐therapy as a predictor of the therapeutic alliance | Suicide attempts pre‐therapy as a predictor of the therapeutic alliance | Change in suicidal ideation and behaviour combined as a predictor of change in the therapeutic alliance | Suicide attempts as a predictor of change in the therapeutic alliance over time |
| 1. Shearin and Linehan ( | N/A | N/A |
Client χ2(8) = 29.46, Therapist χ2(8) = 25.68, | N/A |
| 3. Goldman and Gregory ( | N/A |
Client
| N/A | N/A |
| 7. Tsai et al. ( |
Client Session 1:
Session 5:
|
Client Session 1:
Session 5:
| N/A | N/A |
| 10. Gysin‐Maillart et al. ( | N/A |
Client
Session 3:
| N/A | N/A |
| 11. Plöderl et al. ( | N/A |
Client
| N/A | N/A |
| 13. Ibrahim et al. ( |
Client β = −.04, | N/A | N/A | N/A |
| 14. Haddock et al. ( |
Client ideation:
Potential:
Therapist ideation:
Potential:
| N/A | N/A | N/A |
| 15. Johnson et al. ( |
Client
| N/A | N/A | N/A |
| 17. Stratton et al. ( | N/A |
| N/A |
|
| 18. Huggett et al. ( |
Client
Therapist
|
Client
Therapist
| N/A | N/A |
The authors amended the alpha level to .01 to minimize the probability of a Type 1 error occurring and to correct for multiple testing.
Details of analyses used and statistics produced in included studies which examined suicidal experiences as a correlate of the therapeutic alliance at the same time point during psychotherapy
| Suicidal experiences as a correlate of the therapeutic alliance at the same time point during psychotherapy | ||
|---|---|---|
| Study number and reference | Suicidal ideation in relation to the therapeutic alliance at the same time point during therapy | Suicide attempts in relation to the therapeutic alliance at the same time‐point during therapy |
| 3. Goldman and Gregory ( | N/A |
Client
|
| 6. Perry et al. ( |
Client 1 month: | N/A |
| 11. Plöderl et al. ( |
Client Session 1:
Final session:
| N/A |
Details of analyses used and statistics produced in included studies which examined the therapeutic alliance as a predictor of prospective suicidal experiences during and post‐therapy
| Therapeutic alliance as a predictor of prospective suicidal experiences during and post‐therapy | ||||
|---|---|---|---|---|
| Study number and reference | Therapeutic alliance in relation to suicidal ideation post‐therapy | Therapeutic alliance as a predictor of prospective suicidal behaviour (e.g. suicide attempts and self‐harm) during and post‐therapy | Therapeutic alliance during psychotherapy in relation to predicting prospective changes in suicidal ideation over time | Therapeutic alliance during psychotherapy in relation to predicting change in suicidal behaviour (e.g. suicide attempts) over time |
| 1. Shearin and Linehan ( | N/A | N/A | N/A |
Client χ2(8) = 25.68, Therapist χ2(8) = 17.26, |
| 2. Turner ( |
Alliance: Canonical coefficient = .628 Intervention: Canonical coefficient = .631 Therapy cessation suicidal ideation: Canonical coefficient = .84 |
Therapy cessation suicide attempts and self‐harm (composite measure) Canonical coefficient = .80 | N/A | N/A |
| 3. Goldman and Gregory ( | N/A |
| N/A | N/A |
| 4. Hirsh et al. ( | N/A | N/A | N/A |
Client
Reduction in suicide attempts
|
| 5. Bryan et al. ( | N/A | N/A |
Client
| N/A |
| 6. Perry et al. ( | N/A | N/A |
Interactions
Client
Therapist
| N/A |
| 8. Bedics et al. ( | N/A | N/A | N/A |
Changes in alliance
Working capacity Suicide‐focused therapy
Therapy without focus on suicide prevention
Overall alliance across both therapies
Suicide‐focused therapy Overall alliance
Client commitment
Client working capacity
Therapy without focus on suicide prevention Understanding and involvement
Overall alliance
|
| 9. Gysin‐Maillart et al. ( |
Client 12‐month follow‐up:
24‐month follow‐up:
| N/A | N/A | N/A |
| 10. Gysin‐Maillart et al. ( |
Client β = −.334, R2 = .386, | N/A | N/A | N/A |
| 11. Plöderl et al. ( | N/A | N/A |
Client
| N/A |
| 15. Johnson et al. ( | N/A | N/A |
Client
| N/A |
| 16. Ryberg et al. ( | N/A | N/A |
Overall alliance 6‐month follow‐up: β = .38, Client–therapist bond 6‐month follow‐up β = .1.47, 12‐month follow‐up β = 1.10, | N/A |
| 18. Huggett et al. ( |
Client
Therapist
Client Model 1: β = −.33, R2 = .110, Model 2: β = −.28, R2 = .231, Model 3: β = −.27, R2 = .231,
Client Interaction effect: Total number of minutes spent in therapy Short: Mean: Long: = − .21, 95% CI [−1.76, 1.34], |
Client t Therapist
| N/A | N/A |
| 19. Ibrahim et al. ( |
Interaction between therapy adherence and client alliance in relation to suicidal ideation
∆R2 = .02, ∆F (3, 329) = 2.80, | N/A | N/A | N/A |
Quality assessment for included studies
| CASP question | 1. Did the trial address a clearly focused issue? | 2. Was the exposure accurately measured to minimize bias? | 3. Was the outcome accurately measured to minimize bias? | 4. Have authors identified all important confounding factors? | 5. Was the follow‐up of subjects complete enough? | 6. Can the results be applied to the local population? | 7. Are the benefits worth the harms and costs? |
|---|---|---|---|---|---|---|---|
| Adaption | Does the study examine the relationship between the therapeutic alliance and suicidal experiences? | Does the study systematically train therapists and monitor therapist fidelity? | Were measures of therapeutic alliance and suicidal experiences reliable and valid? | Have authors identified and controlled for at least age and gender as confounding factors? | Were retention rates acceptable or did the authors account for attrition in the analysis? | Can the results be generalized to a similar population as the study population? | Is the psychotherapy safe, that is, were adverse and serious adverse events monitored and assessed? |
| 1. Shearin and Linehan ( | Y | UC | UC | N | UC | N | UC |
| 2. Turner ( | Y | Y | UC | UC | Y | UC | UC |
| 3. Goldman and Gregory ( | Y | Y | UC | UC | Y | N | UC |
| 4. Hirsh et al. ( | Y | Y | Y | Y | Y | Y | UC |
| 5. Bryan et al. ( | Y | UC | Y | Y | UC | Y | UC |
| 6. Perry et al. ( | Y | N | Y | Y | Y | UC | UC |
| 7. Tsai et al. ( | Y | UC | Y | UC | Y | Y | UC |
| 8. Bedics et al. ( | Y | Y | Y | UC | Y | Y | UC |
| 9. Gysin‐Maillart et al. ( | Y | Y | Y | Y | Y | Y | UC |
| 10. Gysin‐Maillart et al. ( | Y | Y | Y | Y | Y | Y | UC |
| 11. Plöderl et al. ( | Y | UC | Y | UC | Y | UC | UC |
| 12. Rufino and Ellis ( | Y | UC | Y | N | N | N | UC |
| 13. Ibrahim et al. ( | Y | UC | Y | Y | Y | Y | UC |
| 14. Haddock et al. ( | Y | Y | Y | UC | Y | UC | Y |
| 15. Johnson et al. ( | Y | UC | Y | UC | Y | Y | UC |
| 16. Ryberg et al. ( | Y | Y | Y | Y | Y | UC | UC |
| 17. Stratton et al. ( | Y | Y | Y | Y | Y | UC | UC |
| 18. Huggett et al. ( | Y | Y | Y | Y | Y | Y | Y |
| 19. Ibrahim et al. ( | Y | Y | Y | UC | Y | Y | UC |
Used the same RCT sample.