Literature DB >> 33816128

Supporting parents of children with chronic conditions: A randomized controlled trial of web-based and self-help ACT interventions.

Päivi Lappalainen1,2, Inka Pakkala1,2, Juho Strömmer1, Essi Sairanen3, Kirsikka Kaipainen4, Raimo Lappalainen1.   

Abstract

OBJECTIVE: Many parents of children with chronic conditions and developmental disabilities experience high rates of burnout and psychological distress. The aim of the current study was to examine the effects of two differently delivered interventions based on acceptance and commitment therapy (ACT) on symptoms of burnout, depression, quality of life, psychological flexibility, and mindfulness skills.
METHOD: A total of 110 parents of children aged 0.8 to 17 years with chronic conditions and developmental disabilities participated in a randomized controlled trial lasting 13 weeks with two intervention groups: (1) an iACT intervention, including three psychologist-led video conferencing sessions, and (2) a self-help ACT, which received self-help material: an ACT-based booklet with the possibility of using ACT-based online exercises.
RESULTS: For the main outcome measure burnout, a similar decrease was found in both groups. The supported iACT intervention produced significantly larger improvements in depressive symptoms (d = 0.49), psychological flexibility (d = 0.64), and mindfulness (d = 0.55) compared to the self-help ACT intervention. For health-related quality of life, only the dimension of role limitations caused by emotional problems showed a significant difference in favor of the supported iACT (d = 0.58).
CONCLUSIONS: The results suggest that the iACT intervention including three video conferencing sessions with a psychologist produced broader improvements in parents' psychological well-being than the self-help ACT. Overall, Internet-delivered interventions and video conferencing technology may offer a feasible alternative to psychological support and self-care for parents of children with chronic conditions. Further research is needed to investigate the long-term effects of the current delivery models.
© 2021 The Authors.

Entities:  

Keywords:  Acceptance and commitment therapy; Burnout; Internet; Parents of children with chronic conditions; Self-help; Video conferencing

Year:  2021        PMID: 33816128      PMCID: PMC8010620          DOI: 10.1016/j.invent.2021.100382

Source DB:  PubMed          Journal:  Internet Interv        ISSN: 2214-7829


Introduction

The number of chronic health conditions and disabilities among children has steadily increased in the last decades (Perrin et al., 2014). Children with long-term conditions and complex needs require several hours of additional care and assistance on a daily basis compared to their healthy counterparts (Heyman et al., 2004), thereby posing extra burdens on their parents' well-being. Parents of children with chronic conditions have been found to experience distress, insecurity, loss of self-esteem, negative emotions, anxiety, disease-related fear, depression, and physical and mental distress (Boman et al., 2004). Burnout symptoms are more typical of parents of chronically ill children than those of healthy children, and mothers, in particular, have been found to suffer from burnout (Lindström et al., 2010). Although the level of distress diminishes over time, some symptoms persist for years after a child has been diagnosed with a serious illness (Boman et al., 2003). In addition, studies show that parents with a child with a developmental abnormality perceive their quality of life to be lower than those whose child develops normally (Huang et al., 2014; Xiang et al., 2009). As there is abundant research suggesting that parental distress is associated with a large number of adverse family outcomes, including increased mental health problems in children (Amrock and Weitzman, 2014; Merrill et al., 2007) and poorer long-term adjustment to the child's illness (Rabineau et al., 2008), there is a need for interventions aimed at reducing parental strain. Parents of children with chronic conditions may engage in a variety of avoidant coping strategies to deal with their child's illness, such as eliminating or avoiding painful thoughts, feelings, and sensations related to the child's condition. Avoidant coping strategies may provide temporary relief but may lead to increased distress in the long term (Bardeen and Fergus, 2016; Hayes et al., 2006). Evidence shows that parents who have poor psychological flexibility, i.e., engage in avoidant coping strategies, may experience challenges when adjusting to caring for their child with a chronic condition and may exhibit psychological symptoms such as anxiety, depression, and stress (e.g., Chong et al., 2017). Increasing parents' ability to take an accepting, non-judging stance toward their own thoughts and feelings and their child's potential behavioral problems may assist parents in regulating their emotions and choosing more appropriate parenting behaviors (Prevedini et al., 2020). A third wave of cognitive behavioral therapy (CBT) or the process-based CBT approach, such as acceptance and commitment therapy (ACT, Hayes et al., 1999), may be particularly useful in addressing avoidant coping strategies and promoting skills that support children's socioemotional development (Lunsky et al., 2018). In recent years, there has been an increase in the number of ACT-based interventions for supporting parents of children with chronic conditions. These interventions have varied in duration and have been targeted at parents whose children have been diagnosed with a variety of long-term illnesses, such as asthma (Chong et al., 2017, Chong et al., 2019), autism spectrum disorder (Blackledge and Hayes, 2006; Fung et al., 2018; Joekar et al., 2016; Lunsky et al., 2012; Lunsky et al., 2018; Poddar et al., 2015; Zody, 2017), cerebral palsy (Whittingham et al., 2016; Whittingham et al., 2019; Whittingham et al., 2020), intellectual disabilities (Reid et al., 2016), life-threatening illnesses (Burke et al., 2014), diabetes, and other chronic illnesses (Sairanen et al., 2019). According to recent meta-analyses and reviews (Byrne et al., in press; Parmar et al., 2019; Ruskin et al., in press; Yu et al., 2019), interventions based on ACT, mindfulness, and acceptance show promise in helping parents cope with the stress and psychological distress associated with having children with chronic conditions. As most studies have predominantly examined the impact of individually or group-delivered interventions on the well-being of parents of children with chronic conditions, there is a need for more research on alternative ways to support these parents, who often lack the professional help and services and, owing to time constraints, spend less time on personal care (Brandon, 2007). Furthermore, the barrier of access to support cannot be overcome with the dominant models of delivering psychosocial interventions (Kazdin, 2019). In countries where caring for chronically ill children often coincides with working life, parents may find it particularly difficult or nearly impossible to incorporate the care of a chronically ill child, employment, and self-care into their schedule. Therefore, parents of children with chronic conditions could benefit from novel models of delivering support that are not tied to time or place, allowing them to devote time to self-care whenever they have the time and opportunity to do so. Feasible options to provide parents support are self-help models or web-based interventions combined with video conferencing technology. Currently, there is substantial research supporting the clinical effectiveness of video therapy (Simpson et al., 2020). So far, only few trials have investigated the efficacy of ACT-based online interventions for parents of children with chronic conditions (Sairanen et al., 2019; Whittingham et al., 2016), and an online parent support program for families of infants identified as at high risk of cerebral palsy, which is currently being implemented (Whittingham et al., 2020). The ACT-based web intervention, developed and tested by Sairanen et al. (2019), produced large between-group effect sizes for burnout, depression and anxiety symptoms, and aspects of mindfulness in comparison to a no-treatment (wait-list control) group. As our research lab participated in the development of the Swedish web-based program utilized in the Sairanen et al. (2019) study, the equivalent web program provided in another language (Finnish) and in another country was utilized in the current study.

Aim of the study

As the study of Sairanen et al. concluded that Internet-delivered ACT with the guidance of student therapists was effective at enhancing the psychological well-being of parents, we wanted to confirm these results and, furthermore, investigate whether comparable results could be attained with two differently delivered ACT-based interventions. We were especially interested in investigating the impact of a psychologist-supported iACT intervention using video conferencing technology in comparison to a self-help ACT intervention also including ACT-based exercises online but without any guidance. Thus, the aim of the current non-inferiority study was to examine whether the psychologist-supported iACT intervention with three video conferencing sessions would be superior to the self-help ACT intervention in reducing burnout and depressive symptoms and enhancing psychological flexibility, mindfulness, and quality of life in parents.

Methods

Settings and participants

The study was conducted in the Psychology Department Clinic at the University of Jyväskylä in 2019–2020. Ethical approval for the study was obtained from the Ethical Committee of the Central Finland Health Care District (Board Affiliation: Central Finland Central Hospital. Approval Number 12/U2018 on November, 6, 2018, registered at www.clinicaltrials.gov; ClinicalTrials.gov, Identifier: NCT04250012, Protocol ID 18/26/2018). The participants took part in the study on a voluntary basis and gave written informed consent for their participation. Parents were recruited through advertisements in local newspapers and the Facebook pages of diverse caregiver and family organizations. Interested parents were invited to contact the study team by phone or by sending their contact information via e-mail, after which an appointment for a telephone interview was arranged. In the phone call, preliminary information about the study was provided, and initial inclusion criteria were assessed. Those willing to participate received a link to an online survey, including a questionnaire on burnout that confirmed the suitability of the parent for the study. Parents who fulfilled the following inclusion criteria were eligible to participate: 1) had a child under the age of 18 with a chronic condition or developmental disability; 2) scored greater than 2.75 points on the Shirom-Melamed Burnout Questionnaire (SMBQ), indicating mild symptoms of burnout (Lundgren-Nilsson et al., 2012; Melamed et al., 1999); 3) had no parallel psychological treatment; 4) did not suffer from a serious mental disorder; 5) had sufficient Finnish language skills; and 6) had access to the Internet through a computer or other device. The data were collected in three phases, with the first wave starting in February 2019 and the last post-measurements taking place in May/June 2020. The randomization in the two groups followed each data collection using a randomization tool (see www.random.org). A total of 119 interested parents contacted the study team (see study flow in Fig. 1). Of these, nine were excluded: four of them did not meet the burnout (SMBQ) inclusion criteria; four dropped out before the pre-measurement; and one could not participate due to time constraints. Altogether, 110 parents comprising 103 females (93.6%) and seven males (6.4%) completed the pre-measurements, including background information (supported iACT, n = 57; ACT self-help, n = 53, Table 1). The mean age of the parents was 40.1 years (SD = 6.68, range 27–55), and close to 70% had a university-level education. A significant difference between the groups was noted in the age of the parents, with the parents in the iACT group being slightly younger (M = 38.9 years; SD = 6.85) compared to those in the self-help ACT group (M = 41.5 years; SD = 6.29). However, we considered this difference (39 vs. 41.5 years) as clinically non-significant. Sample demographics are presented in Table 1.
Fig. 1

Participant flow.

Table 1

Characteristics of parents.

Parental variablesAll (n = 110)iACT (n = 57)Self-help ACT (n = 53)
Age [mean (SD)]40.1 (6.69)range 27–5538.9 (6.9)range 27–5341.5 (6.3)range 27–55
Sex
 Female103 (93.6%)54 (94.7%)49 (92.5%)
 Male7 (6.4%)3 (5.3%)4 (7.5%)
Marital status
 Married or living together91 (82.7%)48 (84.2%)43 (81.1%)
 Single parent19 (17.3%)9 (15.8%)10 (18.9%)
Educationa
 Primary level3 (2.7%)3 (5.3%)
 Secondary level31 (28.2%)13 (22.8%)18 (34%)
 University level76 (69.1%)41 (71.9%)35 (66%)
Working status⁎⁎
 Full time48 (44%)23 (41.1%)25 (47.2%)
 Part time25 (22.9%)12 (21.4%)13 (24.5%)
 Unemployed5 (4.6%)2 (3.6%)3 (5.7%)
 Student11 (10.1%)6 (10.7%)5 (9.4%)
 Sick leave2 (1.8%)2 (3.6%)
 Caregiver/maternity leave18 (16.5%)11 (19.6%)7 (13.2%)
Has own disease or diagnosis49 (44.5%)23 (40.4%)26 (49.1%)
Child's age [mean, (SD)]9.0 (4.29)range 0.8–178.5 (4.3)range 0.8–179.6 (4.2)range 1–17
Child's gender
 Male76 (69.1%)41 (71.9%)35 (66%)
 Female35 (30.9%)16 (28.1%)18 (34%)
Child's condition⁎⁎⁎
 Developmental disability36 (33.3%)16 (29.1%)20 (37.7%)
 Autism spectrum disorder20 (18.5%)14 (25.5%)6 (11.3%)
 ADHD9 (8.3%)5 (9.1%)4 (7.5%)
 Diabetes8 (7.4%)3 (5.5%)5 (9.4%)
 Gastrointestinal diseases8 (7.4%)3 (5.5%)5 (9.4%)
 Coronary diseases6 (5.6%)3 (5.5%)3 (5.7%)
 Muscle diseases5 (4.6%)4 (7.3%)1 (1.9%)
 Other16 (14.8%)7 (12.7%)9 (17%)

Primary > 9 years; secondary 9–12 years; university 12 > years (university, college, etc.)

Missing information: n = 52.

Missing information: n = 56.

Missing information: n = 55.

Participant flow. Characteristics of parents. Primary > 9 years; secondary 9–12 years; university 12 > years (university, college, etc.) Missing information: n = 52. Missing information: n = 56. Missing information: n = 55.

Interventions

Description of the supported iACT intervention

The iACT group (n = 57) participated in a web-based ACT intervention, including a web-program called Uupu and three online meetings with a psychologist via the doxy.me telemedicine solution. The parents received credentials to the program website (www.uupu.fi), and the intervention lasted 13 weeks, of which the web-based program lasted 10 weeks and included five modules (2 weeks each), according to an ACT approach: (1) What is important to you? (2) meaningful actions; (3) present moment; (4) distance to thoughts and feelings; and (5) acceptance and self-compassion (see Table 2). The modules were composed of ACT-related content such as text, pictures, audio exercises, and videos. The content of the web-based program was identical to that in the study of Sairanen et al. (2019), except for changes related to data security according to the wishes of the Ethical Committee: 1) the discussion forum was left out; 2) the program did not include any possibility to write reflections or store any input on the program platform; and 3) email reminders were not sent to the participants. Instead, the parents were encouraged to write and reflect on the two-weekly home assignment for each module in a diary in paper form, which was sent to them by regular mail before the start of the intervention.
Table 2

Content of the web-based program (supported iACT group).

Modules (ACT processes)Program content
IntroductionWelcome to the program
Module 1: What is important to you?(Values)Text, video on “Important to you” experiential exercises:Curtains in your life's windowA meaningful moment90th birthday party
 Assignment, weeks 1–2Reflect on your life values, and formulate them. Choose one or more areas of life that feel/s right for you right now. Do what it takes!
Module 2: Meaningful actions!(Value-based actions)Text, experiential exercises:Do it now!Relieving stressFocus on breathingA place to restTiredPassengers on the busBut-storiesOn your life's journey
 Assignment, weeks 3–4Choose at least two important life values, and make a plan. Write down your plan, as in the example below:My life value (what matters to me) is: …What do I choose to do?
Module 3: Present moment(Present moment)Text, video, experiential exercises:SensesBreathing exerciseMindful listeningMindfulness in daily lifeMindfully washing the dishesMindful eatingMindful walkingMindful body
 Assignment, weeks 5–61. Apply the SOAL (stop, observe, accept, and let go) method in your everyday life.2. Choose a daily chore, and do it mindfully.3. How can you influence your well-being? What actions are you willing to choose during the next two weeks
Module 4: Distance to thoughts and feelings(Defusion)Text, video, experiential exercises:The little manLeaves in the streamThe sky and the weatherObserver
 Assignment, weeks 7–81. Stop once in a while, and focus on what you are feeling or thinking. Label your thoughts, feelings, and body sensations as they appear: Now, I've got the feeling that I'm sadNow, I've got the feeling to …Now, the memory that comes to me …Now, it feels like this in the body ….2. Train distance to your thoughts by asking yourself Who is in charge here; me or my thoughts? Or Is this thought helpful? Has it helped me to live a good life?
Module 5: Acceptance(Acceptance and self-compassion)Text, video, experiential exercises:KöydenvetoHillomunkitBroken machineLet it beCompassionate handStone on the beachA good friendThe guesthouse
 Assignment, weeks 9–101. Is there anything in your life that you need to learn to accept? Apply the general model of acceptance to what you have difficulty accepting:1. Note and describe the present moment.2. Accept what you note.3. Accept your painful and unpleasant thoughts and feelings.4. Do not avoid.2. Be compassionate with yourself and others. Which small acts of kindness can improve your well-being and that of others?
Closing wordsThe journey continues…
Content of the web-based program (supported iACT group). In addition, the intervention included three 45-minute online meetings with a clinical psychologist using the Doxy.me telecommunication application (www.doxy.me). The two psychologists, who worked as coaches, had ample experience in ACT. The first virtual session was arranged at the beginning of the intervention—before access to the web-program—the second after the parents had worked through the first two modules (i.e., four weeks from the start), and the third online meeting took place at the end of the intervention (i.e., weeks 11–12). During the first appointment, each parent's set of problems, assets, and circumstances were mapped using the modified psychosocial interview model (see Strosahl et al., 2012), including questions related to family and work life, leisure, and health behaviors. Based on the interview, the psychologist prepared a vector-graphic case formulation of the parent's overall situation (according to the Functional Analytic Clinical Case Model, FACCM; Haynes and O'Brien, 2000; Haynes et al., 2011), which was sent to the parent via regular mail. During the second appointment, the case formulation was discussed, and according to the content of the first two modules, concrete short- and long-term goals were discussed and set to guide the parent toward a valued life. The third online meeting was devoted to sharing experiences and lessons learned, the need for additional practice, and take-home messages for the parent.

Description of the ACT self-help material

The parents in the self-help group (n = 53) received a 20-page self-help booklet highlighting an ACT approach, which was sent by regular mail (see Table 3). In addition, they were encouraged to visit a website called Oivamieli (www.oivamieli.fi), a web page accessible to the public that included a series of ACT-based exercises (to read or listen) on topics such as values, acceptance, and the present moment (see Table 4). The participants in this group did not have access to the same website as the supported iACT group, neither did they receive professional support during the intervention period.
Table 3

Content of self-help booklet (self-help ACT group).

ChapterContent
Introduction to the value, acceptance, and mindfulness-based approach(2 pages)
The mindful mind(4 pages)Being present: Be present; live in this moment. Thoughts as traps and double-edged sword. The skill of being present
The wise mind(6 pages)Observing mind: Take a flexible stance on your thoughts. You are not your thoughts (3 pages).Accepting mind: What is acceptance? Accept your thoughts and emotions. Accept what you cannot change (3 pages).
The valuing mind(3 pages)What are values? Reflect on your own values and act accordingly. What is important to you?
Healthy body(2 pages)RelaxationExerciseMindful eating
Table 4

Content of the self-help ACT material on the web.

ProcessMP3 exercises
1. The mind
Present momentFocus on what you are doing.IntroductionFollow your breathMindful sittingConnect with sounds around youDrop the anchorMindful choresSummary
ObservingYou are not the same as your mindIntroductionObserverThe birdLeaves in the streamTerrier thoughtsThe little manI have a thoughtSummary
AcceptanceAccept what you cannot changeIntroductionWarm jelly doughnutsTug-of-warStone on the beachBroken machineCompassionate handSummary



2. Values and choices
ValuesFind what is important to youIntroductionYour life nowEpitaphImportant in lifeValue domainsSix months to liveNotice the little things in your lifeSummary
Value-based actionsAct according to your valuesIntroductionSet a goalValue-based actionDo it now!Mindful listeningAppreciate a loved onePassengers in the busI cannot do itSummary



3. Body wellness
The sensing bodyFeel the calm and peace in your bodyIntroductionBreath in, breath outRelease your tensionsBe a mountainAccept your bodyMassage the pain awayRelaxation exerciseSummary
Mindful eatingNutrition to your body, mind and heartIntroductionMindful eatingWho is hungry?Individual eating rhythmThe value of food choicesBarriers to eating choicesMindful groceriesSummary
The moving bodyTake care of your bodyIntroductionThe value of exercisingBarriers to exercisingChoose the stairs!Dance your troubles awayMindful exerciseSummary
Content of self-help booklet (self-help ACT group). Content of the self-help ACT material on the web.

Measures

Symptom and quality of life measures

The main outcome measure was the Shirom-Melamed Burnout Questionnaire (SMBQ, Lundgren-Nilsson et al., 2012; Melamed et al., 1999). The questionnaire contains 22 statements measuring different aspects of burnout. The measure comprises of four subscales: emotional exhaustion, physical fatigue, listlessness, and tension. The statements are answered on a 7-point Likert scale, where the response options range from 1 = “almost never” to 7 = “almost always.” Based on the SMBQ, burnout can be divided into low (2.75–3.74), high (3.75–4.46), and pathological (≥4.47) levels. The validity and reliability of the SMBQ has been found to be good in previous studies (Lundgren-Nilsson et al., 2012). In this study, Cronbach's alpha at baseline was excellent, 0.92. Depressive symptoms were measured by the Patient Health Questionnaire-9 (PHQ-9) questionnaire (Kroenke et al., 2001), which is a dual-purpose instrument for making preliminary diagnoses and assessing the severity of depressive disorders. The PHQ-9 contains nine items, which are answered on a 4-point Likert scale, where the answer options range from 0 = “not at all” and 3 = “almost every day.” The total score on the PHQ-9 ranges from 0 to 27, with a higher score indicating more depressive symptoms. PHQ-9 scores of 5 (5–9), 10 (10–14), 15 (15–19), and 20 (20–27) represent mild, moderate, moderately severe, and severe depression, respectively. The validity and reliability of the PHQ-9 meter have been found to be good (Kroenke et al., 2001). In this study, Cronbach's alpha indicated high reliability, 0.78. Health-related quality of life was measured with the Finnish version of the SF-36 measure (Dempster and Donnelly, 2000; Ware and Sherbourne, 1992) RAND-36 (Aalto et al., 1999). The RAND-36 measures the following eight dimensions: physical functioning, role limitations due to physical health problems, bodily pain, social functioning, general mental health, psychological distress and well-being, role limitations due to emotional problems, and vitality, energy. Each dimension is measured with Likert scales and “Yes” or “No” questions and forms its own entity. The original numeric values are recoded to give a value of 0–100. Regarding the scoring, index values were calculated, which were obtained by summing the number of questions for each dimension divided by the number of questions answered, with high scores indicating good health and quality of life. The validity and reliability of the RAND-36 have been found to be good in the Finnish population (Aalto et al., 1999). Cronbach's alpha for the RAND-36 in this study was high, 0.89.

Process measures

Psychological flexibility was measured with the Comprehensive assessment of ACT processes (CompACT; Francis et al., 2016), a 23-item questionnaire that includes three subscales: openness to experience (CompACT-OE), behavioral awareness (CompACT-BA), and valued action (CompACT-VA). The items are answered on a 7-point Likert scale ranging from 0 (strongly disagree) to 6 (strongly agree), with higher scores representing greater levels of psychological flexibility (openness, awareness, activation). The total score of the CompACT ranges from 0 to 138, with CompACT-OE ranging from 0 to 60, CompACT-BA ranging from 0 to 30, and CompACT-VA ranging from 0 to 48. In this study, the CompACT showed good internal consistency for the total score (α = 0.83), α = 0.79 for CompACT-OE, α = 0.76 for CompACT-VA, and α = 0.80 for CompACT-BA. Mindfulness skills were assessed using the Five Facet Mindfulness Questionnaire (FFMQ, Baer et al., 2006), which measures five aspects of mindfulness: observing (noticing internal and external experiences), describing (naming and labeling internal experiences), acting with awareness (paying attentions to one's activities in the present moment), non-judging of inner experiences (having a non-evaluative stance toward inner experiences), non-reactivity to inner experiences (ability to let thoughts and feelings to come and go without struggle). The scale comprises 39 items rated on a 5-point Likert-type scale ranging from 1 (never or very rarely true) to 5 (very often or always true), with higher scores indicating higher levels of mindfulness. The structure, reliability, and validity of FFMQ have been found to be good (Baer et al., 2006). In this study, the FFMQ showed high reliability for the total score (α = 0.87), with α = 0.74 for observing, α = 0.91 for describing, α = 0.79 for non-judging and non-reacting, and α = 0.82 for acting with awareness.

User activity and intervention satisfaction

In addition to the standardized instruments, we collected data on user activity and participant satisfaction. In the supported web-based group, user activity was determined as a percentage of the Uupu web program, which each parent had completed based on the log data. In the self-help group, the usage of the publicly accessible Oivamieli website could not be tracked, and instead, the parents were asked to report with “Yes” or “No” whether they had used the self-help booklet and the website, including the MP3 exercises. Overall satisfaction with the support received (web-based group) was measured using 0–10 visual rating scales (0 = not at all satisfied with the support model, 10 = very satisfied with the support model). Both groups of parents were also asked to evaluate with “Yes” or “No” whether they would recommend this kind of support (web + psychologist support or the self-help material) to other parents.

Statistical analysis

Latent change score (LCS) modelling (Wald test) was used to analyze the Group × Time interaction, i.e., whether the groups changed differently from the pre- to post-measurement (Klopack and Wickrama, 2020). LCS modelling applies structural equation modelling (SEM) and is equivalent to repeated measures ANOVA. It accounts for missing values at random (MAR) and includes all available data. The parameters were estimated using the full maximum likelihood (MLF) method (robust maximum likelihood (MLR) estimation in Mplus) (Muthén and Muthén, 1998–2015). Effect sizes (ESs) are reported using Cohen's d. This was calculated from the baseline to post-measurements within, and corrected between, groups to estimate the ESs using estimated values. ES was calculated by dividing the difference between the means by the average of the standard deviations. When calculating the between-group ES at post-measurement, we took into account the possible pre-measurement difference between the groups. An ES of 0.2 is considered small, 0.5 medium or moderate, and 0.8 large (Roth and Fonagy, 2005). The power analysis suggested that in the current study we needed a sample size of 128 participants given the effect size (d) = 0.25, α = 0.05, power = 0.80. Thus, the between group effect size d > 0.20 was the lowest effect size of interest, and our sample n = 110 was large enough to detect the difference between the groups.

Results

Baseline psychological distress and dropout rates

Regarding burnout (SMBQ), the majority of the parents in the iACT group were classified as experiencing pathological levels of burnout (≥4.47, n = 34, 59.6%); 12 parents (21.1%) had high burnout (3.75–4.46); and 11 parents (19.3%) experienced mild burnout (2.75–3.74). In the self-help ACT group, the equivalent values were 35 (66%), 13 (24.5%), and 5 (9.4%). With regard to depression (PHQ-9), mild depression was reported by 21 (36.8%) parents in the iACT and 26 (49.1%) in the self-help ACT group; moderate depression was reported by 18 parents (31.6%) in the iACT and 14 (26.4%) in the self-help group; moderately severe to severe depression was experienced by 10 parents (17.6%) in the iACT group and six parents (11.4%) in the self-help ACT group. Out of the 110 parents who participated in the pre-measurement, a total of 28 (25.5%) dropped out at the post-measurement, leaving 42 parents in the supported iACT group (dropout 26.3%) and 40 in the self-help ACT (dropout 24.53%) at post-measurement. Fig. 1 presents the flow of the study.

Symptom, quality of life, and process measures

The effects of the two interventions on the symptom and process measures are summarized in Table 5, and those regarding the quality of life measures are summarized in Table 6. For the main outcome measure, symptoms of burnout (SMBQ), there was no significant interaction effect. Instead, the groups showed relatively similar and significant within group decreases (p < 0.01) in burnout symptoms (SMBQ), and the within group effect sizes were medium in both groups (iACT: d = 0.63–0.99; self-help ACT: d = 0.48–1.10). In terms of depressive symptoms, a comparison revealed that the two groups changed differently (PHQ-9; a significant interaction effect, p = 0.021), with a larger decrease in the supported iACT group. For the process measures, we observed the following significant interaction effects: the supported iACT produced larger changes for the total CompACT score (p = 0.039) and its subscale valued action (p = 0.039) as well as for the total mindfulness score (FFMQ; p = 0.047) and its subscale describing (p = 0.007). These significant interactions showed medium-sized differences (d = 0.49–0.64) in favor of the supported iACT intervention. For health-related quality of life (RAND-36), both groups showed significant positive changes in vitality and general mental health (Table 5). The within-group ESs indicated large changes in the iACT (d = 0.94/0.84 for vitality and general mental health, respectively) and small to medium changes in the self-help ACT for vitality and mental health (d = 0.42–0.55). However, the RAND subscale role limitations caused by emotional problems showed a significant medium-sized (d = 0.58) difference between the groups in favor of the supported iACT (significant interaction effect, p = 0.021). An investigation of the between- and within-group ESs revealed that the changes in several symptom, process, and quality of life measures were somewhat larger in the supported iACT than in the self-help ACT.
Table 5

Estimated sample statistics (mean ± standard deviation (SD)) and the effect of the intervention on outcomes.

Supported iACT
Self-help ACT
Interaction padd
PrePostpbdePrePostpcde
SMBQ4.51 ± 0.883.57 ± 1.08<0.010.994.76 ± 0.754.04 ± 1.11<0.010.770.270.29
Phys.fatigue4.68 ± 0.983.52 ± 1.19<0.010.844.82 ± 0.813.99 ± 1.15<0.011.100.140.39
Listlessness4.67 ± 0.853.84 ± 1.06<0.010.895.02 ± 0.954.20 ± 1.28<0.010.720.860.05
Tension4.25 ± 1.183.45 ± 1.19<0.010.684.60 ± 0.994.04 ± 1.15<0.010.550.470.19
Emot.exhaust.4.33 ± 1.253.53 ± 1.40<0.010.634.56 ± 1.044.00 ± 1.44<0.010.480.350.21
PHQ-99.61 ± 4.976.61 ± 5.13<0.010.639.21 ± 4.408.15 ± 4.750.260.190.020.49
CompACT77.20 ± 18.6591.61 ± 18.16<0.010.7675.24 ± 14.0178.95 ± 11.720.220.270.040.64
OE32.59 ± 11.2540.18 ± 10.20<0.010.6533.08 ± 8.5435.84 ± 8.340.150.280.090.47
BA13.75 ± 6.1715.43 ± 5.970.160.3012.53 ± 5.2512.21 ± 3.200.740.070.180.37
VA30.86 ± 7.1336.00 ± 5.76<0.010.7429.63 ± 6.4430.90 ± 4.990.180.250.040.49
FFMQ125.72 ± 16.62138.07 ± 17.69<0.010.72126.37 ± 14.00129.47 ± 13.870.150.270.050.55
OBS25.82 ± 5.3628.39 ± 4.75<0.010.4926.41 ± 4.9226.63 ± 5.320.310.190.180.30
DESC28.46 ± 5.9231.29 ± 7.09<0.010.4028.98 ± 5.4928.37 ± 5.100.410.15<0.010.59
AWA22.75 ± 5.1224.43 ± 5.250.040.3421.55 ± 4.0622.55 ± 3.700.350.250.740.17
NJ28.04 ± 7.3431.11 ± 7.390.020.4128.29 ± 6.5329.90 ± 6.050.120.280.390.20
NR20.66 ± 4.4022.86 ± 3.170.010.5821.14 ± 3.5422.05 ± 4.070.390.190.210.38

SMBQ = Shirom-Melamed Burnout Questionnaire.

SMBQ Phys.fatigue = physical fatigue.

SMBQ Emot.exhaust. = emotional exhaustion.

PHQ-9 = Patient Health Questionnaire (depressive symptoms).

CompACT = comprehensive assessment of ACT processes.

CompACT-OE = openness to experiences.

CompACT-BA = behavioral awareness.

CompACT-VA = valued action.

FFMQ = Five Facet Mindfulness Questionnaire.

FFMQ-OBS = observing.

FFMQ-DESC = describing.

FFMQ-AWA = acting with awareness.

FFMQ-NJ = non-judgement.

FFMQ-NR = non-reactivity.

p-Value for differences in changes between the groups using estimated parameters (Latent Change Score, Wald test). Bold text indicates significant p-value < 0.05.

p-Values of the change between pre and post within the supported iACT group.

p-Values of the change between pre and post within self-help ACT group.

Cohen's d from baseline to post-measures between the supported iACT group and the self-help ACT group using estimated parameters.

Cohen's d from baseline to post-measures within the group using estimated parameters.

Table 6

Estimated sample statistics (mean ± standard deviation (SD)) and the effect of the intervention on Health-related quality of life (RAND-36).

RAND-36Supported iACT
Self-help ACT
Interaction padd
PrePostpbdePrePostpcde
Physical function.85.61 ± 16.6186.19 ± 20.410.050.1385.00 ± 14.0186.83 ± 14.350.900.020.330.13
Role limit./phys. health75.00 ± 10.6977.98 ± 33.270.270.1461.79 ± 37.4962.81 ± 36.680.970.010.560.12
Role limit./emot. probl.39.18 ± 35.3961.11 ± 37.03<0.010.6045.28 ± 38.9046.34 ± 41.570.990.000.020.58
Vitality34.91 ± 14.4950.00 ± 19.24<0.010.9433.89 ± 14.8844.02 ± 21.56<0.010.550.170.38
Mental health54.18 ± 14.8066.00 ± 13.81<0.010.8451.93 ± 14.2757.76 ± 16.030.010.420.100.39
Social functioning58.77 ± 22.7069.05 ± 27.45<0.010.4660.82 ± 21.3865.94 ± 18.750.150.240.200.30
Bodily pain67.50 ± 26.0472.08 ± 28.080.060.2266.70 ± 22.1071.95 ± 20.690.120.260.990.02
Health perceptions54.12 ± 18.5259.17 ± 21.010.030.2251.60 ± 18.7857.76 ± 20.130.070.260.960.02

Physical function. = physical functioning.

Role limitat./phys. health = role limitations due to physical health problems.

Role limitat./emot. probl. = role limitations due to emotional problems.

Vitality = vitality, energy.

Mental health = general mental health covering psychological distress & well-being.

Social functioning.

Bodily pain.

Health perceptions = general health perceptions.

p-Value for differences in changes between the groups using estimated parameters (latent change score, Wald test). Bold text indicates significant p-value < 0.05.

p-Values of the change between pre and post within supported iACT group.

p-Values of the change between pre and post within self-help ACT group.

Cohen's d from baseline to post-measures between the iACT group and the self-help ACT group using estimated parameters.

Cohen's d from baseline to post-measures within the group using estimated parameters.

Estimated sample statistics (mean ± standard deviation (SD)) and the effect of the intervention on outcomes. SMBQ = Shirom-Melamed Burnout Questionnaire. SMBQ Phys.fatigue = physical fatigue. SMBQ Emot.exhaust. = emotional exhaustion. PHQ-9 = Patient Health Questionnaire (depressive symptoms). CompACT = comprehensive assessment of ACT processes. CompACT-OE = openness to experiences. CompACT-BA = behavioral awareness. CompACT-VA = valued action. FFMQ = Five Facet Mindfulness Questionnaire. FFMQ-OBS = observing. FFMQ-DESC = describing. FFMQ-AWA = acting with awareness. FFMQ-NJ = non-judgement. FFMQ-NR = non-reactivity. p-Value for differences in changes between the groups using estimated parameters (Latent Change Score, Wald test). Bold text indicates significant p-value < 0.05. p-Values of the change between pre and post within the supported iACT group. p-Values of the change between pre and post within self-help ACT group. Cohen's d from baseline to post-measures between the supported iACT group and the self-help ACT group using estimated parameters. Cohen's d from baseline to post-measures within the group using estimated parameters. Estimated sample statistics (mean ± standard deviation (SD)) and the effect of the intervention on Health-related quality of life (RAND-36). Physical function. = physical functioning. Role limitat./phys. health = role limitations due to physical health problems. Role limitat./emot. probl. = role limitations due to emotional problems. Vitality = vitality, energy. Mental health = general mental health covering psychological distress & well-being. Social functioning. Bodily pain. Health perceptions = general health perceptions. p-Value for differences in changes between the groups using estimated parameters (latent change score, Wald test). Bold text indicates significant p-value < 0.05. p-Values of the change between pre and post within supported iACT group. p-Values of the change between pre and post within self-help ACT group. Cohen's d from baseline to post-measures between the iACT group and the self-help ACT group using estimated parameters. Cohen's d from baseline to post-measures within the group using estimated parameters.

User activity

In the supported iACT group, a great majority (69%, n = 29/42) of the parents completed the whole program or most of it (76–100%); 11.9% (n = 5) completed between 51 and 75%; and 19.1% completed 50% or less. Overall, approximately 80% of the parents completed more than 50% of the web intervention. Further, the log data indicated that approximately 62% had been using the web program over five to eight weeks (45.2%) or longer (16.7%, over 9–12 weeks). For the self-help ACT, no user activity data were available, but following the intervention, 62.5% of the parents reported that they had used the self-help booklet, while 32.5% had used the website with the ACT-based exercises. More precisely, 30% of the parents in the self-help ACT group (n = 12/40) had used both the self-help booklet and the website.

Intervention satisfaction

The parents in the supported iACT gave a rating of 7.8 (scale 0–10) for their satisfaction with the overall support. In the self-help ACT, their satisfaction with the self-help material was rated 5.4, on average, using the same scale. The participants were also asked to evaluate with “Yes” or “No” whether they would recommend this kind of support (web + psychologist support) to other parents of children with chronic conditions. In the iACT group, 95% of the parents would recommend the intervention to other parents, whereas in the self-help ACT, 65% of them would recommend the self-help material to other parents.

Discussion

Parents of children with chronic conditions have been found to experience physical and mental distress, which can have harmful consequences for the entire family. The aim of the present study was to examine two types of interventions with the purpose of supporting such families, namely the impact of a psychologist-supported iACT intervention and self-help ACT regarding burnout, depressive symptoms, quality of life, and psychological flexibility among parents of children with chronic conditions. With regard to the main outcome measure burnout, the results showed that both the psychologist-supported iACT and the self-help ACT intervention reduced burnout symptoms. However, regarding depressive symptoms, psychological flexibility, mindfulness, and in one dimension of health-related quality of life, the supported iACT produced significantly larger improvements compared to the self-help ACT intervention. In these measures, the between group effect sizes showed medium-sized differences (d = 0.49–0.64) in favor of the supported iACT intervention. In an examination of psychological flexibility (CompACT) and mindfulness skills (FFMQ) at the subscale level, the valued action and describing (labeling feelings, thoughts and experiences with words) subscales showed larger changes in the iACT group compared to the self-help ACT group. In an examination of the within-group effect sizes, small or very small effects in mindfulness skills were generally observed in the ACT self-help group, however, larger changes were recorded in the supported iACT group. This may be due to the fact that only one third of the parents undergoing the self-help approach had undertaken the experiential exercises of teaching value-, acceptance and mindfulness skills, which may have reflected in the outcomes in these constructs. One explanation why no significant changes in other mindfulness and flexibility skills were detected in the supported iACT group could be that skills such as observing (noticing or attending to internal feelings and thoughts), acting with awareness (attending to what is happening in the present), and non-reacting (allowing emotions and thoughts to come and go) may require more practice and take more time to appear, which is similar to the argument regarding the subskill of non-judging (Hofer et al., 2018). The same may apply to other psychological flexibility skills measured by CompACT, such as openness to experience and behavioral awareness, which are very close, if not overlapping, constructs to mindfulness skills. The change in valued actions may be due to the fact, as a construct, it is easier to understand and to promote compared to mindfulness constructs, which require more practice. This, potentially, suggest that the parents – who were reminded by the psychologist – had more actively committed to exercises dealing with value work, and, consequently, may have engaged in value-based actions. Interestingly, both interventions had an impact on burnout symptoms. In the past years, research has been inconclusive in terms of whether or not burnout and depression are the same construct or not and whether burnout is a risk factor in developing depression (Kaschka et al., 2011; Koutsimani et al., 2019). According to Koutsimani et al. (2019), burnout and depression seem to be different constructs that share some common characteristics and may develop in parallel. Given that burnout is an antecedent of depression, a possible explanation could be that the self-help ACT intervention had started to have an impact on burnout, but had not yet affected depressive symptoms. An alternative explanation is that provided by Baer et al. (2012) who stated that before learning any mindfulness skills, other factors such as coming to a treatment group and sharing with fellow participants with similar problems may lead to small decreases in perceived stress. In this study, being allocated to a research group and received attention may have also induced changes in burnout in the self-help ACT group. As mindfulness and flexibility skills begin to develop, additional decreases in burnout may be expected (see Baer et al., 2012). With regard to the amount of support, our findings are consistent with previous research suggesting that unsupported treatments are less effective than treatments that incorporate support (e.g., Andersson and Cuijpers, 2009; Farrand and Woodford, 2013). The current study is also in line with meta-analyses that have compared guided Internet-based treatments with unsupported control conditions and indicated larger effect sizes in favor of guided Internet-based treatments in which a therapist or coach supports the client through the treatment program (between-group d = 0.42–0.78; Andersson and Cuijpers, 2009; Richards and Richardson, 2012). At the same time, the results also indicate that pure self-help ACT may produce positive outcomes in parents. Despite of the differential design, this study can be compared with that of Hofer et al. (2018) which concluded that ACT delivered through a self-help book without contact from a therapist reduced stress and burnout for individuals among working population compared to those in a waiting-list control group. An important aspect was the satisfactory user activity in both intervention groups. In the supported web-intervention group, approximately 70% completed all or nearly all of the program, and only 5% (n = 2) took very little advantage of the program (1–25% usage observed). Conversely, self-help material, which was provided with no support, was utilized by over 60% of the parents. These numbers can be regarded as encouraging. To attain even better adherence to the web intervention (iACT) and self-help material (self-help ACT), some parents may have needed more professional support, peer support, and/or email-reminders inviting them back to the program. Therefore, there is a need to examine in greater detail parents' usage activity in terms of reflecting their engagement and patterns of usage in the current iACT and self-help ACT interventions. In addition, future studies should pay attention to remaining sensitive to parental needs and wishes for support. Support for families—as Coyne et al. (2020) suggest—should be provided in small, doable doses. Even when the dose is small, it can still make a difference (Coyne et al., 2020). The current interventions are one step in this direction, providing parents with flexible tools for managing their own distress and promoting self-care. The study by Sairanen et al. (2019) offers an interesting comparison to the current study as it applied a comparable web-based ACT intervention in a different country and language. Juxtaposing the results of the current study with those of the equivalent study by Sairanen et al. (2019), comparable changes were observed in the context of burnout (within-group effect size, d = 0.99 (FI) versus 0.70 (SWE)). Interestingly, these ESs were comparable to burnout decrease in the self-help group (d = 0.77). Although different measures for depression were used, the magnitude of the change was also similar in both iACT interventions (d = 0.63 (FI) versus 0.45 (SWE)). Moreover, regarding mindfulness, the impact was equal in the two interventions (d = 0.63 (FI) versus 0.72 (SWE)). In addition, the percentages for dropouts were equal at post-measurement, with 26% (n = 15) in the current iACT intervention compared with 27% in the Swedish treatment group. Both percentages are in accordance with the findings of a meta-analysis of computer-based interventions for depression, showing dropout rates of 28% for therapist-support treatments (Richards and Richardson, 2012). Interestingly, the dropout rate for the self-help group (25%) was comparable to that of the supported iACT group and, therefore, was not consistent with dropout evidence for non-supported treatments (74%, Richards and Richardson, 2012). In conclusion, the current study confirmed the results observed in the previous study by Sairanen et al. (2019), which showed that a psychologist supported ACT intervention delivered via the Internet can decrease symptoms of burnout and depression among parents of children with chronic conditions.

Limitations

Several limitations need to be considered in interpreting the results of this study. First, the recruitment method and data collection may limit the generalizability of the results. By conducting the recruitment through family and parent organizations, we may have excluded parents who were not actively engaged in these organizations and who may not use the Internet. Second, the current study reports only the pre- and post-intervention results. However, the ongoing follow-up period will determine whether the changes were maintained over a longer period of time. Third, the lack of a waiting-list control group (WLC) that did not undergo intervention suggests that we cannot draw firm conclusions from the results of the study, neither can we exclude that other factors might have impacted the results. It is possible that the improvements in the outcomes of the two groups were caused by repeated measures or spontaneous recovery effects. However, changes in a WLC group were verified in the Swedish study by Sairanen et al., 2019, showing no or minimal changes in the no-intervention group, with a web-based ACT intervention showing significantly larger improvements. Fourth, all the assessment scales were self-report questionnaires. Ecological momentary assessment through smartphones could have given additional information on the impact of the study. Fifth, given the large number of significant test performed, and the increased risk of type I and type II errors (and in purpose to ensure that our conclusions were reliable), the conclusions were based both on statistical differences and corrected between group effect sizes. Thus, among those variables that showed significantly different changes between the groups, the corrected between group effect sizes were at medium size level (d = 0.49–0.64) indicating clear differences at the end of the intervention. Finally, the sample identified themselves mainly as highly educated, most of whom were mothers. The above-presented findings can only be generalized to a group of highly educated and motivated parents reporting high levels of burnout and depression symptoms. Consequently, future research should aim to investigate parents with a greater heterogeneity of participant characteristics, including males and parents from different backgrounds and minority populations.

Conclusions and future directions

Many parents experience burnout and other mental health problems in caring for children with chronic conditions. However, the severity of these parents' symptoms is rarely recognized or treated by health professionals. Many parents wait too long before seeking treatment for their symptoms of burnout, which often results to a prolonged recovery (Glise et al., 2012). Therefore, it is important to continue to develop and evaluate relevant interventions for this vulnerable group of parents, who often lack access to services. Supporting them is vital because of the crucial role they play in the lives and well-being of their children. These parents need treatments or self-care-providing skills to manage distress and promote well-being. As they deal with several challenges regarding combining childcare with work and leisure time, they need self-care tools that can easily be integrated into their daily life. Furthermore, as there are barriers in the provision of support services for these parents, digital health interventions may offer a feasible alternative to psychological support and self-care, which are readily accessible. Video conferencing opens the lines of communication for parents to be put in touch with a psychologist for a virtual therapy session, independent of geographic location. While we need to be cautious about the conclusions herein due to some limitations in the current study, our findings suggest that parents of children with chronic conditions may be able to alleviate their symptoms of burnout by participating in either the psychologist-supported web-based ACT intervention or a self-help ACT intervention. A relatively brief (three months) web-based ACT intervention with totally three virtual sessions with a psychologist may offer additional benefits such as reduced symptoms of depression and increased psychological flexibility and mindfulness skills. Since the ACT self-help delivery model showed nearly equivalent improvements in burnout symptoms, the self-help guide combined with ACT-based experiential exercises in the Internet can also be considered a feasible option for distressed parents as it uses fewer resources than supported interventions. Based on our findings, however, we propose that whenever possible, a supported iACT intervention should be prioritized over a self-help ACT intervention as the supported model produced broader changes and was overwhelmingly accepted by the parents. In addition, our findings suggest that video conferencing technology can bring opportunities to work with this population and support them in virtual settings regardless of physical location. There are grounds to explore in greater detail how the current ACT interventions could be improved to guarantee the best way to deliver psychological support to parents of children with chronic conditions. In particular, it is worth exploring how the support provided via video conference calls could be improved to provide more convenient and adequate support for parents of children with chronic conditions. The importance of including peer support in the intervention should also be examined. Moreover, the effectiveness and acceptability of interventions developed in collaboration with parents should be investigated, and further research should investigate the long-term effects of the current delivery models. Both parents and health professionals should be informed that there are feasible alternatives to support, such as web-based programs combined with support using video conference sessions or pure self-help models which may help in reducing the distress of parents of children with chronic conditions.

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
  39 in total

1.  Chronic burnout, somatic arousal and elevated salivary cortisol levels.

Authors:  S Melamed; U Ugarten; A Shirom; L Kahana; Y Lerman; P Froom
Journal:  J Psychosom Res       Date:  1999-06       Impact factor: 3.006

2.  Adapting acceptance and commitment therapy for parents of children with life-threatening illness: pilot study.

Authors:  Kylie Burke; Frank Muscara; Maria McCarthy; Anica Dimovski; Stephen Hearps; Vicki Anderson; Robyn Walser
Journal:  Fam Syst Health       Date:  2014-03       Impact factor: 1.950

3.  Using self-report assessment methods to explore facets of mindfulness.

Authors:  Ruth A Baer; Gregory T Smith; Jaclyn Hopkins; Jennifer Krietemeyer; Leslie Toney
Journal:  Assessment       Date:  2006-03

Review 4.  Impact of support on the effectiveness of written cognitive behavioural self-help: a systematic review and meta-analysis of randomised controlled trials.

Authors:  Paul Farrand; Joanne Woodford
Journal:  Clin Psychol Rev       Date:  2012-11-23

5.  Effects of Caregiver-Focused Programs on Psychosocial Outcomes in Caregivers of Individuals with ASD: A Meta-analysis.

Authors:  Yue Yu; John H McGrew; Jorgina Boloor
Journal:  J Autism Dev Disord       Date:  2019-12

6.  Economic and psychologic costs for maternal caregivers of gastrostomy-dependent children.

Authors:  Melvin B Heyman; Paul Harmatz; Michael Acree; Leslie Wilson; Judith Tedlie Moskowitz; Steve Ferrando; Susan Folkman
Journal:  J Pediatr       Date:  2004-10       Impact factor: 4.406

7.  The rise in chronic conditions among infants, children, and youth can be met with continued health system innovations.

Authors:  James M Perrin; L Elizabeth Anderson; Jeanne Van Cleave
Journal:  Health Aff (Millwood)       Date:  2014-12       Impact factor: 6.301

8.  Serious illness in childhood: the different threats of cancer and diabetes from a parent perspective.

Authors:  Krister K Boman; Jonas Viksten; Per Kogner; Ulf Samuelsson
Journal:  J Pediatr       Date:  2004-09       Impact factor: 4.406

9.  Modeling Latent Change Score Analysis and Extensions in Mplus: A Practical Guide for Researchers.

Authors:  Eric T Klopack; Kandauda K A S Wickrama
Journal:  Struct Equ Modeling       Date:  2019-04-25       Impact factor: 6.125

10.  The Relationship Between Burnout, Depression, and Anxiety: A Systematic Review and Meta-Analysis.

Authors:  Panagiota Koutsimani; Anthony Montgomery; Katerina Georganta
Journal:  Front Psychol       Date:  2019-03-13
View more
  1 in total

Review 1.  The Efficacy of Parent Training Interventions with Parents of Children with Developmental Disabilities.

Authors:  Benedetta Ragni; Francesca Boldrini; Sonia Mangialavori; Marco Cacioppo; Michele Capurso; Simona De Stasio
Journal:  Int J Environ Res Public Health       Date:  2022-08-05       Impact factor: 4.614

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.