Toshitaka Hamamura1,2, Shinichiro Suganuma1, Mami Ueda1, Jack Mearns3, Haruhiko Shimoyama1. 1. Division of Clinical Psychology, University of Tokyo, Bunkyo, Tokyo, Japan. 2. Japan Society for the Promotion of Science, Chiyoda, Tokyo, Japan. 3. Department of Psychology, California State University, Fullerton, Fullerton, CA, United States.
Computer-delivered interventions (CDIs) are therapeutic or quasi-therapeutic interactions delivered digitally rather than through interaction with another person. They have become widely available over the last decade and benefits of CDIs include cost-effectiveness and accessibility to a wider population [1]. Recent systematic reviews and meta-analyses have shown these interventions to be effective for treating depression [2] and anxiety [3]. For risky drinking, CDIs appear to have weak effects at 6 months, but none at 12 months [4].Recent increases in the number of people carrying mobile phones have led to the development of psychological interventions through mobile apps. Evidence-based apps are only a small portion of available apps, but studies have shown that mobile phone-based CDIs have the potential to reduce psychological and physical symptoms [5-7] and possibly risky drinking [8]. In light of their cost-effectiveness and accessibility to many users, mobile phone-based interventions may be useful in a hierarchical model of treatment.
Cognitive Behavioral Therapy
Cognitive behavioral therapy (CBT) is a widely used psychological intervention and much evidence shows its effectiveness for a number of psychological disorders, including depression, anxiety [9], and substance abuse [10]. An important element of CBT is monitoring one’s thoughts and activities. Daily behavioral and thought records are often assigned as homework to examine individuals’ lifestyle and thinking patterns. Neimeyer and Feixas [11] found that homework assignments that included records of thoughts, activity, and emotional responses alleviated depression in the short term for participants diagnosed with unipolar depression. Hundt et al [12] found that cognitive awareness of dysfunctional thoughts meditated the effectiveness of CBT treatments for depression. The literature demonstrates that mobile-based CBT is effective for reducing various psychological symptoms [13-15]; however, studies that examined standalone effects without professional contacts seemed to be limited [16]. To our knowledge, no other studies have assessed standalone effects of mobile CBT or any theory-based intervention.
Mental Health Treatment in Japan
There are various reasons that people in Japan could benefit from CDIs. Many Japanese are unwilling to receive professional mental health services. Studies have shown that many Japanese view mental health problems as not a curable condition [17] and thus have little confidence in the effectiveness of treatment by mental health professionals. People may also avoid face-to-face mental health care in Japan because of societal stigmas [18]. Although advocating for receiving professional services for mental health problems is necessary for providing appropriate care, alternative forms of interventions such as CDIs may increase the accessibility of mental health services in Japan.Recent research on Internet-based CBT has demonstrated reductions in depression among the Japanese [19,20]. People in the workforce are particularly vulnerable to psychological distress in Japan because overwork is common and predicts mental health problems [21]. To our knowledge, no studies have yet been conducted with CBT-based mobile interventions in Japan.
Negative Mood Regulation Expectancies
One possible explanation of the effect of CBT-based interventions on psychological distress and substance use may be that CBT-based interventions increase individuals’ negative mood regulation expectancies. Negative mood regulation expectancies are defined as one’s belief that, when feeling upset, one can use thought or action to improve one’s mood [22]. Much research demonstrates that people with strong negative mood regulation expectancies cope more adaptively with stress and report fewer symptoms of anxiety and depression [23]. Negative mood regulation expectancies are also associated negatively with problematic drinking behavior, even after controlling for alcohol consumption, motivation, and coping styles [24]. Improvement in negative mood regulation expectancies during the early stages of CBT is associated with greater symptom reduction at the end of treatment and at follow-up [25,26]. Recent studies demonstrated that negative mood regulation expectancies operate in Japan in a similar way to how they do in the West [27,28].
Development of a Mobile Phone-Delivered Cognitive Behavioral Therapy App
We developed an app called “ jibun kiroku ” [Self Record], which allows users to receive a CBT-based intervention on their mobile phone (see Multimedia Appendix 1). This app focuses particularly on self-monitoring and awareness of negative thoughts, daily activities, and daily mood. It first provides psychoeducation about the relationships among negative thoughts, feelings, behavior, and physical responses (see Multimedia Appendix 2). Users can record their daily activities on an hourly basis, which promotes cognitive restructuring by helping users to identify automatic thoughts, emotions, and behavior from their daily activities (see Multimedia Appendix 3). Users can also evaluate the quality of their sleep, mood, and energy level, and they can track changes over the week (see Multimedia Appendix 4).
Study Purpose
The purpose of this study was to conduct a pilot trial to evaluate feasibility of the Self Record mobile phone app. We were particularly interested in examining standalone effects of the Self Record app on psychological distress and alcohol consumption. Although the intervention in this study was not developed to treat alcohol-related problems directly, we expected that reduction in psychological distress would lead to reduction in alcohol consumption, because alcohol consumption is positively associated with stress due to the tension-reducing properties of alcohol [29] and negatively with negative mood regulation expectancies [24]. We hypothesized that participants who received the intervention would show decreased psychological distress and alcohol consumption and increased psychological well-being and negative mood regulation expectancies (hypothesis 1). We also hypothesized that negative mood regulation expectancies would moderate the effect of the intervention on distress and alcohol consumption (hypothesis 2). Self-awareness, by itself, may not necessarily ameliorate symptoms; rather, people must have confidence that they can successfully regulate the processes they become aware of (ie, have strong negative mood regulation expectancies) [23].
Methods
Participation Selection
A research marketing company recruited individuals aged between 20 and 60 years, who indicated working full time and being “interested” or “somewhat interested” in using a self-monitoring app on their mobile phone. We also used a Japanese version of the Kessler Psychological Distress Scale (K6) to select participants experiencing psychological distress (see subsequent section for a full description of the K6). Participants whose K6 score fell between 5 and 12, indicating mild to moderate psychological distress, were recruited for this study. A total of 6921 participants were screened for eligibility, and 1396 met criteria for study participation.
Outcome Measures
The Japanese Negative Mood Regulation Scale assessed negative mood regulation expectancies [27]. Forty items complete the stem: “When I’m mildly depressed or irritated...” Responses use a 5-point scale (1=strongly disagree to 5=strongly agree). An example item is “Telling myself it will pass will help me calm down.” Alphas in this study ranged from .91 to .93.A Japanese version of the WHO (Five) Well-Being Index (WHO-5) assessed positive well-being [30]. The scale consists of five items that use a 6-point scale (0=at no time to 5=all of the time). An example item is “I felt cheerful and in good spirits.” The alphas in this study ranged from .89 to .92.A Japanese version of the K6 was used to measure general distress [31]. The scale comprises six items that answer this question: “During the last 30 days, how did you feel about the following?” Examples items are “nervous” and “everything was an effort.” Participants use a 5-point scale (0=none of the time to 4=all of the time). Alphas in this study ranged from .84 to .85.A Japanese version of the Center for Epidemiological Studies Depression Scale (CES-D) [32] measured depressive symptoms. The scale consists of 20 items responded to with a 4-point scale (0=rarely or none of the time [less than 1 day] to 3=most or all of the time [5-7 days]). The items assess various depressive symptoms (eg, “I feel sad,” “My sleep was restless,” “I felt that people dislike me”). Alphas for this study ranged from .84 to .89.Trait anxiety was assessed using the State-Trait Anxiety Inventory (STAI-Trait). A Japanese version was created by Shimizu and Imae [33]. The scale consists of 20 items responded to with a 4-point scale (1=almost never to 4=almost always). Items include “I lack self-confidence,” “I worry over something that doesn’t matter,” and “I feel secure.” Alphas in this study ranged from .88 to .89.To assess typical drinking and heavy drinking in the last 30 days, the Daily Drinking Questionnaire was used [34]. For typical drinking, participants recall a typical week and indicate how many drinks they consumed and the time they spent drinking each day from Monday to Sunday. For heavy drinking, they recalled the week they drank the most alcohol. A sum score of typical drinking and heavy drinking was calculated by summing the drinking quantity of all seven days. Participants reported their drinking quantity by converting all their drinks to 500 mL of beer, which is equivalent to 1 unit of alcohol in Japan.
Procedure
The Life Science Research Ethics and Safety committee at the University of Tokyo in Tokyo, Japan, reviewed and approved this study (16-88). Participants, who were registered in the research marketing company’s pool, received a notification about the study over the Internet. The screening for eligibility asked potential participants whether they were willing to use a self-monitoring app on their mobile phone. Specifics about the app were not revealed until after participants consented to be in the study. Because this study had to provide the intervention to those who were interested in using the app, this study implemented a quasi-experimental design. Participants who were willing to use the Self Record app represented the intervention condition, and those who were not represented the control condition.After participants were screened for eligibility, they read the informed consent and then completed pretest measures in this order: general distress, negative mood regulation expectancies, depression, anxiety, alcohol consumption, and positive well-being. After the 4-week intervention period, participants in both conditions retook the identical battery of questionnaires.
Intervention
Participants in the intervention condition first read a psychoeducation section presenting the basic concepts of CBT, which included an explanation about how thoughts affect feelings, behavior, and physical reactions (see Multimedia Appendix 2). Then, they were instructed to record their daily activities, thoughts, mood, and sleep quality, which would help them discover and modify dysfunctional thoughts as part of cognitive restructuring (see Multimedia Appendixes 3 and 4). To identify the frequency of their app use, they were instructed to send a screenshot of their weekly daily activity and thought records at the beginning of the trial period. All participation was conducted online.
Experimental Design and Statistical Analyses
All participants in the intervention and control groups were included for intention-to-treat analyses. Multiple imputations were performed to replace missing values that were lost at follow-up. Additionally, we performed per-protocol analyses because some variation in app use was expected and that inaccurate responses in outcome measures indicate lack of diligence.For examining the effectiveness of the intervention (hypothesis 1), we treated the condition (intervention vs control), the time (pretest and posttest), and the condition × time interaction as independent variables. Dependent variables were general distress (K6), depression (CES-D), anxiety (STAI-Trait), positive well-being (WHO-5), negative mood regulation expectancies, typical drinking, and heavy drinking. Mixed-effect analyses of variance (ANOVA) were performed. The condition × time interaction examined the effect of using the intervention for 4 weeks compared to the assessment-only effect in the control condition. An R package called “nlme” was used to perform this analysis [35].To examine the moderating effect of negative mood regulation expectancies (hypothesis 2), we implemented multiple regression analyses. Independent variables were condition (intervention vs control), negative mood regulation expectancies, and the condition × negative mood regulation expectancies interaction. For dependent variables, we used difference in the outcome variables between posttest and the pretest to simplify the statistical analyses. An R package called “car” was used to perform the multiple regression analyses [36]. For effect sizes, we calculated beta. All analyses used the .05 level of significance.
Power Analysis
Based on prior studies’ weak effect sizes for CDIs on alcohol consumption, we estimated at least a sample of 393 was needed for 80% statistical power at the P<.05 significance level. Because high attrition and poor quality of responses were expected, we collected beyond the number estimated by the power analysis.
Results
Attrition
Figure 1 shows the flowchart of this study. During recruitment beginning in February 2017, 6921 participants were approached for screening, 1083 of 6921 (15.65%) met eligibility criteria, and 557 of 6921 (8.05%) completed the baseline measure. Then, 306 of 557 participants (54.9%) were allocated to the intervention group and 251 of 557 (45.1%) to the control group based on their self-selection regarding willingness to use the mobile phone app. The 1-month follow-up occurred in March 2017; 58 of 306 participants (19.0%) in the intervention group and 27 of 251 (10.8%) participants in the control group were lost because they did not complete outcome measures.
Figure 1
The Consolidated Standards of Reporting Trials (CONSORT) extension flow diagram.
For the frequency of the Self Record app use, 107 of 306 participants (35.0%) reported they continued using the app after the first day, 63 participants (20.6%) used it for more than a week, 37 participants (12.1%) used it for more than 2 weeks, 14 participants (4.6%) used it for more than 3 weeks, and 8 participants (2.6%) used it for more than 4 weeks.
Participant Characteristics
Of the 557 participants enrolled in the trial, 230 (41.2%) were women. The mean age was 38.82 (SD 9.58) years. Regarding work status, 399 of 557 (71.6%) reported employment by a company, 42 of 557 (7.5%) reported employment by the government or a nonprofit organization, 35 of 557 (6.3%) reported self-employment, and 17 of 557 (3.1%) reported working as a professional (eg, lawyer, accountant, and medical staff).
Data Screening
Data were screened for missingness, outliers, normality, and heteroscedasticity. All measures were winsorized to adjust outliers. For the K6, CES-D, and WHO-5, square-root transformation was used, and for typical drinking and heavy drinking, logarithmic transformation was used to adjust for positive skewness and kurtosis.
Descriptive Statistics
Descriptive statistics are shown in Table 1. Multivariate analysis of variance indicated no significant group differences in the pretest variables (F7,549=0.95, P=.47). The mean scores on the K6 and CES-D were higher than in other studies that examined Japanese workers [19,20], indicating higher levels of psychological distress among participants in this study.
Table 1
Mean and standard deviation of outcome measures (N=557).
The Consolidated Standards of Reporting Trials (CONSORT) extension flow diagram.
Intention-to-Treat Primary Analyses
For intention-to-treat analyses, mixed-effect ANOVA was used to assess the main effects of condition and time, and the condition × time interaction (hypothesis 1). Table 2 shows results of the analyses. The main effect of condition was significant for typical drinking (η2<.001) and heavy drinking (η2=.002). Participants in the intervention group reported higher typical and heavy drinking than did those in the control group. The main effect of time was significant for WHO-5 (η2=.003), negative mood regulation expectancies (η2=.004), K6 (η2=.002), CES-D (η2=.003), typical drinking (η2<.001), and heavy drinking (η2=.002). At the 1-month follow-up, participants reported higher scores on the WHO-5, K6, CES-D, typical drinking, and heavy drinking, and lower negative mood regulation expectancies compared to baseline. The condition × time interaction was significant for typical drinking (η2=.009; see Figure 2) and heavy drinking (η2=.001; see Figure 3). For both typical and heavy drinking, participants in the intervention group reported higher scores at the 1-month follow-up compared to the participants in the control group.
Table 2
Intention-to-treat primary analyses: effects of condition, time, and condition × time interaction on outcome variables.
Change in typical drinking as a function of condition and time in the intention-to-treat analysis.
Figure 3
Change in heavy drinking as a function of condition and time in the intention-to-treat analysis.
We also examined the moderation by negative mood regulation expectancies of the effect of the intervention (hypothesis 2). Because three-way interactions are often difficult to interpret, we implemented multiple regression analyses. Independent variables were group (intervention and control), negative mood regulation expectancies, and the group × negative mood regulation expectancies interaction. Dependent variables were changes from baseline to 1-month follow-up of outcome variables. None of the results were statistically significant.Mean and standard deviation of outcome measures (N=557).aCES-D: Centers for Epidemiological Studies Depression; K6: Kessler Psychological Distress Scale; NMRE: Negative mood regulation expectancies; STAI: State-Trait Anxiety Inventory; WHO-5: WHO (Five) Well-Being Index.Intention-to-treat primary analyses: effects of condition, time, and condition × time interaction on outcome variables.aCES-D: Centers for Epidemiological Studies Depression; K6: Kessler Psychological Distress Scale; NMRE: Negative mood regulation expectancies; STAI: State-Trait Anxiety Inventory; WHO-5: WHO (Five) Well-Being Index.Change in typical drinking as a function of condition and time in the intention-to-treat analysis.Change in heavy drinking as a function of condition and time in the intention-to-treat analysis.
Per-Protocol Secondary Analyses
The intention-to-treat analyses were problematic due to attrition; approximately two-thirds of the participants (65.0%, 199/306) in the intervention group discontinued using the app on the first day. In addition, two-thirds of the participants in both groups (65.7%, 366/557) incorrectly answered validity items. As a result, substantially lower alphas for outcome measures were observed when these participants were included in reliability analyses, suggesting random or inattentive responding. For these reasons, we conducted per-protocol analyses by excluding participants who discontinued using the app after the first day and answered the validity items incorrectly. Forty-two participants in the intervention and 85 participants in the control remained in the analyses.Table 3 shows results of the per-protocol secondary analyses. A mixed-effect ANOVA revealed that the main effect of condition was significant for K6 (η2=.09). Participants in the intervention group reported significantly lower K6 scores than did those in the control group. The main effect of time was significant for negative mood regulation expectancies (η2=.009). Participants reported significantly lower negative mood regulation expectancies at the 1-month follow-up. The condition × time interaction was significant for anxiety (η2=.04), typical drinking (η2=.06), and heavy drinking (η2=.09). Participants in the intervention group reported higher scores for all three outcome measures at the 1-month follow-up compared to the control group.
Table 3
Per-protocol secondary analyses: effects of condition, time, and condition × time interaction on outcome variables.
Per-protocol secondary analyses: effects of condition, time, and condition × time interaction on outcome variables.aCES-D: Centers for Epidemiological Studies Depression; K6: Kessler Psychological Distress Scale; NMRE: Negative mood regulation expectancies; STAI: State-Trait Anxiety Inventory; WHO-5: WHO (Five) Well-Being Index.For moderation by negative mood regulation expectancies (hypothesis 2), the condition × negative mood regulation expectancies interaction predicted general distress (beta=.39, P=.03). Among participants with high negative mood regulation expectancies, those in the intervention group reported higher general distress compared to those in the control group. However, there was no difference among those with low negative mood regulation expectancies.
Discussion
This study examined standalone effects of a CBT-based mobile intervention called Self Record on psychological distress and drinking consumption. The intention-to-treat analyses revealed that participants who used the Self Record app reported increased typical drinking and heavy drinking, which was contrary to our hypothesis. In the per-protocol secondary analyses, we removed participants who discontinued using the app on the first day and participants who showed inattentiveness in answering outcome measures. The per-protocol analysis revealed that participants who used the intervention more often over the 4-week trial period reported increases in anxiety, typical drinking, and heavy drinking compared to those who rarely used the intervention or members of the control group. The effect sizes were small to medium.The goal of the intervention in this study was to raise participants’ awareness of potentially pathological thinking and to discover solutions to it. The first objective may have succeeded, raising participants’ awareness of their maladaptive patterns; however, the intervention apparently did not help participants self-treat their problematic thinking. Consequently, this heightened awareness may have affected results in two ways: (1) people may have reported increases in distress because they became more aware of their distress, and (2) such awareness may have started a vicious cycle in which heightened awareness led to greater distress, which the interventions focused their awareness on.Our result was contrary to previous studies that demonstrated the positive effects of mobile phone-based interventions on psychological distress [14,15]. One difference of these studies’ designs is that their participants had personal contacts with a mental health professional or researcher to discuss their experience with the interventions, whereas participants in this study focused on self-monitoring and had no personal contacts with any professional. It is possible that contact with the professional was more responsible for symptom improvement than was the CDI in prior studies. Gajecki et al [37] investigated a standalone mobile-based intervention for reducing risky drinking. They also found that using the mobile app led to more frequent alcohol use among men. Standalone use of CDIs was completely reliant on the participants for its success. Our findings and those of Gajecki et al highlight that, if participants are not capable of successfully using the information the intervention provides, the intervention may have unintended negative consequences.We also investigated the moderating role of negative mood regulation expectancies on the effect of the intervention. The level of negative mood regulation expectancies affected the impact of the intervention on general distress. Among participants with high negative mood regulation expectancies, those in the control condition showed decreases, whereas those in the intervention condition showed increases in general distress. The unexpected effects of the Self Record app on general distress were more evident among those with high negative mood regulation expectancies than those with low negative mood regulation expectancies. More studies are necessary to investigate the moderating role of negative mood regulation expectancies on CDI psychological interventions.There are several limitations of this study. First, this study used a quasi-experimental design, in which only those who were interested in using the mobile phone-based intervention were placed in the intervention group. Although there were no group differences in measures at pretest, it is still possible that some unmeasured factor was responsible for changes from pretest to posttest. More research needs to be conducted to confirm the findings of this study. Confounding variables, such as participants’ willingness to use the intervention or other characteristics, might have contributed to the findings in this study. Also, the study was conducted during the last month of the fiscal year in Japan and the participants, who were all full-time workers, may have been experiencing workplace stress. This environmental factor may have contributed in the increase in their stress in general and may have overshadowed the influence of personality variables.Second, there was a high attrition rate in this study. Although attrition at 1-month follow-up was not relatively high (15.3%, 85/557), 65.0% (199/306) of the participants in the intervention group discontinued using the app on the first day. Furthermore, 65.7% (366/557) of the total sample incorrectly answered all the accuracy-check items. Some literature points to high attrition as a characteristic of many Internet-based studies [38], but this attrition may limit the generalizability of our results.Nevertheless, this study may suggest unintended effects of standalone use of mobile-based CDIs for Japanese experiencing moderate stress. The mobile intervention may be beneficial when it is combined with other interventions that include contact with professionals to discuss thoughts and behaviors. This contact would allow clinicians to adjust interventions that lead countertherapeutically to higher distress. More intense computerized interventions or face-to-face psychotherapy may be necessary to alleviate psychological stress.Future studies may use more rigorous research designs, such as a randomized controlled trial. If standalone computerized self-monitoring increases people’s anxiety and drinking behavior, future studies may clarify mechanisms for such increases. There are several ways to improve low response rates. First, reminders can be sent to participants about using the app because this study did not provide any reminders. Second, participants could receive more specific instructions for using the app, so that they could focus on the daily activities and negative thoughts they prefer to work on with the app. This will focus their thinking on the most important thoughts for intervention. Third, future studies should design apps with more automatic functions, such as syncing with other apps to record sleep time, to reduce the manual entries needed to be done by users.
Authors: Elizabeth Stratton; Amit Lampit; Isabella Choi; Hanna Malmberg Gavelin; Melissa Aji; Jennifer Taylor; Rafael A Calvo; Samuel B Harvey; Nick Glozier Journal: J Med Internet Res Date: 2022-09-27 Impact factor: 7.076