Literature DB >> 30122730

The Japanese Workplace PERMA-Profiler: A validation study among Japanese workers.

Kazuhiro Watanabe1, Norito Kawakami1, Toru Shiotani2, Hidehiko Adachi1, Kaori Matsumoto2, Kotaro Imamura1, Kei Matsumoto2, Fumino Yamagami2, Ayumi Fusejima2, Tomoko Muraoka2, Tomomitsu Kagami2, Akihito Shimazu3, Margaret L Kern4.   

Abstract

OBJECTIVES: Although well-being at work is important for occupational health, multi-dimensional workplace well-being measures do not exist for Japanese workers. The purpose of this study was to investigate the validity of the Japanese version of the Workplace PERMA-Profiler.
METHODS: Japanese workers completed online surveys at baseline (N = 310) and 1 month later (N = 100). The Workplace PERMA-Profiler was translated according to international guidelines. Job and life satisfaction, work engagement, psychological distress, work-related psychosocial factors, and work performance were measured as comparisons for convergent validity. Cronbach's alphas, Intra-class Correlation Coefficients (ICCs), and measurement errors were calculated for the reliability, and the validity of the measure was tested by correlational analyses and confirmatory factor analysis.
RESULTS: A total of 310 (baseline) and 86 (follow-up) workers responded and were included in the analyses. Cronbach's alphas and ICCs of the Japanese Workplace PERMA-Profiler ranged from 0.75 to 0.96. Confirmatory factor analysis indicated that the 5-factor model demonstrated a marginally acceptable fit (χ2 (80) = 351.30, CFI = 0.892, TLI = 0.858, RMSEA = 0.105, SRMR = 0.051). Overall well-being and the five PERMA domains had moderate-to-strong correlations with job satisfaction, psychological distress (inversely), and work-related factors.
CONCLUSIONS: The Japanese version of the Workplace PERMA-Profiler demonstrated adequate reliability and validity. This measure could be useful to assess well-being at work, promote well-being research among Japanese workers, and address the problem of definition for well-being in further studies.

Entities:  

Keywords:  Flourishing; Japanese workers; PERMA; Psychometrics; Well-being; Workplace

Mesh:

Year:  2018        PMID: 30122730      PMCID: PMC6176035          DOI: 10.1539/joh.2018-0050-OA

Source DB:  PubMed          Journal:  J Occup Health        ISSN: 1341-9145            Impact factor:   2.708


Introduction

The importance of well-being has been recognized not only in academic fields but also in public policy and economics[1],[2)]. Multiple well-designed cohort studies and meta-analyses have reported that well-being correlates with lower mortality risk[2]-[4)]. Within occupational settings, a positive perspective, including a focus on well-being, has also been recognized as important for fostering human capital and productivity[5],[6)]. The conceptualization and definition of well-being is a difficult problem and topic of active discussion among researchers, and currently focuses on a diverse array of dimensions or descriptions rather than definitions[7)]. Perhaps the most well-defined trait of well-being is the separation of positive and negative dimensions. A systematic review indicates that effects of well-being are independent of negative affect[8)]. Well-being can thus be critically distinguished from the absence of negative factors (e.g., negative affect, depression, anxiety, and distress). The other distinction that has been made is between hedonic (emotion, pursuing pleasure, avoiding pain) and eudaimonic (the good life) dimensions[9)]. A cognitive evaluation of one's life (satisfaction with life) provides a third dimension. Most of the proposed well-being models utilize a combination of hedonic, eudaimonic, positive, negative, and evaluative dimensions[2)]. For instance, Diener's subjective well-being theory (SWB)[10)] suggested three dimensions of well-being: pleasant affect, unpleasant affect, and life satisfaction. Ryff's psychological well-being (PWB)[11)], focuses on six eudaimonic dimensions: autonomy, environmental mastery, personal growth, positive relations with others, purpose in life, and self-acceptance. Well-being at work has been discussed primarily in emotional (e.g., positive affect at work) and cognitive (e.g., job satisfaction) dimensions[12)]. Alternatively, well-being has been conceptualized more holistically as flourishing, which combines multiple hedonic and eudaimonic dimensions. For example, Seligman's PERMA model[13)] consists of five domains: positive emotion (P), engagement (E), relationships (R), meaning (M), and accomplishment (A). The problem of defining these concepts of well-being should be addressed through operationalization, using established measures[7)]. Most of the well-being and flourishing models have corresponding measures. For instance, the PERMA-Profiler developed by Butler and Kern[14)] allows individuals to monitor their well-being. This tool can also be useful for integrating the dimensions of well-being, compared with other previously developed measures[15],[16)]. Kern developed a workplace version of the measure (the Workplace PERMA-Profiler)[17)], which adjusted the questions to the workplace context to measure well-being at work (Table 1). Mirroring the general version of the PERMA-Profiler, the workplace measure consists of five factors (positive emotion, engagement, relationships, meaning, and accomplishment) across 15 items, along with 8 additional items to measure happiness (1 item), negative emotion (3 items), health (3 items), and loneliness (1 item). The measure is freely available for individual use (www.permahsurvey.com).
Table 1.

The English Workplace PERMA-Profiler

LabelQuestionResponse Anchors
The PERMA domains, negative emotion (N), and physical health (H) are computed as the average across the three items. Overall happiness is the average of the 15 PERMA items and the overall happiness (Hap) item. Loneliness (Lon) is a single item. Copyright Kern (2014), used by permission from the author.
A1How often do you feel you are making progress towards accomplishing your work-related goals?0 = never, 10 = always
E1At work, how often do you become absorbed in what you are doing?
P1At work, how often do you feel joyful?
N1At work, how often do you feel anxious?
A2How often do you achieve the important work goals you have set for yourself?
H1In general, how would you say your health is?0 = terrible, 10 = excellent
M1To what extent is your work purposeful and meaningful?0 =not at all, 10 = completely
R1To what extent do you receive help and support from coworkers when you need it?
M2In general, to what extent do you feel that what you do at work is valuable and worthwhile?
E2To what extent do you feel excited and interested in your work?
LonHow lonely do you feel at work?
H2How satisfied are you with your current physical health?
P2At work, how often do you feel positive?0 = never, 10 = always
N2At work, how often do you feel angry?
A3How often are you able to handle your work-related responsibilities?
N3At work, how often do you feel sad?
E3At work, how often do you lose track of time while doing something you enjoy?
H3Compared to others of your same age and sex, how is your health?0 = terrible, 10 = excellent
R2To what extent do you feel appreciated by your coworkers?0 =not at all, 10 = completely
M3To what extent do you generally feel that you have a sense of direction in your work?
R3How satisfied are you with your professional relationships?
P3At work, to what extent do you feel contented?
HapTaking all things together, how happy would you say you are with your work?0 =not at all, 10 = completely
The English Workplace PERMA-Profiler However, no multi-dimensional measurements for well-being at work have been developed in Japan. In addition, the reliability and validity of the original Workplace PERMA-Profiler has not been confirmed in published papers. Although well-being at work can cover the same dimensions as overall well-being, work-related well-being might operate in different contexts and might be associated with different outcomes (e.g., productivity) than overall well-being[5],[6)]. In addition, specification and stratification of well-being will address further questions such as a spill-over effect of well-being between work and life[12)]. In practice, because the Workplace PERMA-Profiler is easy to complete in a short time (23 items, or 15 items using only the PERMA domains), it could be useful as an indicator of positive aspects for prevention and health promotion approaches in the workplace. The current study aimed to investigate the reliability and validity of the Japanese version of the Workplace PERMA-Profiler among Japanese workers. The internal consistency, test-retest reliability, structural validity, and convergent validity of a translated version of the measure were tested. We hypothesized that the Japanese version of the Workplace PERMA-Profiler would have good internal consistency, test-retest reliability, and five-factor structural validity. Based on correlations for the original PERMA-Profiler[14)], we also hypothesized that well-being measured by the Workplace PERMA-Profiler would have a moderate-to-strong positive correlation with job satisfaction (r≥ 0.50) and a moderate negative correlation with psychological distress (r≤ −0.30). We expected that well-being at work would overlap with job satisfaction and work-related factors, and would be negatively associated with adverse health outcomes. Because work engagement[18)] could be a similar concept with engagement (E) in the PERMA model for the workplace, we expected that this measure would have weak-to-moderate correlations with work-related psychosocial factors and work performance (r≥ 0.20)[19)].

Subjects and Methods

Design

This was a validation study consisting of baseline (November 2016) and one-month follow-up (December 2016) online surveys in Japan. The internal consistency, structural validity, and convergent validity of the Japanese version of the Workplace PERMA-Profiler were investigated using the cross-sectional data. Test-retest reliability was investigated using the longitudinal data one month after follow-up. Because Seligman suggests that the PERMA domains are more stable reflections of well-being[13)], we conducted the follow-up study after one month, expecting scores to remain fairly stable over that period. This manuscript was written according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) reporting guidelines[20)]. Each characteristic of the measure was reported according to the COSMIN checklist.

Participants

Participants were drawn from workers registered as respondents of an Internet survey company, Macromill, Inc[21)]. Of the available respondents, 310 workers completed a web-based questionnaire in order of arrival. Macromill had access to over 2,000,000 potential participants representing all prefectures in Japan, and recruited participants based on their demographic attributes to obtain a relatively representative sample. These registered members have diverse characteristics in terms of gender and age. Participant inclusion criteria were (a) Japanese workers who lived in a prefecture of Japan and (b) age 18 or older. There were no exclusion criteria. Based on these criteria, the Internet survey company recruited workers from their potential pool of participants, until the targeted number was reached. If the eligible workers agreed with the terms and conditions of the online survey, they could access the self-report questionnaire. After one month, the company randomly sampled 100 participants from the workers who completed the baseline survey again. Participating workers were awarded approximately 100 'Macromill points' as a reward for each survey, which could be used for cashing out and shopping (one point was equivalent to 1 Japanese yen). Informed consent was obtained from all participants via instructions on the survey. The instructions assured protection of personal information and explained that any identifying information would be removed from the data. The study protocol was approved by the research ethics committee of the Graduate School of Medicine and the Faculty of Medicine, The University of Tokyo, Japan (No. 11242).

Measurements

Participants completed an online self-reporting survey that included the Workplace PERMA-Profiler and questions regarding job and life satisfaction, work engagement, psychological distress, work-related psychosocial factors (job demands, job control, and social support from supervisors and colleagues)[22],[23)], and work performance.

The Workplace PERMA-Profiler

The Japanese version of the Workplace PERMA-Profiler was used to measure multidimensional well-being at work. The measure includes the five factors of the PERMA model (positive emotion, engagement, relationships, meaning, and accomplishment), as well as overall happiness at work, negative emotion, health, and loneliness. Each factor score of the Workplace PERMA-Profiler was calculated as an average of the item scores. An overall score of well-being at work was calculated as an average of 15 items and happiness (1 item). All items were rated on an 11-point Likert-type scale (ranging from 0 to 10). The Japanese version of the measure was developed according to the procedure specified in the International Society of Pharmacoeconomics and Outcomes Research (ISPOR) task force guidelines[24)]. First, we obtained permission from the developer of the original Workplace PERMA-Profiler (MLK) to translate the measure into Japanese (preparation). Forward-translation was independently conducted and was followed by reconciliation, back-translation, back-translation review, harmonization, and cognitive debriefing. The back-translation was conducted by two experts in Japanese and English affiliated with the English Language Program of the Kanazawa Institute of Technology, who did not know the purpose of the study. The original developer checked the back-translated measure and made revisions at the back-translation review stage. Cognitive debriefing sessions were conducted with nine Japanese workers who were recruited using snowball sampling, and included a company president and occupational health staff members (occupational doctor, public health nurse, clinical psychologist, and human resource management workers). They were asked to complete the harmonized measure and revise the wording if they had difficulty understanding an item, and their feedback was used for further revision. Results from the different stages were combined to create the final measure. For the full version of the Japanese Workplace PERMA-Profiler, please see Appendix 1.

Job and life satisfaction

Job and life satisfaction were measured by questions from the Brief Job Stress Questionnaire (BJSQ)[25)]. This scale has been widely used to assess stress responses in Japan. Job and life satisfaction measures consisted of one item each: 'I am satisfied with my job' and 'I am satisfied with my family life', respectively. The two items are rated on a four-point Likert scale (1 = Dissatisfied, 4 = Satisfied), with higher scores indicating higher satisfaction.

Work engagement

The nine-item Japanese version of the Utrecht Work Engagement Scale (UWES) was used to assess work engagement[26)]. The UWES consists of three subscales: vigor (three items, e.g., 'At my job, I feel strong and vigorous'), dedication (three items, e.g., 'I am enthusiastic about my job'), and absorption (three items, e.g., 'I am immersed in my work'). All items are rated on a seven-point Likert scale (0 = Never, 6 = Always). The reliability and unidimensional validity of the Japanese version of the UWES were confirmed in a previous study[26)]. The scores from each of the nine items were averaged and used for analyses (Cronbach's alpha (α) = 0.96).

Psychological distress

Two scales were used to measure non-specific and specific psychological distress. Non-specific psychological distress was measured by the Japanese version of the K6 scale[27)]. The scale consisted of six items (e.g., 'About how often did you feel nervous?'), asking respondents how often they had experienced symptoms of psychological distress during the last 30 days. All items were rated on a five-point Likert scale (0 = None of the time, 4 = All the time). The reliability and validity of the K6 were confirmed in a previous study[27)]. In this study, the total continuous scores on the Japanese version of the K6 were used for analyses (α = 0.91). Specific types of psychological distress were also measured by questions from the BJSQ[25)]: vigor (three items, e.g., 'I have been very active'; α = 0.93), irritation (three items, e.g., 'I have felt angry'; α = 0.91), fatigue (three items, e.g., 'I have felt extremely tired'; α = 0.91), anxiety (three items, e.g., 'I have felt tense'; α = 0.82), and depression (six items, e.g., 'I have felt depressed'; α = 0.93). The BJSQ has been widely used in Japan to assess responses to stress and has demonstrated satisfactory internal consistency, test-retest reliability, convergent validity, and predictive validity for the onset of depression[28)]. All items are rated on a four-point Likert scale (1 = Almost never, 4 = Almost always).

Work-related psychosocial factors

Job demands (three items, e.g., 'I have an extremely large amount of work to do'; α = 0.83), job control (three items, e.g., 'I can work at my own pace'; α = 0.83), and social support from supervisors (three items, e.g., 'How reliable are your superiors when you are troubled?'; α = 0.84) and colleagues (three items, e.g., 'How freely can you talk with your co-workers?'; α = 0.87) were also measured by the BJSQ[25)]. All items are rated on a four-point Likert scale (for job demands and job control: 1 = Not at all, 4 = Very much so; for social support: 1 = Not at all, 4 = Extremely). Higher scores mean higher job demands, job control, and social support.

Work performance

Work performance was assessed using an item from a validated scale, the Japanese short version of the WHO Health and Work Performance Questionnaire (WHO-HPQ)[29)]. The item rated an individual's overall job performance for the past month on a scale of 0 to 10, with 0 being the worst job performance and 10 being the best. The ratings were multiplied by 10 to calculate work performance according to the WHO-HPQ scoring guidelines.

Analysis

To test reliability, some statistical values (Cronbach's alphas, Intra-class Correlation Coefficients, the Standard Error of Measurement, and the Smallest Detectable Change) of the Japanese version of the Workplace PERMA-Profiler were calculated. Confirmatory factor analysis (CFA) and correlational analysis were conducted to test validity. We used PASW statistics version 18 (IBM SPSS software) and Mplus version 7.4[30)] for each analysis.

Internal consistency

To assess internal consistency, Cronbach's alphas were calculated for the total score and for each factor score (i.e., positive emotion, engagement, relationships, meaning, and accomplishment) of the Japanese Workplace PERMA-Profiler. Based on previous research[31)], the sample size of more than 100 was considered sufficient for methodological quality for Cronbach's alpha. Because a five-factor structure of the measure was confirmed in previous studies[13],[14)], we did not check the dimensionality of the measure but calculated Cronbach's alphas for the total score and each factor score directly.

Test-retest reliability

Intra-class Correlation Coefficients (ICCs) for the total score and each factor score were calculated to assess test-retest reliability across the 1 month period. Although the previous study reported different parameters (Pearson's r) as the standard of test-retest reliability, the sample size can be considered good to excellent when 50-100 participants are recruited in the test-retest reliability analysis[31)]. In addition, the Standard Error of Measurement (SEM) and the Smallest Detectable Change (SDC) were calculated as the standards of measurement error[32]-[34)]. The SEM describes the standard deviation of repeated measures in one participant, and the SDC represents the minimal change that one participant must show on the measure to ensure that the observed change is real and not just measurement error[32)]. The SEM was calculated as (the standard deviation of all testing scores) × √ (1 - ICC)[33],[34)], and the SDC was calculated as 1.96 × √ (2 × SEM)[32)].

Structural validity

To confirm the five-factor structural validity, CFA was conducted among the 15 items, using a robust maximum likelihood estimation in Mplus[30)]. The original five-factor model (each of three items was explained by the five factors) and a one-factor model (all 15 items were explained by one factor) were assumed and tested in several model fit indices: the chi square (χ2), the Comparative Fit Index (CFI), the Tucker-Lewis Index (TLI), the Root Mean Square Error of Approximation (RMSEA), and the Standardized Root Mean Square Residual (SRMR). We considered the model a good fit if the CFI and TLI exceeded 0.95 and the RMSEA and SRMR was less than 0.06[35)]. Based on a previous study[31)], the sample size required for factor analysis was at least five to seven times the number of items, with a minimum of 100. Given that the Japanese version of the Workplace PERMA-Profiler has 15 items, an adequate number of participants (N≥ 105) was recruited in the study.

Convergent validity

Pearson's correlation coefficients (r) among the PERMA factors, job and life satisfaction, work engagement, psychological distress, work-related psychosocial factors, and work performance were calculated to examine convergent validity. The minimum effect size for detection in the study was 0.20 (ρ). Based on a sample size calculation using G*Power version 3.1.9.2[36)], the necessary sample size was estimated to be more than 255 in the case of α error probability of 0.05 and power (1 - β) of 0.90. Therefore, an adequate number of participants was recruited in the study.

Results

Characteristics of participants

A flow chart of the participants is shown in Fig. 1. Because the survey company ceased recruitment once the target number of respondents had been reached, the baseline response rate could not be determined. In the one month follow-up survey, 86 of 100 workers randomly sampled from the baseline participants responded to the questionnaire again (response rate = 86.0%). Because the Internet-based survey required the participants to answer all items, there were no missing values on any variables or items. The demographic characteristics of the participants at baseline and follow-up are shown in Table 2. In the baseline survey (N = 310, 155 men and 155 women, mean age = 44.9 ± 13.6), the majority of the participants had graduated from university (42.6%) or had some college (23.5%). Most participants were full-time (50.3%), day-time workers (90.7%) engaged in occupations such as clerical (22.3%), service (18.1%), or professional/technical jobs (18.1%). Most workers were employed by worksites that had less than 50 workers (47.1%), which covered a wide range of job categories such as services (18.7%), manufacturing (16.5%), and medical/welfare (10.6%). Characteristics of the participants in the follow-up survey (N = 86, 40 men and 46 women, mean age = 45.8 ± 13.0) did not differ from those at baseline, and no significant change was observed.
Fig. 1.
Table 2.

Demographic characteristics of the participants

Baseline Survey(N = 310)Follow-up Survey(N = 86)
n (%)Mean (SD)n (%)Mean (SD)
Gender
Men155 (50.0)40 (46.5)
Women155 (50.0)46 (53.5)
Age44.9 (13.6)45.8 (13.0)
Educational status
Junior high school4 (1.3)0 (0.0)
High school86 (27.7)30 (34.9)
College73 (23.5)19 (22.1)
University132 (42.6)35 (40.7)
Graduate school16 (5.2)2 (2.3)
Employment status
Full-time156 (50.3)47 (54.7)
Part-time91 (29.4)25 (29.1)
Contract/Dispatched28 (9.0)6 (7.0)
Freelance28 (9.0)7 (8.1)
Other7 (2.2)1 (1.2)
Employment shift status
Day shift281 (90.7)79 (91.9)
Rotation/night shift29 (9.4)7 (8.2)
Job type
Managerial26 (8.4)8 (9.3)
Professional/Technical56 (18.1)13 (15.1)
Clerical69 (22.3)21 (24.4)
Sales40 (12.9)5 (5.8)
Services56 (18.1)16 (18.6)
Transport/Construction12 (3.9)2 (2.4)
Production/Skilled31 (10.0)13 (15.1)
Other20 (6.5)8 (9.3)
Job category
Services58 (18.7)20 (23.3)
Manufacturing51 (16.5)16 (18.6)
Medical/Welfare33 (10.6)7 (8.1)
Retail31 (10.0)6 (7.0)
Education20 (6.5)9 (10.5)
Construction20 (6.5)3 (3.5)
Transport16 (5.2)4 (4.7)
Public service15 (4.8)3 (3.5)
Financial/Insurance14 (4.5)5 (5.8)
Information13 (4.2)3 (3.5)
Other39 (12.6)10 (11.6)
Size of worksite
≤49 employees146 (47.1)37 (43.0)
50-299 employees64 (20.6)21 (24.4)
≥300 employees84 (27.1)26 (30.2)
Unknown16 (5.2)2 (2.3)
Demographic characteristics of the participants

Internal consistency and test-retest reliability

Table 3 shows mean scores, Cronbach's alphas (α), ICCs, SEMs, and SDCs for the PERMA factors. Cronbach's alpha coefficients ranged from 0.75 to 0.96. ICCs ranged from 0.77 to 0.88, meaning that approximately 80% of variance in two time measurements was explained by individuals. SDCs ranged from 1.81 to 2.56.
Table 3.

Mean scores, internal consistency, and reliability of the Japanese version of the Workplace PERMA-Profiler (N = 310)

FactorsBaseline Mean (SD)Min-MaxCronbach's alphaFollow-up Mean (SD)Test-retest Reliability (ICC)SMESDC
N = 86. ICC: intra-class correlation coefficient, SME: standard error of measurement, SDC: smallest detectable change. ** p < 0.01
Positive emotion5.46 (2.3)0-100.925.38 (2.4)0.86**0.902.49
P15.32 (2.5)0-105.35 (2.5)0.79**1.163.22
P25.76 (2.4)0-105.49 (2.4)0.82**1.042.89
P35.29 (2.5)0-105.30 (2.6)0.77**1.293.57
Engagement5.86 (2.2)0-100.855.99 (2.1)0.83**0.872.42
E16.05 (2.4)0-106.20 (2.5)0.83**1.002.77
E25.72 (2.4)0-105.85 (2.3)0.76**1.133.14
E35.81 (2.6)0-105.92 (2.5)0.65**1.514.17
Relationships5.59 (2.0)0-100.755.60 (2.0)0.83**0.822.27
R16.03 (2.5)0-105.62 (2.5)0.69**1.343.71
R24.87 (2.3)0-105.28 (2.4)0.70**1.313.64
R35.88 (2.4)0-105.90 (2.6)0.77**1.213.34
Meaning6.24 (2.1)0-100.886.21 (1.9)0.77**0.922.56
M16.85 (2.3)0-106.77 (2.1)0.63**1.253.47
M25.92 (2.4)0-105.91 (2.3)0.65**1.363.77
M35.94 (2.3)0-105.95 (2.2)0.75**1.113.07
Accomplishment6.19 (1.9)0-100.846.29 (2.0)0.77**0.922.56
A15.60 (2.3)0-105.56 (2.2)0.68**1.263.49
A26.25 (2.2)0-106.49 (2.4)0.69**1.293.57
A36.73 (2.1)0-106.84 (2.3)0.63**1.343.71
Happiness6.01 (2.3)0-106.02 (2.6)0.83**1.072.97
Overall well-being (16 items)5.88 (1.8)0-100.965.90 (1.9)0.88**0.651.81
Negative emotion (3 items)4.53 (2.1)0-100.784.48 (2.3)0.79**1.042.88
Health (3 items)5.77 (2.2)0-100.935.57 (2.2)0.87**0.802.23
Loneliness (1 item)4.24 (2.9)0-104.34 (2.8)0.64**1.714.73
Mean scores, internal consistency, and reliability of the Japanese version of the Workplace PERMA-Profiler (N = 310)

Structural validity

The results of CFA are shown in Table 4. Of the one-factor and five-factor models, the original five-factor hypothesized model demonstrated marginally acceptable fit (χ [80] = 351.30, CFI = 0.892, TLI = 0.858, RMSEA = 0.105, SRMR = 0.051). Standardized covariances among the five factors ranged from 0.73 to 0.97, indicating strong correlations. The five-factor model demonstrated the best fit between the two models compared with the one-factor model (Δχ [10] = 297.13, p < 0.05).
Table 4.

Factor loadings of the 15 PERMA items, factor correlations, and model fit in confirmatory factor analyses

ItemsFactor loadingsCorrelation coefficients in the 5-factor model
1-factor model5-factor model
The robust maximum likelihood estimation method was used. *p < 0.05.
P10.87*0.88*F1 (P)F2 (E)F3 (R)F4 (M)F5 (A)
P20.83*0.88*F1 (P)1.00
P3-0.27*0.91*F2 (E)0.94*1.00
E10.84*0.77*F3 (R)0.92*0.78*1.00
E20.76*0.86*F4 (M)0.89*0.97*0.73*1.00
E30.45*0.78*F5 (A)0.90*0.89*0.77*0.95*1.00
R10.75*0.56*Model fit1-factor5-factor
R2-0.21*0.71*χ2 (df)648.43 (90) *351.30 (80) *
R30.68*0.83*CFI0.7050.892
M1-0.070.80*TLI0.6560.858
M2-0.22*0.84*RMSEA (95% CI)0.141 (0.131, 0.152)0.105 (0.094, 0.116)
M30.52*0.87*SRMR0.1000.051
A10.86*0.90*1-factor model vs. 5-factor model: Δχ2 (df)297.13 (10) *
A20.47*0.70*
A30.68*0.67*
Factor loadings of the 15 PERMA items, factor correlations, and model fit in confirmatory factor analyses

Convergent validity

Table 5 shows Pearson's correlation coefficients (r) among the PERMA factors, job and life satisfaction, work engagement, psychological distress, work-related psychosocial factors, and work performance. The overall well-being score and five PERMA factors had strong positive correlations with job satisfaction and work engagement (0.60 ≤ r ≤ 0.82). In addition, they had small to moderate positive correlations with life satisfaction (0.19 ≤ r ≤ 0.34). Moreover, the PERMA factors were moderately negatively correlated with non-specific psychological distress (−0.53 ≤ r ≤ −0.39). With regards to specific types of psychological distress, they had comparatively strong correlations with vigor (0.47 ≤ r ≤ 0.58) and depression (−0.53≤ r ≤ −0.38). Among work-related psychosocial factors, job control and social support were moderately to strongly associated with PERMA factors (0.32 ≤ r ≤ 0.60). Self-reported work performance also had moderate to strong positive associations with the PERMA factors (0.48 ≤ r ≤ 0.73). Only job demands had comparatively weak associations (0.01 ≤ r ≤ 0.20).
Table 5.

Convergent validity (r) of the Japanese version of the Workplace PERMA-profiler (N = 310)

VariablesMean (SD)PERMAOverall
BJSQ: brief job stress questionnaire, UWES: Utrecht work engagement scale, HPQ: health performance questionnaire. *p < 0.05, **p < 0.01.
Workplace PERMA-Profiler
Positive emotion (P)5.46 (2.3)1.00
Engagement (E)5.86 (2.2)0.83**1.00
Relationships (R)5.59 (2.0)0.74**0.64**1.00
Meaning (M)6.24 (2.1)0.79**0.81**0.58**1.00
Accomplishment (A)6.19 (1.9)0.73**0.70**0.59**0.75**1.00
Overall well-being5.88 (1.8)0.94**0.91**0.81**0.89**0.85**1.00
Negative emotion4.53 (2.1)-0.35**-0.21**-0.28**-0.17**-0.25**-0.30**
Health5.77 (2.2)0.50**0.38**0.47**0.41**0.46**0.51**
Loneliness4.24 (2.9)-0.38**-0.34**-0.43**-0.32**-0.31**-0.41**
Satisfaction
Job satisfaction (BJSQ)2.59 (0.9)0.75**0.70**0.60**0.64**0.61**0.76**
Life satisfaction (BJSQ)2.79 (0.9)0.32**0.21**0.34**0.19**0.30**0.32**
Work engagement (UWES)2.79 (1.3)0.77**0.79**0.61**0.72**0.69**0.82**
Psychological distress (K6)6.52 (5.4)-0.53**-0.39**-0.49**-0.42**-0.43**-0.52**
Psychological distress (BJSQ)
Vigor6.45 (2.4)0.58**0.51**0.48**0.51**0.47**0.59**
Irritation6.64 (2.5)-0.31**-0.22**-0.37**-0.15**-0.25**-0.31**
Fatigue6.66 (2.6)-0.41**-0.27**-0.32**-0.26**-0.32**-0.37**
Anxiety6.17 (2.4)-0.35**-0.19**-0.28**-0.21**-0.29**-0.31**
Depression11.03 (4.7)-0.53**-0.38**-0.45**-0.39**-0.42**-0.50**
Job demands (BJSQ)7.73 (2.3)0.040.18**0.010.20**0.010.10
Job control (BJSQ)7.98 (2.4)0.42**0.36**0.27**0.35**0.36**0.40**
Social support from supervisors (BJSQ)7.46 (2.1)0.41**0.34**0.53**0.32**0.33**0.45**
Social support from colleagues (BJSQ)7.32 (2.4)0.45**0.34**0.60**0.35**0.32**0.47**
Work performance (HPQ)61.84 (19.1)0.57**0.54**0.48**0.55**0.73**0.65**
Convergent validity (r) of the Japanese version of the Workplace PERMA-profiler (N = 310)

Discussion

In this study, the Japanese version of the Workplace PERMA-Profiler demonstrated good reliability and convergent validity, with adequate structural validity. Well-being at work was associated with not only health outcomes but also work-related psychosocial factors and work performance. Indeed, the PERMA factors were more strongly related to job satisfaction than to life satisfaction, suggesting that the concepts of the original PERMA-profiler and the Workplace PERMA are critically distinct. This measure could be applicable for assessment of well-being at work among Japanese workers. The measure demonstrated strong internal consistency, and was generally stable over a one month period. Measurement error was low. Meaningful differences in well-being at work could be detected around 2 points within the 11-point Likert scale of the scores, and may be useful for future intervention studies. Convergent validity was also well supported. The effect sizes for health outcomes were consistent with the previous validation study[14)]. In addition, work engagement indicated the strongest positive correlations with the measure, especially with the engagement (E) dimension. The associations with work-related psychosocial factors (job demands, job control, and social support) were also similar with those of work engagement[19)]. Though the relationships with job demands were weak, this can be explained by the job demands-resource model[37)]. In this model, job demands can cause deterioration of mental illness and do not strongly affect positive outcomes (i.e., work engagement). Well-being at work was not strongly correlated with job demands. The PERMA domains were strongly related to job satisfaction and work performance. While the original PERMA-Profiler[14)] had strong positive correlations with life satisfaction and weak positive correlations with work performance, the Workplace PERMA-Profiler had weak correlations with life satisfaction and strong correlations with job satisfaction and work performance. Indeed, the correlations were stronger here than in prior studies[19],[26],[38)]. Future studies should investigate the extent to which the measure can predict future work performance and productivity. The CFA did not completely support the five-factor PERMA model of the measure, and the different factors are strongly correlated with one another. However, the original PERMA-profiler[14)] demonstrated similar values to this study (CFI = 0.894, TLI = 0.864, RMSEA = 0.107). The lack of good model fit could occur for multiple reasons. Seligman[13)] argues that the five PERMA domains are separate, measurable dimensions of well-being. First, the model itself could be wrong, such that while the theory distinguishes different factors, the everyday worker does not. Second, the measure itself could be wrong, such that the current items do not adequately distinguish the five factors. Future studies might further investigate the items, using qualitative interviews and other approaches to better understand how respondents understand each item, and whether the factors can be pulled apart psychometrically. Third, the PERMA model may not be the most appropriate model for workplaces in general, or for the Japanese workplace in particular. Prior workplace wellbeing models have focused on affective (positive and negative emotion), evaluative (job satisfaction), and work engagement dimensions[19],[26],[38)]. The PERMA model further breaks apart these dimensions, which may not be a helpful distinction in the workplace. Still, from a practical perspective, the PERMA domains provide specific areas to intervene (e.g., the quality of one's relationships, one's sense of competence at work), which are more tangible than the broader domains (e.g., overall job satisfaction)[39],[40)]. Future studies might further investigate the multidimensional structure of workplace well-being, the extent to which PERMA versus other well-being models are most appropriate for the workplace in general and within the Japanese culture, as well as possible practical applications of the model. Several limitations exist in this study. First, because the response rate could not be calculated, selection bias might exist. For instance, participants who were unhealthy and had low well-being may have been reluctant to participate in the survey. Second, there could be measurement errors in the assessment of the standards of convergent validity. Third, other confounders not measured in the study might distort the results of correlation analyses, such as psychological capital (e.g., self-efficacy, optimism, and intrinsic motivation). Finally, as mentioned previously, the generalizability of the results for Japanese workers could be questioned due to the use of an online survey. In conclusion, the Japanese version of the Workplace PERMA-Profiler indicated good reliability and validity. This measure could be useful to assess well-being at work, promote well-being research among Japanese workers, and address the problem of defining well-being in further studies. Acknowledgments: This work is supported by the Health and Labor Sciences Research Grant 2015-2017 (H27-Rodo-Ippan-004) from the Ministry of Health, Labour and Welfare, Japan. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. We thank Kiyomi Fujii and Brent Wright for their cooperation in the back-translation of the Japanese version of the Workplace PERMA Profiler. Conflicts of interest: None declared. Supplementary material: This article contains supplementary material (Apendix), which is available in the online version (doi: 10.1539/joh.2018-0050-OA). Click here for additional data file.
  20 in total

1.  The World Health Organization Health and Work Performance Questionnaire (HPQ).

Authors:  Ronald C Kessler; Catherine Barber; Arne Beck; Patricia Berglund; Paul D Cleary; David McKenas; Nico Pronk; Gregory Simon; Paul Stang; T Bedirhan Ustun; Phillip Wang
Journal:  J Occup Environ Med       Date:  2003-02       Impact factor: 2.162

2.  Do workaholism and work engagement predict employee well-being and performance in opposite directions?

Authors:  Akihito Shimazu; Wilmar B Schaufeli; Kazumi Kubota; Norito Kawakami
Journal:  Ind Health       Date:  2012-05-30       Impact factor: 2.179

3.  The performance of the Japanese version of the K6 and K10 in the World Mental Health Survey Japan.

Authors:  Toshi A Furukawa; Norito Kawakami; Mari Saitoh; Yutaka Ono; Yoshibumi Nakane; Yosikazu Nakamura; Hisateru Tachimori; Noboru Iwata; Hidenori Uda; Hideyuki Nakane; Makoto Watanabe; Yoichi Naganuma; Yukihiro Hata; Masayo Kobayashi; Yuko Miyake; Tadashi Takeshima; Takehiko Kikkawa
Journal:  Int J Methods Psychiatr Res       Date:  2008       Impact factor: 4.035

4.  Job strain, work place social support, and cardiovascular disease: a cross-sectional study of a random sample of the Swedish working population.

Authors:  J V Johnson; E M Hall
Journal:  Am J Public Health       Date:  1988-10       Impact factor: 9.308

5.  Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: report of the ISPOR Task Force for Translation and Cultural Adaptation.

Authors:  Diane Wild; Alyson Grove; Mona Martin; Sonya Eremenco; Sandra McElroy; Aneesa Verjee-Lorenz; Pennifer Erikson
Journal:  Value Health       Date:  2005 Mar-Apr       Impact factor: 5.725

6.  The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study.

Authors:  Lidwine B Mokkink; Caroline B Terwee; Donald L Patrick; Jordi Alonso; Paul W Stratford; Dirk L Knol; Lex M Bouter; Henrica C W de Vet
Journal:  Qual Life Res       Date:  2010-02-19       Impact factor: 4.147

7.  The minimal detectable change of the simplified stroke rehabilitation assessment of movement measure.

Authors:  Wen-Shian Lu; Chun-Hou Wang; Jao-Hong Lin; Ching-Fan Sheu; Ching-Lin Hsieh
Journal:  J Rehabil Med       Date:  2008-08       Impact factor: 2.912

8.  Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist.

Authors:  Caroline B Terwee; Lidwine B Mokkink; Dirk L Knol; Raymond W J G Ostelo; Lex M Bouter; Henrica C W de Vet
Journal:  Qual Life Res       Date:  2011-07-06       Impact factor: 4.147

9.  Flourishing Across Europe: Application of a New Conceptual Framework for Defining Well-Being.

Authors:  Felicia A Huppert; Timothy T C So
Journal:  Soc Indic Res       Date:  2011-12-15

10.  Determination and comparison of the smallest detectable change (SDC) and the minimal important change (MIC) of four-shoulder patient-reported outcome measures (PROMs).

Authors:  Derk A van Kampen; W Jaap Willems; Loes W A H van Beers; Rene M Castelein; Vanessa A B Scholtes; Caroline B Terwee
Journal:  J Orthop Surg Res       Date:  2013-11-14       Impact factor: 2.359

View more
  7 in total

1.  Association between personal values in adolescence and mental health and well-being in adulthood: a cross-cultural study of working populations in Japan and the United States.

Authors:  Kazuhiro Watanabe; Norito Kawakami; Daisuke Nishi
Journal:  Ann Gen Psychiatry       Date:  2020-02-11       Impact factor: 3.455

2.  Measuring eudemonic well-being at work: a validation study for the 24-item the University of Tokyo Occupational Mental Health (TOMH) well-being scale among Japanese workers.

Authors:  Kazuhiro Watanabe; Kotaro Imamura; Akiomi Inoue; Yasumasa Otsuka; Akihito Shimazu; Hisashi Eguchi; Hidehiko Adachi; Asuka Sakuraya; Yuka Kobayashi; Hideaki Arima; Norito Kawakami
Journal:  Ind Health       Date:  2019-08-01       Impact factor: 2.179

3.  Positive Psychology: Looking Back and Looking Forward.

Authors:  Carol D Ryff
Journal:  Front Psychol       Date:  2022-03-17

4.  Happiness at Work among Public Relations Practitioners in Spain.

Authors:  José Antonio Muñiz-Velázquez; Alejandro José Tapia Frade; Javier Lozano Delmar; Puri Alcaide-Pulido; Andrés Del Toro
Journal:  Int J Environ Res Public Health       Date:  2022-03-27       Impact factor: 3.390

5.  Buffering the Effects of Burnout on Healthcare Professionals' Health-The Mediating Role of Compassionate Relationships at Work in the COVID Era.

Authors:  Ilaria Buonomo; Paolo Emilio Santoro; Paula Benevene; Ivan Borrelli; Giacomo Angelini; Caterina Fiorilli; Maria Rosaria Gualano; Umberto Moscato
Journal:  Int J Environ Res Public Health       Date:  2022-07-23       Impact factor: 4.614

6.  The Longitudinal Link between Organizational Citizenship Behaviors and Three Different Models of Happiness.

Authors:  Wenceslao Unanue; Eduardo Barros; Marcos Gómez
Journal:  Int J Environ Res Public Health       Date:  2021-06-12       Impact factor: 3.390

7.  Korean translation and validation of the Workplace Positive emotion, Engagement, Relationships, Meaning, and Accomplishment (PERMA)-Profiler.

Authors:  Seong Pil Choi; Chunhui Suh; Jae Won Yang; Byung Jin Ye; Chae Kwan Lee; Byung Chul Son; Maro Choi
Journal:  Ann Occup Environ Med       Date:  2019-08-13
  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.