Literature DB >> 35898622

Associations Between Six Core Processes of Psychological Flexibility and Functioning for Chronic Pain Patients: A Three-Level Meta-Analysis.

Dongyan Ding1, Mengna Zheng1.   

Abstract

The previous research showed contradictions in the relationships between psychological flexibility processes and functioning. This meta-analysis is the first to provide a comprehensive meta-analysis of the associations between six core processes of psychological flexibility and functioning among chronic pain patients. Four databases were searched (PsycINFO; PubMed; CINAHL; Web of Science) along with reference lists. Thirty-six cross-sectional studies were included (7,812 chronic pain patients). A three-level meta-analytic model was used to examine the associations. The publication bias was assessed with the Egger test, funnel plot, and p-curve analysis. Significant associations were found between functioning and six processes of psychological flexibility (i.e., acceptance, defusion, present moment, committed action, self as context, and values). Except for the relationship between defusion and functioning, the relationships between the other five psychological flexibility processes and functioning were all moderated by domains of functioning. No moderators were found regarding age, percentage of females, country, or type of instrument used to measure functioning. These findings may carry significant implications for chronic pain patients and clinical workers. It might be more effective to focus on functioning-related psychological flexibility processes rather than all therapy packages if the relationships between functioning and specific processes of psychological flexibility were better informed. Limitations were also discussed.
Copyright © 2022 Ding and Zheng.

Entities:  

Keywords:  acceptance; acceptance and commitment therapy; chronic pain; meta-analysis; physical functioning; processes of psychological flexibility; psychological functioning

Year:  2022        PMID: 35898622      PMCID: PMC9309299          DOI: 10.3389/fpsyt.2022.893150

Source DB:  PubMed          Journal:  Front Psychiatry        ISSN: 1664-0640            Impact factor:   5.435


Introduction

Chronic pain is one of the most common physical problems all over the world in the general population (1–3) and is a source of distress and disability that affects all aspects of a patient’s life (4, 5). Furthermore, individuals in a state of psychological distress experience more intense pain, leading to a reciprocal reinforcement between psychological distress and pain (5, 6). Chronic pain also costs economically higher than other diseases (4), leading to immense suffering for their families and high costs on our communities and healthcare systems (7). Traditional pain management has been focused mainly on reducing pain and pain-related distress, with pain interference (i.e., functional impairment) being a neglected dimension (8). In treating chronic pain, recent research supports the view that a critical issue concerns the changes necessary to improve physical and psychological functioning (8, 9). One of these views comes from acceptance and commitment therapy (ACT), which defends a greater focus on functioning, and encourages patients to engage with valued activities and meaningful areas even when pain and distress persist (9, 10). The expressed goal of ACT is to increase behaviors in the direction of functionality by increasing psychological flexibility (11, 12). Psychological flexibility refers to an individual’s ability to focus on the present moment, move toward their goals, and persist or change behaviors to serve valued ends (13–15). Actually, the psychological flexibility model of ACT can be seen as a basis for an integrated and progressive psychological approach to chronic pain management (16). This model fully integrates cognitive and environmental influences as the core processes of healthy and problem behaviors (16). As suggested by the psychological flexibility model, pain and suffering are inherent aspects of human life, and the psychological function of pain is central to the analysis (8). It means that a behavioral response is not directly related to the level of pain intensity but rather to its function or meaning for the individual in that particular context (8). Thus, individual functional behavior can be increased by improving psychological flexibility. Actually, many researchers suggested that ACT is more effective than controls (except CBT) in improving functional impairment or increasing values-congruent behaviors (17–19). The previous studies with chronic pain patients have supported the role of the various components of psychological flexibility in reducing disability and functional impairment (20, 21). However, different results also appeared in different studies for the exact relationship between outcome variables. For example, some studies showed that the magnitude of the correlation coefficient between acceptance and functioning was small (22) or medium (23, 24), while in other studies, the effect sizes were large (25, 26). These discrepancies can also be found in the relationship between functioning and other psychological flexibility processes (27, 28). It is worth noting that most studies examining the relationship between psychological flexibility and functioning take psychological flexibility or functioning as a whole. However, the psychological flexibility model is comprised of six core ACT processes, i.e., acceptance, defusion, present moment, self as context, committed action, and values (15). All these six components may have a particular relationship with the functioning of patients with chronic pain. Specifically, acceptance is defined as acknowledging and experiencing unwanted thoughts and feelings without having to follow, reduce, or alter them and has been linked to better functioning in chronic pain patients (29, 30). For chronic pain patients, defusion involves learning to distance themself from pain and distress in order to reduce the influence of these experiences on behavior. The present moment entails flexible awareness and non-judgmental contact with ongoing events. Self as context entails an experience of taking a perspective from which to observe one’s psychological experiences without attachment to them or an investment in which particular experiences occur. Values are chosen qualities of purposive action that we want to achieve and reflect in our behavior. Committed action is the ability to flexibly persist in actions guided by values (15, 31). These six core processes can be fostered in the ACT by different exercises. From the view of the psychological flexibility model, chronic pain patients can relieve the psychological burden or improve their psychological functioning through accepting inner experiences, being mindful, and participating in actions that are aligned with individual goals and values (2, 32). Likewise, many researches have classified functioning into physical and psychological functioning (7, 33). Physical functioning is made up of independent ambulation, mobility, and body care and movement scales, while the psychosocial domain is made up of social interaction, alertness, emotional behavior, and communication (7, 33). To date, no study makes a comprehensive meta-analysis of the relationship between specific mechanisms of psychological flexibility (e.g., acceptance, defusion, present moment, self as context, committed action, and values) and different domains of functioning. Many current researches examined the relationship between psychological flexibility and function without considering their sub-domains. Some researchers thought it is necessary to find which components of therapy work for which type of patient on which outcome/s and try to understand why (34). It would be hard to understand the mechanisms of psychological flexibility for functioning if we take psychological flexibility as a whole. The science and core clinical competencies of ACT also require the understanding of process-based therapy, which refers to contextually specific evidence-based processes associated with evidence-based procedures (35, 36). And the call for process-based therapy suggested that focusing on specific change processes could provide evidence-based methods and make the therapies person-centered to enhance particular people’s physical and psychological health more efficiently (35, 36). A meta-analysis of this subject is essential to understand the basic psychological processes underlying the functioning, which would consequentially form the basis for more robust testing of causal and manipulable relationships. Suppose we knew which process of psychological flexibility is more closely related to the domains of functioning. In that case, we could provide targeted intervention services to chronic pain patients to improve their functioning. Thus, it may have important implications for healthcare professionals, organizations, and patient care. As suggested by the psychological flexibility model, increased psychological flexibility is not intended to reduce pain intensity, while the psychological function of pain is central to the analysis (8). Therefore, we hypothesize that the components of psychological flexibility may be more relevant to psychological functioning than to physical functioning. Besides, some studies suggested associations between psychological factors and functioning may be influenced by culture (37). Hence, we assumed that culture might be a moderating variable. We also considered age and the proportion of females as moderators. The primary aim of this review was to identify and integrate all published findings on associations between different processes of psychological flexibility and domains of functioning, and address an analytic question about the magnitude and direction of the associations among chronic pain patients. A second aim is to determine which variables potentially moderate the relationships. We hypothesized that the following five moderators would systematically influence the effect: (1) the domain of functioning, (2) the age of the target sample, (3) the country, (4) the proportion of females, and (5) the type of measurements of functioning. A third research goal is to address descriptive questions about how these variables are being measured for chronic pain.

Materials and Methods

Selection of Studies

The meta-analysis was reported following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement (38). The first author conducted a search using PsycINFO, PubMed, CINAHL, and Web of Science, all of which were searched on October 1, 2021, and updated on May 27, 2022. No date restrictions were applied to the search to maximize the search strategy. Because acceptance and value are wide-ranging, this study mainly uses instruments that measure them instead of these constructs. Other instruments commonly used to measure psychological flexibility processes were also used in order to minimize potential publication bias. The main search terms used included keywords and free words: [(Acceptance Questionnaire) OR (Valued Living Questionnaire) OR (Chronic Pain Values Inventory) OR (Valuing Questionnaire) OR (Personal Values Questionnaire) OR (Mindful Attention Awareness Scale) OR (Mindfulness) OR (Avoidance and Fusion Questionnaire) OR (Thought Suppression Inventory) OR (Automatic Thought Questionnaire) OR (present moment) OR (committed action) OR (self-as-context) OR (cognitive defusion) OR (psychological inflexibility) OR (psychological flexibility)] AND (functioning OR dysfunction OR (pain disability) OR (pain interference)] AND [(chronic pain) OR fibromyalgia). In addition, reference lists of eligible studies and relevant review articles, as well as relevant meta-analyses were manually searched to minimize potential publication bias. The sample population included chronic pain patients and fibromyalgia patients; One of six core processes of psychological flexibility was measured as well as the functioning (i.e., psychological functioning and/or physical functioning) of the patients. The relationship between processes of psychological flexibility and functioning was reported with Pearson’s r correlation coefficient. Review, meta-analysis, or theoretical articles; Without reporting Pearson’s r correlation coefficient.

Exclusion Criteria

Difficulties in deciding the selection were discussed between the two authors. According to the criteria, any ambiguity about studying eligibility was settled via discussion, and a full consensus was reached between the two authors.

Data Extraction and Coding

Data extraction was performed by the first author and checked by the second author. If there were disagreements, agreements would be reached through a full consultation. Extracted data include: authors and year of publication, country, instruments used to measure processes of psychological flexibility and functioning, study characteristics (e.g., sample size, mean age, and percentage of females), and effect sizes. According to the authors’ definition, processes flexibility was coded as belonging to the six dimensions, i.e., acceptance, defusion, present moment, self as context, committed action, and values. Functioning was coded as three domains, i.e., psychological, physical, and overall functioning. When the total functioning score was used, and psychological or physical functioning was not reported, it would then be classified under the “overall functioning” heading. Besides psychological functioning, emotional and social functioning were also coded as psychological functioning. Physical functioning was coded as physical functioning. We created three dummy variables for domains of functioning: psychological functioning, physical functioning, and overall functioning. The value 1 in these dummy variables is indicative of the specific type of functioning being applicable, whereas the value 0 indicates that the specific type of functioning is not applicable. We also created dummy variables for the type of the measurements of functioning. If the measurement was used only in one effect size, it would be coded as “other” to reduce the number of dummy variables. These dummy variables are mutually exclusive. Directions of these effects were adjusted accordingly within each study. For example, the direction of the relationship between acceptance and dysfunction would be reversely coded to represent the relationship between acceptance and functioning.

Data Analysis

In the present study, a three-level meta-analytic model was used to synthesize effect sizes and conduct moderator analyses to achieve maximum statistical power (39). The three-level model examined three sources of variance: sampling variance of the observed effect sizes (Level 1); variance between effect sizes from the same study (Level 2); and variance between studies (Level 3) (39, 40). Some scholars have noted that heterogeneity can be considered substantial if less than 75% of the total variance can be attributed to level 1 (41). Therefore, potential moderating effects that may impact the overall effect will be examined according to the 75% rule. When a study reported multiple effect sizes due to the multiple instruments used to assess the same construct, all relevant effect sizes would be extracted so that we could control for within-study dependency without reducing the number of effect sizes available in the literature (39). All analyses were conducted in R version 4.1.2 (42), using the meta and metafor package (39). The R syntax was written following related tutorials (41, 43). All model parameters were estimated using the restricted maximum likelihood method. Due to differences in measurement tools, the effect sizes were analyzed using the random-effects model. Individual study effect sizes (r and rs) and sample sizes were entered to calculate pooled effect size estimates (r). All extracted effects were converted to Fisher’s Z-values and weighted by sample size before analysis. These effects were then meta-analyzed, and the results were subsequently converted back to correlations for interpretation (44). In accordance with Cohen’s convention, the magnitude of effect for r is classified as small (0.10), medium (0.30), or large (0.50) with 95% CI. The heterogeneity among the results was tested by the Q test and the I2 test (45, 46). If I2 > 50%, it is considered to have moderate-to-high heterogeneity. Egger test and funnel plot assessed the possibility of publication bias, with significant publication bias as p < 0.1 (45). When it revealed possible publication bias, trim and fill analyses were performed to provide an adjusted average effect size (47) to correct. P-curve analysis was also used to detect selective reporting (48, 49). The p-curve method is based on the distribution of significant p-values of a set of findings. If an actual effect exists, it will skew to the right or the left if selective reporting is prevalent (48, 49).

Results

Description of Studies

Studies Characteristics

Initially, 1,759 citations were identified through searches of electronic bibliographic databases and reference lists. After detecting duplicates and screening titles and abstracts for relevance, 134 articles were identified as potentially eligible for further assessment. After reading the full text of each article, 36 studies met the criteria and were included in this study (see Figure 1 for the details).
FIGURE 1

Study flow diagram.

Study flow diagram. The characteristics of the 36 included studies were summarized in Table 1, from which a total of 109 correlations could be extracted. Sample sizes for included studies ranged from 23 to 555 (total participants = 7,812). Among them, 15 studies were from the United Kingdom, six studies from the United States, four from Spain, Australia, and Sweden, one from Portugal, Singapore, Belgium, Republic of Cyprus, and multi-country (i.e., United States (30.1%), Ireland (30.1%), England (21.13%)]. The mean age of participants in these studies ranged from 14.44 to 69.3. There were 763 adolescents, and most participants were adults (97.67%). The proportion of females ranged from 39.2 to 100%.
TABLE 1

Study characteristics and effect size.

ReferencesCountryMean age% female N Process of PFMeasure(s) of processes of PFMeasure(s) of functioning r
Åkerblom et al. (67)Sweden4172.1462Committed actionCAQ-18SF-360.2
Committed actionCAQ-8SF-360.16
Committed actionCAQ-8SF-360.3
Committed actionCAQ-18SF-360.28
Åkerblom et al. (68)Sweden4171.1315Committed actionCAQMPI-pain interference0.26
AcceptanceCPAQMPI-pain interference0.61
ValuesCPVIMPI-pain interference0.27
DefusionPIPSMPI-pain interference0.43
Beeckman et al. (69)Belgium13.7661.0259DefusionAFQ-YPediatric quality of life inventory0.43
AcceptanceCPAQ-AdolescentPediatric quality of life inventory0.45
Carriere et al. (70)USA47.567354AcceptanceCPAQ-8PROMIS physical functioning item bank0.5
Carvalho et al. (71)Portugal50.4910049ValuesVQPDI0.13
Catala et al. (72)Spain55.91100228DefusionCFQFIQ0.29
Cebolla et al. (73)Spain52.496251Present momentMAASFIQ0.46
Feinstein et al. (23)United States159123DefusionAFQ-YFDI0.35
AcceptanceCPAQ-AdolescentFDI0.38
Fish et al. (74)United States, Ireland, England53.0779.54535DefusionPIPSBPI0.27
AcceptanceCPAQ-8 activity engagementBPI0.5
AcceptanceCPAQ-8 pain willingnessBPI0.34
Foote et al. (24)United States41.588.2103ValuesCPVIMIDAS0.47
AcceptanceCPAQMIDAS0.35
Galán et al. (57)Spain47.2191.9258Committed actionCAQ-8PDI0.35
Gauntlett-Gilbert et al. (75)United Kingdom15.3371.28346AcceptanceCPAQ-A8BAPQ0.53
AcceptanceCPAQ-A8BAPQ0.38
AcceptanceCPAQ-A (full length)BAPQ0.52
AcceptanceCPAQ-A (full length)BAPQ0.35
Gentili et al. (76)Sweden47.481252ValuesVQPII0.38
Graham et al. (77)United Kingdom46.7458.39137DefusionCFQHAQ-DI0.06
ValuesELSHAQ-DI−0.03
Kanzler, et al. (78)United StatesNA42207AcceptanceCPAQOswestry Disability Index (ODI)0.63
McCracken and Zhao-O’Brien (79)United Kingdom42.463.9144AcceptanceCPAQSIP-physical disability0.49
AcceptanceCPAQSIP-psychological disability0.49
McCracken and Jones (80)United Kingdom64.362.540Present momentMAASSIP-physical disability0.49
Present momentMAASSIP-psychological disability0.55
ValuesCPVISIP-physical disability−0.06
ValuesCPVISIP-psychological disability0.19
AcceptanceCPAQSIP-physical disability0.55
AcceptanceCPAQSIP-psychological disability0.59
McCracken and Velleman (21)United Kingdom61.558.2239Present momentMAASSF-36-physical disability0.04
Present momentMAASSF-36-emotional functioning0.48
Present momentMAASSF-36-social functioning0.37
ValuesCPVISF-36-physical disability0.36
ValuesCPVISF-36-emotional functioning0.45
ValuesCPVISF-36-social functioning0.53
AcceptanceCPAQSF-36-physical disability0.41
AcceptanceCPAQSF-36-emotional functioning0.51
AcceptanceCPAQSF-36-social functioning0.55
McCracken and Vowles (81)United Kingdom48.156.5115AcceptanceCPAQSIP-physical disability0.25
ValuesCPVISIP-physical disability0.37
ValuesCPVISIP-psychological disability0.39
AcceptanceCPAQSIP-psychological disability0.4
McCracken et al. (22)United Kingdom43.863159ValuesCPVISIP0.33
Present momentMAASSIP0.1
AcceptanceCPAQSIP0.28
McCracken et al. (59)United Kingdom4369.3150Self as contextEQSIP-physical disability−0.02
Self as contextEQSIP-psychological disability0.47
AcceptanceCPAQSIP-physical disability0.2
Present momentMAASSIP-physical disability0.03
Present momentMAASSIP-psychological disability0.56
ValuesCPVISIP-physical disability0.24
ValuesCPVISIP-psychological disability0.49
AcceptanceCPAQSIP-psychological disability0.51
McCracken et al. (20)United Kingdom47.366.9352Self as contextEQSF-360.01
Self as contextEQSF-360.37
Self as contextEQSF-360.04
Self as contextEQSF-360.32
Nigol and Di Benedetto (82)Australia49.5483.16190Present momentFFMQBrief Pain Inventory (BPI)0.32
Self as contextFFMQBrief Pain Inventory (BPI)0.45
DefusionFFMQBrief Pain Inventory (BPI)0.35
Scott et al. (27)United Kingdom69.361.760AcceptanceCPAQSF-36-physical disability0.32
AcceptanceCPAQSF-36-social functioning0.2
DefusionCFQSF-36-physical disability0.02
DefusionCFQSF-36-social functioning0.21
Committed actionCAQSF-36-physical disability0.27
Committed actionCAQSF-36-social functioning0.25
Self as contextEQSF-36-physical disability−0.09
Self as contextEQSF-36-social functioning0.01
Scott et al. (55)United Kingdom45.2268.3294AcceptanceCPAQ-8Brief Pain Inventory (BPI)0.32
Solé et al. (83)Spain14.4461281DefusionCFQFDI0.3
Trainor et al. (84)Australia4695337AcceptanceBEAQFibromyalgia Impact Questionnaire0.52
Vasiliou et al. (85)Republic of Cyprus57.0881.6160Committed actionCPAQ20Brief pain inventory (BPI)0.41
Committed actionCPAQ8Brief Pain Inventory (BPI)0.42
Waldron et al. (61)United Kingdom14.67254AcceptanceCPAQ-activity engagementBAPQ0.4
AcceptanceCPAQ-activity engagementBAPQ0.34
AcceptanceCPAQ -pain willingnessBAPQ0.19
AcceptanceCPAQ -pain willingnessBAPQ0.2
Present momentCAMMBAPQ0.17
Present momentCAMMBAPQ0.11
Williams and Cano (25)United States58.8447.151Present momentFFMQ-acting with awarenessMPI-pain interference0.31
Self as contextFFMQ-non-judgingMPI-pain interference0.27
DefusionFFMQ-non-reactivityMPI-pain interference−0.05
AcceptanceCPAQMPI-pain interference0.8
DefusionFFMQ-non-judgingMPI-pain interference0.27
Wong et al. (86)United States48.239.297AcceptancePIPSWHYMPI0.4
DefusionPIPSWHYMPI0.24
Yang et al. (87)Singapore45.2756200Committed actionCAQBPI0.26
AcceptanceCPAQ-8BPI0.69
Yu et al. (28)United Kingdom44.7393.3298Self as contextSEQBPI0.26
Yu et al. (26)United Kingdom42.9772.789DefusionCFQ-7BPI0.37
DefusionCFQ-7WSAS0.35
Committed actionCAQ-8BPI0.36
Committed actionCAQ-8WSAS0.4
AcceptanceCPAQ-8BPI0.23
AcceptanceCPAQ-8WSAS0.42
Yu et al. (31)United Kingdom4086.3555Self as contextSEQ-8WSAS0.68
Committed actionCAQ-8WSAS0.67
AcceptanceCPAQ-8WSAS0.61
Zetterqvist et al. (88)Sweden48.775368AcceptancePIPSPDI0.51
DefusionPIPSPDI0.19

r, the correlation coefficient between processes of psychological flexibility and functioning; N, the total sample size; FFMQ, Five facet mindfulness questionnaire; CPAQ, chronic pain acceptance questionnaire; MAAS, mindful attention awareness scale; PIPS, psychological Inflexibility in pain scale; MAAS, mindful attention awareness scale; BEAQ, brief experiential avoidance questionnaire; CFQ, cognitive fusion questionnaire; CPVI, chronic pain values inventory; CAQ, committed action questionnaire; SEQ, self experiences questionnaire; CAMM, child and adolescent mindfulness measure; EQ, experiences questionnaire; AFQ-Y, adolescents completed the avoidance and fusion questionnaire for youth; VQ, valuing questionnaire; ELS, the engaged living scale; MPI, multidimensional pain inventory; PDI, pain disability index; WSAS, work and social adjustment scale; BPI, brief pain inventory; SIP, sickness impact profile; SF-36, short-form health survey; FDI, functional disability inventory; BAPQ, bath adolescent pain questionnaire; HAQ-DI, the Stanford health assessment questionnaire-disability index; FIQ, fibromyalgia impact questionnaire; WSAS, work and social adjustment scale; MIDAS, migraine disability assessment scale; PII, pain interference index; WHYMPI, West Haven-Yale multidimensional pain inventory.

Study characteristics and effect size. r, the correlation coefficient between processes of psychological flexibility and functioning; N, the total sample size; FFMQ, Five facet mindfulness questionnaire; CPAQ, chronic pain acceptance questionnaire; MAAS, mindful attention awareness scale; PIPS, psychological Inflexibility in pain scale; MAAS, mindful attention awareness scale; BEAQ, brief experiential avoidance questionnaire; CFQ, cognitive fusion questionnaire; CPVI, chronic pain values inventory; CAQ, committed action questionnaire; SEQ, self experiences questionnaire; CAMM, child and adolescent mindfulness measure; EQ, experiences questionnaire; AFQ-Y, adolescents completed the avoidance and fusion questionnaire for youth; VQ, valuing questionnaire; ELS, the engaged living scale; MPI, multidimensional pain inventory; PDI, pain disability index; WSAS, work and social adjustment scale; BPI, brief pain inventory; SIP, sickness impact profile; SF-36, short-form health survey; FDI, functional disability inventory; BAPQ, bath adolescent pain questionnaire; HAQ-DI, the Stanford health assessment questionnaire-disability index; FIQ, fibromyalgia impact questionnaire; WSAS, work and social adjustment scale; MIDAS, migraine disability assessment scale; PII, pain interference index; WHYMPI, West Haven-Yale multidimensional pain inventory.

The Measurements

Acceptance was measured with the Chronic Pain Acceptance Questionnaire (CPAQ) and Psychological Inflexibility in Pain Scale (PIPS). Committed action was measured with the Committed Action Questionnaire (CAQ). Cognitive defusion was measured with the Cognitive fusion questionnaire (CFQ), subscales of PIPS, the Avoidance and Fusion Questionnaire for Youth (AFQ-Y), and subscales of the Five Facet Mindfulness Questionnaire (FFMQ). The present moment was measured with the Mindful attention awareness scale (MAAS), the Child and Adolescent Mindfulness Measure (CAMM), and subscales of FFMQ (i.e., acting with awareness). Self as context was measured with Experiences Questionnaire (EQ), Self-experiences questionnaire (SEQ), and FFMQ-non-judgment (50). Values were measured with the Chronic Pain Values Inventory (CPVI), the Valuing Questionnaire (VQ), and the Engaged living scale (ELS). Functional impairment mainly was measured with the Brief Pain Inventory-functional impairment subscale (BPI), Sickness Impact Profile (SIP), Short-Form Health Survey (SF-36), Pain Disability Index (PDI), Functional Disability Inventory (FDI), Fibromyalgia impact questionnaire (FIQ), and Multidimensional Pain Inventory (MPI).

Meta-Analyses

Acceptance and Functioning

Aggregating across 39 correlations in 24 studies that examined the relationship between acceptance and functioning, the overall effect size was statistically significant and medium to large (r = 0.48, 95% CI = 0.42, 0.54, p < 0.001; I = 83.89%, Q = 198.83, df = 38, p < 0.001). The results were presented in a forest plot in Figure 2.
FIGURE 2

Forest plot of effect size (r) for the relationship between acceptance and functioning.

Forest plot of effect size (r) for the relationship between acceptance and functioning. There were significant variances within the same studies (i.e., level 2 variance) and between studies (i.e., level 3 variance). The details can be seen in Table 2. Therefore, moderator analyses were conducted in order to determine variables that can explain level 2 and level 3 variance. Moderating effects of mean age, percentage of females, country, domains of functioning, and type of measurements of functioning have been evaluated separately in univariate models. We found a significant moderating effect of the domains of functioning on the association, as shown by the results of the omnibus test (F(2,36) = 6.63, p < 0.01). The mean effect of association between acceptance and overall functioning (r = 0.59, 95% CI = 0.49, 0.69, p < 0.001) and psychological functioning (r = 0.52, 95% CI = 0.40, 0.64, p < 0.001) were both significantly larger than that association of acceptance and physical functioning (r = 0.38, 95% CI = 0.22, 0.53, p < 0.01). However, there was no significant difference in the association between acceptance and psychological functioning and overall functioning. No significant moderating effects were found for the percentage of females, mean age, country, and type of functioning measurements.
TABLE 2

Results for the overall mean effect sizes of the relationship between six processes and functioning.

Processes of PF# Studies# ESMean r95% CI% var. at level 1Level 2 variance% Var. at level 2Level 3 variance% Var. at level 3
Acceptance24390.480.42, 0.5413.990.01*25.890.02**60.12
Committed action8140.320.26, 0.3937.390.0013.310.0149.30
Defusion13160.270.20, 0.3442.430.000.000.0157.57
Present moment8130.310.19, 0.4315.710.04**85.270.000.00
Self as context7120.210.08, 0.3311.120.03**88.880.000.00
Values10150.310.20, 0.4120.430.0131.230.0248.34

PF, psychological flexibility; # Studies, number of studies; # ES, number of effect sizes; CI, confidence interval; Sig, significance; Mean r, Mean effect size expressed as a Pearson’s correlation; Var, variance; Level 1 variance, sampling variance of observed effect sizes; Level 2 variance, variance between effect sizes extracted from the same study; Level 3 variance, variance between studies; *p < 0.05; **p < 0.01.

Results for the overall mean effect sizes of the relationship between six processes and functioning. PF, psychological flexibility; # Studies, number of studies; # ES, number of effect sizes; CI, confidence interval; Sig, significance; Mean r, Mean effect size expressed as a Pearson’s correlation; Var, variance; Level 1 variance, sampling variance of observed effect sizes; Level 2 variance, variance between effect sizes extracted from the same study; Level 3 variance, variance between studies; *p < 0.05; **p < 0.01. There was no publication bias in Egger tests and Funnel plot (p > 0.1) on the relationship between acceptance and functioning. Both the full p-curve and the half p-curve test were significant with p < 0.0001 (Z = −31.74, Z = −30.62), which indicated that the distribution of p-values is significant right-skewed, as seen in Figure 3. Hence, the results further support the initial assessment that evidential value is present in the literature.
FIGURE 3

The p-Curve for statistically significant results on the relationship between acceptance and functioning. The observed p-curve includes 35 statistically significant (p < 0.05 results, of which 35 are p < 0.025. There were four additional results entered but excluded from p-curve because they were p > 0.05.

The p-Curve for statistically significant results on the relationship between acceptance and functioning. The observed p-curve includes 35 statistically significant (p < 0.05 results, of which 35 are p < 0.025. There were four additional results entered but excluded from p-curve because they were p > 0.05.

Committed Action and Functioning

Aggregating across 14 correlations that examined the relationship between committed action and functioning, the overall effect size was statistically significant and medium (r = 0.32, 95% CI = 0.26, 0.39, p < 0.001; I = 61.20%, Q = 35.04, df = 14, p < 0.01). The results were presented in a forest plot in Figure 4.
FIGURE 4

Forest plot of effect size (r) for the relationship between committed action and functioning.

Forest plot of effect size (r) for the relationship between committed action and functioning. There were no significant variances within level 2 and level 3. However, the variance within level 1 was less than 75% (i.e., 37.39), then moderator analyses were conducted. We found a significant moderating effect of the domains of functioning on the association, as shown by the results of the omnibus test (F(2,11) = 4.01, p < 0.05). The relationship of committed action with overall functioning (r = 0.38, 95% CI = 0.31, 0.45, p < 0.001) was significantly larger than that with psychological functioning (r = 0.24, 95% CI = 0.13, 0.34, p < 0.001). but there was no significant difference between the mean effect of overall functioning and physical functioning (r = 0.25, 95% CI = 0.14, 0.35, p < 0.001). The domain of functioning was the main source of heterogeneity. After it was included to analysis, the heterogeneity was significantly reduced (Q = 17.32, df = 11, p > 0.05). There was no publication bias in Egger tests and Funnel plot (p > 0.1) on the relationship between acceptance and functioning. Both the full p-curve and the half p-curve test were significant with p < 0.0001 (Z = −14.19, Z = −14.29), which indicated that the distribution of p-values is significant right-skewed, as seen in Figure 5. Hence, the results further support the initial assessment that evidential value was present in the literature.
FIGURE 5

The p-Curve for statistically significant results on the relationship between committed action and functioning. The observed p-curve includes 13 statistically significant (p < 0.05) results, of which 12 are p < 0.025. There was one additional result entered but excluded from p-curve because it was p > 0.05.

The p-Curve for statistically significant results on the relationship between committed action and functioning. The observed p-curve includes 13 statistically significant (p < 0.05) results, of which 12 are p < 0.025. There was one additional result entered but excluded from p-curve because it was p > 0.05.

Defusion and Functioning

Aggregating across 16 correlations in 13 studies that examined the relationship between defusion and functioning, the overall effect size was statistically significant and nearly medium (r = 0.27, 95% CI = 0.20, 0.34, p < 0.001; I = 57.66%, Q = 34.07, df = 15, p < 0.01). The results were presented in a forest plot in Figure 6.
FIGURE 6

Forest plot of effect size (r) for the relationship between defusion and functioning.

Forest plot of effect size (r) for the relationship between defusion and functioning. There was no significant variance within level 2 and level 3. Moderating effects of mean age, percentage of females, country, domains of functioning, and type of functioning measurements did not exist for the relationship between defusion and functioning. There was no publication bias in Egger tests and Funnel plot (p > 0.1) on the relationship between acceptance and functioning. Both the full p-curve and the half p-curve test were significant with p < 0.0001 (Z = −10.82, Z = −10.32), which indicated that the distribution of p-values is significant right-skewed as seen in Figure 7. Hence, the results further support the initial assessment that evidential value is present in the literature.
FIGURE 7

The p-Curve for statistically significant results on the relationship between defusion and functioning. The observed p-curve includes 10 statistically significant (p < 0.05) results, of which 10 are p < 0.025. There were 6 additional results entered but excluded from p-curve because they were p > 0.05.

The p-Curve for statistically significant results on the relationship between defusion and functioning. The observed p-curve includes 10 statistically significant (p < 0.05) results, of which 10 are p < 0.025. There were 6 additional results entered but excluded from p-curve because they were p > 0.05.

Present Moment and Functioning

There were 13 correlations in seven studies that examined the relationship between present moment and functioning. The overall effect size was statistically significant and medium (r = 0.31, 95% CI = 0.19, 0.43, p < 0.001; I = 84.29%, Q = 79.70, df = 12, p < 0.001). The results were presented in a forest plot in Figure 8.
FIGURE 8

Forest plot of effect size (r) for the relationship between present moment and functioning.

Forest plot of effect size (r) for the relationship between present moment and functioning. There was significant variance within the same studies (i.e., level 2 variance), while there was no significant variance between studies (i.e., level 3 variance). The details can be seen in Table 2. Moderator analyses were conducted in order to determine variables that can explain level 2 variance. We found a significant moderating effect of the domains of functioning on the association, as shown by the results of the omnibus test (F(2,10) = 5.34, p < 0.05). The mean effect of the relationship between present moment and psychological functioning (r = 0.49, 95% CI = 0.29, 0.68, p < 0.001) was substantially larger than the association of present moment and physical functioning (r = 0.13, 95% CI = −0.08, 0.35, p > 0.05). No significant moderating effect was found for the percentage of females, mean age, country, and type of functioning measurements. There was no publication bias in Egger tests and Funnel plot (p > 0.1) on the relationship between the present moment and functioning. Both the full p-curve and the half p-curve test were significant with p < 0.0001 (Z = −12.54, Z = −11.52), which indicated that the distribution of p-values is significant right-skewed, as seen in Figure 9. Hence, the results further support the initial assessment that evidential value is present in the literature.
FIGURE 9

The p-Curve for statistically significant results on the relationship between present moment and functioning. The observed p-curve includes 8 statistically significant (p < 0.05) results, of which 8 are p < 0.025. There were five additional results entered but excluded from p-curve because they were p > 0.05.

The p-Curve for statistically significant results on the relationship between present moment and functioning. The observed p-curve includes 8 statistically significant (p < 0.05) results, of which 8 are p < 0.025. There were five additional results entered but excluded from p-curve because they were p > 0.05.

Self as Context and Functioning

There were 12 correlations in seven studies that examined the relationship between self as context and functioning. The overall effect size was significant (r = 0.21, 95% CI = 0.08, 0.33, p < 0.01; I = 88.88%, Q = 83.72, df = 11, p < 0.001). The results were presented in a forest plot in Figure 10.
FIGURE 10

Forest plot of effect size (r) for the relationship between self as context and functioning.

Forest plot of effect size (r) for the relationship between self as context and functioning. There was significant variance within the same studies (i.e., level 2 variance), while there was no significant variance between studies (i.e., level 3 variance). The details can be seen in Table 2. There was a significant moderating effect of the domain of functioning on the association, as shown by the results of the omnibus test (F(2,10) = 29.56, p < 0.001). The mean effect of the relationship between self as context and overall functioning (r = 0.30, 95% CI = 0.19, 0.41, p < 0.001) and psychological functioning (r = 0.33, 95% CI = 0.19, 0.48, p < 0.001) was substantially larger than that association with physical functioning (r = −0.02, 95% CI = −0.17, 0.13, p > 0.05). No significant moderating effect was found for the percentage of females, mean age, country, type of functioning measurements. There was no publication bias in Egger test, Funnel plot (p > 0.1), and trim-and-fill analyses. Both the full p-curve and the half p-curve test were significant with p < 0.0001 (Z = −13.15, Z = −12.83), which indicated that the distribution of p-values is significant right-skewed, as seen in Figure 11. Hence, the results further support the initial assessment that evidential value is present in the literature.
FIGURE 11

The p-Curve for statistically significant results on the relationship between self and context and functioning. The observed p-curve includes three statistically significant (p < 0.05) results, of which three are p < 0.025. There were four additional results entered but excluded from p-curve because they were p > 0.05.

The p-Curve for statistically significant results on the relationship between self and context and functioning. The observed p-curve includes three statistically significant (p < 0.05) results, of which three are p < 0.025. There were four additional results entered but excluded from p-curve because they were p > 0.05.

Values and Functioning

There were fifteen correlations in ten studies that examined the relationship between values and functioning. The overall effect size was statistically significant and medium (r = 0.31, 95% CI = 0.20, 0.41, p < 0.01; I = 79.78%, Q = 58.23, df = 15, p < 0.001). The results were presented in a forest plot in Figure 12.
FIGURE 12

Forest plot of effect size (r) for the relationship between values and functioning.

Forest plot of effect size (r) for the relationship between values and functioning. There was no significant variance within the same studies (i.e., level 2 variance) and between studies (i.e., level 3 variance). The details can be seen in Table 2. We found a significant moderating effect of the domains of functioning on the association, as shown by the results of the omnibus test (F(2,12) = 4.66, p < 0.05). The relationship between values and psychological functioning (r = 0.45, 95% CI = 0.34, 0.55, p < 0.05) was substantially larger than the association of values and physical functioning (r = 0.27, 95% CI = 0.04, 0.48, p < 0.05). No significant moderating effects were found for the percentage of females, mean age, country, and type of functioning measurements. There was no publication bias in Egger tests (p > 0.1) and the Funnel plot. Both the full p-curve and the half p-curve test were significant with p < 0.001 (Z = −15.41, Z = −14.85), which indicated that the distribution of p-values is significant right-skewed, as seen in Figure 13. Hence, the results further support the initial assessment that evidential value is present in the literature.
FIGURE 13

The p-Curve for statistically significant results on the relationship between values and functioning. The observed p-curve includes 11 statistically significant (p < 0.05) results, of which 11 are p < 0.025. There were four additional results entered but excluded from p-curve because they were p > 0.05.

The p-Curve for statistically significant results on the relationship between values and functioning. The observed p-curve includes 11 statistically significant (p < 0.05) results, of which 11 are p < 0.025. There were four additional results entered but excluded from p-curve because they were p > 0.05.

Discussion

The present meta-analytic study aimed to estimate an overall association between functioning and six processes of psychological flexibility (i.e., acceptance, defusion, present moment, self as context, committed action, and values). A second aim was to assess whether the strength of these associations is influenced by domains of functioning, type of measurements of functioning, age of sample, country, and the proportion of females. In general, higher levels of psychological flexibility processes are significantly associated with higher levels of functioning. Except for the relationship between defusion and functioning, the relationships between the other five psychological flexibility processes and functioning were all moderated by domains of functioning. Specifically, the strength of the relationship between committed action and overall functioning exceeds its associations with psychological functioning. Also, the strength of the relationship between acceptance/self as context and overall functioning exceeds their associations with physical functioning. Besides, the mean effect of the relationship between acceptance/present moment/self as context/values and psychological functioning exceeds their associations with physical functioning. It was worth noting that the mean effect of the association between the present moment and physical functioning was not significant. Acceptance is fostered as a behavioral response to pain and distress that cannot be directly changed to engage in meaningful but potentially painful activities (8). Thus, chronic pain patients with high acceptance could be more likely to accept their negative emotions and life events, and would not waste time on events or behaviors that are worthless, i.e., having high functioning. A prospective study found patients who reported greater acceptance at the base time would report better functioning in the future, which suggested that willingness to experience pain and accept it can lead to healthy functioning for chronic pain patients (51). In addition, acceptance is more related to overall and psychological functioning than physical functioning. It is not surprising, as there is a strong correlation between acceptance and an individual’s emotional or mental health (52, 53), and some scholars thought that acceptance alone is a better predictor of psychopathology and well-being than other variables (53). A randomized controlled trial found that acceptance and value clarification could improve participants’ social interaction after experiencing stressful social situations (54). The previous studies and present study both suggested that acceptance is strongly related to psychological functioning in patients with chronic pain. Enhancing personal acceptance may also mean enhancing individual psychological functioning. It may be due to the instruments used to measure overall functioning, such as the BPI (55), as the relationship between acceptance and overall functioning is also stronger than the association between acceptance and physical functioning. The BPI contains seven areas, including emotions and social and physical functioning, and emotions are closely associated with acceptance (52, 53). Committed action is the ability to build and flexibly adhere to actions guided by values (56). As a behavior pattern oriented toward valued living, committed action may be important for the adaptive adjustment to pain in chronic pain patients (57, 58). Thus, if chronic pain patients have a high level of committed action, they may stay with the behavior or action that is useful to them (e.g., engaging in some recovery training or exercise) and would have a high level of physical functioning. In the present study, the relationship between committed action and physical functioning was higher than the association between committed action and psychological flexibility. However, there was no significant difference which may be due to the small number of studies included. Thus future studies should investigate whether there are differences between the two. The relationship between overall functioning and committed action was significantly higher than the association between psychological functioning and committed action, which may be due to the measurement of overall functioning aforementioned. Also, cognitive defusion encourages patients to disengage or step back from thoughts and view them as what they are (i.e., merely cognitive events) rather than reality to reduce their impact on behavior (8). It was argued that defusion and acceptance loaded onto a single factor (58). Both processes relate to the willingness to deal with difficult experiences when attempts for change are ineffective or lead to further problems (58). Therefore, patients with greater defusion could lead to healthier functioning. Previous studies also suggested that chronic pain patients with a greater capacity to take a detached view of their own thoughts and emotional experiences (i.e., cognitive defusion) were more likely to suffer less and have better functioning (59). McCracken and colleagues argued being more mindful or contacting the present moment can lead to a more “balanced, non-reactive and realistic” relationship to pain experiences (60). The present moment involves purposeful, non-judgmental, and fluid focus on present experiences (58, 61), which are not all directly related to pain but rather the processes of acceptance and the present moment play important roles in the suffering and functioning of chronic pain (60). Furthermore, chronic pain patients’ functioning can also be predicted by acceptance and present moment (60). Thus, the higher present moment is associated with higher functioning. However, in this study, we further found that physical functioning has a non-significant association with the present moment, while the present moment has a medium to large relationship with psychological functioning. A systematic review, which examined physical functioning and mindfulness skills training in chronic pain, suggested that contacting the present moment has no efficacy on physical functioning (62), while it has an important role in psychological functioning (63). These were consistent with our study. In the present study, there was a small positive relationship between self as context and functioning. It should be noted that there was a small negative relationship between self as context and physiological function, but it was not significant. Self as context entails an experience of taking a perspective from their thoughts and feelings and distancing oneself from their thoughts and feelings, but it does not guide the patient’s behavior. Thus, self as context has a strong relationship with depression and can predict emotional functioning (28). And this may be the reason why the association between psychological/overall functioning and self as context were high than that with physical functioning. Values can help chronic pain patients identify directions for meaningful activities essential to living (58). Treatment programs from ACT theoretical framework found that increased engagement in valued activities was significantly associated with greater improvement in psychological functioning but was not related to change in physical functioning at post-treatment (64). Thus, enhanced values orientation can have a more critical impact on psychological functioning than physical functioning. That may be why values have a higher relationship with psychological functioning in our analysis. The hypothesized moderating effects (i.e., the percentage of females, mean age, country, and type of functioning measurements) were not found in this study, except for domains of functioning. The relatively narrow age range of participants in this study, which included only five studies that focused on adolescents, may limit detecting a real moderating effect of age on the associations. Also, most studies have focused on Europe and the United States, with very few studies on Asia (only one), so it would be difficult to identify the moderating role of culture. Therefore, future research in different cultural contexts is highly recommended, especially in Asia. As no known studies have made a comprehensive meta-analysis of the relationship between specific processes of psychological flexibility (e.g., acceptance, defusion, present moment, self as context, committed action, and values) and different domains of functioning (i.e., physical functioning, psychological functioning, and overall functioning), the main strength of the current study lies in addressing this gap in the literature. The findings of this study produced more knowledge on the true associations between variables as well as contradictions or variances between studies. This study offers a possible explanation for why a particular therapy is more effective and can help researchers understand what is most important to pain patients and what might be more effective in improving their functioning. Knowing the relationship between the processes of psychological flexibility and functioning allows process-based therapy to be tailored to chronic pain patients. Patients can be better and more effectively served by emphasizing functioning-related psychological flexibility processes when designing intervention programs. The current study suggests that the ACT programs that focused on acceptance, committed action, the present moment, and values would be more recommendable or applicable to patients with chronic pain, because these processes have a medium to large relationship with functioning. Also, further study is needed to understand factors that influence functioning in attempting to mitigate functional impairment for chronic pain patients. Although this study provided a conceptual and empirical basis for future work, there were some limitations. First, a major weakness of this meta-analysis is that the methodological quality of the studies was not rated. It was suggested that rating would be difficult due to the lack of clear methodological standards and relevant detail in the methods sections of these studies (56, 65). This study excluded unpublished studies, providing a general approach to ensure methodological quality, but also raising the risk of publication bias affecting the results. A more comprehensive search of the published and unpublished literature may be helpful for further research in this area. Second, the studies included were based on cross-sectional research, so the direction of causality remains unclear. Based on these findings, we cannot determine, for example, whether acceptance influences functioning, functioning influences acceptance, or (more likely) these factors have mutual influence. In addition, self-report data were used in included studies, which may lead to the inflationary effects of common method variance. Thus, the results need to be interpreted with caution. Longitudinal or experimental studies in which psychological flexibility processes are manipulated are needed to evaluate its potential causal impact on chronic pain patients’ functioning. Third, psychological flexibility and psychological inflexibility are two different concepts (50, 66) that were simplified in this study by reversing the results of measuring inflexibility to represent flexibility due to the limited number of available studies. Future research could explore the relationship between the different dimensions of psychological inflexibility and flexibility (i.e., the 12 dimensions) and domains of functioning. Besides, the current meta-analysis only examined gender, region, percentage of females, type of instruments, and domains of functioning as potential moderators. Other potential moderating variables (e.g., education level, family economic status) have not been analyzed and should be further explored in the future to investigate the role of other potential moderating variables in the relationship between functioning and psychological flexibility processes. Furthermore, region and culture are different, and the regional coding does not fully reflect the cultural context. Future research should explore a better way to code the cultural context. Finally, the number of some effect sizes of the moderation variables in the current meta-analytic studies are small, which may impact the results.

Data Availability Statement

The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Author Contributions

DD conceived and designed the analysis, collected the data, performed the analysis, and wrote the manuscript. MZ supported the data collecting, reviewed the included studies, and assisted in data analysis. Both authors contributed to the article and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
  74 in total

Review 1.  How do mindfulness-based cognitive therapy and mindfulness-based stress reduction improve mental health and wellbeing? A systematic review and meta-analysis of mediation studies.

Authors:  Jenny Gu; Clara Strauss; Rod Bond; Kate Cavanagh
Journal:  Clin Psychol Rev       Date:  2015-01-31

2.  Decentering, rumination, cognitive defusion, and psychological flexibility in people with chronic pain.

Authors:  Lance M McCracken; Estelle Barker; Joseph Chilcot
Journal:  J Behav Med       Date:  2014-05-17

3.  Acceptance alone is a better predictor of psychopathology and well-being than emotional competence, emotion regulation and mindfulness.

Authors:  Ilios Kotsou; Christophe Leys; Pierre Fossion
Journal:  J Affect Disord       Date:  2017-09-25       Impact factor: 4.839

Review 4.  Associations between rejection sensitivity and mental health outcomes: A meta-analytic review.

Authors:  Shuling Gao; Mark Assink; Andrea Cipriani; Kangguang Lin
Journal:  Clin Psychol Rev       Date:  2017-08-15

5.  Construct validity of the G-CPAQ and its mediating role in pain interference and adjustment.

Authors:  Vasilis S Vasiliou; Maria Karekla; Michalis P Michaelides; Orestis Kasinopoulos
Journal:  Psychol Assess       Date:  2017-04-03

6.  The Sickness Impact Profile: development and final revision of a health status measure.

Authors:  M Bergner; R A Bobbitt; W B Carter; B S Gilson
Journal:  Med Care       Date:  1981-08       Impact factor: 2.983

7.  Committed Action, Disability and Perceived Health in Individuals with Fibromyalgia.

Authors:  Santiago Galán; Rubén Roy; Ester Solé; Mélanie Racine; Rocío de la Vega; Mark P Jensen; Jordi Miró
Journal:  Behav Med       Date:  2018-05-22       Impact factor: 3.104

8.  Efficacy of Online-Based Acceptance and Commitment Therapy for Chronic Pain: A Systematic Review and Meta-Analysis.

Authors:  Inês A Trindade; Raquel Guiomar; Sérgio A Carvalho; Joana Duarte; Teresa Lapa; Paulo Menezes; Maria Rita Nogueira; Bruno Patrão; José Pinto-Gouveia; Paula Castilho
Journal:  J Pain       Date:  2021-04-20       Impact factor: 5.820

9.  A Clinical Pilot Study of Individual and Group Treatment for Adolescents with Chronic Pain and Their Parents: Effects of Acceptance and Commitment Therapy on Functioning.

Authors:  Marie Kanstrup; Rikard K Wicksell; Mike Kemani; Camilla Wiwe Lipsker; Mats Lekander; Linda Holmström
Journal:  Children (Basel)       Date:  2016-11-16

10.  The Psychological Functioning in the COVID-19 Pandemic and Its Association With Psychological Flexibility and Broader Functioning in People With Chronic Pain.

Authors:  Lin Yu; Kitty Kioskli; Lance M McCracken
Journal:  J Pain       Date:  2021-03-04       Impact factor: 5.820

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.