Establishing best practices in cancer online support groups: protocol for a realist review.

INTRODUCTION: Considerable observational evidence suggests that cancer online support groups reduce feelings of isolation, depression and anxiety, enhance coping and self-management, and lead to better informed patients. Other studies indicate that cancer online support groups can increase distress. Yet no studies theorise the complex, context-dependent mechanisms by which cancer online support groups generate their-sometimes contrasting-outcomes. METHODS AND ANALYSIS: Guided by an integrated knowledge translation approach and the strategy for patient-oriented research, we will conduct a realist review of cancer online support groups in partnership with stakeholders. We will follow Pawson's five steps and existing quality standards to develop a program theory that explains how cancer online support groups work, for whom and in what circumstances. The specific research questions will be: what positive and negative outcomes have been reported on cancer online support groups? What are the mechanisms that are associated with these outcomes, in which contexts and for whom? Through a rigorous review of relevant scientific and grey literature, as well as ongoing dialogue with stakeholders, a program theory will be developed to explain who benefits from cancer online support groups and who does not, what benefits they derive (or do not), and the factors that affect these outcomes. ETHICS AND DISSEMINATION: The use of secondary data for this review precludes the need for ethical approval. Dissemination will be informed by the knowledge-to-action framework and will consist of tailored knowledge products that are conceived of collaboratively with stakeholders. These will include peer-reviewed publications on how cancer online support groups can be optimised and best practice recommendations to maximise the benefits experienced by people with cancer. These traditional scientific outputs, along with their respective evidence summaries, will be amplified through strategic social media events hosted and promoted by knowledge users. PROSPERO REGISTRATION NUMBER: CRD42021250046. © Author(s) (or their employer(s)) 2021. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

This will be the first realist review to explore how cancer online support groups work, in what circumstances, for whom and why.

The realist approach will help to uncover the context-dependent mechanisms by which cancer online support groups generate their outcomes.

Involvement of stakeholders and patient partners will ensure relevance of the program theory and knowledge products.

The predominance of literature on breast cancer online support groups may limit the generalisability of findings.

Introduction

Cancer is the leading cause of death, premature death and years of life lost worldwide.1 In 2020, 19.3 million people were diagnosed with cancer, and 9.6 million died from it.2 The number of new cases of cancer is expected to increase to 30.2 million by 2040.2 With advances in detection and treatment, it is estimated that over two-thirds of people who are diagnosed with cancer will become long-term survivors.2

Although survival rates continue to improve, the diagnosis and treatment of cancer is associated with multiple physical and psychosocial challenges that can reduce overall quality of life.3 4 Yet, many patients and survivors struggle with the effects of cancer and its treatment without much professional help or support.5 6 As a result, many cancer patients and survivors report being dissatisfied with the information they receive from healthcare professionals7 and experience high levels of unmet supportive care needs.8 9 Addressing the supportive care needs of the growing population of cancer patients and survivors will require innovative strategies and delivery methods.5 6

Cancer patients and survivors may be able to address many of their supportive care needs with support from peers.10 11 Peer support is an important complement to the supportive care provided by health professionals and is highly valued by patients with cancer,12 13 even for those with support from family and friends.14 Support from other patients with cancer and survivors provides reassurance, practical know-how and emotional support that cannot be gained from other supportive relationships.15 Further, research has shown that social support has a direct effect on physical and mental health, and may extend cancer survival.16

Online support groups offer a promising means of reaching a wider segment of cancer patients and survivors at a reduced cost.10 Online support groups, also known as online communities, are virtual social spaces where people with a common condition or shared interests come together to get and give information and support, to learn or to find company.17 They may be independent discussion forums or embedded within popular social media platforms, like Facebook and Twitter. Some of them are moderated by community managers or health professionals; others are not. Research suggests that as many as one in four cancer patients and survivors will turn to online support groups to seek information and support from peers.11

Considerable observational evidence suggests that online support groups reduce feelings of isolation, depression and anxiety, and enhance knowledge, coping and self-management among cancer patients and survivors.18–24 Studies also suggest that adding an online support group to a digital health intervention can reduce attrition, enhance engagement and increase effect sizes.25 26 However, online support groups are not risk-free. A randomized controlled trial (RCT) comparing an unmoderated online support group for newly diagnosed patients with breast cancer reported an increase in distress among participants in the intervention group.27 Paradoxically, 60% of participants reported high levels of satisfaction with the online support group and some took the initiative to establish an online support group of their own after the study had ended.

Overall, there is a lack of clear evidence on the effects of cancer online support groups, along with how and why they work or do not work. Prior systematic reviews of cancer online support groups have found a heterogeneous evidence base and few have examined their underlying mechanisms.28–31 A 2017 systematic review of six RCTs of breast cancer online support groups found a small to moderate reduction in depression among online support group users compared with controls, and no significant improvements in anxiety or quality of life.31 No differences in outcomes in online support groups led by peers compared with those led by health professionals were found. However, the qualitative data collected in many of the trials highlighted benefits experienced by the participants that were not captured by the self-report measures. These findings suggest that online support groups are complex, what works for one person or in one setting may not work for others or in other settings. Further, they indicate a need to explore the choice of outcomes measured.

In sum, there is a clear need, which has been confirmed by the knowledge users and patient partners on the project team, for a better understanding of how and why cancer online support groups work in order to optimise their effects. A realist review can address these questions and has been successfully used to help explain how other complex healthcare interventions can be optimised.32–35 However, no realist reviews on the subject have been found. Our project intends to address this knowledge-to-practice gap.

Study design

We will conduct a realist review to investigate how and why cancer online support groups work, in what circumstances and for whom. A realist review is a theory-driven systematic review of the literature that is useful for making sense of diverse outcome patterns from complex, underconceptualised topics with a heterogeneous evidence base.36 Traditional systematic reviews are limited in their ability to unpack conflicting evidence from heterogeneous studies, and cannot always explain which intervention components are responsible for which effects.37 Realist reviews aim to build and test theories that explain how complex interventions work by examining the relationships between the contexts in which they operate, the mechanisms by which they work, and the different outcomes they produce.36

The realist philosophy of science offers a useful way of understanding causation.38 Realism assumes that nothing works in every setting or for everyone, and that outcomes are context-dependent. The outcomes in an intervention happen (or not) because the participants react or make particular decisions in response (or not) to contextual factors. Things that may function as context can include participant characteristics, values, beliefs, norms, cultural roles and previous experiences.38 Hence, many realist reviews commonly consider the underlying psychological or behavioural processes that interact with contextual factors to produce particular outcomes. These underlying causal processes, known as mechanisms, are sensitive to variations in context; they fire when the contexts are right. Thus, the causal explanations produced in realist reviews take the form of ‘Context-Mechanism-Outcome Configurations’, or CMOCs, as they are commonly known. CMOCs explain what is functioning as a context, to trigger what mechanism, resulting in what outcome.38 In the case of cancer online support groups, a realist review can help to uncover the mechanisms that produce different outcomes for different populations of people with cancer in different circumstances.

The realist review methodology begins and ends with theory. It involves developing an initial program theory that attempts to explain how the intervention works, collecting data from the literature to confirm, refute and refine it, and consulting with stakeholders to ensure the resultant program theory is relevant and resonates with their experiences.36 The end product is a middle range theory that it is specific enough to be tested but general enough to be transferable to other settings where the same mechanisms may be in operation.39

To conduct a realist review of cancer online support groups for people with cancer.

To develop a program theory that explains how cancer online support groups work, in what circumstances, for whom and why.

To make best practice recommendations based on the findings from the review.

What positive and negative outcomes have been reported on cancer online support groups?

What are the mechanisms associated with these outcomes, in which contexts, for whom and why?

Review questions

The review will be conducted according to Pawson et al’s five steps36 and will follow the Realist and Meta-narrative Evidence Syntheses Evolving Standards for quality and reporting.40 Figure 1 provides a schematic overview of the project.

Figure 1

Project overview. Adapted with permission from Duddy and Wong.39

Stakeholder involvement

We will adopt an integrated knowledge translation approach,41 which is a collaborative approach to research that engages knowledge users as partners in the research process to enhance the relevance and uptake of the findings. This approach aligns with the realist review methodology, which requires ongoing dialogue with stakeholders throughout the project.40 Five categories of knowledge users have been engaged in the project: (1) program developers including researchers, clinicians and patient educators from healthcare organisations that develop online support groups (both lay and professionally moderated; standalone and multicomponent interventions); (2) community strategists and moderators that manage and moderate online support groups; (3) clinicians who refer patients to and/or deliver online support groups; (4) patients and family members who have used or created their own ‘grassroots’ online support groups; and (5) healthcare administrators and policy-makers responsible for implementing online support groups and driving best practices. Representatives from each category of knowledge user, some of whom span multiple categories, are members of the project team or collaborators and will serve as the core stakeholder group.

Patient and public involvement

We will also follow Canada’s Strategy for Patient-Oriented Research Patient Engagement Framework by engaging patients as partners in the research process to ensure the evidence produced focuses on patient-identified priorities and improves patient outcomes.42 Three patients with cancer and survivors have been engaged as members of the project team and are part of the core stakeholder group. These individuals include men and women, paediatric, young adult and older adult survivors of lymphoma, breast cancer and prostate cancer, respectively. To monitor and improve the patient engagement process, we will track team members’ experience of the patient–researcher partnership using patient engagement surveys created by Abelson et al.43 Theses anonymous, voluntary surveys will be administered online to all team members at the beginning and at the end of the project.

As shown in figure 1, the core stakeholder group, consisting of knowledge users and patient partners (n=15), will be consulted multiple times throughout the project when developing the initial program theory, refining the program theory, identifying strategies to disseminate the findings from the review and generating best practice recommendations. In addition, we will hold an augmented stakeholder workshop32 towards the end of the study to obtain stakeholder feedback on the program theory and best practice recommendations that we generate. This augmented stakeholder group will include a broader range of stakeholders from our five knowledge user categories with diversity in cancer type, gender and ethnicity. All stakeholder meetings and workshops will be held virtually using web-conferencing software.

Step 1: develop initial program theory

To develop an initial program theory,38 we will: (1) perform an informal scoping search to locate candidate theories and (2) consult stakeholders to assess whether the candidate theory(ies) correspond(s) with their experiences.39

To locate existing candidate theories, we will conduct iterative, exploratory searching using structured44 and informal search strategies.45 We will leverage Bender’s multitheory framework on the use and potential effects of breast cancer online support groups24 as a starting point. This multitheory framework draws on the Transactional Theory of Stress and Coping,46 Social Comparison Theory,47 the Technology Acceptance Model48 and the Theory of Planned Behaviour.49 As shown in figure 2, it suggests that people with breast cancer use online support groups to obtain information and emotional support from similar others to lessen negative appraisals of events, enhance feelings of control, and develop coping strategies, which in turn reduce or buffer anxiety.24 The availability, anonymity and low commitment afforded by the online medium are believed to enhance feelings of control. However, the effects of making comparisons with similar others in online support groups may be positive or negative depending on the circumstances and the person’s goals. Lastly, beliefs about the usefulness and trustworthiness of online support groups may influence adoption and engagement.

Figure 2

Multitheory framework for understanding the use and effects of online support groups among women with breast cancer. Reproduced with permission from Bender.11 24

Other potentially valuable theories will include those from the communication and computer sciences, such as Preece’s Sociability and Usability framework for determining success in online communities,50 as well as the Uses and Gratification Theory for understanding motivations and usage patterns.51 In addition, we will consider Perski’s theory of engagement in digital behavioural change interventions52 to understand how different forms and degrees of engagement (eg, posting, liking, lurking) may influence outcomes.

We will then hold a stakeholder consultation workshop with the project team and core stakeholder group to gather their views on the processes by which cancer online support groups produce their effects. The workshop will begin with an overview of what is known about cancer online support groups from the literature, followed by break-out groups where team members will discuss their thoughts and experiences. The following questions will guide the break-out group discussions: How do you feel about cancer online support groups? What are some positive outcomes from participating in cancer online support groups? What are some negative outcomes from participating in cancer online support groups? What makes cancer online support groups work well? What makes cancer online support groups work not so well? The break-out groups will be audiorecorded and notes captured using a collaborative note-taking software. The audiorecordings and notes will be analysed using inductive and deductive content analysis.53

Step 2: search for evidence

Following the development of an initial program theory, we will collect evidence to confirm, refute or refine each aspect of theory.35 36 We will conduct a literature search to gather a broad range of heterogeneous data, including quantitative, qualitative and mixed-methods studies, peer-reviewed articles, opinion and commentary pieces, as well as grey literature.40

Data sources and search strategy

A search strategy was developed by a medical librarian based on a seminal systematic review of online support groups.28 Using this search strategy we conducted a preliminary scoping review of Medline, EMBASE and PsycINFO and found a reasonable number of evaluations of cancer online support groups (n=61). This search strategy was peer-reviewed by an external medical librarian following the Peer Review of Electronic Search Strategy (PRESS) guidelines.54 Using this search strategy, searches will be carried out in the following databases from their inception to present: Medline, EMBASE, the Cochrane Database of Systematic Reviews, PsycINFO (all via Ovid), CINAHL (EbscoHost), Scopus (Elsevier) and the Association for Computing Machinery Digital Library. Grey literature will also be retrieved according to the Canadian Agency for Drugs and Technologies in Health’s guide. Grey literature will include, for instance, resources on industry websites that offer guidance on building and sustaining online communities (eg, www.feverbee.com).

All abstracts published in English that are captured through database and grey literature searching will be screened according to the inclusion and exclusion criteria outlined below.

Study design: Any study design.

Intervention: An online support group (or an online intervention with an online support group component), defined as a group of individuals with similar or common health-related interests who communicate through a communication platform on the internet.

Participants: The online support group must be focused on cancer and include people with a cancer diagnosis and/or their family caregivers.

Outcomes: All types of outcomes associated with participation in online support groups including but not limited to: user engagement, knowledge, self-efficacy, social support, psychological, behavioural or physiological outcomes or use of health services.

Studies that report on content analyses of communication occurring between members of an online support group that do not examine the perceived effect of participation in the online support group. For example, content analyses that report on the illness experience, such as the experience of cancer pain, that do not also examine the effect of participating in the online support group on the experience of cancer pain.

Screening process

Four team members will screen the abstracts using a pilot-tested screening tool supported by Rayyan web-based software for systematic review management.55 Following best practices for abstract screening,56 the screening tool will include clear and concise questions organised hierarchically with the easiest questions first. The screening tool will be piloted on five articles prior to screening. To assess inter-rater reliability, all four team members will screen a random sample of 200 articles independently. Inter-rater reliability will be assessed using percent agreement, where greater than 80% agreement is considered adequate. Once inter-rater reliability is established, the remaining search yield will be divided among the four team members, with the team meeting fortnightly with the project lead to resolve any uncertainties. A 10% random sample of the total search yield will be audited as is common practice in realist reviews.32 Disagreements will be recorded and resolved through discussion.

Additional searching

More searches will be undertaken if the main search does not generate sufficient data to test the program theory or in response to program theory refinements.57 For example, we may need more data to fill a gap in our program theory or investigate a new area of inquiry that our initial search did not find. Where applicable, we will follow cluster search strategies developed by Booth et al45 to identify and track similar or related sources. Any additional searches will be developed by a medical librarian.

Step 3: selection and appraisal

Following abstract screening, two team members will read the full texts of all eligible articles, selecting articles for inclusion based on their relevance and rigour. Relevance will be determined by assessing the extent to which the data could contribute to theory building and/or testing by addressing some aspect of the program theory(ies) under consideration.36 Rigour will be assessed by determining whether the methods used to produce the relevant data are credible and trustworthy according to the epistemological framework of the study being assessed.36 Where necessary, assessments of rigour may involve the use of validated, critical appraisal checklists.57 For example, if relevant data have been generated using a questionnaire, then trustworthiness will be considered greater if the questionnaire has been shown to be reliable and valid. A 10% random subsample will be audited and disagreements will be recorded and resolved through discussion.

Step 4: extracting and organising data

Following study selection, two team members will extract the main study characteristics (eg, study design(s), participants, intervention, technology, moderation, engagement and outcomes). The extraction tool will be piloted on five articles prior to data extraction. The remaining search yield will be divided among the two team members for independent data extraction, with the pair meeting weekly with the project lead to resolve any uncertainties. As with the previous steps, a 10% random subsample of extracted data will be audited with disagreements recorded and resolved through discussion.

One team member will simultaneously upload the included full texts of the articles into NVivo qualitative analysis software to code sections of text that are relevant to supporting, refining or refuting aspects of the program theory. The codes will be conceptual categories that are developed both inductively (codes emerging from the texts) and deductively (codes created in advance and informed by the initial program theory).53 This first round of coding will sort data into broad conceptual buckets. Examples of some of the concepts that will be coded are the sex/gender, cancer diagnosis, ethnicity and socioeconomic status of online support group users, type of online support group (eg, standalone/multicomponent, synchronous/asynchronous, lay/professionally moderated) and reasons for using online support groups and outcomes experienced.

Step 5: analysis and synthesis

In this final step, data that have been sorted into conceptual buckets will be further analysed using a realist logic of analysis. Analysis will be led by a core group of four team members. The goal of this phase of the analysis will be to interpret whether the data are functioning as context, mechanisms or outcomes, and, if so, within which CMOC.36 An example CMOC that might be developed is: ‘When an online support group moderator welcomes new members (context), the new member starts to open up (outcome) because they feel a sense of psychological safety (mechanism)’. Analysis will involve making judgements about how the CMOCs that are developed fit within the initial program theory. The core stakeholder group will be consulted multiple times during the analysis phase to ensure that the developing program theory fits with their experiences.

Strengths, limitations and mitigation strategies

A clear scope and plan is critical for the success of this project.36 58 We have built in a number of strategies to ensure its timely completion. Our preliminary scoping review identified a feasible number of articles from the higher yielding sources (eg, Medline EMBASE and PsycINFO). We have identified several promising theories and will use an existing multitheory framework24 as a starting point. Further, we have established a core stakeholder group with whom we have worked closely to agree on the focus of the study.

Based on our preliminary scoping review, we expect that most studies of cancer online support groups will focus on women with breast cancer and will include a disproportionate number of white, well educated and above-average income earners.31 The predominance of breast cancer-related data may limit the generalisability of findings. However, we anticipate heterogeneity in other respects. This includes variation in the stage of cancer, the communication technology used (eg, discussion form, synchronised chat, microblog community, text/video, anonymous/semianonymous), the structure and format of the intervention (eg, structured/unstructured, stand-alone/multicomponent, anonymous/semianonymous), the nature and extent of moderation (eg, lay/professional/none and moderation strategy) and organisational mandate of the online support group. The availability of rich contextual evidence will determine the extent to which we can address all contextual factors.

Lastly, there is a limit to how much ground we can cover in a single realist review.36 Hence, we may have to prioritise some aspects of the program theory and set aside others for future research.

Ethics and dissemination

The outputs of this review will consist of actionable findings in the form of a theoretical framework that explains the important contextual factors and underlying mechanisms of online support groups for cancer patients and survivors. This will underpin an evidence-based ‘how-to’ guide on ways to improve the development and implementation of cancer online support groups.

In addition, several knowledge products will be produced guided by the knowledge-to-action framework.59 For each knowledge user group, we will produce tailored knowledge products by adapting the knowledge generated from this review for their specific needs, the context in which it will be used, and assessing barriers to use. This will involve working directly with stakeholders to produce tailored summaries of the findings and identifying and executing dissemination strategies.

For researchers, clinicians and patient educators, two peer-reviewed publications will be produced: (1) the study findings from the realist review and the refined program theory and (2) a ‘how-to’ guide that outlines practical advice to optimise, tailor and implement cancer online support groups. For community strategists/moderators, healthcare administrators, and patients/survivors who run cancer online support groups, we will produce3 user-friendly summaries of the findings and best practice recommendations.

The results will be communicated through presentations at scientific conferences and publications in open-source journals, newsletters distributed to relevant healthcare professional associations and healthcare organisations, and evidence summaries distributed by partnering healthcare administrators. In addition, social media dissemination and mobilisation strategies will include a tweet chat on the Cancer Survivor Social Media (#CSSMchat) online community and a webinar hosted by the Mayo Clinic Social Media Network Webinar Series. Knowledge users on the team will be active in identifying and executing additional strategies to reach more audiences.

The use of secondary data for this review precludes the need for ethical approval.