| Literature DB >> 30081957 |
Elizabeth Somes1, Joanna Dukes2, Adreanne Brungardt3, Sarah Jordan3, Kristen DeSanto4, Christine D Jones5, Urvi Jhaveri Sanghvi6, Khadijah Breathett7, Jacqueline Jones6, Hillary D Lum8,9.
Abstract
BACKGROUND: Laypersons including volunteers, community health navigators, or peer educators provide important support to individuals with serious illnesses in community or healthcare settings. The experiences of laypersons in communication with seriously ill peers is unknown.Entities:
Keywords: Advance care planning; Communication; Hospice care; Lay health navigators; Palliative care; Peer educators; Terminal care; Volunteers
Mesh:
Year: 2018 PMID: 30081957 PMCID: PMC6080535 DOI: 10.1186/s12904-018-0354-9
Source DB: PubMed Journal: BMC Palliat Care ISSN: 1472-684X Impact factor: 3.234
Search strategy and study selection
| Search terms | 1. Volunteers OR lay navigators OR peer groups |
| Inclusion criteria | 1. Qualitative methods |
| Exclusion criteria | 1. Non-English language |
Fig. 1PRISMA flow diagram
Studies of layperson perspectives on layperson-to-peer communication related to serious illness or advance care planning
| Study | Study aim | Design and method | Participants and setting | Results from primary study | Overall score from critical appraisal of study quality |
|---|---|---|---|---|---|
| 1 Berry and Planalp, USA, 2009 [ | To explore ethical issues hospice volunteers confront in their work | Thematic analysis of interviews | 39 hospice volunteers in urban and rural areas in Southwestern US. Mean age 64, 76% female, 100% White | Four themes of ethical issues: 1) dilemmas about gifts, 2) patient care and family concerns, 3) issues related to volunteer roles and boundaries, and 4) suicide/hastening death. | 60% |
| 2 Brighton et al., UK, 2017 [ | To explore hospital volunteers’ end-of-life care training needs and learning preferences, and the acceptability of training evaluation methods | Thematic analysis of focus groups | 25 hospital volunteers with at least 3 months experience. Mean age 50 (range 19–80 years), 76% female, highly ethnically diverse sample | Four themes emerged: 1) preparation for volunteering role; 2) end-of-life care training needs, including a) communication skills, b) understanding grief and bereavement, c) understanding spiritual diversity, d) understanding symptoms at end-of-life, and e) volunteers’ self-care; 3) learning preferences, including a) teaching methods, b) teachers, c) optional vs mandatory training, d) consolidating learning; and 4) evaluation preferences. | 95% |
| 3 Clarke et al., UK, 2009 [ | To evaluate whether researchers successfully worked with peer educators to develop and pilot an education program for advance care planning | Participatory action research; analysis of questionnaires, field notes, interviews | 5 “older adult” peer educators from community organizations, who were research advisors and volunteer peer educators | Peer educator findings from the program development process included: 1) enjoying project meetings, 2) involvement in reviewing material, 3) enhanced awareness of advance care planning, 4) training encouraging action, and 5) training enabling action. | 61% |
| 4 Foster, USA, 2002 [ | To describe volunteer-patient relationships and communication at the end-of-life | Narrative ethnography using interviews, observations, small groups | 9 hospice volunteers and researcher over 12-months in 1 hospice | Three themes related to volunteer-patient relationships emerged: 1) focus on the life of the patient – “The patient is alive”, 2) volunteer prioritizes the patient – “It’s not about me”, and 3) importance of presence – “Being there”. | 60% |
| 5 Jones et al., UK, 2015 [ | To evaluate volunteers’ experiences of advance care planning in a hospice | Mixed-method descriptive case studies, data from open-ended questions | 10 advance care planning -trained hospice volunteers completed questionnaires, providing 23 statements for analysis | The first theme was benefits of being an advance care planning volunteer, including a) positive interactions, b) gratitude shown by peers, and c) personal impact. The second theme was challenges of being an advance care planning volunteer, including: a) no engagement by peer, b) negative attitude of caregiver, c) being asked for inappropriate advice, and d) denial by peers. | 50% |
| 6 Planalp and Trost, USA, 2008 [ | To understand difficult communication issues or dilemmas experienced by hospice volunteers, patients, and their families | Qualitative analysis of data from 3 open-ended questions | 351 hospice volunteers from urban and rural areas in Southwestern US. Mean age 55 (range 15–88 years), 75% female. | Three themes of communication issues were identified: 1) denial between the dying person and their caregiver/family; 2) dealing with many negative feelings experienced by the patient and their caregiver/family; 3) family issues, including a) within-family conflicts, b) conflicts about patient care/treatment, c) financial/estate issues, d) unresolved relationship issues. Sources of communication difficulties were physical and/or mental impairments that made it difficult to talk with the dying person. | 68% |
| 7 Planalp et al., USA, 2011 [ | To describe conversations volunteers had with patients that they considered meaningful | Qualitative analysis of data from open-ended questions and in-depth interviews | 350 hospice volunteers from 32 hospices in Southwestern US completed questionnaires, 31 volunteers interviewed | Prominent themes about meaningful conversations were: 1) meaning of life, experiences and life stories, 2) talk about death and spirituality, 3) families and relationships, 4) shared interests with volunteers, 5) unfinished business, and 6) loss of capacities. Volunteers appreciated gaining life lessons. | 60% |
| 8 Rocque et al., USA, 2017 [ | To evaluate implementation of lay navigator-led advance care planning | Mixed-methods design, including thematic content analysis of lay navigator interviews | 26 lay navigators in Respecting Choices advance care planning Facilitator training in Southeastern US. Mean age 45, 81% female; 39% Black, 58% White. | Navigators identified key facilitators and barriers of implementation of advance care planning. Facilitators included physician buy-in, patient readiness, and prior advance care planning experience. Barriers included space limitations, identifying the “right” time to start conversations, and personal discomfort discussing end-of-life. | 95% |
| 9 Seymour et al., UK, 2013 [ | To report volunteers’ perspectives on a advance care planning peer education program and feelings on role of volunteer peer educator | Participatory action research; mixed methods including interviews and focus groups | 24 older adult volunteers and 8 care staff. 25% below 55 years, 9% over 75 years; 81% white, 6% black | At 6 and 12 months after training, the volunteers’ perspectives related to 1) personal and emotional implications of being a peer educator, and 2) report of community engagement activities in the year after peer education training. | 84% |
Fig. 2Layperson perspectives on layperson-to-Peer communication related to training, experiences, and outcomes
Domains and themes exploring layperson perspectives about communication in serious illness or advance care planning
| Derived domains, themes and subthemes | Theme from primary study (# refers to Table | Exemplar layperson quotations for each subtheme (# refers to Table |
|---|---|---|
| Domain 1. Layperson-to-peer communication | ||
| Building rapport (Subthemes: Building trust; Developing relationships over time) | Benefits as an advance care planning: Positive interactions (5); Difficult communication: Volunteer’s role (6); Navigator-level facilitators to advance care planning (8) | Of course, all of these patients have a relationship with me. Have rapport with me. I have seen them several times previously before I bring it up, so they know who I am and what I look like. They trust me. (8) |
| Talking about sensitive issues (Subthemes: Advance care planning; Prognosis; Death; Family/caregiver issues; Bereavement; Suicide) | Patient care and family concerns (1); Suicide and Hastening Death (1); End-of-Life Care Training Needs: Symptoms; Communication skills (2); Training encouraging action (3); The Patient is Alive (4); Personal Impact (5); Difficult communication: Denial; Dealing with pain/discomfort; Negative feelings of caregiver/family (6); Meaningful conversations: Life stories; death and spirituality; families and relationships; unfinished business (7); Patient-level barriers to advance care planning (8); Increased confidence in the topic (9) | Before [advance care planning] always felt like a major topic, you know ‘Oh how am I going to raise this?’ … [the training has] made it seem like something more natural to talk about, not to feel so awkward about discussing end-of-life matters and decisions … so that was really helpful. (9) |
| Listening and allowing silence | End-of-Life Care Training Needs: Communication skills (2); Being There (4); Shared interests (5); Difficult communication: Physical/mental impairment (6); Meaningful conversations: Life Stories (7) | Most striking was how much he needed somebody to listen and not judge. (7) |
| Responding to patient and family emotions | End-of-Life Care Training Needs: Communication skills (2); Difficult communication: Negative feelings (6) | [The patient] was in one of the rooms where you have to wear extra protective clothing as well, and I remember his children there. And they were really upset, and obviously me and him were having…He is telling me about times he went to Jamaica, and we’re talking, but I could see that his children were visibly upset. So I asked them if they wanted me to leave, and they were like no, no, no. To them, they are seeing their dad, someone who has looked after them, in an ill position, but I didn’t really know what to say to them. (2) |
| Communication facilitators (Subthemes: Physician endorsement; Healthcare team involvement) | System-level facilitators to advance care planning (8) | I want to get into the clinics and I want to have the doctor say to the patient, ‘Your navigator is gonna come in, and they’re gonna cover all of this, including advance directive, and I think that everybody should get it done.’ (8) |
| Communication barriers (Subthemes: Physical or cognitive limitations; Health literacy limitations; Limited time for advance care planning conversations; Cultural norms) | End-of-Life Care Training Needs: Communication Skills (2); It’s Not About Me (4); Personal Impact (5); Difficult communication: Physical/mental impairment; Religious differences (6); Patient-level barriers to advance care planning (8); System-level barriers and facilitators to advance care planning (8) | I think the hardest issue for me was when my lady couldn’t think of the word she wanted to say. She would get very frustrated and would cry. The best way I could get through this was to try to understand the concept of what she was talking about, then redirect the conversations. Sometimes I would use humor or we would listen to her favorite music. (6) |
| Domain 2: Layperson-to-peer interpersonal interactions | ||
| Discomfort with peer’s situation (Subthemes: Witnessing symptoms; Witnessing family distress) | Patient care and family concerns (1); End-of-Life Care Training Needs: Symptoms; communication skills (2); Being There (4); Difficult communication: Denial; Dealing with pain and discomfort; Family issues (6) | I actually thought he was dead because he didn’t say anything for a while, and I was like ‘Oh no, what am I going to do’. Because he had really heaving breathing, I don’t know what was actually wrong with him. Air would get caught in him and it seemed like he was choking, so I told the nurse straight away. And she was like, ‘No, don’t worry.’ (2) |
| Uncertainty of layperson role (Subtheme: Responding to patient/family requests; Gifts; Responding to symptoms) | Patient care and family concerns (1); Dilemmas about Gifts (1); Volunteer roles and boundaries (1); Difficult communication: Conflicts about patient care (6) | The person asked me if I would…If I would stay 8 h - for the day, and I told ‘em, “Now, that’s really not my job.” I said, “It’s a four-hour shift and I’ll be glad to do that, but 8 h…that’s really a lot.” (1) |
| Interpersonal differences between layperson and peer (Subthemes: Cultural/religious differences; Socioeconomic differences) | End-of-Life Care Training Needs: Understanding spiritual diversity (2); The Patient is Alive (4); Difficult communication: Religious differences (6) | The one that stood out for me the most is understanding spiritual, cultural, and environmental aspects of dying because nowadays we are living in a society where people are very religious. And even though there may be some patients that aren’t religious, you just have to respect what somebody believes. (2) |
| Domain 3: Personal impact on the layperson | ||
| Building meaningful relationships (Subthemes: Learning from the peer; Receiving gratitude; Experiencing loss) | End-of-Life Care Training Needs: Self-care (2); The patient is alive; Being There (4); Benefits as an advance care planning volunteer: positive interactions; gratitude shown by peers; personal impact (5); Peer loss (6); Meaningful conversations: Shared interests; Gaining life lessons (7); Implications of being a peer educator (9) | Some things I don’t understand and he explains to me. He wants to be informed about the future. He’s not - he doesn’t stop living here in the present. He makes me understand that, too, the way he talks about politics. He’s all into that. I’m ashamed sometimes, I think, “Gosh, you know, I’m 23 and I don’t know that a bomb exploded here or there.” I think he keeps his life, very simple, day-to-day, to live in the moment. Maybe that’s a lesson I’m supposed to learn. (4) |
| Gaining awareness of end-of-life (Subthemes: Personal reflection; Personal application; Personal difficulty with mortality) | Training encouraging action; training enhancing awareness (3); It’s Not About Me (4); Difficult communication: Denial (6); Navigator-level barriers to advance care planning (8); Implications of being a peer educator (9) | The subject of dying and death is very delicate and how it is presented makes a difference. Over the months, the training we received has helped me become comfortable with the subject and, to a certain extent, more knowledgeable. (3) |
| Domain 4: Layperson contributions | ||
| Educating others | Training encouraging action (3); Training enabling action (3); | I certainly didn’t feel fazed by any of the questions that we were asked and, fortunately, other people participating in the group also answered questions, it wasn’t just left to us as the leaders. (3) |
| Engaging in community outreach | Community engagement activities (9) | I’ll be quite frank, I certainly wouldn’t have got as involved as I am if I hadn’t done it (the training). After the last training day we had a meeting [and] said well okay, we’ll go and meet these people and see what they’re doing ... one thing we found was who knows what is out there as far as care provision. So we went and saw the hospice. We went and saw the PCT [Primary Health Care Trust]. We went and saw the Council. ... We literally pressed our PCT to get an (end-of-life) care strategy together because we went and saw them and we said okay we’re going to hold an information day and we will invite them to come and talk. So it pressurized them into having something ready. (9) |
| Domain 5: Layperson training | ||
| Strategies (Subthemes: Experiential learning; Meetings over time; Supervision; Group-based learning) | Learning preferences (2); Program development process; Training encouraging action (3); Helpful additional supervision (5); Personal and emotional implications of being a peer educator (9) | If I know that it actually happens and this was the scenario that someone actually faced, it makes it seem more than just an exercise [sounds of agreement]. (2) |
| Instructional personnel | Learning preferences (2); Training encouraging action (3) | I think both [staff and volunteers], because you will get the professional experience or the professional knowledge of the situation and they might have been dealing with it for years, so their training, and then a bit from the volunteers because they are hands on also. So I think both is important. (2) |
| Materials | Learning preferences (2); Reviewing training materials (3); Suggestions for programme improvement (5) | The material is too detailed for use in a peer education guide. Most people, myself included, would find it most daunting to prepare an advance directive after reading the book. The subject presentation is too complicated for a peer guide where simplicity should be of the essence. (3) |
Search strategies. Comprehensive search strategies used to identify articles for each database
| MEDLINE, including Ovid MEDLINE Epub Ahead of Print, In-Process & Other Non-Indexed Citations, and Ovid MEDLINE Daily (1946-present) | (exp Peer Group/ or exp. Volunteers/ or exp. Mentors/ or exp. Patient Navigation/ or (voluntary or peer* or volunteer* or mentor* or navigator* or lay*).tw,kf.) and (exp Advance Care Planning/ or exp. Hospices/ or exp. Hospice and Palliative Care Nursing/ or exp. Palliative Medicine/ or exp. Palliative Care/ or exp. Terminal Care/ or (Living Will* or Medical Power* Attorney or Health Care Power* Attorney or Healthcare Power* Attorney or advance* care plan* or advance* directive* or advance* health care plan* or advance* healthcare plan* or advance* medical plan* or hospice* or palliative or terminal care or end-of-life).tw,kf.) and (exp Patient Education as Topic/ or exp. Counseling/or exp. Information Dissemination/ or exp. Teaching/ or exp. Consumer Health Information/ or (discussion* or coaching or navigation* or navigating or learning or awareness or training or conversation* or engag* or promotion* or story or stories or experienc* or sharing or educator* or education* or educating or encourag* or teaching or counseling or information or knowledge or communicat*).tw,kf.) and (exp Qualitative Research/ or exp. Grounded Theory/ or exp. Interviews as Topic/ or exp. Focus Groups/ or exp. Nursing Methodology Research/ or exp. anecdotes as topic/ or exp. narration/ or exp. “surveys and questionnaires”/ or exp. personal narratives as topic/ or exp. Observational Studies as Topic/ or exp. interview/ or exp. personal narratives/ or exp. observational study/ or (qualitative or ethnograph* or phenomenol* or grounded theor* or purposive sampl* or hermeneutic* or heuristic* or semiotics or lived experience* or narrat* or life experience* or cluster sample* or action research or observational method* or content analys* or thematic analys* or constant comparative method* or field stud* or theoretical sampl* or discourse analys* or focus group* or ethnological research or ethnomethodolog* or interview* or mixed method* or mixed model* or mixed design* or survey* or questionnaire* or anecdote*).tw,kf.) | Results = 745 |
| PsycINFO via Ovid (1806 to March Week 2 2017) | (exp peers/ or exp. volunteers/ or mentor/ or (voluntary or peer* or volunteer* or mentor* or navigator* or lay*).ab,ti.) and (exp advance directives/ or exp. Palliative Care/ or exp. hospice/ or (Living Will* or Medical Power* Attorney or Health Care Power* Attorney or Healthcare Power* Attorney or advance* care plan* or advance* directive* or advance* health care plan* or advance* healthcare plan* or advance* medical plan* or hospice* or palliative or terminal care or end-of-life).ab,ti.) and (exp peer education/ or exp. Community Counseling/ or exp. Educational Counseling/ or exp. Peer Counseling/ or exp. information dissemination/ or exp. teaching/ or exp. consumer education/ or exp. death education/ or (discussion* or coaching or navigation* or navigating or learning or awareness or training or conversation* or engag* or promotion* or story or stories or experienc* or sharing or educator* or education* or educating or encourag* or teaching or counseling or information or knowledge or communicat*).ab,ti.) and (exp qualitative research/ or exp. grounded theory/ or exp. Interviews/ or exp. Narratives/ or exp. surveys/ or exp. questionnaires/ or exp. narratives/ or (qualitative or ethnograph* or phenomenol* or grounded theor* or purposive sampl* or hermeneutic* or heuristic* or semiotics or lived experience* or narrat* or life experience* or cluster sample* or action research or observational method* or content analys* or thematic analys* or constant comparative method* or field stud* or theoretical sampl* or discourse analys* or focus group* or ethnological research or ethnomethodolog* or interview* or mixed method* or mixed model* or mixed design* or survey* or questionnaire* or anecdote*).ab,ti.) | Results = 277 |
| CINAHL Cumulative Index to Nursing and Allied Health Literature (CINAHL) via EBSCOhost | (MH “Peer Group” OR MH “Volunteer Workers” OR MH “Volunteer Experiences” OR TI (voluntary or peer* or volunteer* or mentor* or navigator* or lay*) OR AB (voluntary or peer* or volunteer* or mentor* or navigator* or lay*)) AND (MH “Advance Care Planning” OR MH “Advance Directives+” OR MH “Hospice Patients” OR MH “Hospice and Palliative Nursing” OR MH “Hospices” OR MH “Terminal Care+” OR MH “Palliative Care” OR TI (Living Will* or Medical Power* Attorney or Health Care Power* Attorney or Healthcare Power* Attorney or advance* care plan* or advance* directive* or advance* health care plan* or advance* healthcare plan* or advance* medical plan* or hospice* or palliative or terminal care or end-of-life) OR AB (Living Will* or Medical Power* Attorney or Health Care Power* Attorney or Healthcare Power* Attorney or advance* care plan* or advance* directive* or advance* health care plan* or advance* healthcare plan* or advance* medical plan* or hospice* or palliative or terminal care or end-of-life)) AND (MH “Patient Education+” OR MH “Counseling+” OR MH “Teaching” OR MH “Death Education” OR MH “Consumer Health Information+” OR TI (discussion* or coaching or navigation* or navigating or learning or awareness or training or conversation* or engag* or promotion* or story or stories or experienc* or sharing or educator* or education* or educating or encourag* or teaching or counseling or information or knowledge or communicat*) OR AB (discussion* or coaching or navigation* or navigating or learning or awareness or training or conversation* or engag* or promotion* or story or stories or experienc* or sharing or educator* or education* or educating or encourag* or teaching or counseling or information or knowledge or communicat*)) AND (MH “Qualitative Studies+” OR MH “Ethnological Research” OR MH “Action Research” OR MH “Phenomenological Research” OR MH “Ethnographic Research” OR MH “Field Studies” OR MH “Grounded Theory” OR MH “Multimethod Studies” OR MH “Survey Research” OR MH “Phenomenology” OR MH “Focus Groups” OR MH “Interviews+” OR MH “Narratives” OR MH “Surveys+” OR MH “Observational Methods+” OR MH “Discourse Analysis” OR MH “Thematic Analysis” OR MH “Content Analysis” OR MH “Qualitative Validity+” OR TI (qualitative or ethnograph* or phenomenol* or grounded theor* or purposive sampl* or hermeneutic* or heuristic* or semiotics or lived experience* or narrat* or life experience* or cluster sample* or action research or observational method* or content analys* or thematic analys* or constant comparative method* or field stud* or theoretical sampl* or discourse analys* or focus group* or ethnological research or ethnomethodolog* or interview* or mixed method* or mixed model* or mixed design* or survey* or questionnaire* or anecdote*) OR AB (qualitative or ethnograph* or phenomenol* or grounded theor* or purposive sampl* or hermeneutic* or heuristic* or semiotics or lived experience* or narrat* or life experience* or cluster sample* or action research or observational method* or content analys* or thematic analys* or constant comparative method* or field stud* or theoretical sampl* or discourse analys* or focus group* or ethnological research or ethnomethodolog* or interview* or mixed method* or mixed model* or mixed design* or survey* or questionnaire* or anecdote*)) | Results = 359 |
| Cochrane Library (via Wiley, including Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effect, Cochrane Central Register of Controlled Trials, Cochrane Methodology Register, Health Technology Assessment Database, and NHS Economic Evaluation Database) | #1 → MeSH descriptor: [Peer Group] explode all trees | Results = 37 |
| Allied and Complementary Medicine (AMED) via Ovid (1985 to March 2017) | (exp Peer group/ or exp. Voluntary workers/ or exp. Mentors/ or (voluntary or peer* or volunteer* or mentor* or navigator* or lay*).ab,ti.) AND (exp advance directives/ or exp. hospices/ or exp. palliative care/ or exp. terminal care/ or (Living Will* or Medical Power* Attorney or Health Care Power* Attorney or Healthcare Power* Attorney or advance* care plan* or advance* directive* or advance* health care plan* or advance* healthcare plan* or advance* medical plan* or hospice* or palliative or terminal care or end-of-life).ab,ti.) AND (exp patient education/ or exp. counseling/ or exp. teaching/ or (discussion* or coaching or navigation* or navigating or learning or awareness or training or conversation* or engag* or promotion* or story or stories or experienc* or sharing or educator* or education* or educating or encourag* or teaching or counseling or information or knowledge or communicat*).ab,ti.) and (exp interviews/ or exp. questionnaires/ or (qualitative or ethnograph* or phenomenol* or grounded theor* or purposive sampl* or hermeneutic* or heuristic* or semiotics or lived experience* or narrat* or life experience* or cluster sample* or action research or observational method* or content analys* or thematic analys* or constant comparative method* or field stud* or theoretical sampl* or discourse analys* or focus group* or ethnological research or ethnomethodolog* or interview* or mixed method* or mixed model* or mixed design* or survey* or questionnaire* or anecdote*).ab,ti.) | Results = 148 |
Summary of critical appraisal of study quality
| Domain | Berry & Planalp | Brighton et al. | Clarke et al. | Foster | Jones et al. | Planalp & Trost | Planalp et al. | Rocque et al. | Seymour et al. |
|---|---|---|---|---|---|---|---|---|---|
| Study purpose: Was purpose or research question stated? | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Literature: Was relevant literature reviewed? | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Study design: Was a theoretical perspective identified? | Yes | Yes | Yes | Yes | No | Yes | No | Yes | Yes |
| Sampling: Was the process of purposeful selection described? | No | Yes | Yes | No | Yes | No | No | No | Yes |
| Was sampling done until redundancy in data was reached? | N.A. | Yes | N.A. | N.A. | N.A. | N.A. | N.A. | N.A. | N.A. |
| Was informed consent obtained? | Yes | Yes | No | No | Yes | N.A. | N.A. | Yes | N.A. |
| Data Collection: Was procedural rigor used? | Yes | Yes | N.A. | No | N.A. | Yes | Yes | Yes | Yes |
| Descriptive clarity: Complete description of site | No | Yes | No | No | Yes | No | No | Yes | Yes |
| Descriptive clarity: Complete description of participant | Yes | Yes | No | No | Yes | Yes | No | Yes | Yes |
| Description of role of researcher and relationship with participants | No | Yes | Yes | Yes | No | No | No | Yes | Yes |
| Identification of assumption and biases of researcher | No | Yes | No | Yes | No | No | No | Yes | No |
| Analytical rigor: Were data analyses inductive? | No | Yes | N.A. | Yes | Yes | Yes | Yes | Yes | N.A. |
| Were findings consistent with and reflective of data? | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Auditability: Was a decision trail developed? | N.A. | Yes | N.A. | Yes | No | N.A. | Yes | N.A. | No |
| Was the process of analyzing the data described adequately? | Yes | Yes | No | N.A. | No | Yes | Yes | Yes | Yes |
| Theoretical connections: Did a meaningful picture emerge? | No | No | Yes | Yes | No | Yes | No | Yes | Yes |
| Credibility: Do descriptions and interpretations of participants capture the phenomenon? | Yes | Yes | Yes | Yes | No | No | Yes | Yes | Yes |
| Transferability: Can the findings be transferred to other situations? | Yes | Yes | No | No | No | Yes | Yes | Yes | Yes |
| Dependability: Was there consistency between data and findings? | No | Yes | Yes | No | No | Yes | Yes | Yes | Yes |
| Confirmability: Were strategies employed to minimize bias? | No | Yes | Yes | No | No | No | No | Yes | No |
| Conclusions: Were conclusions appropriate given study findings? | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Implications: Were findings meaningful to “laypersons” and communication? | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes |
| Total score: | 60% | 95% | 61% | 60% | 50% | 68% | 60% | 95% | 84% |
Quality appraisal results and scoring of included studies using McMaster University tool