| Literature DB >> 33982844 |
Sharon M Varela1, Catherine Hays1, Sabina Knight1, Richard Hays1.
Abstract
INTRODUCTION: Psychology workforce shortages in geographically rural or remote contexts have highlighted the need to understand the supervisory experiences of psychologists practising in these locations, and the models of supervision employed to support their practice and improve client safety.Entities:
Keywords: models of remote supervision; professional supervision; psychologists; rural and remote practice; supervisory experiences
Year: 2021 PMID: 33982844 PMCID: PMC8252660 DOI: 10.1111/ajr.12740
Source DB: PubMed Journal: Aust J Rural Health ISSN: 1038-5282 Impact factor: 1.662
FIGURE 1Study selection: PRISMA flow diagram
Critical appraisal summary of included studies using MMAT v2018
| Ducat et al | Inman et al | Miller & Gibson | Xavier et al | ||
|---|---|---|---|---|---|
| Screening questions (all study types) | Are there clear qualitative and quantitative research questions or objectives, or a clear mixed‐methods questions or objectives? | Y | Y | Y | Y |
| Do the collected data allow to address the research question (objective)? For example, consider whether the follow‐up period is long enough for the outcome to occur (for longitudinal studies or study components). | Y | Y | Y | Y | |
| 1. Qualitative | 1.1. Is the qualitative approach appropriate to answer the research question? | Y | Y | Y | Y |
| 1.2. Are the qualitative data collection methods adequate to address the research question? | Y | Y | Y | Y | |
| 1.3. Are the findings adequately derived from the data? | Y | Y | Y | Y | |
| 1.4. Is the interpretation of results sufficiently substantiated by data? | Y | Y | N | N | |
| 1.5. Is there coherence between qualitative data sources, collection, analysis and interpretation? | Y | Y | Y | Y | |
| 2. Quantitative randomised controlled (trials) | 2.1. Is randomisation appropriately performed? | N/A. No studies included a randomised control trial. | |||
| 2.2. Are the groups comparable at baseline? | |||||
| 2.3. Are there complete outcome data? | |||||
| 2.4. Are outcome assessors blinded to the intervention provided? | |||||
| 2.5 Did the participants adhere to the assigned intervention? | |||||
| 3. Quantitative non‐randomised | 3.1. Are the participants representative of the target population? | N/A. No studies included a non‐randomised trial. | |||
| 3.2. Are measurements appropriate regarding both the outcome and intervention (or exposure)? | |||||
| 3.3. Are there complete outcome data? | |||||
| 3.4. Are the confounders accounted for in the design and analysis? | |||||
| 3.5. During the study period, is the intervention administered (or exposure occurred) as intended? | |||||
| 4. Quantitative descriptive | 4.1. Is the sampling strategy relevant to address the research question? | N/A | Y | N/A | Y |
| 4.2. Is the sample representative of the target population? | N/A | Y | N/A | Y | |
| 4.3. Are the measurements appropriate? | N/A | Y | N/A | Y | |
| 4.4. Is the risk of non‐response bias low? | N/A | N | N/A | Y | |
| 4.5. Is the statistical analysis appropriate to answer the research question? | N/A | Y | N/A | Y | |
| 5. Mixed methods | 5.1. Is there an adequate rationale for using a mixed‐methods design to address the research question? | N/A | Y | N/A | Y |
| 5.2. Are the different components of the study effectively integrated to answer the research question? | N/A | Y | N/A | Y | |
| 5.3. Are the outputs of the integration of qualitative and quantitative components adequately interpreted? | N/A | Y | N/A | Y | |
| 5.4. Are divergences and inconsistencies between quantitative and qualitative results adequately addressed? | N/A | N | N/A | Y | |
| 5.5. Do the different components of the study adhere to the quality criteria of each tradition of the methods involved? | N/A | Y | N/A | Y | |
Research designs of included studies are mixed methods (MM) and qualitative (QUAL). Quality criteria are assessed as: Y = criteria met; N = criteria not met; ? = not reported in study; N/A = not applicable.
Characteristics of studies: results from JBI SUMARI data extraction tool ,
| Study | Ducat et al | Inman et al | Miller and Gibson | Xavier et al |
|---|---|---|---|---|
| Country/region | Australia, Queensland | USA, Pennsylvania | Australia, South‐West Victoria | Australia, New South Wales |
| Setting/context/culture | Allied health training program; public health; rural and remote | University; supervisors‐in‐training program; remote models of supervision | University; remote supervision; rural and remote | Public health; cancer care; rural and remote; teaching hospital |
| Participants | 42 rural and remote allied health professionals: dietetics (4); medical radiation (2); nutrition (7); occupational therapy (8); physiotherapy (6); psychology (1); social work (11); speech pathology (3). | 15 alumni and current doctoral psychotherapy students who completed the supervision apprenticeship course at Lehigh University (female: n = 12; male: n = 3; aged between 25 and 39 years). A 44.12% response rate was reported. | 26 psychologists from regional Australia. Four had recently attained registration through face‐to‐face supervision; 18 had recently attained registration through remote supervision, and 4 were university supervisors adept at both remote and face‐to‐face supervision. | 18 psycho‐oncology staff who were participating in group supervision and education sessions by videoconference. Seven were psychologists, and 11 were social workers. 11 were working in a rural setting, and 7 were working in an urban setting. |
| Aims | The study aimed to understand allied health professionals’ experiences of supervision, with a focus on what has been useful, what effect it has had on practice and barriers to participating (in supervision). | The study aimed to evaluate the developed model of remote supervision by understanding the experiences of supervisors who had or were completing the skills training for engaging in remote supervision. | The study aimed to explore the experiences of psychologists who had participated in remote supervision and to validate a framework for further study. | The study aimed to identify whether remote provision of clinical supervision and education was feasible and acceptable. The efficacy of the model in the context of cancer care was also analysed. |
| Methods | A qualitative, descriptive research design was applied using thematic analysis. Interviews were semi‐structured telephone interviews (20‐40 min). Interviews were transcribed verbatim by an independent transcriber. Quality processes were employed to ensure rigour. Ethics were disclosed. Purposive sampling was used to ensure a represented sample. Response rates were not disclosed. | An online mixed‐methods survey design was applied. The online survey consisted of 5 open‐ended questions that asked about the challenges, benefits, ethical dilemmas and effectiveness of face‐to‐face vs remote supervision. Participants were also asked one Likert‐scale question that included 7 items that needed to be answered from strongly disagree (1) through to strongly agree (5). A consensual qualitative research‐modified approach was used to analyse the qualitative data, with data being presented in themes and frequencies (to identify the number of responses that aligned with a particular category). Frequency statistics were also used to report the results of the Likert‐type items. | Semi‐structured interviews were conducted with small groups and individuals. The 3 key areas targeted were as follows: general experience of videoconferencing and face‐to‐face supervision; supervision roles and content areas of discussion; and the relevance of power and involvement to supervision interactions. Interviews averaged 60 min and were transcribed. The interviews were coded into categories by 2 individual raters. Inter‐rater reliability was calculated as the kappa coefficient of agreement. Data were presented in categories as frequencies and percentages, within identified themes. | A purposive sampling design was applied. 26 supervisees from 13 cancer centres were invited to participate in supervision and education sessions that were provided from a metropolitan teaching hospital. The final analysis was based on 18 participants who attended more than 25% of the sessions. Pre‐post design was used, with data collected on confidence, effectiveness, education preferences and evaluation of the program. |
| Results | Results were discussed under the broad themes of effectiveness of supervision (skills, knowledge and confidence; reduced professional isolation; enhanced professional enthusiasm; patient safety; usefulness) and facilitators and barriers of supervision (supervision culture; supervisee‐supervisors fit). A model of effective supervision was proposed to address the concerns raised and build on the strengths of supervision: the Y model of effective supervision in rural and remote settings. | Qualitative results were discussed under the broad themes of challenges while engaging in remote supervision; supervisor benefits; supervisee benefits; ethical concerns; and the working in alliance in face‐to‐face/remote supervision. Quantitative results were discussed narratively with no ranges or means provided. Results indicated that preference for remote supervision vs face‐to‐face supervision remains a largely person one. The majority of participants noted that both were effective, both enabled a strong alliance to be built and for supervisees to stay on task. Many of the concerns raised indicated technology issues remained a concern (eg connectivity issues, ability to see and read non‐verbals) and ethical issues (eg privacy, confidentiality, access to resources). | Results were discussed within 6 topic areas: practical problems of videoconferencing; participants emotional and cognitive responses to the experience of videoconferencing; main roles of supervisors from an uncued question; cued responses for activities completed by supervisors; power balances perceived between supervisor and supervisee; and features associated with social and emotional presence during videoconferencing. The face‐to‐face trainee voice was included in 4 topic areas; the supervisors’ voice was included in 5 topic areas; and the videoconference trainees’ voice was included in all topic areas. The study identified that technical issues were frequently experienced when participating in videoconferencing, including those who are experienced in using the technology. Reduced non‐verbal cues and spontaneity in conversation were identified as issues associated with the use of the technology. Privacy was also raised as a concern, with the need for a soundproofed private space identified. Negative reactions were identified from the supervisee and supervisor who both reported irritation and discomfort with the technology. The study proposed that videoconferenced supervision can be understood with the prosed model of supervision, and dimensions of power and involvement. | Results indicated that comfort with the technology increased over time and that preferences (for the format and type of supervision) were individual. Supervisees identified that their effectiveness and confidence increased from attending the supervision and education sessions. |
| Limitations | Response rates were not disclosed. Psychology was grossly under‐represented in the sample; discipline‐specific results were not discussed. | Small sample size with low response rate. Qualitative data were open‐ended online responses, rather than transcribed interviews. Quantitative data were descriptive only. It is unclear what process was followed for ethical approval. | Participant voices were not adequately represented. Despite interviews being transcribed, no direct quotes were provided. Participant voices were reduced to categories and the authors’ interpretation of their responses. It is unclear what process was followed for ethical approval. | The sample was small, with no rural/urban or social worker/psychologist comparisons when analysing results. There was also varied attendance at the sessions, with a very low required attendance rate that would have impacted on results. It is unclear what process was followed for ethical approval. |
Reviewed models of supervision
| Description | Ducat et al | Inman et al | Miller & Gibson | Xavier et al |
|---|---|---|---|---|
| Program | Allied Health Rural and Remote Training and Support (AHRRTS) Program | Lehigh University's Master's and Doctoral Supervision Program | Deakin University Supervision Program | Clinical Supervision and Education Program for Psycho‐oncology Health professionals (Psychologists and Social Workers) |
| Model | The ‘Y model’ of remote supervision. | Supervision apprenticeship training model | Traditional clinical supervision model for trainee psychologists | Hub‐and‐spoke clinical supervision and education model |
| Details | Clinical education and support (mentoring and supervision) that is based on providing useful and effective remote supervision through investing in organisational factors (investment in technology, supervision as a value and support); and supervisor‐supervisee fit (matching supervisee to a supervisor where a positive supervisory relationship can be developed). | Supervisors matched to remote supervisees (1‐2) and local supervisees (1‐2). Supervisees attend a weekly clinical supervision session, either face‐to‐face or remote (using videoconferencing technology) depending on location on their location. Email and case review were also used to support the supervisor process. | A traditional supervision model was used with supervisees having to meet a minimum of 100 supervision hours within their education and training program, with remote supervision being provided through videoconferencing technology. | The model included monthly group supervision and education sessions (1‐4 session per supervisee) through videoconference (3‐5 supervisees from 1 to 3 sites). The education component was recorded with slides and copies of the video provided to all supervisees on the program (regardless of attendance). Additionally, supervisees received monthly individual telephone supervision for 30 min per session (1‐4 session per supervisee). |
| Comments | Model aimed to reduce professional isolation, improve retention and increase patient safety. | Supervisors were matched with students in master's and doctoral counselling and counselling psychology programs. Supervisors were considered to be in training. Supervision sessions were recorded for training purposes. | Bernard's discrimination model was applied as a framework to investigate the effectiveness of videoconferenced supervision vs face‐to‐face supervision. | The clinical education program provided support to 13 cancer centres (spokes) from the teaching hospital (hub) |