Feasibility of a Randomized Controlled Trial of Paediatric Interdisciplinary Pain Management Using Home-Based Telehealth.

PURPOSE: Chronic pain is common in adolescents. Evidence-based guidelines recommend interdisciplinary treatment, but access is limited by geography. The development of hybrid programs utilizing both face-to-face and videoconference treatment may help overcome this. We developed a 7-week hybrid pediatric interdisciplinary pain program (Hybrid-PIPP) and wished to compare it to individual face-to-face sessions (Standard Care). Our objective was to test the feasibility of a protocol that used a matched pair un-blinded randomized controlled design to investigate the efficacy and cost-effectiveness of the Hybrid-PIPP compared to Standard Care. PATIENTS AND METHODS: Parent-adolescent dyads were recruited from tertiary pediatric clinics and matched by disability before randomization to minimize allocation bias. The adolescents (aged 11-17) had experienced primary pain for >3 months. Hybrid-PIPP involved 11 hrs of group therapy and 4 individual videoconference sessions. Standard care was provided by the same clinical team, using the same treatment model and similar intensity as the Hybrid-PIPP. The intention was to recruit participants for 3 Hybrid-PIPP groups with a comparison stream. Recruitment was ceased after 2 groups due to the high participant disability requiring more intensive intervention.
RESULTS: Eighteen dyads were screened and 13 randomized (7 Hybrid-PIPP, 6 Standard Care, 2 unsuitable, 3 unallocated when the study was stopped). The study met a priori feasibility criteria for staff availability; recruitment rate; treatment completion; and data collection. Global satisfaction ratings were similar in both streams (SC median 7, range 5-9 and Hybrid-PIPP median 8.5, range 5-10). Challenges were identified in both streams. A future modified Hybrid-PIPP was considered acceptable if the intensity is increased to manage the high level of disability. Standard care was considered inefficient. No adverse events were reported.
CONCLUSION: The study determined that the protocol met a priori feasibility criteria, but to be practicable in a real world, health environment requires significant modifications. REGISTRATION: ANZTR(ACTRN2614000489695).

Introduction

Chronic pain is a significant issue for children and adolescents with a prevalence rate of between 11% and 38%.1 Common presentations include widespread pain, and pain localized to the abdomen, back, head, and musculoskeletal system.1 Left untreated, chronic pain can have a significant impact on a young person’s life trajectory, affecting their physical and mental health into adult life.2–4

Evidence-based guidelines recommend an interdisciplinary approach to treatment using programs that incorporate cognitive behavioral therapy into functional restoration programs.5 This interdisciplinary model involves practitioners working together to provide a comprehensive and integrated treatment package, using a common treatment philosophy, and constant communication between team members that operate from the same physical location.6 The treatment usually involves the parents or caregivers who are provided with strategies to encourage more adaptive responses to their child’s pain.5 Access to this type of treatment is limited by the scarcity of clinical expertise7 and geographical barriers.8

The use of electronic information and communication technology to deliver health services (known as eHealth)9 has the potential to improve access to a wide range of treatment including pain management programs. This term describes a broad range of service delivery models including phone, videoconferencing, web, or app-based treatment delivery platforms. Services may be delivered solely via digital technology, or combined with traditional face-to-face treatments10 in programs known as “hybrid”.11

This feasibility study focuses specifically on videoconferencing. Recent technological advances mean that encrypted video links can be easily shared between clinicians and patients using a variety of devices such as computers, smartphones or iPads without the requirement for the patient to have special software, accounts or dial-in details.12 Examples include Health Direct Australia VideoCall (). This technology extends the reach of healthcare to the patient’s community environment such as their home, school or work.13

Before the large-scale adoption of this type of technology, it is essential that the benefits are rigorously tested in real-world environments.13 Changing the delivery mechanism of a treatment may arguably change its nature, so it is important to be aware of this when analyzing efficacy; for example, interacting with a clinician during a videoconference is mechanistically different from interacting with an app on a mobile phone. Research into videoconference pain treatment interventions is emerging but study numbers are low. Despite some promising studies, three systematic reviews evaluating the delivery of adult pain interventions via various eHealth modalities have been unable to unequivocally demonstrate the benefit of videoconferencing due to the low number of studies using this technology.9,14,15 Pediatric literature related to videoconferencing is increasing. A systematic review of technology-based family interventions for a variety of pediatric chronic illnesses identified 23 relevant studies of which the overwhelming majority (87%) featured a hybrid design. Although three studies investigated technology-based interventions for chronic pain or headache, none of these used videoconferencing. The mixed results and varying intervention targets for different chronic diseases made it hard for the authors to draw summative conclusions and they recommended further research evaluating both clinical and economic outcomes, and the identification of the “active ingredients” of the interventions.11

We wished to evaluate whether videoconferencing could be used to deliver components of a pediatric interdisciplinary pain program (PIPP). We developed a program that included a combination of group face-to-face sessions and individual videoconference into the home that we called Hybrid-PIPP. We reasoned that this would provide better outcomes than treatment delivered via individual face-to-face sessions (Standard Care) because the group therapy environment would provide positive peer modelling opportunities, reinforcement, and social support. The objective of this study was to assess the feasibility of conducting a randomized controlled trial to test the efficacy and cost-effectiveness of the Hybrid-PIPP compared to Standard Care. The feasibility study was designed to a) test the integrity of the study protocol including the eligibility criteria; recruitment and consent process; data collection methods; randomization process; and acceptability of the intervention, and b) inform sample size calculation and selection of primary outcomes for the randomized controlled trial. Exploratory pre-and post-intervention outcome measures are reported; however, as this was a feasibility study there was no hypothesis established for statistical significance of treatment efficacy.

Methods

Participants and Setting

Approval for the study was obtained from the Western Australian Child and Adolescent Health Service Human Research Ethics Committee (2014016EP). The study protocol was registered with the Australian and New Zealand Clinical Trial Registry (ANZCTR 12614000489695) . A non-blinded matched pair randomized controlled model with parallel assignment was used. A matched pair design was chosen to reduce allocation bias by minimizing the differences between the treatment streams that may occur with a non-matched randomization, particularly with small sample sizes and heterogeneous participants.16 At the point of entry of each participant to the study, the streams represent the best possible balance related to functional disability.16 As this was a feasibility study, it was not powered to show statistical differences. Following consultation between the clinicians (two of whom had experience in delivering group interdisciplinary pain programs to adults totalling over 30 years), it was determined that three cycles of Hybrid-PIPP groups (with 4 to 8 families in each group) would be used to test the protocol. Because Hybrid-PIPP participants were matched to Standard Care, the intended participant numbers would therefore be between 24 and 48, dependent upon how many participants were randomized to the Hybrid-PIPP groups in each cycle.

Families were referred from tertiary clinics at the state Child and Adolescent Health Service (CAHS), Western Australia if they were considered to meet criteria by the assessing pain consultant. They were then screened by the treating team that included a clinical psychologist, physiotherapist and occupational therapist. Inclusion criteria were: a) aged 11 to 17 years old, b) experiencing a primary pain disorder for more than 3 months, c) pain occurring at least 4 days a week, d) one adult family member/carer willing to participate, e) no major changes in the participant’s medical management anticipated in the next 4 months, and f) family access to phone, internet and e-mails at their home, community health center or other convenient location. Participants were not eligible if the adolescent had a) high dependency on analgesic medication, b) primary symptom of fatigue, c) current or previous treatment for cancer, d) pain explained by identified pathological process (eg, rheumatological disease or inflammatory bowel disease), e) documented developmental delay, f) co-existing psychiatric or psychosocial issues that were considered more relevant to the participant’s reduced function than their pain was, g) significant mental health disorder including bipolar disorder, psychosis, active suicidality or eating disorders, h) were currently participating in other rehabilitation programs or cognitive behavioral therapy, and i) barriers that would prevent the participant’s comprehension of principles taught in intervention.

Enrolment was performed by the treating clinicians. After obtaining consent from the carer and assent from the adolescent, participants underwent a matched allocation process using their Functional Disability Index (FDI)17 scores. Using the FDI they were classified as either No/Minimal Disability (0–12), Moderate Disability (13–29) or Severe Disability (30+).17 An independent person drew a marble from a concealed bag containing 24 white marbles (indicating Standard Care) and 24 colored marbles (indicating Hybrid-PIPP). Once selected, the marble was not placed back in the bag. This process did not occur if the participant’s FDI score matched a previously enrolled participant who had not yet been matched. When this occurred, they were assigned to the stream that did not include their match and the corresponding marble for their stream allocation was removed from the bag to maintain the probability. Participants were offered a place in the alternative stream after their involvement in the study was completed.

Feasibility Measures

Criteria for feasibility of success were established a priori and included: a) greater than 70% of participants who commence the intervention complete the intervention (Hybrid-PIPP or 7 weeks of Standard Care); b) greater than 60% of participants complete the Week 11 data collection; c) suitably qualified staff were available; and d) on average three participants per month were recruited of which 90% met criteria. In addition to these data, semi-structured interviews were conducted with the three treating clinicians to gain qualitative information on 1) eligibility criteria, 2) recruitment and consent process, 3) data collection forms, 4) randomization process, 5) acceptability of the interventions, and 6) selection of the primary outcome.

Outcome Measures

The study was designed to capture data over 11 weeks, across all domains recommended by the Pediatric Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (PedIMMPACT)18 including pain intensity; physical functioning; emotional functioning; role functioning; adverse events; global satisfaction with treatment; sleep; and economic factors, as detailed in Table 1. Self-report measures were taken at standardized timepoints: Timepoint 1, baseline assessment; Time-point 2, Week 7 (to coincide with the end of Hybrid-PIPP intervention); and Time-point 3, Week 11 (end of study period), see Figure 1. Participants completed their questionnaires electronically either from home or at the hospital using a secure website (). This took approximately 30 mins for the adolescents, and 40 mins for the parents. The electronic data capture website had been custom-made to manage data from an adult pain service and was modified to administer the pediatric instruments required for this study.

Table 1

Outcome Measures

Adolescent Measures
	Domain	Items	Time Point
Functional Disability Index (FDI)17	Physical function	15	T1, T2, T3
The Bath Adolescent Pain Questionnaire (BAPQ)27	Multiple	61	T1, T2, T3
Revised Child Anxiety and Depression Scale – (RCADS)28	Psychological function	47	T1, T2, T3
Child Self Efficacy Scale (CSES)29	Psychological function	7	T1, T2, T3
Fear of Pain Questionnaire (FOPQ)30	Psychological function	24	T1, T2, T3
Pain numerical rating scale (worst, average, current)	Pain	3	T1, T2, T3
PROMIS Pediatric Pain Interference Scale (one sleep question)31	Sleep	1	T1, T2, T3
Global satisfaction: "Please consider the following aspects of your treatment – Physical function, emotional function, sleep, pain, your role as a student and family member, and any adverse events that may have occurred during treatment.Considering the above factors please indicate on the scale below how satisfied you were with treatment (0–10 Numerical Rating Scale)."	Global satisfaction	1	T2, T3
Adverse events: documented by clinicians in medical record and included in Global Satisfaction question to participants.	Adverse events	1	T2, T3
Feedback: “What was the most helpful part of your treatment, least helpful part of your treatment, any changes you would suggest?"	Not applicable	1	T2, T3
Total Items		161
Parent/Carer Measures
	Domain	Items	Time point
Bath Adolescent Pain Parent Impact Questionnaire (BAPQ-PIQ)26	Parent	62	T1, T2, T3
The Bath Adolescent Pain Questionnaire (Parent Proxy)27	Multiple	61	T1, T2, T3
Revised Child Anxiety and Depression Scale (Parent Proxy)28	Psychological function	47	T1, T2, T3
Child Self Efficacy Scale (Parent Proxy)29	Psychological function	7	T1, T2, T3
Fear of Pain Questionnaire (Parent Proxy)30	Psychological function	24	T1, T2, T3
Pain numerical rating scale (Parent Proxy)	Pain	3	T1, T2, T3
PROMIS Pediatric Pain Interference Scale (one sleep question) (Parent Proxy)31	Sleep	1	T1, T2, T3
School Attendance (paper diary for last two weeks)	Role function	1	T1, T2, T3
Economic Impact: (Travel and Time). Best estimate in last 2 months of: total trips to hospital or clinic for pain related checkup (specialist, GP, Physiotherapist, psychologist OT etc); average km travelled each hospital/clinic trip; average number of hours spent at each hospital/clinic trip; estimated number of workdays missed by family member due to child’s pain. Modified from Ho et al32	Economic	4	T1, T2, T3
Global satisfaction: "Please consider the following aspects of your child’s treatment – Physical function, emotional function, sleep, pain, their role as a student and family member, and any adverse events that may have occurred during treatment. Considering the above factors please indicate on the scale below how satisfied you were with treatment (0–10 Numerical Rating Scale)."	Global satisfaction	1	T2, T3
Adverse events: documented by clinicians in medical record, and included in Global Satisfaction question to participants	Adverse events	1	T2, T3
Feedback: "What were most helpful part of your treatment for you and your child, the least helpful part of your treatment for you and your child, any changes you would suggest?"	Not applicable	1	T2, T3
Total Items		213

Figure 1

Participant flow.

Notes: T1=Time point 1, T2= Time point 2, T3 = Time point 3.

Interventions

Clinical Concepts Common to Both Streams

The treatment team for both intervention streams was the same and included a clinical psychologist, physiotherapist and occupational therapist who were all experienced in managing patients with complex pain. The intervention was informed by several sources5,19,20 and used an interdisciplinary cognitive behavioural pain management model, delivered within a neuroscience psycho-educational framework. The primary themes were the promotion of self-efficacy and increased engagement in functional activities despite pain; independence from medical and social care; and return to normal adolescent activity including school. The treatment model explored how pain can be amplified by thoughts and feelings; physiological responses (fight or flight); and maladaptive behavioural responses to pain. A contemporary pain neuroscience platform was used to describe the perpetuating factors of pain and provide the rationale for engaging in cognitive behavioural pain management strategies including “balanced thinking”, goal setting, activity management, physical conditioning, communication skills training, sleep health, relaxation and mindfulness, and graded exposure to challenging activities. Participants were encouraged to: identify their own activity/pain patterns; set goals; identify core daily exercises based on treatment goals; plan and prioritize activities; and schedule their days (including avoiding long periods of rest or activity). Parents received the same information as the adolescents in addition to skills training to promote reinforcement of pain management strategies at home. Parents and adolescents were also asked to identify avoidant behaviours and develop a plan to address them using a graded hierarchy. These concepts were presented in age-appropriate terms, using metaphors and analogies to support learning. A file with handouts and worksheets was provided for both adolescents and parents. Families also had support from a school liaison teacher. Clinicians met at least weekly to discuss the participant’s progress and provide interdisciplinary support to each other, with one clinician being allocated as a case manager for each participant.

Standard Care

The adolescent and their parent were assessed by the team during 3 one hour “face-to-face” individual sessions. Treatment was then provided in individual sessions by each therapist. The therapists endeavoured to co-ordinate their bookings with each other to reduce travel time for the participants. Sessions with each clinician were generally offered fortnightly to ensure similar treatment intensity in both streams. The number and length of treatment sessions was recorded. The treatment model and content was the same as Hybrid-PIPP but was less structured - the order of content delivery and time spent on each topic was determined on a case by case basis by each therapist for their particular session, which was standard practice in the hospital at the time.

Hybrid-PIPP

The Hybrid-PIPP program was conducted over 7 weeks (Table 2) with a structured schedule. The adolescent and their parent/carer attended a 2 hr face-to-face physical assessment (physiotherapy and occupational therapy combined) and a 1 hr face-to-face psychology assessment. They then commenced the next available Hybrid-PIPP program which consisted of an initial 7 hr face-to-face workshop (involving up to 8 families attending parallel group sessions for carers and adolescents); a five-week period involving four individual videoconference sessions in their home (detailed below); and a final 4 hr face-to-face workshop (total hours detailed in Table 2). The workshops were facilitated by the three treating clinicians plus a clinical assistant. The total contact time for the workshops and videoconference sessions was 14.5 hrs (plus 3 hr physical and psychological assessment).

Table 2

Service Delivery of Hybrid-PIPP

Week	Intervention	Therapists (n)	Delivery	Hours
	Assessment at hospital	3	Individual	3
1	Workshop at hospital	4	Group	7
2	Telehealth session at home	1–3	Individual	1
3	Telehealth session at home	1–3	Individual	1
4	Telehealth session at home	1–3	Individual	1
5	Telehealth session at home	1–3	Individual	0.5
6	No contact	NA	NA	0
7	Workshop at hospital	4	Group	4
				Total 17.5

Abbreviations: PIPP, pediatric interdisciplinary pain program; NA, not applicable.

Videoconference Support Sessions

Videoconference sessions used SCOPIA () that was the hospital’s recommended system at the time. SCOPIA provided an encrypted video link between the hospital and the participant’s home, community or school environment. The structure of the sessions was informed by an evidence-based internet delivered adult pain program described by Dear et al21 and aimed to:

Summarize content from the face-to-face workshop, but not deliver new concepts or content.

Answer questions.

Reinforce progress and encourage practical application of pain management strategies.

Normalize challenges of treatment.

Gain feedback about the participant’s engagement in the program.

The adolescents were asked to complete daily charts related to activity management, cognitive strategies, and flare up and set back planning that were reviewed at the videoconference sessions. Parents were monitored by verbal questioning during the videoconference session with an emphasis on supporting parental skills acquisition utilizing a problem-solving-based approach.

The initial protocol determined that families participate in 30 min home videoconference sessions with their case manager in Weeks 2 to 5. However, following the assessment of the first group of participants in the Hybrid-PIPP group, the clinical team decided to increase the time allocated for these sessions to 60 mins in Weeks 2 to 5 so that they could do a 30-min session with the adolescent, and the remaining time with their carer. This was continued for all Hybrid-PIPP participants. Additionally, the original protocol described videoconference input from only the case manager whereas the adjusted protocol allowed for the case manager to request input from other clinicians in the team as required (eg, specialized input regarding mood was directed by the psychologist and advice on physical activity was directed by the physiotherapist).

Analysis

Data were analyzed using statistical software Stata 14 (College Station, TX: StataCorp LP). This was a feasibility study therefore the analysis used descriptive statistics with proportions, medians and ranges reported due to skewed distributions and small sample size.22

Results

Figure 1 shows the enrolment and progression of participants through the study. Recruitment commenced in August 2014 with the intention of recruiting for 3 Hybrid-PIPP groups with matched Standard Care participants. Recruitment ceased in March 2015 after 2 Hybrid-PIPP groups were delivered, when a higher than expected level of disability was identified in both streams (Standard Care FDI median 27, range 18–41, Hybrid PIIPP FDI median 28.5, range 18–45). It became clear that the 14.5 hr intervention was insufficient for the level of disability, and funding became available for a more intensive program. The clinical reasoning for this decision is described in the discussion.

Eighteen consecutive adolescent/parent dyads were assessed for eligibility and 2 were excluded as they did not meet criteria. The 3 families who were being triaged when the decision was made to stop the trial were provided with an alternative treatment in the same hospital. In total, 13 families were randomly allocated to the two treatment streams with 7 families allocated to the Hybrid-PIPP and 6 to Standard Care. One family chose not to commence Hybrid-PIPP because of problems arranging parental leave. This family requested a place on a future program, but the trial was ceased. Two families in the Standard Care stream chose to attend Hybrid-PIPP after their involvement in the study was complete. In total both Hybrid-PIPP groups had 4 participating families. All families that commenced Hybrid-PIPP completed the intervention and final data collection. Two families dropped out of the Standard Care stream – one actively withdrew before commencement to participate in a drug trial, and one passively withdrew during treatment by declining to attend (no reason given). Details can be seen in Figure 1. Table 3 presents demographic data for the two treatment streams, Table 4 presents the feasibility criteria results, Table 5 reports the attendance data, and Table 6 details the qualitative feedback from clinicians.

Table 3

Adolescent Demographics

	Hybrid-PIPP	Standard Care
Gender (n)	Female: 6Male: 0	Female: 4Male: 1
Age median (range)	14.9 (14.4 to 17.8)	15.2 (12.1 to 16.6)
FDI median (range)	28.5 (18 to 45)	27 (18 to 41)

Abbreviations: PIPP, pediatric interdisciplinary pain program; FDI, Functional Disability Index.

Table 4

Feasibility Criteria

	Hybrid-PIPP	Standard Care
At least 70% of participants complete the seven-week intervention	86%	83%
At least 60% of participants complete the Week 11 data collection	86%	67%
Suitably qualified staff available?	Yes
An average of three families recruited/month with 90% eligible?	Yes

Abbreviation: PIPP, pediatric interdisciplinary pain program.

Table 5

Attendance

	Hybrid-PIPP (Count)	Standard Care (Count)
Total number of appointments attended in stream: expected attended	3634 (94%)	4025 (63%)
Rescheduled	0	9
Did not attend	2	7
Withdrew from treatment	0	2

Abbreviation: PIPP, pediatric interdisciplinary pain program.

Table 6

Qualitative Feedback

1. Acceptability of Hybrid-PIPP to clinicians

General Face to face aspects of the workshops were very beneficial, allowing peer support and opportunities for behavioral shaping. The primary issue identified was that this contact time and follow up period was too short for the level of disability and distress seen in the participants. Because of the disability and distress seen in the participants, the group should involve 6 rather than 8 families to ensure all participants get the individualized attention required. Telehealth sessions were designed to promote engagement in pain management strategies taught in the face to face workshop. However, clinicians often had to use the telehealth sessions to teach basic concepts because of the limited face to face time. Participants in Hybrid-PIPP with rigid schedule had much better attendance than the flexible Standard Care schedule – “this was unexpected”. Limitations of telehealth (Therapeutic) Limited capacity for therapists to use behavioral strategies such as shaping incidental healthy behaviors during telehealth. Spontaneous healthy behaviors were less likely to occur in this type of setting because the participant was usually seated. Graded exposure programs were discussed but were hard to implement during the session. Barriers to the development of a therapeutic relationship because of the interaction via a screen. The individual telehealth sessions did not provide capacity to “leverage” clinician time by interacting with several participants at the same time; or the development of positive group effects seen at the workshop such as peer problem-solving approaches. The less formal home environment appeared to reduce the value placed on the intervention by some participants and lead to disengagement such as the use of mobile phones during the session. Telehealth into the home may reinforce avoidance behaviors such as avoiding outings, car travel, etc. Difficult to access private time with the parent because computer access is often in public family space. Limitations of Telehealth (Practical) Technical difficulties with videoconferencing – problems for both participants and clinicians logging in to the SCOPIA software. Difficulties in accessing room with teleconference equipment (eg, clinicians using room beforehand were running late, speakers had been removed). Image quality made it difficult to review activity and planning charts at times. Positive aspects of telehealth into the home More convenient for the participants and their families Allows for a de-medicalization of the pain condition (ie, participants are not seen as sick enough to need to attend hospital) which fits with the biopsychosocial model of management. Reduced load on the hospital (eg, parking, therapeutic space) Aspects that could be developed Increased individual parent sessions without adolescent present, offered at convenient times such outside of normal work hours. The use of a mobile device could allow evaluation of activities of daily living in the home environment process (eg, bath/toilet transfers) that would be prohibited otherwise due to travel time. Home telehealth sessions could be extended to involve other key people in the adolescent's life such as grandparents, siblings, and schools. Improved processes to determine post treatment support needs for each family. Currently those that need help the most do not return to the pain team but present to the Emergency Department instead which reinforces a medical model

2. Acceptability of Standard Care to clinicians

Significant issues were reported with the unstructured appointment timetable in Standard Care, including repeated rescheduling of appointments by parents, and frequent non-attendance at booked sessions. This took up significant clinician and administration time, particularly when trying to organize appointments for families to see 2 or 3 clinicians on the same day to save travel demands. Standard Care did not allow “leveraging” of clinician’s time by interacting with multiple participants at one time, or peer support for participants, as existed in the group model.

3. Feedback Common to Both Treatment Streams

The development of online resources to enhance the therapeutic process for adolescents and parents would be very beneficial particularly if specific information could be “pushed” to participants as required. It would also improve efficiency because the clinician would not need to repeat information. Eligibility Criteria - Some participants remain focused on seeking further diagnoses and medical model treatments. The addition of inclusion criteria “no further investigations or medical treatments are required, and the child and parent accept this notion” may ensure families are ready to accept a biopsychosocial model. A three months history of pain appeared too short for families to accept biopsychosocial model treatment. Recruitment, consent and randomization process – ran smoothly – families accepting of allocation. Primary measures – to determine if the intervention is a success, improvements in functional ability; increased school attendance; and reduced parental protective behavior need to be demonstrated. Therefore, suggested primary measures are FDI, parent or school reported school attendance last term, and the Parent Behavior scale of the BAPQ-PIQ.

4. Data Collection Forms

Data collection was much easier in the Hybrid-PIPP as it was administered in a group setting on iPads at the hospital. Collection of data from Standard Care stream at time points 2 and 3 (when participants did them at home) required considerable clinician time to chase up. Electronic data capture system was non-intuitive and did not provide functions required (eg easy identification of missing data and download of a full raw data set). The system wasted time and was frustrating. Issues were noted with the data capture for school attendance. Parents were asked about a child’s attendance in the last 2 weeks which lead to school holiday periods being misreported as school absence. It was identified that the Department of Health database could be used to determine healthcare utilisation in the evaluation of future interventions.

Abbreviation: PIPP, pediatric interdisciplinary pain program.

The study met predetermined feasibility criteria for completion of intervention, data collection, recruitment rate and staffing (Table 4). Although treatment sessions in Standard Care were usually offered fortnightly (to have similar treatment intensity in both streams) the uptake of sessions varied. Only 63% of the recommended sessions were attended in the Standard Care stream, compared to 94% in the Hybrid-PIPP stream. The Hybrid-PIPP stream had superior attendance and used staff resources more efficiently than the Standard Care stream (Tables 5 and 6 Section 2). The Hybrid-PIPP stream had similar participant Global Satisfaction ratings to Standard Care (median 7, range 5–9), Hybrid-PIPP (median 8.5, range 5–10) on an 11-point scale. No adverse events were reported in either stream.

Treatment Outcome Measures

Both streams had a similar trend for most variables with improvements seen at 7 weeks that were not maintained at 11 weeks. The median (range) for functional disability (FDI) in the Hybrid-PIPP stream at baseline, 7weeks, and 11 weeks, respectively, was 28.5 (18–45), 23 (10–42), and 26.5 (8–44). The median (range) for functional disability (FDI) in the Standard Care stream at baseline, 7weeks, and 11 weeks, respectively, was 27 (18–41), 26 (14–35), and 27 (8–36). Neither group showed improvements over the 30% threshold in any measure required for clinical significance.23

Feedback from Clinicians

Semi-structured interviews with the treating clinicians on completion of the study provided feedback detailed in Table 6.

Discussion

While the study met a priori feasibility criteria relating to the availability of suitably trained staff; the rate of recruitment; treatment completion; and data collection - qualitative data identified several factors which limit the protocol’s usefulness for a randomized controlled trial. These included the intervention intensity related to participant disability, and time inefficiencies related to attendance. Because of this, the protocol was considered impracticable without significant modification.

Attendance was identified as a significant issue in the Standard Care stream. Whilst intuitively it might appear that flexible appointment scheduling would lead to better attendance, in this study this was not the case. In the Standard Care stream, the families booked sessions at their convenience and were able to reschedule appointments as required. This required considerable administrative and clinician time to coordinate appointments between the 3 practitioners, made more complex by attempts to book sessions with all three clinicians in 1 day to reduce the travel burden on the participants. Despite this flexibility there was frequent poor attendance in this stream including both non-attendance of booked appointments, and poor uptake of offered sessions. Only 63% of the recommended sessions were attended by the families completing the Standard Care stream (that had flexible scheduling policy), compared to 94% in the Hybrid-PIPP stream (that had a rigid scheduling policy) see Table 5. Further inefficiencies in the Standard Care stream included the inability to leverage clinician time (such as by seeing more than one participant at once in a group), and time required to facilitate data collection. Taken as a whole, within this research protocol the Standard Care model was considered impractical by clinicians.

In the Hybrid-PIPP stream, the primary issue was lack of intensity in the initial workshop, limiting the capacity to teach pain management skills, shape behaviors, and develop therapeutic relationships. This lack of intensity in the face-to-face component resulted in the videoconference sessions being used to deliver basic pain management strategies rather than reinforcing progress and encouraging skills practice as was intended. In addition, the positive group effects seen in the workshop could not be developed further in the individual videoconference sessions. This significantly limited the potential benefits of peer problem solving and support for both the adolescents and their parents. For some participants, the home base treatment was believed to reinforce avoidance behavior (eg, adolescents staying in their bedroom) and diminish the value that participants placed on the intervention (eg, using mobile phones during sessions). Separate videoconference sessions with the adolescent and their parent were also difficult to arrange.

The decision to stop recruitment early was related to funding and clinical reasoning that was informed by a) evidence-based guidelines that recommend interventions of at least 60 hrs for individuals presenting with high levels of disability and distress,24 and b) comparison of participant disability levels to 5 published studies of children with chronic pain summarized by Gauntlett-Gilbert and Eccleston.25 The authors reported FDI values varying from 11.3 to 26.3. The functional disability in the study cohort was considered high in comparison (Standard Care median 27 (18 −41), Hybrid PIIPP median 28.5 (18–45)). The 14.5 hr Hybrid-PIPP intervention was determined to be too brief for the study cohort. At the time that the protocol was developed there was no funding allocated to interdisciplinary pediatric pain management in the health service where the study took place. During the study, funding for an intensive pain program became available. Recruitment was stopped at this time because it was considered unethical to continue if a more intensive option was available. This decision was affirmed when the outcome data were analyzed, and no clinically significant improvement was seen in either stream.

Geographical barriers will remain for this high-intensity group until effective remote delivery methods are developed. More work needs to be done in area of e-Health delivery of pain interventions to determine which components of treatment, for which families, can be delivered in this way.7 To facilitate this, studies should describe the intervention in detail so that possible active components can be determined.7,11 This knowledge, along with a clearer understanding of factors that predict success, will provide a structured model for triage into various treatment delivery streams11 and intensities.

Limitations of the study include the inability to blind the participants and clinicians to the stream allocation, and fewer participants than anticipated. There was a variation in treatment intensity between streams because of poor uptake of the Standard Care sessions offered. Although time spent on scheduled clinical interactions and non-attendance of appointments was recorded, non-acceptance of offered treatment, and administrative time spent coordinating appointments was not. Fidelity checking of the intervention curriculum was not completed. There was a significant burden on clinical staff to recruit participants and ensure data were collected and processed accurately which reduced their capacity to provide clinical services and was a potential source of experimental bias. The electronic database we used made it difficult for clinicians to identify and rectify missing data points and did not have the functionality required as raw data could not be exported for the cohort.

Recommendations

Considering the inefficiencies demonstrated in the Standard Care stream, the original protocol is not considered practicable within our hospital funding environment without a significant increase in staff funding. We recommend that further research should focus on either a single-case experimental design or a single stream study to investigate a modified Hybrid-PIPP program (with a waitlist control if practicable). Modifications should include: eligibility requirements changed from pain disorder >3 months to >6 months, and the addition of “all investigations completed and parents accepting of a biopsychosocial model”; capacity to provide at least two levels of treatment intensity (according to levels of adolescent pain-related disability, and adolescent and parent distress) with the intensive intervention having at least 60/30 hrs for the adolescent/parent; group size limited to 6 families at one time; group videoconference sessions rather than individual to facilitate peer support and engagement for adolescent and parents (run separately); documentation of type and duration of administrative tasks related to intervention delivery; development of digital resources to support learning and to leverage clinician time; research support and an intuitive electronic database; technical support for clinicians; selection of the FDI17, parent or school reported school attendance last term, and the Parent Behavior scale of the Bath Adolescent Pain Parent Impact Questionnaire26 as the primary outcome measures; and adverse events data to be recorded with a separate question rather than limited to inclusion in global satisfaction.

In summary, although the a priori feasibility criteria were met, the limitations identified in the qualitative analysis meant that the protocol requires significant modification for a future study to be feasible.

Conclusion

There are significant challenges evaluating technology-based service delivery methods within real word health environments. This study describes the development of a protocol to evaluate a pediatric pain intervention delivered in part using videoconferencing. The study determined that the protocol met a priori feasibility criteria, but to be practicable in our hospital environment requires significant modifications related to issues identified regarding 1) attendance, time efficiency and data collection in the Standard Care stream, 2) the intensity of both interventions related to the disability of the participants, and 3) the study design.

Recommendations are made for either a single-case experimental design or a single stream study using a modified version of Hybrid-PIPP with an increased number of face-to-face contact hours and/or online resources. The significant challenges identified in this study highlight the importance of feasibility studies in the development of evaluation protocols for complex interventions such as PIPPs, particularly when evaluating new service delivery methods such as videoconferencing.

Generalizability

These results could be cautiously generalized to other pediatric pain populations if consideration is taken of comparative levels of disability (measured by the FDI), tertiary referrals and eligibility criteria. This paper was written and accepted for publication before COVID-19. Some of the recommendations may not be feasible during a pandemic where face to face clinical contact is limited.