| Literature DB >> 35143494 |
Katherine Kuhl-Meltzoff Stavropoulos1, Yasamin Bolourian1, Jan Blacher1,2.
Abstract
BACKGROUND: Considering the COVID-19 pandemic, understanding the reliability, validity, social validity, and feasibility of using telehealth to diagnose ASD is a critical public health issue. This paper examines evidence supporting the use of telehealth methods to diagnose ASD and outlines the necessary modifications and adaptations to support telehealth diagnosis. METHODS AND PROCEDURES: Studies were identified by searching PubMed and PsychInfo electronic databases and references lists of relevant articles. Only peer reviewed articles published in English with a focus on using telehealth for the purposes of diagnosing ASD were included. Searches were conducted through June 3rd, 2021. OUTCOMES ANDEntities:
Mesh:
Year: 2022 PMID: 35143494 PMCID: PMC8830614 DOI: 10.1371/journal.pone.0263062
Source DB: PubMed Journal: PLoS One ISSN: 1932-6203 Impact factor: 3.240
Fig 1PRISMA flow diagram for selection of studies.
Search terms and reasons for exclusion.
|
| |
| Population of Interest | “ASPERGER” OR “PDD-NOS” OR “AUTISM” OR “AUTISTIC” |
| Type of telehealth | “TELEHEALTH” OR “TELEMEDICINE” OR “TELECARE” OR “VIDEOCONFERENCE*” OR “STORE AND FORWARD” |
| Diagnostic procedures | “DIAGNOSIS” OR “ASSESSMENT” OR “DIAGNOSTIC” |
|
| Not an original article (reviews/meta-analyses, proposals not supported by data) |
| Not in English | |
| Not an ASD sample | |
| Evaluation of symptoms or behaviors not for diagnostic | |
| Assessment through machine learning or telephone only | |
| Training for parents or providers | |
| Treatment, intervention, or therapy | |
| Consultative or collaborative care | |
| Qualitative data only (e.g., stakeholder feedback only) |
Sample characteristics of included studies.
| Study | Country | State/ Region | Sample | Age at evaluation | Sex | Race | SES | Type of community |
|---|---|---|---|---|---|---|---|---|
| Savin et al., | USA | Rapid City, South Dakota and Denver, Colorado | 21 children | NR | American Indian | |||
| Reese et al., | USA | Midwest | 21 children (11 with pre-existing diagnosis of ASD; 10 with pre-existing diagnosis of DD) | 3–5 yrs. | 18 males | 19 white, 1 African American, 1 biracial, | NR | NR |
| Nazneen et al., | USA | Georgia | 5 children (4 with pre-existing diagnosis of ASD) 3 clinicians | 2–6 yrs. ( | NR | NR | NR | NR |
| Reese et al., | USA | NR | 17 families | 2.4–5.8 yrs. ( | 70.6% male | 88.2% white, 5.9% African American 5.9% Hispanic | NR | NR |
| Schutte et al., | USA | Pittsburg, Pennsylvania | 23 adults with an existing diagnosis of an ASD | 19–30 yrs. ( | 16 males | NR | NR | |
| Smith et al., | USA | Southwest | 51 families (11 TD children) | 18 mos. - 6 yrs., 11 mos. | 36 males | 21 Caucasian, 22 Hispanic, 4 Black, 4 Other | NR | NR |
| Juarez et al., | USA | Study 1: NR Study 2: Rural counties | Study 1: 20 families of children with early concerns about ASD Study 2: 45 families (29 children with ASD) | Study 1: 20–34 mos. ( | Study 1: 16 males Study 2: 35 males | Study 1: NR Study 2: 30 White/Non-Hispanic, 9 Black/African American, 3 Hispanic, 3 Biracial | Study 1: NR Study 2: 62% of caregivers in the ASD sample reported highest grade completed as high school. Partnered with local regional center for families that had a high poverty rate; county data reported (median household income: $40,541.20; % living in poverty: 20.25) | Study 1: NR Study 2: No sample data reported; partnered with a regional center serving 23 rural county regions, geographically distant from the urban diagnostic centers in the state |
| Sutantio et al., | Indonesia | Jakarta | 40 families | 18–30 mos. | 29 males | NR | NR | NR |
| Wagner et al., | USA | Tennessee, Alabama, Kentucky | 204 children; 9 clinicians | 16–36 mos. ( | 157 males47 females | NR | NR | NR |
| Corona et al., | USA | NR | 51 families of young children (35 were recruited from a research database consisting of children with ASD and DD) 7 assessors | 18–36 mos. | 46 males 15 females | 32 White 10 Black or African American 2 More than one race; 3 Hispanic or Latino | Within the ASD sample, 23% reported household income as $50,000 or less; 52% as $50,000-$100,000, 20% as $100,000 or more (6% did not answer) | NR |
NOTE. If participants had a pre-existing diagnosis, the N was reported under the sample column. Information on SES (socioeconomic status) is provided in the table if parental education or income was reported in the study.
Telehealth assessment information and procedures from included studies.
| Study | Telehealth method and location | Telehealth assessment protocol and modifications | Telehealth assessment completion time | People involved in telehealth assessment procedures |
|---|---|---|---|---|
| Savin et al., | Video-conferencing from home | Clinical evaluation | Approximately 80 minutes | Two general psychiatrists, one psychologist, and one nurse practitioner who have more than 20 collective years of full-time experience at the hospital; the two psychiatrists had more than 12 collective years of experience working with American Indians Both child and caregiver present during telehealth assessment. |
| Reese et al., | Video-conferencing simulation at a university medical center; one room was connected through video-conferencing to an observation room in the same building | ADOS Module 1: Caregivers administered ADOS presses ADI-R: Only algorithm items were administered | NR | Five clinicians who were blinded to participant diagnosis; clinicians received training on the ADOS, ADI-R, and DSM-IV-TR diagnostic criteria for autism, and had experience working on interdisciplinary teams Caregiver facilitated the ADOS and was provided instructions on how to administer ADOS presses |
| Nazneen et al., | Store and forward; home videos recorded and uploaded by caregivers | Clinical evaluation via NODA systems (i.e., smartCapture and Connect) | Using the NODA Connect portal, diagnosticians reported an average of 68 minutes to review videos and complete assessment; average of 37 minutes was reported for TD children | Three diagnosticians experienced in autism diagnosis and unfamiliar with diagnostic assessments via NODA systems Caregivers recorded as many as four, 10-minute long videos of the child in specific settings and uploaded them to the NODA assessment portal. Instructions were provided. |
| Reese et al., | Video-conferencing simulation at a university medical center; one room was connected through video-conferencing to an observation room in the same building | Observation of unstructured play, modified ADOS-2 activities, ADI-R interview using algorithm items only, and medical/family history | NR | Four research clinicians worked in pairs (one per setting–videoconferencing and in-person) Caregivers were directed through modified ADOS-2 activities (following procedures from Reese et al., 2013) |
| Schutte et al., | Video-conferencing at a clinician site (e.g., University of Pittsburgh) and a client site (e.g., rural clinic) | ADOS Module 4 | NR | One Module 4 research reliable clinician Caregivers were not reported to be present or involved during telehealth assessments (likely due to the age of participants, i.e., young adults) |
| Smith et al., | Store and forward; home videos recorded and uploaded by caregivers | Store and forward: Brief developmental history interview and DSM-5 checklist for ASD using video data In-person assessment: ADI-R, ADOS-2, VABS, MSEL/KBIT | Most completed the assessment in under an hour | Assessor: Psychologist with 20 years of experience evaluating individuals with ASD for research purposes Raters: Primary NODA rater with a master’s degree in psychology and 10 years conducting ASD assessments. 10 secondary raters, either clinical or research professionals, with a minimum of 10 years of experience conducting observational assessments for ASD; all raters received a 30-minute training on NODA procedures and assessment portal Caregivers recorded as many as four, 10-minute long videos of the child in specific settings and uploaded them to the NODA assessment portal. Instructions were provided, following procedures from Nazneen et al., 2015. |
| Juarez et al., | Video-conferencing through clinic rooms at a health care facility | Study 1 and 2: STAT, DSM-5 Clinical Interview, DSM-5 Symptom Checklist, MSEL, VABS, ADOS-2 | Telemedicine appointment lasted no more than 1-hour. | Study 1: licensed psychological provider Study 2: psychologists and STAT administrator Caregivers were not involved in the administration of assessments in Study 1 or 2. |
| Sutantio et al., | Store and forward; home videos recorded and uploaded by caregivers | Indonesian-translated DSM-5 checklist for ASD | NR | Evaluation of videorecording was done by a psychologist with 15 years of experience diagnosing ASD. ASD diagnosis done by a pediatric neurologist with 30 years of experience. The two diagnosticians had 15 years of experience in the same clinic together. |
| Wagner et al., | Video-conferencing from home using a personal device (smart phone, tablet, laptop) to access a Zoom video platform | TELE-ASD-PEDS | 67% reported spending between 60 to 120 minutes and 33% reported spending 120–180 minutes during telemedicine visits | Nine licensed clinical psychology providers with expertise diagnosing ASD in young children (M years of experience in pediatric settings with children with ASD = 8 years, SD = 6.14 years, range 2–20 years). All clinicians were research reliable on the ADOS-2. Two clinicians reported using telemedicine in clinical practice. Caregivers were guided to complete interactive activities with their children during telehealth appointments. |
| Corona et al., | Video-conferencing through tele-screening rooms (rooms connected by video conference technology to both the clinician and the family) | TELE-STAT, TELE-ASD-PEDS | On average, 23 minutes per tele-visit (SD = 5 minutes) | Seven licensed clinical psychologists and licensed senior psychological examiners with expertise in diagnosing ASD in young children. All assessors were research reliable on the ADOS-2. Caregivers were guided to complete interactive activities with their children during telehealth appointments. |
Outcomes of included studies.
| Study | Reliability reported? | Validity reported? | Social Validity reported? | Feasibility reported? | |
|---|---|---|---|---|---|
| Sensitivity | Specificity | ||||
| Savin et al., | No | No | No | Yes | Yes |
| Reese et al., | Yes | No | No | Yes | Yes |
| Nazneen et al., | Yes | Yes | Yes | Yes | Yes |
| Reese et al., | Yes | Yes | Yes | No | No |
| Schutte et al., | Yes | No | No | Yes | Yes |
| Smith et al., | Yes | Yes | Yes | No | No |
| Juarez et al., | Yes | Yes | No | Yes | Yes |
| Sutantio et al., | Yes | Yes | Yes | No | No |
| Wagner et al., | No | No | No | Yes | Yes |
| Corona et al., | Yes | Yes | Yes | Yes | Yes |