| Literature DB >> 35162220 |
Prabal Datta Barua1,2, Jahmunah Vicnesh3, Raj Gururajan1, Shu Lih Oh3, Elizabeth Palmer4,5, Muhammad Mokhzaini Azizan6, Nahrizul Adib Kadri7, U Rajendra Acharya3,8,9.
Abstract
Mental disorders (MDs) with onset in childhood or adolescence include neurodevelopmental disorders (NDDs) (intellectual disability and specific learning disabilities, such as dyslexia, attention deficit disorder (ADHD), and autism spectrum disorders (ASD)), as well as a broad range of mental health disorders (MHDs), including anxiety, depressive, stress-related and psychotic disorders. There is a high co-morbidity of NDDs and MHDs. Globally, there have been dramatic increases in the diagnosis of childhood-onset mental disorders, with a 2- to 3-fold rise in prevalence for several MHDs in the US over the past 20 years. Depending on the type of MD, children often grapple with social and communication deficits and difficulties adapting to changes in their environment, which can impact their ability to learn effectively. To improve outcomes for children, it is important to provide timely and effective interventions. This review summarises the range and effectiveness of AI-assisted tools, developed using machine learning models, which have been applied to address learning challenges in students with a range of NDDs. Our review summarises the evidence that AI tools can be successfully used to improve social interaction and supportive education. Based on the limitations of existing AI tools, we provide recommendations for the development of future AI tools with a focus on providing personalised learning for individuals with NDDs.Entities:
Keywords: artificial intelligence; machine learning; mental disorders; neurodevelopmental disorders; personalisation
Mesh:
Year: 2022 PMID: 35162220 PMCID: PMC8835076 DOI: 10.3390/ijerph19031192
Source DB: PubMed Journal: Int J Environ Res Public Health ISSN: 1660-4601 Impact factor: 3.390
Figure 1(a) Normal brain and (b) ADHD brain with smaller volume.
Figure 2(a) Large neural adaptation in normal brain and (b) reduced neural adaptation in dyslexic brain.
Figure 3(a) Neurotypical brain and (b) ASD brain with denser neural connections.
Individualised educational practices in schools for children with ADHD.
| Learning Area | Intervention |
|---|---|
| Reading comprehension | Establish a sustained silent reading time daily. |
| Phonics | Teaching children simple reminders on how to learn tougher phonics. |
| Writing | Using storyboards to teach students to recognise parts of a story for writing. |
| Spelling | Aligning spelling words to frequently used words by children everyday. |
| Handwriting | Using special writing paper or teaching how to use a finger spacing to space out each word when writing. |
| Mathematics computation | Using mnemonics to describe fundamental steps easily for Maths computation. |
Individualised educational practices in schools for children with dyslexia.
| Learning Area | Intervention |
|---|---|
| 1. Failure in reading, grouping letters in words. | Using visual perceptions, such as signage or touching letters, to help in reading. |
| 2. Phonology | Employing strategies that help phonological processing, such as ‘minimal pairs,’ ‘common syllable words,’ and ‘vocal syllabification’ [ |
| 3. Grammar | Using grammatical processing strategies, such as ‘syllabification,’ ‘declension of nouns,’ ‘stress,’ and ‘nouns’ [ |
| 4. Writing | Using the syntactic approach to teach punctuation and sentences/paragraphs. |
Individualised instructional practices in schools for children with ASD.
| Structured Teaching Strategies | Intervention |
|---|---|
| Physical structure | Establish a supportive classroom environment by creating clear physical or visual boundaries such that expected behaviours for each defined space can be taught and reinforced [ |
| Reducing auditory and visual disturbances | Too much auditory or visual stimuli may hamper processing power; hence, unnecessary distractions are removed in classrooms to help students focus better on concepts taught [ |
| Visual schedules | Implementing visual schedules for the day (instead of using verbal probes), according to the learning needs of each student to enhance student independence and engagement during lessons [ |
| Work system | Implementing a work system for any type of educational activity helps to organise the student by providing a systematic work routine [ |
| Visual structures | Adding a physical or visual aspect to some tasks to help students understand better how an activity needs to be completed [ |
Figure 4Sequence of steps for training a machine learning model.
Figure 5Illustration of the CNN model.
Figure 6Illustration of the LSTM model.
Figure 7Illustration of the Autoencoder model.
Results of the Boolean search string for the respective repositories.
| Boolean Search String | |||
|---|---|---|---|
| Database | Title | AND [Title/Abstract/Full Text] | No. of Articles |
| IEEE | “Autism spectrum disorder”, AND/OR “Attention deficit hyperactivity disorder” AND/OR “dyslexia”, Artificial intelligence AND/OR tools, students AND/OR learning | Machine learning, Neural networks, deep learning | Autism: 0, ADHD: 1, Dyslexia: 0 |
| Google Scholar | Autism: 12 100, ADHD: 3900, Dyslexia: 3800 | ||
| PubMed | Autism: 0, ADHD: 0, Dyslexia: 0 | ||
| Science Direct | Autism: 176, ADHD: 172, Dyslexia: 97 | ||
| Springer Link | Autism: 357, ADHD: 179, Dyslexia: 144 | ||
Figure 8Flowchart detailing the use of PRISMA guidelines for selection of relevant articles.
Review of AI assistive tools used to address learning disabilities of students with NDDs.
| Author/Year | AI Tool | Features/Model Used for Training | Type of Technology | Learning Area Addressed | Effectiveness |
|---|---|---|---|---|---|
|
| |||||
| 2014 [ | KAR robot | - | Assistive technology | Improve social skills via storytelling. | Improves children’s cognitive performance. |
| 2015 [ | Child activity sensing and training tool |
42 features (users’ physical and physiological) Machine learning algorithm (not specified) | Real time assistive technology | Real-time assistive tool that tracks activities and helps students sustain attention. | An assistive intervention that is based on a smartphone and has the potential to aid a child with ADHD who has lost focus in his/her work. |
| 2018 [ | WatchMinder vibrating watch |
Sensors that collect activity and behaviour data Bespoke algorithm/application | Wearable technology | Helps to send constant reminders to students to refocus on their work. | The watch has been effective as a simple memory aid for ADHD children with the auditory or vibrating alarm feature. The watch has been found to be affordable, durable, dependable and effective by users [ |
| 2018 [ | Speech recognition software (Dragon Naturallyspeaking(Dragon Sytems company, United States, version 15, /Voice Finger/ViaTalk (LLC Company, New York/Tazti (Voice Tech Group company, United States) |
Audio data Deep learning models (spectrograms/filter banks [ | Assistive technology | Replaces writing activity with speech to allow students to express themselves efficiently without tiring themselves | Dragon Naturallyspeaking, Voice Finger, Via Talk, Tazti softwares have been reported to be beneficial to students with ADHD and resulted in improvement in the areas of writing, reading and spelling [ |
| 2018 [ | Talking calculators |
User’s data such as pressing of numbers Built-in speech synthesiser | Assistive technology | Helps students hear and process numbers easily for mathematics. | Students are able to complete assessments faster with the help of the calculator and has helped students gain independence [ |
|
| |||||
| 2013 [ | Intelligent dyslexic system | Machine learning algorithm, visualisation concept | Assistive technology | Helps students gain knowledge on alphabets and letters | The technology has the potential to improve the reading and writing skills of students. |
| 2014 [ | Agent DYSL adaptive reading system | Machine learning algorithm, Mel-frequency cepstral coefficients, discrete cosine transform | Assistive technology | Enables the personalisation of reading environment of Greek students. | Students’ reading pace and accuracy were increased. |
| 2015 [ | Computer-based learning model | Machine learning technique | - | Explores the use of machine learning method to improve effectiveness of learning process. | - |
| 2017 [ | Applications for reading and writing | Generation of audio files, pytorch deep convolutional text-to-speech models | Digital application | Helps students with reading and writing skills. | Audiobooks, such as learning Ally, has enabled students to gain confidence, independence and success [ |
| 2018 [ | DIMMAND, capturaTalk application |
Chatbots | Digital application | Provides tailored interventions for difficulties encountered in literacy. | Information is not available. |
| 2020 [ | Voice dream reader, natural reader, web reader |
Text, audio data Voicebot | Digital application | Helps with building reading skills. | E-readers have been found to generally improve reading speed and comprehension as compared to reading on paper [ |
| 2020 [ | DytectiveU |
Learning patterns of students Support vector machine algorithm | Digital application | Provides personalised game-based exercises to enhance specific cognitive skills related linked to dyslexia. | The DytectiveU application is reported to be able to offer students a variety of actions that are helpful in the learning of reading and writing [ |
| 2020 [ | Generative adversarial network | Conversion of image/speech to text | Assistive technology | Converts natural language text to images to aid students in their learning. | - |
|
| |||||
| 2011 [ | LIFEisGAME game |
Shape and appearance-based facial features Second feedback loop, visual input from player obtained through webcam | Digital application | To teach students to recognise facial emotions. | Information is not available. |
| 2017 [ | ‘Empower me’ application |
Emotion recognition features Google smartglass, augmented reality environment, web-based dashboard to monitor progress | Wearable technology | Encourages social interaction between user and peers/educators. | Students were able to improve their social skills using the Google glass. It was also reported to be fun, useful and engaging [ |
| 2018 [ | Kaspar robot |
Sensory data Reinforcement learning algorithm [ | Assistive technology | Helps enhance social interaction skills. | The human-like body and features of Kaspar have been reported to help an ASD student to be more interactive [ |
| 2018 [ | ABA flashcards- Emotions, Autism emotion, conversation builder, emotions and feelings- autism, Find me, Kid in storybook maker, learning with Rufus, Look in my eyes: Train engineer, Model me going places 2, Pictello, Social stories, Special stories, The social express, Toca Boca |
Deep learning/machine learning algorithms using unstructured data | Digital application | Teaches social skills | Information is not available. |
| 2018 [ | ABA find it, Agnitus, Autism learning games- camp discovery, Intro to letters, Intro to Math, Math Bingo, Pop Math, Starfall ABC, Word wagon |
Deep learning/machine learning algorithms using unstructured data | Digital application | Helps in different learning areas | The camp discovery enabled participants to show high learning rates over a short period of time. It has been suggested that the application teaches the selected skills effectively [ |
| 2019 [ | Emotify game |
Audio features, such as pitch of voice Speech data to train Random forest classifier | Digital application | Helps students to recognise and express feelings. | The application caused participants to experience more engagement and exhibit higher behavioural intentions towards it [ |
| 2019 [ | Milo, NAO, Pepper, Aisoy 1, Keepon robots |
Supervised machine learning algorithms; generalised models trained on users’ data and individualised models trained on initial subclass of users’ data [ | Assistive technology | Helps build social and communication skills. | Social robots, such as NAO, have been reported to improve social skills in students, especially in terms of eye contact and concentration. Nonverbal children also reportedly started pronouncing some words [ |
| 2020 [ | GoTalks speech generating device, AAC speech buddy, Proloquo2go, talking Larry, Touch chat HD, VAST autism 1-Core |
Behavioural features, such as grabbing, vocalisations Deep learning/machine learning algorithms, neural networks [ | Augmentative/alternative communication device | Helps with building communication skills. | Review studies report that high-technology speech generating devices are very effective in teaching manding, intraverbal and multistep tacting to ASD students [ |
| 2020 [ | Facesay games |
Scores on social interactions Facial expression recognition techniques, interactive environment with lifelike avatars | Digital application | Software games help recognise behavioural and emotional clues and enhance social skills. | Facesay application is found to be very promising, cost-effective and efficient for teaching affect recognition and mentalising constructs to high-functioning ASD students [ |
| 2020 [ | Personalised ‘Kiwi’ robot for learning |
Video and audio data, such as eye contact and verbal dialogue Supervised machine learning algorithms; generalised models trained on users’ data and individualised models trained on initial subclass of users’ data [ | Assistive technology | Adapts lessons according to students’ changing needs. | Kiwi robot has been reported to improve the Maths skills and social skills in ASD students who were part of the study group [ |
| 2020 [ | Life skills winner application |
Deep learning/machine learning algorithms using unstructured data | Digital application | Teaches students daily living skills through the application. | Information is not available. |
| 2020 [ | PvBOT robot | LEGO Mindstorms EV3 model | Assistive technology | Helps to teach students ‘place value’ concept in Mathematics. | PvBOT is helpful in motivating students to pay attention and stay focused for a longer period. |
| 2021 [ | Squizzy educational software | Scrum methodology | Assistive technology | Helps children stay focused during activities that involve cognition, such as colour selection or using pictures. | Effective in the cognitive aspect of therapy. |
Figure 9Pie chart representation of assistive tools used to aid in the learning of ADHD, dyslexia and ASD students.
Figure 10Bar graph representation of various assistive tools used to aid in the learning of ADHD, dyslexia and ASD students.
Figure 11Benefits of using the cloud system in schools for personalised education.
Figure 12Proposed AI-based tool for personalised learning.