Nelson Silva1, Dajie Zhang2, Tomas Kulvicius3, Alexander Gail4, Carla Barreiros5, Stefanie Lindstaedt5, Marc Kraft6, Sven Bölte7, Luise Poustka8, Karin Nielsen-Saines9, Florentin Wörgötter10, Christa Einspieler11, Peter B Marschik12. 1. iDN - Interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria; Know-Center GmbH, Graz, Austria. 2. iDN - Interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria; Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany; Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany. 3. Department for Computational Neuroscience, Third Institute of Physics-Biophysics, Georg-August-University of Göttingen, Göttingen, Germany. 4. Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany; German Primate Center - Leibniz Institute for Primate Research, Göttingen, Germany. 5. Know-Center GmbH, Graz, Austria; Institute of Interactive Systems and Data Science, Graz University of Technology, Graz, Austria. 6. Department of Medical Engineering, Technical University Berlin, Berlin, Germany. 7. Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden; Child and Adolescent Psychiatry, Stockholm Health Care Services, Region Stockholm, Stockholm, Sweden; Curtin Autism Research Group, School of Occupational Therapy, Social Work and Speech Pathology, Curtin University, Perth, Western Australia, Australia. 8. Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany; Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany. 9. Division of Pediatric Infectious Diseases, David Geffen UCLA School of Medicine, USA. 10. Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany; Department for Computational Neuroscience, Third Institute of Physics-Biophysics, Georg-August-University of Göttingen, Göttingen, Germany; Institute of Physics, Department for Computational Neuroscience at the Bernstein Center Göttingen, Georg-August-University of Göttingen, Göttingen, Germany. 11. iDN - Interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria. 12. iDN - Interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria; Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, Göttingen, Germany; Leibniz-ScienceCampus Primate Cognition, Göttingen, Germany; Center of Neurodevelopmental Disorders (KIND), Centre for Psychiatry Research, Department of Women's and Children's Health, Karolinska Institutet, Stockholm, Sweden. Electronic address: peter.marschik@med.uni-goettingen.de.
Abstract
BACKGROUND: The clinical and scientific value of Prechtl general movement assessment (GMA) has been increasingly recognised, which has extended beyond the detection of cerebral palsy throughout the years. With advancing computer science, a surging interest in developing automated GMA emerges. AIMS: In this scoping review, we focused on video-based approaches, since it remains authentic to the non-intrusive principle of the classic GMA. Specifically, we aimed to provide an overview of recent video-based approaches targeting GMs; identify their techniques for movement detection and classification; examine if the technological solutions conform to the fundamental concepts of GMA; and discuss the challenges of developing automated GMA. METHODS AND PROCEDURES: We performed a systematic search for computer vision-based studies on GMs. OUTCOMES AND RESULTS: We identified 40 peer-reviewed articles, most (n = 30) were published between 2017 and 2020. A wide variety of sensing, tracking, detection, and classification tools for computer vision-based GMA were found. Only a small portion of these studies applied deep learning approaches. A comprehensive comparison between data acquisition and sensing setups across the reviewed studies, highlighting limitations and advantages of each modality in performing automated GMA is provided. CONCLUSIONS AND IMPLICATIONS: A "method-of-choice" for automated GMA does not exist. Besides creating large datasets, understanding the fundamental concepts and prerequisites of GMA is necessary for developing automated solutions. Future research shall look beyond the narrow field of detecting cerebral palsy and open up to the full potential of applying GMA to enable an even broader application.
BACKGROUND: The clinical and scientific value of Prechtl general movement assessment (GMA) has been increasingly recognised, which has extended beyond the detection of cerebral palsy throughout the years. With advancing computer science, a surging interest in developing automated GMA emerges. AIMS: In this scoping review, we focused on video-based approaches, since it remains authentic to the non-intrusive principle of the classic GMA. Specifically, we aimed to provide an overview of recent video-based approaches targeting GMs; identify their techniques for movement detection and classification; examine if the technological solutions conform to the fundamental concepts of GMA; and discuss the challenges of developing automated GMA. METHODS AND PROCEDURES: We performed a systematic search for computer vision-based studies on GMs. OUTCOMES AND RESULTS: We identified 40 peer-reviewed articles, most (n = 30) were published between 2017 and 2020. A wide variety of sensing, tracking, detection, and classification tools for computer vision-based GMA were found. Only a small portion of these studies applied deep learning approaches. A comprehensive comparison between data acquisition and sensing setups across the reviewed studies, highlighting limitations and advantages of each modality in performing automated GMA is provided. CONCLUSIONS AND IMPLICATIONS: A "method-of-choice" for automated GMA does not exist. Besides creating large datasets, understanding the fundamental concepts and prerequisites of GMA is necessary for developing automated solutions. Future research shall look beyond the narrow field of detecting cerebral palsy and open up to the full potential of applying GMA to enable an even broader application.
Keywords:
Augmented general movement assessment; Automation; Cerebral palsy; Computer vision; Deep learning; Developmental disorder; Early detection; General movements; Infancy; Machine learning; Neurodevelopment; Pose estimation
Authors: Sahar Salavati; Christa Einspieler; Giulia Vagelli; Dajie Zhang; Jasmin Pansy; Johannes G M Burgerhof; Peter B Marschik; Arend F Bos Journal: Early Hum Dev Date: 2017-05-23 Impact factor: 2.079
Authors: S Bölte; K D Bartl-Pokorny; U Jonsson; S Berggren; D Zhang; E Kostrzewa; T Falck-Ytter; C Einspieler; F B Pokorny; E J H Jones; H Roeyers; T Charman; P B Marschik Journal: Acta Paediatr Date: 2015-12-08 Impact factor: 2.299
Authors: Christa Einspieler; Jeff Sigafoos; Sven Bölte; Katrin D Bratl-Pokorny; Rebecca Landa; Peter B Marschik Journal: Res Autism Spectr Disord Date: 2014-01-09
Authors: Dylan den Hartog; Marjolein M van der Krogt; Sven van der Burg; Ignazio Aleo; Johannes Gijsbers; Laura A Bonouvrié; Jaap Harlaar; Annemieke I Buizer; Helga Haberfehlner Journal: Sensors (Basel) Date: 2022-06-09 Impact factor: 3.847
Authors: Daniel Groos; Lars Adde; Sindre Aubert; Lynn Boswell; Raye-Ann de Regnier; Toril Fjørtoft; Deborah Gaebler-Spira; Andreas Haukeland; Marianne Loennecken; Michael Msall; Unn Inger Möinichen; Aurelie Pascal; Colleen Peyton; Heri Ramampiaro; Michael D Schreiber; Inger Elisabeth Silberg; Nils Thomas Songstad; Niranjan Thomas; Christine Van den Broeck; Gunn Kristin Øberg; Espen A F Ihlen; Ragnhild Støen Journal: JAMA Netw Open Date: 2022-07-01
Authors: Simon Reich; Dajie Zhang; Tomas Kulvicius; Sven Bölte; Karin Nielsen-Saines; Florian B Pokorny; Robert Peharz; Luise Poustka; Florentin Wörgötter; Christa Einspieler; Peter B Marschik Journal: Sci Rep Date: 2021-05-10 Impact factor: 4.379