2019
Journal article  Open Access

Augmented Interaction Systems for Supporting Autistic Children. Evolution of a Multichannel Expressive Tool: The SEMI Project Feasibility Study

Magrini M., Curzio O., Carboni A., Moroni D., Salvetti O., Melani A.

augmented interaction  [SCCO]Cognitive science  children with autism  [INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing  [SDV.MHEP.PED]Life Sciences [q-bio]/Human health and pathology/Pediatrics  assistive technology  Instrumentation  [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]  gesture tracking techniques  General Materials Science  General Engineering  healthcare  assistive technologies  Process Chemistry and Technology  Computer Science Applications  [SDV.IB]Life Sciences [q-bio]/Bioengineering  Fluid Flow and Transfer Processes  multisensory experience  interaction design  multimedia and sensory input 

Background: Over the past ten years, the authors have been designing, developing, and testing pervasive technology to support children with autism (ASD). Methods: In the present study, an integrated system based on multimedia and augmented interaction technologies have been tested on young subjects with ASD and dyspraxia in the age range of 6-10 years, in charge for rehabilitation treatments; a team of clinical psychologists has analyzed the results of the experimentation. The ten children involved in the project underwent an initial assessment of praxis skills and motor coordination. Subsequently, the subjects were subdivided into two subgroups: five children participated in the experimentation and five were evaluated as the control group (treatment as usual). Results: The evaluation showed an increased score in the several aspects considered, and particularly those related to motor coordination. An improvement in balancing tests and in hands-movement testing was found. Conclusion: The children involved in the sessions showed greater ability to self-control the movement as well as to select specific motor areas. The methods used seem to be promising to improve emotional and social skills too in a motivating and enjoyable climate. A high level of acceptance by professionals was observed and parents' feedback was also positive.

Source: Applied sciences 9 (2019). doi:10.3390/app9153081

Publisher: Molecular Diversity Preservation International, Basel


Kozima, H.; Nakagawa, C.; Yasuda, Y. Interactive robots for communication-care: A case-study in autism therapy. In Proceedings of the IEEE International Workshop on Robot and Human Interactive Communication, Nashville, TN, USA, 13-15 August 2005.
In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility, Portland, OR, USA, 23-25 October 2006.
Villafuerte, L.; Markova, M.; Jorda, S. Acquisition of social abilities through musical tangible user interface: Children with autism spectrum condition and the reactable. In Proceedings of the CHI '12 Extended Abstracts on Human Factors in Computing Systems, Austin, TX, USA, 5-10 May 2012; pp. 745-760.
Johnston, D.J.; Egermann, H.W.; Kearney, G.C. An Interactive Spatial Audio Experience for Children with Autism Spectrum Disorder. In Proceedings of the 2019 AES International Conference on Immersive and Interactive Audio, York, UK, 27-29 March 2019.
Tentori, M.; Escobedo, L.; Balderas, G. A Smart Environment for Children with Autism. IEEE Pervasive Comput. 2015, 14, 42-50. [CrossRef] Ploog, B.O.; Scharf, A.; Nelson, D.; Brooks, P.J. Use of computer-assisted technologies (CAT) to enhance social, communicative, and language development in children with autism spectrum disorders. J. Autism Dev. Disord. 2013, 43, 301-322. [CrossRef] [PubMed] Parés, N.; Masri, P.; van Wolferen, G.; Creed, C. Achieving dialogue with children with severe autism in an adaptive multisensory interaction: The “MEDIAte” project. IEEE Trans. Vis. Comput. Graph. 2005, 11, 734-743. [CrossRef] [PubMed] Riva, D.; Bulgheroni, S.; Zappella, M. Neurobiology, Diagnosis & Treatment in Autism: An Update; John Libbey Eurotex: London, UK, 2013.
Pajareya, K.; Kaewta, N. A pilot randomized con-trolled trial of DIR/Floortime— parent training intervention for pre-school children with autistic spectrum disorders. Autism 2011, 15, 563-577. [CrossRef] [PubMed] Magrini, M.; Salvetti, O.; Carboni, A.; Curzio, O. An Interactive Multimedia System for Treating Autism Spectrum Disorder. In Computer Vision-ECCV 2016 Workshops, Part II, LNCS 9914; Hua, G., Jégou, H., Eds.; Springer International Publishing: Cham, Switzerland, 2016; Volume 9914, pp. 331-342.
11. Rini, M.; Carboni, A.; Salvetti, O.; Curzio, O. An Auditory Feedback based system for treating Autism Spectrum Disorder. In Proceedings of the REHAB '15 2015 Workshop on ICTs for improving Patients Rehabilitation Research Techniques, Lisbon, Portugal, 1-2 October 2015; pp. 30-33.
12. Magrini, M.; Pieri, G. Real time system for gesture tracking in psycho-motorial rehabilitation. In Proceedings of the HEALTHINF 2014-7th International Conference on Health Informatics-Special session on Signals and Signs Understanding for Personalized, Angers, Loire Valley, France, 3-6 March 2014.
13. Magrini, M.; Rossi, E. SIDOREMI, Sistema di Rieducazione Espressiva del Movimento e dell'Interazione. In Proceedings of the Autismo 2014 Novità Dalla Ricerca Scientifica Percorsi di Formazione Specialistica Proposte Operative per Scuola e Servizi, Palacongressi di Rimini, Italy, 14-15 Novembre 2014.
14. Burnside, K.; Wright, K.; Poulin-Dubois, D. Social motivation and implicit theory of mind in children with autism spectrum disorder. Autism Res. 2017, 10, 1834-1844. [CrossRef] [PubMed]
15. Freeman, L.M.; Locke, J.; Rotheram-Fuller, E.; Mandell, D. Brief Report: Examining Executive and Social Functioning in Elementary-Aged Children with Autism. J. Autism Dev. Disorders. 2017, 47, 1890-1895. [CrossRef] [PubMed]
16. Morgan, B.; Maybery, M.; Durkin, K. Weak central coherence, poor joint attention, and low verbal ability: Independent deficits in early autism. Dev. Psychol. 2003, 39, 646-656. [CrossRef] [PubMed]
17. Pellicano, E.; Maybery, M.; Durkin, K.; Maley, A. Multiple cognitive capabilities/deficits in children with an autism spectrum disorder: “Weak” central coherence and its relationship to theory of mind and executive control. Dev. Psychopathol. 2006, 18, 77-98. [CrossRef]
18. Gallardo, J.; López, C.; Aguelo, A.; Cebrián, B.; Coma, T.; Cerezo, E. Development of a Pervasive Game for ADHD Children. In Proceedings of the Interactivity, Game Creation, Design, Learning, and Innovation, Braga, Portugal, 2018; pp. 526-531.
19. Weisberg, O.; GalOz, A.; Berkowitz, R.; Weiss, N.; Peretz, O.; Azoulai, S.; KoplemanRubin, D.; Zuckerman, O. TangiPlan: Designing an assistive technology to enhance executive functioning among children with adhd. In Proceedings of the Conference on Interaction design and children, Aarhus, Denmark, 2014; pp. 293-296.
20. Magrini, M.; Rossi, E.; Spina, D.M.; Curzio, O.; Mirri, P.; Menicagli, D.; Turini, M.; Cutrupi, V.; Bastiani, L. Progetto «Si Re Mi» (Sistema di Rieducazione Espressiva del Movimento e dell'Interazione) Analisi Qualitative ed Evidenze da uno Studio Pilota di Valutazione con Bambini A etti da Disturbi dello Spettro Autistico, Autismo, Ed.; Cent. Studi Erickson S.p.a Trento: Trento, Italy, 2015; Volume 13, pp. 369-402.
21. Magrini, M.; Carboni, A.; Villa, A.; Righi, M.; Salvetti, O. SEMI-Sistema Espressivo Multicanale Interattivo, SEMI. Project Report 0000. 2016. Available online: http://www.cnr.it/prodotto/i/368862 (accessed on 26 July 2019).
22. Bono, V.; Narzisi, A.; Jouen, A.L.; Tilmont, E.; Hommel, S.; Jamal, W.; Xavier, J.; Billeci, L.; Maharatna, K.; Wald, M.; et al. MICHELANGELO Study Group, GOLIAH: A Gaming Platform for Home-Based Intervention in Autism-Principles and Design. Front. Psychiatry 2006, 7, 70. [CrossRef]
23. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th ed.; (DSM-IV); American Psychiatric Association: Washington, DC, USA, 1994.
24. Howlin, P. Children with Autism and Asperger Syndrome: A Guide for Practitioners and Carers; John Wiley & Sons Ltd.: Chichester, UK, 1998.
25. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; American Psychiatric Association: Washington, DC, USA, 2013.
26. Centers for Disease Control and Prevention (CDC). Autism and Developmental Disabilities Monitoring Network Surveillance Year 2010 Principal Investigators; Centers for Disease Control and Prevention (CDC): Atlanta, GA, USA, 2014.
27. Lai, M.C.; Lombardo, M.V.; Baron-Cohen, S. Autism. Lancet 2014, 383, 896-910. [CrossRef]
28. Narzisi, A.; Colombi, C.; Balottin, U. Non-pharmacological treatments in autism spectrum disorders: An overview on early interventions for pre-schoolers. Curr. Clin. Pharmacol. 2013, 9, 17-26. [CrossRef]
29. Oono, I.P.; Honey, E.J.; McConachie, H. Parent-mediated early intervention for young children with autism spectrum disorders (ASD). Cochrane Database Syst. Rev. 2013, 4, CD009774. [CrossRef]
30. Iovannone, R.; Dunlap, G.; Huber, H.; Kincaid, D. E ective Educational Practices for Students With Autism Spectrum Disorders. Focus Autism Dev. Disabil. 2003, 18, 150-165. [CrossRef]
31. Hollis, C.; Falconer, C.J.; Martin, J.L.; Whittington, C.; Stockton, S.; Glazebrook, C.; Davies, E.B. Annual Research Review: Digital health interventions for children and young people with mental health problems-A systematic and meta-review. J. Child Psychol. Psychiatry 2017, 58, 474-503. [CrossRef]
32. Saperstein, A.; Kurtz, M. Current trends in the empirical study of cognitive remediation for schizophrenia. Can. J. Psychiatry 2013, 58, 311-318. [CrossRef]
33. Tanaka, J.W.; Wolf, J.M.; Klaiman, C.; Koenig, K.; Cockburn, J.; Herlihy, L.; Brown, C.; Stahl, S.; Kaiser, M.D.; Schultz, R.T. Using computerized games to teach face recognition skills to children with autism spectrum disorder: The Let's Face It program. J. Child Psychol. Psychiatry 2010, 51, 944-952. [CrossRef]
34. Wainer, A.L.; Ingersol, B.R. The use of innovative computer technology for teaching social communication to individuals with autism spectrum disorders. Res. Autism Spectr. Disord. 2011, 5, 96-107. [CrossRef]
35. Grynszpan, O.; Martin, J.M.; Nadel, J. Human Computer Interfaces for Autism: Assessing the Influence of Task Assignment and Output Modalities. 2005. Available online: https://wiki.inf.ed.ac.uk/pub/ECHOES/ MultiModalInterfaces/Grynszpan2005.pdf (accessed on July 2019).
36. Kapp, S.K.; Gillespie-Lynch, K.; Sherman, L.E.; Hutman, T. Deficit, di erence, or both? Autism and neurodiversity. Dev. Psychol. 2013, 49, 59-71. [CrossRef]
37. Picard, R.W.; Goodwin, M.S. Developing Innovative Technology for Future Personalized Autism Research and Treatment. Autism Advocate 2008, 50, 32-39.
38. Dautenhahn, K. Proc. Workshop Robotic and Virtual Interactive Systems in Autism Therapy. 2001. Available online: http://rescif.scicog.fr/seminaires/archives/2002-2003/robot_autism.html (accessed on 26 July 2019).
39. De Gangi, G.; Berck, R. Test of Sensory Integration; Western Psychological Services: Los Angeles, CA, USA, 1983.
40. Dunn, W. Sensory Profile-School Companion Manual; Psychological Corporation: San Antonio, TX, USA, 2006.
41. Politi, P.; Emanuele, E.; Grassi, M. The Invisible Orchestra Project. Development of the “Playing-in-Touch” (PiT) questionnaire. Neuro Endocrinol. Lett. 2012, 33, 552-558.
42. Ospina, M.B.; Seida, J.K.; Clark, B.; Karkhaneh, M.; Hartling, L.; Tjosvold, L.; Vandermeer, B.; Smith, V. Behavioural and developmental interventions for autism spectrum disorder: A clinical systematic review. PLoS ONE 2008, 3. [CrossRef] [PubMed]
43. Dawson, G. Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorder. Dev. Psychopathol. 2008, 20, 775-803. [CrossRef]
44. Kaur, M.; Srinivasan, S.M.; Bhat, A.N. Comparing motor performance, praxis, coordination, and interpersonal synchrony between children with and without Autism Spectrum Disorder (ASD). Res. Dev. Disabil. 2018, 72, 79-95. [CrossRef] [PubMed]
45. Meini, C.; Guiot, G.; Sindelar, M.T. Autismo e Musica. Il Modello Floortime Nei Disturbi Della Comunicazione e Della Relazione; I materiali; Erickson: Trento, Italy, 2012.
46. Sabbadini, L. APCM-2-Abilità Prassiche e Della Coordinazione Motoria, 2nd ed.; Hogrefe Editore: Florence, Italy, 2015.
47. Bresnahan, T.; Rizzo, A.A.; Burke, S.L.; Partin, M.; Ahlness, R.M.; Trimmer, M. Using Virtual Interactive Training Agents (VITA) with Adults with Autism and other Developmental Disabilities. In Proceedings of the International Conference on Disability, Virtual Reality and Associated Technologies, Los Angels, CA, USA, 20-22 September 2016.
48. Yang, Y.J.D.; Allen, T.; Abdullahi, S.M.; Pelphrey, K.A.; Volkmar, F.R.; Chapman, S.B. Brain responses to biological motion predict treatment outcome in young adults with autism receiving Virtual Reality Social Cognition Training: Preliminary findings. Behav. Res. Ther. 2017, 93, 55-66. [CrossRef] [PubMed]

Metrics



Back to previous page
BibTeX entry
@article{oai:it.cnr:prodotti:405804,
	title = {Augmented Interaction Systems for Supporting Autistic Children. Evolution of a Multichannel Expressive Tool: The SEMI Project Feasibility Study},
	author = {Magrini M. and Curzio O. and Carboni A. and Moroni D. and Salvetti O. and Melani A.},
	publisher = {Molecular Diversity Preservation International, Basel },
	doi = {10.3390/app9153081},
	journal = {Applied sciences},
	volume = {9},
	year = {2019}
}