Skip to content
BY 4.0 license Open Access Published by De Gruyter Open Access March 5, 2019

Interactive robots with model-based ‘autism-like’ behaviors

Assessing validity and potential benefits

  • Kim Baraka EMAIL logo , Francisco S. Melo and Manuela Veloso


Due to their predictability, controllability, and simple social abilities, robots are starting to be used in diverse ways to assist individuals with Autism Spectrum Disorder (ASD). In this work, we investigate an alternative and novel research direction for using robots in relation to ASD, through programming a humanoid robot to exhibit behaviors similar to those observed in children with ASD. We designed 16 ‘autism-like’ behaviors of different severities on a NAO robot, based on ADOS-2, the gold standard for ASD diagnosis. Our behaviors span four dimensions, verbal and non-verbal, and correspond to a spectrum of typical ASD responses to 3 different stimulus families inspired by standard diagnostic tasks. We integrated these behaviors in an autonomous agent running on the robot, with which humans can continuously interact through predefined stimuli. Through user-controllable features, we allow for 256 unique customizations of the robot’s behavioral profile.We evaluated the validity of our interactive robot both in video-based and ‘in situ’ studies with 3 therapists. We also present subjective evaluations on the potential benefits of such robots to complement existing therapist training, as well as to enable novel tasks for ASD therapy.


[1] American Psychiatric Association, Diagnostic and statistical manual of mental disorders (DSM-5®), American Psychiatric Publishing, 201310.1176/appi.books.9780890425596Search in Google Scholar

[2] M. Sigman, S. J. Spence, A. T.Wang, Autism from developmental and neuropsychological perspectives, Annual Review of Clinical Psychology, 2006, 2, 327-35510.1146/annurev.clinpsy.2.022305.095210Search in Google Scholar PubMed

[3] R.Muhle, S. V. Trentacoste, I. Rapin, The genetics of autism, Pediatrics, 2004, 113(5), e472-e48610.1542/peds.113.5.e472Search in Google Scholar PubMed

[4] P. Chaste, M. Leboyer, Autism risk factors: genes, environment, and gene-environment interactions, Dialogues in Clinical Neuroscience, 2012, 14(3), 281-29210.31887/DCNS.2012.14.3/pchasteSearch in Google Scholar

[5] C. Lord, M. Rutter, P. C. DiLavore, S. Risi, K. Gotham, S Bishop, Autism diagnostic observation schedule - Second edition (ADOS-2), Los Angeles: Western Psychological Services, 2012Search in Google Scholar

[6] K. Baraka, F. S. Melo, M. Veloso, ’Autistic robots’ for embodied emulation of behaviors typically seen in children with different autism severities, In: Proceedings of the 2017 International Conference on Social Robotics, Springer, Cham, 2017, 105-11410.1007/978-3-319-70022-9_11Search in Google Scholar

[7] H. Van Ditmarsch, W. Labuschagne, My beliefs about your beliefs: a case study in theory of mind and epistemic logic, Synthese, 2007, 155(2) 191-20910.1007/s11229-006-9144-7Search in Google Scholar

[8] F. Dinum, R. Prada, G. J. Hofstede, From autistic to social agents, In: Proceedings of the 2014 International Conference on Autonomous Agents andMulti-agent Systems, International Foundation for Autonomous Agents and Multiagent Systems, 2014, 1161-1164Search in Google Scholar

[9] K. Richardson, M. Coeckelbergh, K. Wakunuma, E. Billing, T. Ziemke, P. Gomez, B. Vanderborght, T. Belpaeme, Robot enhanced therapy for children with autism (DREAM): A social model of autism, IEEE Technology and Society Magazine, 2018, 37(1), 30-3910.1109/MTS.2018.2795096Search in Google Scholar

[10] B. Scassellati, H. Admoni, M. Matarić, Robots for use in autism research, Annual Review of Biomedical Engineering, 2012, 14, 275-29410.1146/annurev-bioeng-071811-150036Search in Google Scholar PubMed

[11] K. Dautenhahn, I. Werry, Towards interactive robots in autism therapy: background, motivation and challenges, Pragmatics and Cognition, 2004, 12(1), 1-3510.1075/pc.12.1.03dauSearch in Google Scholar

[12] J. Psotka, Immersive training systems: Virtual reality and education and training, Instructional Science, 1995, 23(5-6), 405-43110.1007/BF00896880Search in Google Scholar

[13] P. Dieckmann, D. Gaba, M. Rall, Deepening the theoretical foundations of patient simulation as social practice, Simulation in Healthcare, 2007, 2(3), 183-19310.1097/SIH.0b013e3180f637f5Search in Google Scholar PubMed

[14] A. T. Lee, Flight simulation: virtual environments in aviation, Routledge, 2017Search in Google Scholar

[15] N. E. Seymour, VR to OR: a review of the evidence that reality simulation improves operating room performance, World Journal of Surgery, 2008, 32(2), 182-18810.1007/s00268-007-9307-9Search in Google Scholar PubMed

[16] M. J. Shapiro, J. C. Morey, S. D. Small, V. Langford, C. J. Kaylor, L. Jagminas, S. Suner, M. L. Salisbury, R. Simon, G. D. Jay, Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum?, BMJ Quality and Safety, 2004, 13(6), 417-42110.1136/qshc.2003.005447Search in Google Scholar

[17] M. Macedonia, Games, simulation, and the military education dilemma, In: Internet and the University: 2001 Forum, Louisville, CO, Educause, 2002, 157-167Search in Google Scholar

[18] R. Querrec, C. Buche, E. Maffre, P. Chevaillier, SécuRéVi: virtual environments for fire-fighting training, In: Proceedings of the 5th Virtual Reality International Conference, 2003, 169-175Search in Google Scholar

[19] S. E. Kirkley, J. R. Kirkley, Creating next generation blended learning environments using mixed reality, video games and simulations, TechTrends, 2005, 49(3), 42-5310.1007/BF02763646Search in Google Scholar

[20] M. Baptista, C. R.Martinho, F. Lima, P. A. Santos, H. Prendinger, Improving learning in business simulations with an agentbased approach, Journal of Artificial Societies and Social Simulation, 2014, 17(3), 710.18564/jasss.2516Search in Google Scholar

[21] H. Lin, C. T. Sun, Problems in simulating social reality: Observations on a MUD construction, Simulation and Gaming, 2003, 34(1), 69-8810.1177/1046878102250607Search in Google Scholar

[22] S. Babu, E. Suma, T. Barnes, L. F. Hodges, Can immersive virtual humans teach social conversational protocols?, In: Transactions of Virtual Reality Conference, IEEE, 2007, 215-21810.1109/VR.2007.352484Search in Google Scholar

[23] M. J. Smith, E. J. Ginger, K. Wright, M. A. Wright, J. L. Taylor, L. B. Humm, D. E. Olsen, M. D. Bell, M. F. Fleming, Virtual reality job interview training in adults with autism spectrum disorder, Journal of Autism and Developmental Disorders, 2014, 44(10), 2450-246310.1007/s10803-014-2113-ySearch in Google Scholar PubMed PubMed Central

[24] J. Rickel, W. L. Johnson, Animated agents for procedural training in virtual reality: Perception, cognition, and motor control, Applied Artificial Intelligence, 1999, 13(4-5), 343-38210.1080/088395199117315Search in Google Scholar

[25] K. Fast, T. Gifford, R. Yancey, Virtual training for welding, In: the Third IEEE and ACM International Symposiumon Proceedings of Mixed and Augmented Reality, IEEE, 2004, 298-299Search in Google Scholar

[26] N. Epley, A. Waytz, J. T. Cacioppo, On seeing human: a three-factor theory of anthropomorphism, Psychological review, American Psychological Association, 2007, 114(4), 86410.1037/0033-295X.114.4.864Search in Google Scholar PubMed

[27] B. Ingersoll, The social role of imitation in autism: Implications for the treatment of imitation deficits, Infants and Young Children, 2008, 21(2), 107-11910.1097/01.IYC.0000314482.24087.14Search in Google Scholar

[28] G. Dawson, A. Adams, Imitation and social responsiveness in autistic children, Journal of Abnormal Child Psychology, 1984, 12(2), 209-22610.1007/BF00910664Search in Google Scholar PubMed

[29] S. Lemaignan, A. Jacq, D. Hood, F. Garcia, A. Paiva, P. Dillenbourg, Learning by teaching a robot: The case of handwriting, IEEE Robotics and Automation Magazine, 2016, 23(2), 56-6610.1109/MRA.2016.2546700Search in Google Scholar

[30] P. Kenny, A. Hartholt, J. Gratch, W. Swartout, D. Traum, S. Marsella, D. Piepol, Building interactive virtual humans for training environments, In: Proceedings of I/ITSEC, 2007, 174, 911-916Search in Google Scholar

[31] S. Rossi, F. Ferland, A. Tapus, User profiling and behavioral adaptation for HRI: a survey, Pattern Recognition Letters, 2017, 99, 3-1210.1016/j.patrec.2017.06.002Search in Google Scholar

[32] A. Tapus, C. Țăpuş, M. J. Matarić, User-robot personality matching and assistive robot behavior adaptation for post-stroke re habilitation therapy, Intelligent Service Robotics, 2008, 1(2), 16910.1007/s11370-008-0017-4Search in Google Scholar

[33] N. Mitsunaga, C. Smith, T. Kanda, H. Ishiguro, N. Hagita, Adapting robot behavior for human-robot interaction, IEEE Transactions on Robotics, 2008, 24(4), 911-91610.1109/TRO.2008.926867Search in Google Scholar

[34] J. C. Gillesen, E. I. Barakova, B. E. Huskens, L. M. Feijs, From training to robot behavior: Towards custom scenarios for robotics in training programs for ASD, In: Transactions of the 2011 IEEE International Conference on Rehabilitation Robotics, IEEE, 2011, 1-710.1109/ICORR.2011.5975381Search in Google Scholar PubMed

[35] A. Tapus, A. Peca, A. Aly, C. Pop, L. Jisa, S. Pintea, A. S. Rusu, D. O. David, Children with autism social engagement in interaction with Nao, an imitative robot: A series of single case experiments, Interaction Studies, 2012, 13(3), 315-34710.1075/is.13.3.01tapSearch in Google Scholar

[36] E. I. Barakova, W. Chonnaparamutt, Timing sensory integration - robot simulation of autistic behavior, IEEE Robotics&AutomationMagazine, 2009, 16(3), 5110.1109/MRA.2009.933626Search in Google Scholar

[37] B. Scassellati, Investigating models of social development using a humanoid robot, In: B. Webb, T. Consi (Eds.), Biorobotics, MIT Press, 2000Search in Google Scholar

[38] E. Zander, C. Willfors, S. Berggren, N. Choque-Olsson, C. Coco, A. Elmund et al., The objectivity of the Autism Diagnostic Observation Schedule (ADOS) in naturalistic clinical settings, European Child and Adolescent Psychiatry, 2016, 25(7), 769-78010.1007/s00787-015-0793-2Search in Google Scholar PubMed

[39] K. Baraka, F. S. Melo, M. Veloso, Data-driven generation of synthetic behavioral feature vectors modeling children with autism spectrum disorders, In: Proceedings of the 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics, 2017, IEEE10.1109/DEVLRN.2017.8329808Search in Google Scholar

[40] T. Falkmer, K. Anderson, M. Falkmer, C. Horlin, Diagnostic procedures in autism spectrum disorders: a systematic literature review, European Child and Adolescent Psychiatry, 2013, 22(6), 329-34010.1007/s00787-013-0375-0Search in Google Scholar PubMed

Received: 2018-06-30
Accepted: 2019-01-26
Published Online: 2019-03-05

© 2019 Kim Baraka, et al., published by De Gruyter

This work is licensed under the Creative Commons Attribution 4.0 Public License.

Downloaded on 7.12.2023 from
Scroll to top button