Interactive robots with model-based ‘autism-like’ behaviors


Due to their predictability, controllability, and simple social abilities, robots are starting to be used in diverse ways to assist individuals with Autism Spectrum Disorder (ASD). In this work, we investigate an alternative and novel research direction for using robots in relation to ASD, through programming a humanoid robot to exhibit behaviors similar to those observed in children with ASD. We designed 16 ‘autism-like’ behaviors of different severities on a NAO robot, based on ADOS-2, the gold standard for ASD diagnosis. Our behaviors span four dimensions, verbal and non-verbal, and correspond to a spectrum of typical ASD responses to 3 different stimulus families inspired by standard diagnostic tasks. We integrated these behaviors in an autonomous agent running on the robot, with which humans can continuously interact through predefined stimuli. Through user-controllable features, we allow for 256 unique customizations of the robot’s behavioral profile.We evaluated the validity of our interactive robot both in video-based and ‘in situ’ studies with 3 therapists. We also present subjective evaluations on the potential benefits of such robots to complement existing therapist training, as well as to enable novel tasks for ASD therapy.

If the inline PDF is not rendering correctly, you can download the PDF file here.

  • [1] American Psychiatric Association, Diagnostic and statistical manual of mental disorders (DSM-5®), American Psychiatric Publishing, 2013

  • [2] M. Sigman, S. J. Spence, A. T.Wang, Autism from developmental and neuropsychological perspectives, Annual Review of Clinical Psychology, 2006, 2, 327-355

  • [3] R.Muhle, S. V. Trentacoste, I. Rapin, The genetics of autism, Pediatrics, 2004, 113(5), e472-e486

  • [4] P. Chaste, M. Leboyer, Autism risk factors: genes, environment, and gene-environment interactions, Dialogues in Clinical Neuroscience, 2012, 14(3), 281-292

  • [5] C. Lord, M. Rutter, P. C. DiLavore, S. Risi, K. Gotham, S Bishop, Autism diagnostic observation schedule - Second edition (ADOS-2), Los Angeles: Western Psychological Services, 2012

  • [6] K. Baraka, F. S. Melo, M. Veloso, ’Autistic robots’ for embodied emulation of behaviors typically seen in children with different autism severities, In: Proceedings of the 2017 International Conference on Social Robotics, Springer, Cham, 2017, 105-114

  • [7] H. Van Ditmarsch, W. Labuschagne, My beliefs about your beliefs: a case study in theory of mind and epistemic logic, Synthese, 2007, 155(2) 191-209

  • [8] F. Dinum, R. Prada, G. J. Hofstede, From autistic to social agents, In: Proceedings of the 2014 International Conference on Autonomous Agents andMulti-agent Systems, International Foundation for Autonomous Agents and Multiagent Systems, 2014, 1161-1164

  • [9] K. Richardson, M. Coeckelbergh, K. Wakunuma, E. Billing, T. Ziemke, P. Gomez, B. Vanderborght, T. Belpaeme, Robot enhanced therapy for children with autism (DREAM): A social model of autism, IEEE Technology and Society Magazine, 2018, 37(1), 30-39

  • [10] B. Scassellati, H. Admoni, M. Matarić, Robots for use in autism research, Annual Review of Biomedical Engineering, 2012, 14, 275-294

  • [11] K. Dautenhahn, I. Werry, Towards interactive robots in autism therapy: background, motivation and challenges, Pragmatics and Cognition, 2004, 12(1), 1-35

  • [12] J. Psotka, Immersive training systems: Virtual reality and education and training, Instructional Science, 1995, 23(5-6), 405-431

  • [13] P. Dieckmann, D. Gaba, M. Rall, Deepening the theoretical foundations of patient simulation as social practice, Simulation in Healthcare, 2007, 2(3), 183-193

  • [14] A. T. Lee, Flight simulation: virtual environments in aviation, Routledge, 2017

  • [15] N. E. Seymour, VR to OR: a review of the evidence that reality simulation improves operating room performance, World Journal of Surgery, 2008, 32(2), 182-188

  • [16] M. J. Shapiro, J. C. Morey, S. D. Small, V. Langford, C. J. Kaylor, L. Jagminas, S. Suner, M. L. Salisbury, R. Simon, G. D. Jay, Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum?, BMJ Quality and Safety, 2004, 13(6), 417-421

  • [17] M. Macedonia, Games, simulation, and the military education dilemma, In: Internet and the University: 2001 Forum, Louisville, CO, Educause, 2002, 157-167

  • [18] R. Querrec, C. Buche, E. Maffre, P. Chevaillier, SécuRéVi: virtual environments for fire-fighting training, In: Proceedings of the 5th Virtual Reality International Conference, 2003, 169-175

  • [19] S. E. Kirkley, J. R. Kirkley, Creating next generation blended learning environments using mixed reality, video games and simulations, TechTrends, 2005, 49(3), 42-53

  • [20] M. Baptista, C. R.Martinho, F. Lima, P. A. Santos, H. Prendinger, Improving learning in business simulations with an agentbased approach, Journal of Artificial Societies and Social Simulation, 2014, 17(3), 7

  • [21] H. Lin, C. T. Sun, Problems in simulating social reality: Observations on a MUD construction, Simulation and Gaming, 2003, 34(1), 69-88

  • [22] S. Babu, E. Suma, T. Barnes, L. F. Hodges, Can immersive virtual humans teach social conversational protocols?, In: Transactions of Virtual Reality Conference, IEEE, 2007, 215-218

  • [23] M. J. Smith, E. J. Ginger, K. Wright, M. A. Wright, J. L. Taylor, L. B. Humm, D. E. Olsen, M. D. Bell, M. F. Fleming, Virtual reality job interview training in adults with autism spectrum disorder, Journal of Autism and Developmental Disorders, 2014, 44(10), 2450-2463

  • [24] J. Rickel, W. L. Johnson, Animated agents for procedural training in virtual reality: Perception, cognition, and motor control, Applied Artificial Intelligence, 1999, 13(4-5), 343-382

  • [25] K. Fast, T. Gifford, R. Yancey, Virtual training for welding, In: the Third IEEE and ACM International Symposiumon Proceedings of Mixed and Augmented Reality, IEEE, 2004, 298-299

  • [26] N. Epley, A. Waytz, J. T. Cacioppo, On seeing human: a three-factor theory of anthropomorphism, Psychological review, American Psychological Association, 2007, 114(4), 864

  • [27] B. Ingersoll, The social role of imitation in autism: Implications for the treatment of imitation deficits, Infants and Young Children, 2008, 21(2), 107-119

  • [28] G. Dawson, A. Adams, Imitation and social responsiveness in autistic children, Journal of Abnormal Child Psychology, 1984, 12(2), 209-226

  • [29] S. Lemaignan, A. Jacq, D. Hood, F. Garcia, A. Paiva, P. Dillenbourg, Learning by teaching a robot: The case of handwriting, IEEE Robotics and Automation Magazine, 2016, 23(2), 56-66

  • [30] P. Kenny, A. Hartholt, J. Gratch, W. Swartout, D. Traum, S. Marsella, D. Piepol, Building interactive virtual humans for training environments, In: Proceedings of I/ITSEC, 2007, 174, 911-916

  • [31] S. Rossi, F. Ferland, A. Tapus, User profiling and behavioral adaptation for HRI: a survey, Pattern Recognition Letters, 2017, 99, 3-12

  • [32] A. Tapus, C. Țăpuş, M. J. Matarić, User-robot personality matching and assistive robot behavior adaptation for post-stroke re habilitation therapy, Intelligent Service Robotics, 2008, 1(2), 169

  • [33] N. Mitsunaga, C. Smith, T. Kanda, H. Ishiguro, N. Hagita, Adapting robot behavior for human-robot interaction, IEEE Transactions on Robotics, 2008, 24(4), 911-916

  • [34] J. C. Gillesen, E. I. Barakova, B. E. Huskens, L. M. Feijs, From training to robot behavior: Towards custom scenarios for robotics in training programs for ASD, In: Transactions of the 2011 IEEE International Conference on Rehabilitation Robotics, IEEE, 2011, 1-7

  • [35] A. Tapus, A. Peca, A. Aly, C. Pop, L. Jisa, S. Pintea, A. S. Rusu, D. O. David, Children with autism social engagement in interaction with Nao, an imitative robot: A series of single case experiments, Interaction Studies, 2012, 13(3), 315-347

  • [36] E. I. Barakova, W. Chonnaparamutt, Timing sensory integration - robot simulation of autistic behavior, IEEE Robotics&AutomationMagazine, 2009, 16(3), 51

  • [37] B. Scassellati, Investigating models of social development using a humanoid robot, In: B. Webb, T. Consi (Eds.), Biorobotics, MIT Press, 2000

  • [38] E. Zander, C. Willfors, S. Berggren, N. Choque-Olsson, C. Coco, A. Elmund et al., The objectivity of the Autism Diagnostic Observation Schedule (ADOS) in naturalistic clinical settings, European Child and Adolescent Psychiatry, 2016, 25(7), 769-780

  • [39] K. Baraka, F. S. Melo, M. Veloso, Data-driven generation of synthetic behavioral feature vectors modeling children with autism spectrum disorders, In: Proceedings of the 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics, 2017, IEEE

  • [40] T. Falkmer, K. Anderson, M. Falkmer, C. Horlin, Diagnostic procedures in autism spectrum disorders: a systematic literature review, European Child and Adolescent Psychiatry, 2013, 22(6), 329-340


Journal + Issues

Paladyn. Journal of Behavioral Robotics is a new, peer-reviewed, electronic-only journal that publishes original, high-quality research on topics broadly related to neuronally and psychologically inspired robots and other behaving autonomous systems.