Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Paladyn, Journal of Behavioral Robotics

Editor-in-Chief: Schöner, Gregor

1 Issue per year

CiteScore 2017: 0.33

SCImago Journal Rank (SJR) 2017: 0.104

ICV 2017: 99.90

Open Access
See all formats and pricing
More options …

Enhancement of the Communication Effectiveness of Interactive Robots for Autism Therapy by Using Touch and Colour Feedback

Jaeryoung Lee
  • Department of Robotic Science and Technology, Chubu University, 1200 Matsumoto-cho, Kasugai, Aichi 487-8501, Japan
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Hiroki Takehashi / Chikara Nagai
  • BTCC RIKEN BSI-TOYOTA Collaboration Center, 2271-130, Anagahora, Shimoshidami, Moriyama-ku, Nagoya, Aichi, 463-0003, Japan
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Goro Obinata
  • Department of Robotic Science and Technology, Chubu University, 1200 Matsumoto-cho, Kasugai, Aichi 487-8501, Japan
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Dimitar Stefanov
  • Faculty of Engineering and Computing, Coventry University, Priory Street, CV1 5FB, Coventry, United Kingdom
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
Published Online: 2014-08-26 | DOI: https://doi.org/10.2478/pjbr-2014-0004


Previous studies in the field of robot assisted therapy demonstrated that robots engage autistic children’s attention in a better way. Therefore, the interactive robots appear to be a promising approach for improving the social interaction and communication skills of autistic children. However, most of the existing interactive robots use a very small number of communication variableswhich narrow their effectiveness to a few aspects of autistic childrens’ social communication behaviour. In the present work, we explore the effects of touching and colours on the communication effectiveness between a robot and an autistic child and their potential for further adjustability of the robot to child’s behaviour. Firstly, we investigated touching patterns of autistic and non-autistic children in three different situations and validated their responses by comparison of touching forces. Results showed that patterns of touching by non-autistic children have certain consistency, while reaction patterns in autistic children vary from person to person. Secondly, we studied the effect of colour feedback in autism therapy with the robot. Results showed that participants achieved better completion rate when colour feedback was provided. The results could support the design of more effective therapeutic robots for children with autism.

Keywords : Human-robot interaction; Robot-assisted therapy; Therapeutic robot; Autism therapy; Affective touch; Colour


  • [1] A. J. Esbensen, M. M. Seltzer, K. S. L. Lam, and J. W. Bodfish. Age-related differences in restricted repetitive behaviors in autism spectrum disorders. Journal of Autism and Developmental Disorders, 39(1):57–66, January 2009. Web of ScienceCrossrefGoogle Scholar

  • [2] L. K. Koegel, D. Stiebel, and R. L Koegel. Reducing aggression in children with autism toward infant or toddler siblings. The Journal of The Association for Persons with Severe Handicaps, 23(2):111–118, June 1998. CrossrefGoogle Scholar

  • [3] E. G. Carr and V. M. Durand. Reducing behavior problems through functional communication training. Journal of Applied Behavior Analysis, 18(2):111–126, 1985. CrossrefGoogle Scholar

  • [4] D Moes. Parent education and parenting stress. In Robert L. Koegel and Lynn Kern Koegel, editors, Teaching children with autism: strategies for initiating positive interactions and improving learning opportunities, pages 79–93. P.H. Brookes Pub. Co, Baltimore, 1995. Google Scholar

  • [5] B. Scassellati, Henny A., and M. Matari`c. Robots for use in autism research. Annual Review of Biomedical Engineering, 14(1):275–294, August 2012. CrossrefWeb of ScienceGoogle Scholar

  • [6] B. Robins, E. Ferrari, K. Dautenhahn, G. Kronreif, B. Prazak- Aram, G. Gelderblom, B. Tanja, F. Caprino, E. Laudanna, and P. Marti. Human-centred design methods: Developing scenarios for robot assisted play informed by user panels and field trials. International Journal of Human-Computer Studies, 68(12):873–898, December 2010. Web of ScienceCrossrefGoogle Scholar

  • [7] B. Robins, K. Dautenhahn, and J. Dubowski. Does appearance matter in the interaction of children with autism with a humanoid robot? Interaction Studies, 7(3):509–542, January 2006. CrossrefGoogle Scholar

  • [8] A. T. Wang. Reading affect in the face and voice: Neural correlates of interpreting communicative intent in children and adolescents with autism spectrum disorders. Archives of General Psychiatry, 64(6):698–708, June 2007. CrossrefWeb of ScienceGoogle Scholar

  • [9] J. Sinzig, D. Morsch, and G. Lehmkuhl. Do hyperactivity, impulsivity and inattention have an impact on the ability of facial affect recognition in children with autism and ADHD? European Child & Adolescent Psychiatry, 17(2):63–72, September 2007. Web of ScienceGoogle Scholar

  • [10] H. Koshino, R. K. Kana, T. A. Keller, V. L. Cherkassky, N. J. Minshew, and M. A. Just. fMRI investigation of working memory for faces in autism: Visual coding and underconnectivity with frontal areas. Cerebral Cortex, 18(2):289–300, May 2007. Web of ScienceGoogle Scholar

  • [11] L. Boccanfuso and J. M. O’Kane. Adaptive robot design with hand and face tracking for use in autism therapy. In Proceedings of the Second international conference on Social robotics, pages 265–274. Springer-Verlag Berlin, Heidelberg, 2010. Google Scholar

  • [12] L. Boccanfuso and J. M. O’Kane. CHARLIE : An adaptive robot design with hand and face tracking for use in autism therapy. International Journal of Social Robotics, 3(4):337–347, September 2011. Google Scholar

  • [13] A. Duquette, F. Michaud, and H. Mercier. Exploring the use of a mobile robot as an imitation agent with children with lowfunctioning autism. Autonomous Robots, 24(2):147–157, October 2007. Web of ScienceGoogle Scholar

  • [14] G. Pioggia, M. L. Sica, M. Ferro, R. Igliozzi, F. Muratori, A. Ahluwalia, and D. De Rossi. Human-robot interaction in autism: FACE, an android-based social therapy. In Proceeding of the 16th IEEE International Symposium on Robot Human Interactive Communication, pages 605–612, Jeju, Korea, 2007. IEEE. Google Scholar

  • [15] G. Pioggia, M. Ferro, M. L. Sica, G. Dalle Mura, S. Casalini, D. De Rossi, R. Igliozzi, and F. Muratori. Imitation and learning of the emotional behaviour: Towards an android-based treatment for people with autism. In International Workshop on Epigenetic Robotics, Modeling Cognitive D evelopment in R obotics Systems, pages 119–125, 2006. Google Scholar

  • [16] D. Feil-Seifer and M. Matari`c. B3ia: A control architecture for autonomous robot-assisted behavior intervention for children with autism spectrum disorders. In Proceeding of 17th IEEE International Symposium on Robot and Human Interactive Communication, pages 328–333. IEEE, August 2008. Google Scholar

  • [17] B. Robins, K. Dautenhahn, and P. Dickerson. From isolation to communication: A case study evaluation of robot assisted play for children with autism with a minimally expressive humanoid robot. In Proceedings of the Second International Conferences on Advances in Computer-Human Interactions,, pages 205– 211. IEEE, February 2009. Google Scholar

  • [18] H. Kozima, C. Nakagawa, and Y. Yasuda. Children-robot interaction: a pilot study in autism therapy. In Progress in Brain Research, volume 164, pages 385–400. Elsevier, 2007. Web of ScienceGoogle Scholar

  • [19] J. J. Diehl, L. M. Schmitt, M. Villano, and C. R. Crowell. The clinical use of robots for individuals with autism spectrum disorders: A critical review. Research in Autism Spectrum Disorders, 6(1):249–262, January 2012. CrossrefGoogle Scholar

  • [20] J. Lee, H. Takehashi, C. Nagai, G. Obinata, and D. Stefanov. Which robot features can stimulate better responses from children with autism in robot-assisted therapy? International Journal of Advanced Robotic Systems, 9(72):1–6, September 2012. Web of ScienceGoogle Scholar

  • [21] M. L. Knapp. Nonverbal communication in human interaction. Holt, Rinehart and Winston, New York, 1972. Google Scholar

  • [22] K. Barnett. A theoretical construct of the concepts of touch as they relate to nursing. Nursing Research, 2(21):102–109, March 1972. Google Scholar

  • [23] D. Hewett. Do touch: physical contact and people who have severe, profound and multiple learning difficulties. Support for Learning, 22(3):116–123, August 2007. Google Scholar

  • [24] J. P. Bardeen. Interpersonal Perception Through the Tactile, Verbal and Visual Modes. San Francisco State College, 1970. Google Scholar

  • [25] F. Tiffany. Touch. MIT Press, Cambridge, MA, 2001. Google Scholar

  • [26] Spence C. The ICI report on the secret of the senses. The Communication Group, London, 2002. Google Scholar

  • [27] A. Gallace and C. Spence. The science of interpersonal touch: An overview. Neuroscience & Biobehavioral Reviews, 34(2):246–259, February 2010. CrossrefWeb of ScienceGoogle Scholar

  • [28] B. Robins, F. Amirabdollahian, and K. Dautenhahn. Investigating child-robot tactile interactions: A taxonomical classifi- cation of tactile behaviour of children with autism towards a humanoid robot. In Proceeding of the Sixth International Conference on Advances in Computer-Human Interactions, pages 89–94, Nice, France, February 2013. Google Scholar

  • [29] J. H. Foss-Feig, J. L. Heacock, and C. J. Cascio. Tactile responsiveness patterns and their association with core features in autism spectrum disorders. Research in Autism Spectrum Disorders, 6(1):337–344, January 2012. Web of ScienceCrossrefGoogle Scholar

  • [30] K. D. Buron and M. Curtis. The incredible 5-point scale: assisting students in understanding social interactions and controlling their emotional responses. AAPC Pub, Shawnee Mission, Kan, significantly improved and expanded 2nd ed edition, 2012. Google Scholar

  • [31] J. N. Constantino. Social Responsiveness Scale. Western Psychological Service, Los Angeles, 2002. Google Scholar

  • [32] C. Moore. George and Sam. Viking, London, 2004. Google Scholar

  • [33] J. A. Brian, S. P. Tipper, B. Weaver, and S. E. Bryson. Inhibitory mechanisms in autism spectrum disorders: typical selective inhibition of location versus facilitated perceptual processing. Journal of Child Psychology and Psychiatry, 44(4):552–560, May 2003. CrossrefGoogle Scholar

  • [34] F. J. Scott and S. Baron-Cohen. Imagining real and unreal things: Evidence of a dissociation in autism. Journal of Cognitive Neuroscience, 8(4):371–382, October 1996.CrossrefGoogle Scholar

About the article

Received: 2014-04-09

Accepted: 2014-08-09

Published Online: 2014-08-26

Citation Information: Paladyn, Journal of Behavioral Robotics, Volume 5, Issue 1, ISSN (Online) 2081-4836, DOI: https://doi.org/10.2478/pjbr-2014-0004.

Export Citation

© 2014 Jaeryoung Lee et al.. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License. BY-NC-ND 3.0

Citing Articles

Here you can find all Crossref-listed publications in which this article is cited. If you would like to receive automatic email messages as soon as this article is cited in other publications, simply activate the “Citation Alert” on the top of this page.

Ramya S. Moorthy and S. Pugazhenthi
International Journal of Social Robotics, 2017, Volume 9, Number 1, Page 97

Comments (0)

Please log in or register to comment.
Log in