Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Paladyn, Journal of Behavioral Robotics

Editor-in-Chief: Schöner, Gregor

Covered by SCOPUS

CiteScore 2018: 2.17

SCImago Journal Rank (SJR) 2018: 0.336
Source Normalized Impact per Paper (SNIP) 2018: 1.707

ICV 2018: 120.52

Open Access
See all formats and pricing
More options …

Is it useful for a robot to visit a museum?

The impact of cumulative learning on a robot population

Aliaa Moualla / Sofiane Boucenna / Ali Karaouzene / Denis Vidal / Philippe Gaussier
Published Online: 2018-12-13 | DOI: https://doi.org/10.1515/pjbr-2018-0025


In this work, we study how learning in a special environment such as a museum can influence the behavior of robots. More specifically, we show that online learning based on interaction with people at a museum leads the robots to develop individual preferences. We first developed a humanoid robot (Berenson) that has the ability to head toward its preferred object and to make a facial expression that corresponds to its attitude toward said object. The robot is programmed with a biologically-inspired neural network sensory-motor architecture. This architecture allows Berenson to learn and to evaluate objects. During experiments, museum visitors’ emotional responses to artworks were recorded and used to build a database for training. A similar database was created in the laboratory with laboratory objects. We use those databases to train two simulated populations of robots. Each simulated robot emulates the Berenson sensory-motor architecture. Firstly, the results show the good performance of our architecture in artwork recognition in the museum. Secondly, they demonstrate the effect of training variability on preference diversity. The response of the two populations in a new unknown environment is different; the museum population of robots shows a greater variance in preferences than the population of robots that have been trained only on laboratory objects. The obtained diversity increases the chances of success in an unknown environment and could favor an accidental discovery.

Keywords: neural networks; aesthetic preferences; pattern recognition; online learning; robot’s population; chance discovery


  • [1] M. Asada, K. Hosoda, Y. Kuniyoshi, H. Ishiguro, T. Inui, Y. Yoshikawa, et al., Cognitive developmental robotics: A survey, IEEE Transactions on Autonomous Mental Development, 2009, 1(1), 12-34Google Scholar

  • [2] M. Lungarella, G. Metta, R. Pfeifer, G. Sandini, Developmental robotics: a survey, Connection Science, 2003, 15(4), 151-190CrossrefGoogle Scholar

  • [3] A. G. Barto, S. Mahadevan, Recent advances in hierarchical reinforcement learning, Discrete Event Dynamic Systems, 2003, 13(1-2), 41-77Google Scholar

  • [4] A. Karaouzene, P. Gaussier, D. Vidal, A robot to study the development of artwork appreciation through social interactions, In: 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL), IEEE, 2013, 1-7Google Scholar

  • [5] M. Klinnert, J. Campos, J. Sorce, R. Emde, M. Svejda, The development of the social referencing in infancy, Emotion in early development, 1983, 2, 57-86Google Scholar

  • [6] M. D. Klinnert, R. N. Emde, P. Butterfield, J. J. Campos, Social referencing: The infant’s use of emotional signals from a friendly adult with mother present, Developmental Psychology, 1986, 22(4), 427CrossrefGoogle Scholar

  • [7] S. Boucenna, P. Gaussier, P. Andry, L. Hafemeister, Imitation as a communication tool for online facial expression learning and recognition, In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2010, 5323-5328Google Scholar

  • [8] C. Hasson, P. Gaussier, S. Boucenna, Emotions as a dynamical system: the interplay between the meta-control and communication function of emotions, Paladyn, Journal of Behavioral Robotics, 2011, 2(3), 111-125Google Scholar

  • [9] R. A. Schmidt, R. A. Bjork, New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training, Psychological science, 1992, 3(4), 207-218CrossrefGoogle Scholar

  • [10] M. A. Schilling, P. Vidal, R. E. Ployhart, A. Marangoni, Learning by doing something else: Variation, relatedness, and the learning curve, Management Science, 2003, 49(1), 39-56Google Scholar

  • [11] G. Wulf, The effect of type of practice on motor learning in children, Applied Cognitive Psychology, 1991, 5(2), 123-134CrossrefGoogle Scholar

  • [12] A. F. Healy, E. L. Wohldmann, E. M. Sutton, L. E. Bourne Jr, Specificity effects in training and transfer of speeded responses, Journal of Experimental Psychology: Learning, Memory, and Cognition, 2006, 32(3), 534-546CrossrefGoogle Scholar

  • [13] C. Gonzalez, P. Madhavan, Diversity during training enhances detection of novel stimuli, Journal of Cognitive Psychology, 2011, 23(3), 342-350CrossrefGoogle Scholar

  • [14] K. Popper, The logic of scientific discovery, Routledge, 2005Google Scholar

  • [15] P. Langley, H. A. Simon, G. L. Bradshaw, J. M. Zytkow, Scientific discovery: Computational explorations of the creative processes, MIT press, 1987Google Scholar

  • [16] B. C. Falkenhainer, R. S. Michalski, Integrating quantitative and qualitative discovery: the abacus system, Machine Learning, 1986, 1(4), 367-401Google Scholar

  • [17] J. M. Zytkow, Automated discovery of empirical laws, Fundamenta Informaticae, 1996, 27(2-3), 299-318Google Scholar

  • [18] B. Nordhausen, P. Langley, A robust approach to numeric discovery, In: Machine Learning Proceedings 1990, Elsevier, 1990, 411-418Google Scholar

  • [19] A. Sparkes,W. Aubrey, E. Byrne, A. Clare, M. N. Khan, M. Liakata, et al., Towards robot scientists for autonomous scientific discovery, Automated Experimentation, 2010, 2(1), 1Google Scholar

  • [20] H. Prendinger, M. Ishizuka, Methodological considerations on chance discovery, In: 26th Annual Conference of the IEEE, Industrial Electronics Society, IECON 2000, IEEE, 2000, 1652-1655Google Scholar

  • [21] W. Tung, C. Quek, A neurocognitive approach to decisionmaking in chance discovery, In: Chance discoveries in real world decision making, Springer, 2006, 231-250Google Scholar

  • [22] W. Burgard, A. B. Cremers, D. Fox, D. Hähnel, G. Lakemeyer, D. Schulz, et al., The interactive museumtour-guide robot, In: AAAI ’98/IAAI ’98 Proceedings of the Fifteenth National/Tenth Conference on Artificial Intelligence/Innovative Applications of Artificial Intelligence, 1998, 11-18Google Scholar

  • [23] I. Macaluso, A. Chella, Machine consciousness in cecerobot, a museum guide robot, In: Proceedings, AAAI Fall 2007 Symposium, Arlington VA, 2007Google Scholar

  • [24] S. Thrun, M. Beetz, M. Bennewitz, W. Burgard, A. B. Cremers, F. Dellaert, et al., Probabilistic algorithms and the interactive museum tour-guide robot minerva, The International Journal of Robotics Research, 2000, 19(11), 972-999Google Scholar

  • [25] T. Ogata, S. Sugano, Emotional communication between humans and the autonomous robot which has the emotion model, Sensors, 1999, 10(3)Google Scholar

  • [26] S. Marsland, U. Nehmzow, J. Shapiro, On-line novelty detection for autonomous mobile robots, Robotics and Autonomous Systems, 2005, 51(2), 191-206CrossrefGoogle Scholar

  • [27] M. Csikszentmihalyi, Society, culture, and person: A systems view of creativity, In: R. J. Sternberg (Ed.), The Nature of Creativity: Contemporary Psychological Perspectives, 1988Google Scholar

  • [28] P. Gaussier, S. Zrehen, Perac: A neural architecture to control artificial animals, Robotics and Autonomous Systems, 1995, 16(2-4), 291-320CrossrefGoogle Scholar

  • [29] M. A. Goodale, A. D. Milner, Separate visual pathways for perception and action, Trends in neurosciences, 1992, 15(1), 20-25CrossrefGoogle Scholar

  • [30] T. Kanungo, D. M.Mount, N. S. Netanyahu, C. D. Piatko, R. Silverman, A. Y. Wu, An eflcient k-means clustering algorithm: Analysis and implementation, IEEE Transactions of Pattern Analysis and Machine Intelligence, 2002, 24, 881-892CrossrefGoogle Scholar

  • [31] R. A. Rescorla, A. R. Wagner, et al., A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement, Classical conditioning II: Current research and theory, 1972, 2, 64-99Google Scholar

  • [32] B. Widrow, M. E. Hoff, Adaptive switching circuits, In: IRE WESCON, New York: Convention Record, 1960, 96-104Google Scholar

  • [33] S. Boucenna, P. Gaussier, P. Andry, L. Hafemeister, A robot learns the facial expressions recognition and face/nonface discrimination through an imitation game, International Journal of Social Robotics, 2014, 6(4), 633-652Google Scholar

  • [34] S. Boucenna, P. Gaussier, L. Hafemeister, Development of first social referencing skills: Emotional interaction as a way to regulate robot behavior, IEEE Transactions on Autonomous Mental Development, 2014, 6(1), 42-55Google Scholar

  • [35] A. Moualla, A. Karaouzene, S. Boucenna, D. Vidal, P. Gaussier, Readability of the gaze and expressions of a robot museum visitor: impact of the low level sensory-motor control, In: 26th IEEE International Symposiumon Robot and Human Interactive Communication (RO-MAN 2017), IEEE, 2017, 712-719.Google Scholar

About the article

Received: 2018-02-13

Accepted: 2018-10-09

Published Online: 2018-12-13

Published in Print: 2018-12-01

Citation Information: Paladyn, Journal of Behavioral Robotics, Volume 9, Issue 1, Pages 374–390, ISSN (Online) 2081-4836, DOI: https://doi.org/10.1515/pjbr-2018-0025.

Export Citation

© by Aliaa Moualla, et al., published by De Gruyter. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. BY-NC-ND 4.0

Comments (0)

Please log in or register to comment.
Log in