Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Journal of Artificial General Intelligence

The Journal of the Artificial General Intelligence Society

3 Issues per year

Open Access
See all formats and pricing
More options …

Keep it simple - A case study of model development in the context of the Dynamic Stocks and Flows (DSF) task

Marc Halbrügge
Published Online: 2011-11-23 | DOI: https://doi.org/10.2478/v10229-011-0008-2

Keep it simple - A case study of model development in the context of the Dynamic Stocks and Flows (DSF) task

This paper describes the creation of a cognitive model submitted to the ‘Dynamic Stocks and Flows’ (DSF) modeling challenge. This challenge aims at comparing computational cognitive models for human behavior during an open ended control task. Participants in the modeling competition were provided with a simulation environment and training data for benchmarking their models while the actual specification of the competition task was withheld. To meet this challenge, the cognitive model described here was designed and optimized for generalizability. Only two simple assumptions about human problem solving were used to explain the empirical findings of the training data. In-depth analysis of the data set prior to the development of the model led to the dismissal of correlations or other parametric statistics as goodness-of-fit indicators. A new statistical measurement based on rank orders and sequence matching techniques is being proposed instead. This measurement, when being applied to the human sample, also identifies clusters of subjects that use different strategies for the task. The acceptability of the fits achieved by the model is verified using permutation tests.

Keywords: Cognitive Modeling; Model Comparison; Sequence Matching; Cluster Analysis; Bootstrap Test

  • Anderson, J. R.; Bothell, D.; Byrne, M. D.; Douglass, S.; Lebiere, C.; and Qin, Y. 2004. An Integrated Theory of the Mind. Psychological Review 111(4):1036-1060.Google Scholar

  • Baker, R. S.; Corbett, A. T.; and Koedinger, K. R. 2003. Statistical Techniques For Comparing ACT-R Models of Cognitive Performance. In Proceedings of the 10th Annual ACT-R Workshop.Google Scholar

  • Bertsekas, D. P. 2000. Dynamic Programming and Optimal Control. Belmont, Mass.: Athena Scientific.Google Scholar

  • Bortz, J. 1999. Statistik für Sozialwissenschaftler. Berlin: Springer, 5. edition.Google Scholar

  • Davison, A. C., and Hinkley, D. V. 1997. Bootstrap Methods and their Application. New York: Cambridge University Press.Google Scholar

  • Dörner, D. 1989. Die Logik des Misslingens. Reinbek: Rohwohlt Verlag GmbH.Google Scholar

  • Dutt, V., and Gonzalez, C. 2007. Slope of Inflow Impacts Dynamic Decision Making. In Proceedings of the 25th International Conference of the System Dynamics Society, 79. Boston, MA: System Dynamics Society.Google Scholar

  • Gabel, T., and Riedmiller, M. 2010. On Progress in RoboCup: The Simulation League Showcase. In RoboCup 2010: Robot Soccer World Cup XIV, Lecture Notes in Artificial Intelligence. Berlin: Springer.Google Scholar

  • Gluck, K. A.; Stanley, C. T.; Moore, L. R.; Reitter, D.; and Halbrügge, M. 2010. Exploration for Understanding in Cognitive Modeling. Journal of Artificial General Intelligence 2(2):89-108.Google Scholar

  • Halbrügge, M. 2007a. Clusteranalysen für Blicksequenzen. In Röttling, M.; Wozny, G.; Klostermann, A.; and Huss, J., eds., Gestaltung von Mensch-Technik-Interaktion - 7. Berliner Werkstatt Mensch-Maschine-Systeme, number 25 in Fortschritt-Berichte VDI Reihe 22, 17-22. Düsseldorf: VDI Verlag GmbH.Google Scholar

  • Halbrügge, M. 2007b. Evaluating Cognitive Models and Architectures. In Kaminka, G. A., and Burghart, C. R., eds., Evaluating Architectures for Intelligence. Papers from the 2007 AAAI Workshop, 27-31. Menlo Park, California: AAAI Press.Google Scholar

  • Lebiere, C.; Gonzalez, C.; and Warwick, W. 2009. A comparative approach to understanding general intelligence: Predicting cognitive performance in an open-ended dynamic task. In Goertzel, B.; Hitzler, P.; and Hutter, M., eds., Proceedings of the Second Conference on Artificial General Intelligence, 103-107. Amsterdam-Paris: Atlantik Press.Google Scholar

  • Lehmann, E. L., and Romano, J. P. 2005. Testing Statistical Hypotheses. New York: Springer, 3. edition.Google Scholar

  • Li, M., and Vitányi, P. 1997. An Introduction to Kolmogorov Complexity and Its Applications. New York: Springer, 2. edition.Google Scholar

  • Mirkin, B. 1996. Mathematical classification and clustering. Dordrecht: Kluwer Academic Press.Google Scholar

  • Stone, P. 2003. Multiagent Competitions and Research: Lessons from RoboCup and TAC. In Kaminka, G. A.; Lima, P. U.; and Rojas, R., eds., RoboCup 2002: Robot Soccer World Cup VI, Lecture Notes in Artificial Intelligence, 224-237. Berlin: Springer.Google Scholar

  • Wagenaar, W. A., and Sagaria, S. D. 1975. Misperception of exponential growth. Perception & Psychophysics 18(6):416-422.CrossrefGoogle Scholar

About the article

Published Online: 2011-11-23

Published in Print: 2010-12-01

Citation Information: Journal of Artificial General Intelligence, Volume 2, Issue 2, Pages 38–51, ISSN (Online) 1946-0163, DOI: https://doi.org/10.2478/v10229-011-0008-2.

Export Citation

This content is open access.

Citing Articles

Here you can find all Crossref-listed publications in which this article is cited. If you would like to receive automatic email messages as soon as this article is cited in other publications, simply activate the “Citation Alert” on the top of this page.

Sabine Prezenski, André Brechmann, Susann Wolff, and Nele Russwinkel
Frontiers in Psychology, 2017, Volume 8

Comments (0)

Please log in or register to comment.
Log in