Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Journal of Artificial General Intelligence

The Journal of the Artificial General Intelligence Society

3 Issues per year

Open Access
Online
ISSN
1946-0163
See all formats and pricing
More options …

A Measure of Real-Time Intelligence

Vaibhav Gavane
  • Corresponding author
  • School of Computing Science and Engineering VIT University Vellore - 632014, Tamil Nadu, India
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
Published Online: 2014-04-25 | DOI: https://doi.org/10.2478/jagi-2013-0003

Abstract

We propose a new measure of intelligence for general reinforcement learning agents, based on the notion that an agent’s environment can change at any step of execution of the agent. That is, an agent is considered to be interacting with its environment in real-time. In this sense, the resulting intelligence measure is more general than the universal intelligence measure (Legg and Hutter, 2007) and the anytime universal intelligence test (Hernández-Orallo and Dowe, 2010). A major advantage of the measure is that an agent’s computational complexity is factored into the measure in a natural manner. We show that there exist agents with intelligence arbitrarily close to the theoretical maximum, and that the intelligence of agents depends on their parallel processing capability. We thus believe that the measure can provide a better evaluation of agents and guidance for building practical agents with high intelligence.

Keywords: intelligence measure; reinforcement learning; real-time computation; algorithmic probability

References

  • Aanderaa, S. O. 1974. On k-tape versus (k -1)-tape real-time computation. In Karp, R. M., ed., Complexity of Computation (SIAM-AMS Proceedings), volume 7, 75-96. American Mathematical Society, Providence, Rhode Island.Google Scholar

  • Aaronson, S., and Ambainis, A. 2005. Quantum search of spatial regions. Theory of Computing 1:47-79.Google Scholar

  • Hernández-Orallo, J., and Dowe, D. L. 2010. Measuring universal intelligence: Towards an anytime intelligence test. Artificial Intelligence 174(18):1508-1539.Google Scholar

  • Hutter, M. 2005. Universal Artificial Intelligence: Sequential Decisions based on Algorithmic Probability. Springer, Berlin.Google Scholar

  • Hutter, M. 2007. On universal prediction and Bayesian confirmation. Theoretical Computer Science 384(1):33-48.Google Scholar

  • Lattimore, T., and Hutter, M. 2011. Time consistent discounting. In Kivinen, J.; Szepesv´ari, C.; Ukkonen, E.; and Zeugmann, T., eds., Proceedings of The 22nd International Conference on Algorithmic Learning Theory (ALT’11), volume 6925 of LNAI, 383-397. Espoo, Finland: Springer, Berlin.Google Scholar

  • Legg, S., and Hutter, M. 2007. Universal intelligence: A definition of machine intelligence. Minds & Machines 17(4):391-444.Google Scholar

  • Li, M., and Vit´anyi, P. M. B. 2008. An Introduction to Kolmogorov Complexity and Its Applications. Springer, New York, third edition.Google Scholar

  • Paul, W. J.; Seiferas, J. I.; and Simon, J. 1981. An information-theoretic approach to time bounds for on-line computation. Journal of Computer and System Sciences 23:108-126.Google Scholar

  • Rabaey, J. M.; Chandrakasan, A.; and Nikolic, B. 2003. Digital Integrated Circuits. Prentice Hall, second edition.Google Scholar

  • Rosenberg, A. L. 1967. Real-time definable languages. Journal of the Association for Computing Machinery 14(4):645-662.CrossrefGoogle Scholar

  • Schmidhuber, J. 1997. A computer scientist’s view of life, the universe, and everything. In Freksa, C.; Jantzen, M.; and Valk, R., eds., Foundations of Computer Science: Potential - Theory - Cognition, volume 1337 of Lecture Notes in Computer Science. Springer, Berlin. 201-208.Google Scholar

  • Vitányi, P. M. B. 1980. On the power of real-time Turing machines under varying specifications. In Proceedings of the 7th International Colloquium on Automata, Languages and Programming (ICALP’80), volume 85 of Lecture Notes in Computer Science, 658-671. Springer, Berlin. Google Scholar

About the article

Received: 2012-06-30

Accepted: 2013-11-25

Published Online: 2014-04-25

Published in Print: 2013-03-01


Citation Information: Journal of Artificial General Intelligence, ISSN (Online) 1946-0163, DOI: https://doi.org/10.2478/jagi-2013-0003.

Export Citation

© Vaibhav Gavane. This article is distributed under the terms of the Creative Commons Attribution Non-Commercial License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. BY-NC-ND 3.0

Comments (0)

Please log in or register to comment.
Log in