Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Journal of Artificial Intelligence and Soft Computing Research

The Journal of Polish Neural Network Society, the University of Social Sciences in Lodz & Czestochowa University of Technology

4 Issues per year

Open Access
Online
ISSN
2083-2567
See all formats and pricing
More options …

Rule Based Networks: An Efficient and Interpretable Representation of Computational Models

Han Liu
  • School of Computing, University of Portsmouth Buckingham Building, Lion Terrace, Portsmouth, PO1 3HE, United Kingdom of Great Britain and Northern Ireland
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Alexander Gegov
  • School of Computing, University of Portsmouth Buckingham Building, Lion Terrace, Portsmouth, PO1 3HE, United Kingdom of Great Britain and Northern Ireland
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ Mihaela Cocea
  • School of Computing, University of Portsmouth Buckingham Building, Lion Terrace, Portsmouth, PO1 3HE, United Kingdom of Great Britain and Northern Ireland
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
Published Online: 2017-02-23 | DOI: https://doi.org/10.1515/jaiscr-2017-0008

Abstract

Due to the vast and rapid increase in the size of data, data mining has been an increasingly important tool for the purpose of knowledge discovery to prevent the presence of rich data but poor knowledge. In this context, machine learning can be seen as a powerful approach to achieve intelligent data mining. In practice, machine learning is also an intelligent approach for predictive modelling. Rule learning methods, a special type of machine learning methods, can be used to build a rule based system as a special type of expert systems for both knowledge discovery and predictive modelling. A rule based system may be represented through different structures. The techniques for representing rules are known as rule representation, which is significant for knowledge discovery in relation to the interpretability of the model, as well as for predictive modelling with regard to efficiency in predicting unseen instances. This paper justifies the significance of rule representation and presents several existing representation techniques. Two types of novel networked topologies for rule representation are developed against existing techniques. This paper also includes complexity analysis of the networked topologies in order to show their advantages comparing with the existing techniques in terms of model interpretability and computational efficiency.

Keywords: rule based networks; knowledge discovery; predictive modelling; rule representation

References

  • [1] U. Fayyad, G. Piatetsky-Shapiro and P. Smyth, From Data Mining to Knowledge Discovery in Databases, AI Magazine, vol. 17, no. 3, pp. 37–54, 1996Google Scholar

  • [2] F. Stahl and I. Jordanov, An overview of use of neural networks for data mining tasks, WIREs: Data Mining and Knowledge Discovery, pp. 193–208, 2012Google Scholar

  • [3] P.-N. Tan, M. Steinbach and V. Kumar, Introduction to Data Mining, New Jersey: Pearson Education, 2006Google Scholar

  • [4] T. Mitchell, Machine Learning, New York: McGraw Hill, 1997Google Scholar

  • [5] H. Liu, A. Gegov and F. Stahl, Unified Framework for Construction of Rule Based Classification Systems, in Inforamtion Granularity, Big Data and Computational Intelligence, vol. 8, W. Pedrycz and S. Chen, Eds., Springer, 2015, pp. 209–230Google Scholar

  • [6] C. M. Higgins, Classification and Approximation with Rule Based Networks, Pasadena, California, 1993.Google Scholar

  • [7] A. M. Uttley, The Design of Conditional Probability Computers, Information and control, vol. 2, pp. 1–24, 1959Google Scholar

  • [8] I. Kononenko, Bayesain Neual Networks, Biological Cybernetics, vol. 61, pp. 361–370, 1989CrossrefGoogle Scholar

  • [9] F. Rosenblatt, Principles of Neurodynamics: Perceptron and the Theory of Brain Mechanisms, Washington, DC: Spartan Books, 1962Google Scholar

  • [10] O. Ekeberg and A. Lansner, Automatic generation of internal representations in a probabilistic artificial neural network, in Proceedings of the First European Conference on Neural Networks, 1988Google Scholar

  • [11] A. V. Aho, J. E. Hopcraft and J. D. Ullman, Data Structures and Algorithms, Amsterdam: Addison-Wesley, 1983Google Scholar

  • [12] H. Liu, A. Gegov and F. Stahl, Categorization and Construction of Rule Based Systems, in 15th International Conference on Engineering Applications of Neural Networks, Sofia, Bulgaria, 2014Google Scholar

  • [13] J. Furnkranz, Separate-and-Conquer rule learning, Artificial Intelligence Review, vol. 13, pp. 3–54, 1999Google Scholar

  • [14] R. Quinlan, C4.5: programs for machine learning, Morgan Kaufman, 1993Google Scholar

  • [15] J. Cendrowska, PRISM: an algorithm for inducing modular rules, International Journal of Man-Machine Studies, vol. 27, p. 349-370, 1987Google Scholar

  • [16] X. Deng, A covering-based algorithm for classification: PRISM, SK, 2012Google Scholar

  • [17] A. Gegov, Complexity Management in Fuzzy Systems, Berlin: Springer, 2007Google Scholar

  • [18] T. J. Ross, Fuzzy Logic with Engineering Applications, West Sussex: John Wiley & Sons Ltd, 2004Google Scholar

  • [19] S. G. Simpson, Mathematical Logic, PA, 2013Google Scholar

  • [20] A. Holland, Lecture 2: Rules based systems, 2010Google Scholar

  • [21] H. Liu, A. Gegov and M. Cocea, Network Based Rule Representation for Knowledge Discovery and Predictive Modelling, in IEEE International Conference on Fuzzy Systems, Istanbul, 2015Google Scholar

  • [22] H. Liu, A. Gegov and M. Cocea, Rule Based Systems for Big Data: A Machine Learning Approach, 1 ed., vol. 13, Switzerland: Springer, 2016Google Scholar

About the article

Published Online: 2017-02-23

Published in Print: 2017-04-01


Citation Information: Journal of Artificial Intelligence and Soft Computing Research, Volume 7, Issue 2, Pages 111–123, ISSN (Online) 2083-2567, DOI: https://doi.org/10.1515/jaiscr-2017-0008.

Export Citation

© 2017 Academy of Management (SWSPiZ), Lodz. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License. BY-NC-ND 3.0

Comments (0)

Please log in or register to comment.
Log in