Learning Classifier Systems: A Complete Introduction, Review, and Roadmap

Abstract

If complexity is your problem, learning classifier systems (LCSs) may offer a solution. These rule-based, multifaceted, machine learning algorithms originated and have evolved in the cradle of evolutionary biology and artificial intelligence. The LCS concept has inspired a multitude of implementations adapted to manage the different problem domains to which it has been applied (e.g., autonomous robotics, classification, knowledge discovery, and modeling). One field that is taking increasing notice of LCS is epidemiology, where there is a growing demand for powerful tools to facilitate etiological discovery. Unfortunately, implementation optimization is nontrivial, and a cohesive encapsulation of implementation alternatives seems to be lacking. This paper aims to provide an accessible foundation for researchers of different backgrounds interested in selecting or developing their own LCS. Included is a simple yet thorough introduction, a historical review, and a roadmap of algorithmic components, emphasizing differences in alternative LCS implementations.

References

1. J. Holland, Hidden Order: How Adaptation Builds Complexity, Addison-Wesley, Reading, Mass, USA, 1996.
2. H. H. Dam, H. A. Abbass, C. Lokan, and X. Yao, “Neural-based learning classifier systems,” IEEE Transactions on Knowledge and Data Engineering, vol. 20, no. 1, pp. 26–39, 2008. View at: Publisher Site | Google Scholar
3. J. Holland and J. Reitman, “Cognitive systems based on adaptive agents,” in Pattern-Directed Inference Systems, D. A. Waterman and F. Inand, Eds., Hayes-Roth, 1978. View at: Google Scholar
4. J. H. Holmes, P. L. Lanzi, W. Stolzmann, and S. W. Wilson, “Learning classifier systems: new models, successful applications,” Information Processing Letters, vol. 82, no. 1, pp. 23–30, 2002. View at: Publisher Site | Google Scholar | MathSciNet
5. M. Minsky, “Steps toward artificial intelligence,” Proceedings of the IRE, vol. 49, no. 1, pp. 8–30, 1961. View at: Google Scholar
6. J. Holland, Adaptation in Natural and Artificial Systems, University of Michigan Press, Ann Arbor, Mich, USA, 1975.
7. L. Bull and T. Kovacs, Foundations of Learning Classifier Systems, Springer, Berlin, Germany, 2005.
8. D. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison-Wesley Longman, Boston, Mass, USA, 1989.
9. O. Sigaud and S. Wilson, “Learning classifier systems: a survey,” Soft Computing, vol. 11, no. 11, pp. 1065–1078, 2007. View at: Publisher Site | Google Scholar
10. J. Holmes, “Learning classifier systems applied to knowledge discovery in clinical research databases,” in Learning Classifier Systems, from Foundations to Applications, pp. 243–262, 2000. View at: Google Scholar
11. D. Goldberg, The Design of Innovation: Lessons from and for Competent Genetic Algorithms, Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002.
12. P. Langley, Elements of Machine Learning, Morgan Kaufmann, San Francisco, Calif, USA, 1996.
13. M. B. Harries, C. Sammut, and K. Horn, “Extracting hidden context,” Machine Learning, vol. 32, no. 2, pp. 101–126, 1998. View at: Publisher Site | Google Scholar
14. S. Ben-David, E. Kushilevitz, and Y. Mansour, “Online learning versus offline learning,” Machine Learning, vol. 29, no. 1, pp. 45–63, 1997. View at: Google Scholar
15. R. S. Sutton and A. Barto, Reinforcement Learning: An Introduction, MIT Press, Cambridge, Mass, USA, 1998.
16. M. Harmon and S. Harmon, “Reinforcement Learning: A Tutorial,” December 1996. View at: Google Scholar
17. J. Wyatt, “Reinforcement learning: a brief overview,” in Foundations of Learning Classifier Systems, pp. 179–202, 2005. View at: Google Scholar
18. L. Bull, “Two simple learning classifier systems,” in Foundations of Learning Classifier Systems, pp. 63–89, 2005. View at: Google Scholar
19. S. W. Wilson, “ZCS: a zeroth level classifier system,” Evolutionary Computation, vol. 2, no. 1, pp. 1–18, 1994. View at: Google Scholar
20. D. Goldberg, Computer-aided gas pipeline operation using genetic algorithms and machine learning, Ph.D. thesis, Department Civil Engineering, University of Michigan, Ann Arbor, Mich, USA, 1983.
21. J. Baker, “Reducing bias and inefficiency in the selection algorithm,” in Proceedings of the 2nd International Conference on Genetic Algorithms on Genetic Algorithms and Their Application, pp. 14–21, 1987. View at: Google Scholar
22. S. W. Wilson, “Classifier fitness based on accuracy,” Evolutionary Computation, vol. 3, no. 2, pp. 149–175, 1995. View at: Google Scholar
23. S. Smith, A learning system based on genetic adaptive algorithms, Ph.D. thesis, University of Pittsburgh, Pittsburgh, Pa, USA, 1980.
24. W. Stolzmann, “Anticipatory classifier systems,” in Proceedings of the 3rd Annual Genetic Programming Conference, pp. 658–664, 1998. View at: Google Scholar
25. J. Holland, “Adaptation,” Progress in Theoretical Biology, vol. 4, pp. 263–293, 1976. View at: Google Scholar
26. G. G. Robertson and R. L. Riolo, “A tale of two classifier systems,” Machine Learning, vol. 3, no. 2-3, pp. 139–159, 1988. View at: Publisher Site | Google Scholar
27. S. Smith, “Flexible learning of problem solving heuristics through adaptive search,” in Proceedings of the 8th International Joint Conference on Artificial Intelligence, pp. 422–425, 1983. View at: Google Scholar
28. C. Congdon, A comparison of genetic algorithms and other machine learning systems of a complex classification task from common disease research, Ph.D. thesis, University of Michigan, 1995.
29. R. Riolo, Empirical studies of default hierarchies and sequences of rules in learning classifier systems, Doctoral dissertation, University of Michigan, Ann Arbor, Mich, USA, 1988.
30. J. Holland, “Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems,” Machine Learning, vol. 2, pp. 593–623, 1986. View at: Google Scholar
31. J. Holland, “A mathematical framework for studying learning in classifier systems,” Physica D, vol. 2, no. 1–3, pp. 307–317, 1986. View at: Google Scholar
32. J. H. Holland, “Adaptive algorithms for discovering and using general patterns in growing knowledge bases,” International Journal of Policy Analysis and Information Systems, vol. 4, no. 3, pp. 245–268, 1980. View at: Google Scholar
33. J. Holland, “Adaptive knowledge acquisition,” unpublished research proposal, 1980. View at: Google Scholar
34. J. Holland, “Genetic algorithms and adaptation,” Tech. Rep. 34, Department of Computer and Communication Sciences, University of Michigan, Ann Arbor, Mich, USA, 1981. View at: Google Scholar
35. J. Holland, “Induction in artificial intelligence,” Tech. Rep., Department of Computer and Communication Sciences, University of Michigan, Ann Arbor, Mich, USA, 1983. View at: Google Scholar
36. J. Holland, “A more detailed discussion of classifier systems,” Tech. Rep., Department of Computer and Communication Sciences, University of Michigan, Ann Arbor, Mich, USA, 1983. View at: Google Scholar
37. J. Holland, “Genetic algorithms and adaptation,” in Adaptive Control of Ill-Defined Systems, pp. 317–333, 1984. View at: Google Scholar
38. J. Holland, “Properties of the Bucket brigade,” in Proceedings of the 1st International Conference on Genetic Algorithms, pp. 1–7, 1985. View at: Google Scholar
39. J. Holland, “A mathematical framework for studying learning in classifier systems,” Research Memo RIS-25r, The Rowland Institute for Science, Cambridge, Mass, USA, 1985. View at: Google Scholar
40. J. Holland, “Genetic algorithms and classifier systems: foundations and future directions,” in Proceedings of the 2nd International Conference on Genetic Algorithms and Their Application, pp. 82–89, 1987. View at: Google Scholar
41. A. Samuel, “Some studies in machine learning using the game of checkers,” IBM Journal of Research and Development, pp. 211–232, 1959. View at: Google Scholar
42. L. B. Booker, “Intelligent behavior as an adaptation to the task environment,” 1982. View at: Google Scholar
43. S. W. Wilson, “Classifier systems and the animat problem,” Machine Learning, vol. 2, no. 3, pp. 199–228, 1987. View at: Publisher Site | Google Scholar
44. S. W. Wilson, “Knowledge growth in an artificial animal,” in Proceedings of the 1st International Conference on Genetic Algorithms and Their Application, pp. 16–23, 1985. View at: Google Scholar
45. S. W. Wilson and D. Goldberg, “A critical review of classifier systems,” in Proceedings of the 3rd International Conference on Genetic Algorithms and Their Application, pp. 244–255, 1989. View at: Google Scholar
46. P. Bonelli, A. Parodi, S. Sen, and S. Wilson, “NEWBOOLE: a fast GBML system,” in Proceedings of the 7th International Conference on Machine Learning, pp. 153–159, 1990. View at: Google Scholar
47. L. Booker, “Triggered rule discovery in classifier systems,” in Proceedings of the 3rd International Conference on Genetic Algorithms, pp. 265–274, 1989. View at: Google Scholar
48. M. Valenzuela-Rendon, “The fuzzy classifier system: a classifier system for continuously varying variables,” in Proceedings of the 4th International Conference on Genetic Algorithm, pp. 346–353, 1991. View at: Google Scholar
49. A. Bonarini, “An introduction to learning fuzzy classifier systems,” in Proceedings of the International Workshop on Learning Classifier Systems (IWLCS '00), vol. 1813 of Lecture Notes in Artificial Intelligence, pp. 83–104, 2000. View at: Google Scholar
50. R. Riolo, “Bucket brigade performance: I. Long sequences of classifiers,” in Proceedings of the 2nd International Conference on Genetic Algorithms and Their Application, pp. 184–195, Lawrence Erlbaum, Mahwah, NJ, USA, 1987. View at: Google Scholar
51. R. Riolo, “Bucket brigade performance: II. Default hierarchies,” in Proceedings of the 2nd International Conference on Genetic Algorithms and Their Application, pp. 196–201, Lawrence Erlbaum, Mahwah, NJ, USA, 1987. View at: Google Scholar
52. P. Lanzi and R. Riolo, “Recent trends in learning classifier systems research,” in Advances in Evolutionary Computing: Theory and Applications, Natural Computing Series, pp. 955–988, 2003. View at: Google Scholar
53. A. Barry, “Hierarchy formation within classifier systems: a review,” in Proceedings of the 1st International Conference on Evolutionary Algorithms and Their Application (EVCA '96), pp. 195–211, 1996. View at: Google Scholar
54. P. L. Lanzi, “Learning classifier systems: then and now,” Evolutionary Intelligence, vol. 1, no. 1, pp. 63–82, 2008. View at: Google Scholar
55. R. Riolo, “Lookahead planning and latent learning in a classifier system,” in Proceedings of the 1st International Conference on Simulation of Adaptive Behavior on from Animals to Animats, pp. 316–326, 1991. View at: Google Scholar
56. J. Schaffer and J. Grefenstette, “Multi-objective learning via genetic algorithms,” in Proceedings of the 9th International Joint Conference on Artificial Intelligence, pp. 593–595, 1985. View at: Google Scholar
57. D. Greene, “Automated knowledge acquisition: overcoming the expert system bottleneck,” in Proceedings of the 8th International Conference on Information Systems, J. DeGross and C. Kriebel, Eds., pp. 107–117, Pittsburgh, Pa, USA, 1987. View at: Google Scholar
58. J. J. Grefenstette, “Credit assignment in rule discovery systems based on genetic algorithms,” Machine Learning, vol. 3, no. 2-3, pp. 225–245, 1988. View at: Publisher Site | Google Scholar
59. L. B. Booker, “Classifier systems that learn internal world models,” Machine Learning, vol. 3, no. 2-3, pp. 161–192, 1988. View at: Publisher Site | Google Scholar
60. J. Grefenstette, “Incremental learning of control strategies with genetic algorithms,” in Proceedings of the 6th International Workshop on Machine Learning, pp. 340–344, 1989. View at: Google Scholar
61. J. Grefenstette, “The evolution of strategies for multiagent environments,” Adaptive Behavior, vol. 1, no. 1, p. 65, 1992. View at: Google Scholar
62. J. Grefenstette, The User's Guide to SAMUEL-97: An Evolutionary Learning System, Navy Center for Applied Research in Artificial Intelligence, Naval Research Laboratory, Washington, DC, USA, 1997.
63. L. Shu and J. Schaeffer, “HCS: adding hierarchies to classifier systems,” in Proceedings of the 4th International Conference on Genetic Algorithms and Their Application, pp. 339–345, 1991. View at: Google Scholar
64. M. Dorigo and E. Sirtori, “Alecsys: a parallel laboratory for learning classifier systems,” in Proceedings of the 4th International Conference on Genetic Algorithms, 1991. View at: Google Scholar
65. M. Dorigo, “Alecsys and the autonoMouse: learning to control a real robot by distributed classifier systems,” Machine Learning, vol. 19, no. 3, pp. 209–240, 1995. View at: Publisher Site | Google Scholar
66. K. De Jong and W. Spears, “Learning concept classification rules using genetic algorithms,” in Proceedings of the 12th International Conference on Artificial Intelligence (IJCAI '91), vol. 2, 1991. View at: Google Scholar
67. K. A. De Jong, W. M. Spears, and D. F. Gordon, “Using genetic algorithms for concept learning,” Machine Learning, vol. 13, no. 2-3, pp. 161–188, 1993. View at: Publisher Site | Google Scholar
68. C. Janikow, Inductive Learning of decision rules in attribute-based examples: a knowledge-intensive genetic algorithm approach, Ph.D. thesis, University of North Carolina, 1991.
69. C. Z. Janikow, “A knowledge-intensive genetic algorithm for supervised learning,” Machine Learning, vol. 13, no. 2-3, pp. 189–228, 1993. View at: Publisher Site | Google Scholar
70. D. Greene, Inductive knowledge acquisition using genetic adaptive search, Ph.D. thesis, 1992.
71. D. P. Greene and S. F. Smith, “Competition-based induction of decision models from examples,” Machine Learning, vol. 13, no. 2-3, pp. 229–257, 1993. View at: Publisher Site | Google Scholar
72. A. Giordana and L. Saitta, “REGAL: an integrated system for learning relations using genetic algorithms,” in Proceedings of the 2nd International Workshop on Multistrategy Learning, pp. 234–249, 1993. View at: Google Scholar
73. A. Giordana, L. Saitta, and F. Zini, “Learning disjunctive concepts with distributed genetic algorithms,” in Proceedings of the 1st IEEE Conference on Evolutionary Computation, vol. 1, pp. 115–119, Orlando, Fla, USA, June 1994. View at: Google Scholar
74. A. Giordana and F. Neri, “Search-intensive concept induction,” Evolutionary Computation, vol. 3, no. 4, pp. 375–416, 1995. View at: Google Scholar
75. A. Bonarini, “ELF: learning incomplete fuzzy rule sets for an autonomous robot,” in Proceedings of the ELITE Foundation (EUFIT '93), pp. 69–75, Aachen, Germany, 1993. View at: Google Scholar
76. A. Bonarini, “Some methodological issues about designing autonomous agents which learn their behaviors: the ELF experience,” in Proceedings of the Cybernetics and Systems Research, R. Trappl, Ed., pp. 1435–1442, 1994. View at: Google Scholar
77. A. Bonarini, “Evolutionary learning of fuzzy rules: competition and cooperation,” in Fuzzy Modelling: Paradigms and Practice, pp. 265–284, 1996. View at: Google Scholar
78. D. Cliff and S. Ross, “Adding memory to ZCS,” Adaptive Behavior, vol. 3, no. 2, pp. 101–150, 1994. View at: Google Scholar
79. I. Flockhart and N. Radcliffe, “GA-MINER: parallel data mining with hierarchical genetic algorithms-final report,” EPCC AIKMS GA-Miner-Report 1. View at: Google Scholar
80. I. Flockhart, N. Radcliffe, E. Simoudis, J. Han, and U. Fayyad, “A genetic algorithm-based approach to data mining,” in Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD '96), pp. 299–302, 1996. View at: Google Scholar
81. J. Holmes, “A genetics-based machine learning approach to knowledge discovery in clinical data,” in Proceedings of the AMIA Anual Symposim, pp. 883–883, 1996. View at: Google Scholar
82. J. Holmes, “Discovering risk of disease with a learning classifier system,” in Proceedings of the 7th International Conference on Genetic Algorithms (ICGA '97), pp. 426–433, 1997. View at: Google Scholar
83. P. Lanzi, “Adding memory to XCS,” in Proceedings of IEEE Conference on Evolutionary Computation (ICEC '98), pp. 609–614, 1998. View at: Google Scholar
84. P. Lanzi, “An analysis of the memory mechanism of XCSM,” Genetic Programming, vol. 98, pp. 643–651, 1998. View at: Google Scholar
85. A. Tomlinson and L. Bull, “A corporate classifier system,” Lecture Notes in Computer Science, pp. 550–559, 1998. View at: Google Scholar
86. A. Tomlinson and L. Bull, “A zeroth level corporate classifier system,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '99), pp. 306–313, 1999. View at: Google Scholar
87. W. Stolzmann, “An introduction to anticipatory classifier systems,” in Learning Classifier Systems: From Foundations to Applications, Lecture Notes in Computer Science, pp. 175–194, 2000. View at: Google Scholar
88. W. Browne, The Development of an Industrial Learning Classifier System for Application to a Steel Hot Strip Mill, Ph.D. thesis, Division of Mechanical Engineering and Energy Studies, University of Wales, Cardiff, UK, 1999.
89. W. N. L. Browne, K. M. Holford, C. J. Moore, and J. Bullock, “An industrial learning classifier system: the importance of pre-processing real data and choice of alphabet,” Engineering Applications of Artificial Intelligence, vol. 13, no. 1, pp. 25–36, 2000. View at: Publisher Site | Google Scholar
90. P. Lanzi and S. Wilson, “Toward optimal classifier system performance in non-Markov environments,” Evolutionary Computation, vol. 8, no. 4, pp. 393–418, 2000. View at: Google Scholar
91. A. Tomlinson and L. Bull, “A corporate XCS,” in Proceedings of the International Workshop on Learning Classifier Systems, Lecture Notes in Computer Science, pp. 195–208, 2000. View at: Google Scholar
92. S. W. Wilson, “Get real! XCS with continuous-valued inputs,” in Proceedings of the 3rd International Workshop on Advances in Learning Classifier Systems, Lecture Notes in Computer Science, pp. 209–222, 2000. View at: Google Scholar
93. D. Walter and C. K. Mohan, “ClaDia: a fuzzy classifier system for disease diagnosis,” in Proceedings of the IEEE Conference on Evolutionary Computation (ICEC '00), vol. 2, pp. 1429–1435, 2000. View at: Google Scholar
94. K. Takadama, T. Terano, and K. Shimohara, “Learning classifier systems meet multiagent environments,” in Proceedings of the 3rd International Workshop on Learning Classifier Systems (IWLCS '00), L. Lanzi, W. Stolzmann, and S. W. Wilson, Eds., pp. 192–210, Springer, 2000. View at: Google Scholar
95. S. W. Wilson, “Mining oblique data with XCS,” in Proceedings of the 3rd International Workshop on Advances in Learning Classifier Systems, pp. 158–176, 2000. View at: Google Scholar
96. S. W. Wilson, “Compact rulesets from XCSI,” in Proceedings of the 4th International Workshop on Advances in Learning Classifier Systems, pp. 197–210, 2001. View at: Google Scholar
97. E. Bernado-Mansilla and J. Garrell-Guiu, “MOLeCS: a multiObjective learning classifier system,” in Proceedings of the Conference on Genetic and Evolutionary Computation, vol. 1, 2000. View at: Google Scholar
98. E. Mansilla and J. Guiu, “MOLeCS: using multiobjective evolutionary algorithms for learning,” in Proceedings of the 1st International Conference on Evolutionary Multi-Criterion Optimization, Lecture Notes in Computer Science, pp. 696–710, 2001. View at: Google Scholar
99. P. Gérard and O. Sigaud, “YACS: combining dynamic programming with generalization in classifiersystems,” in Proceedings of the 3rd International Workshop on Advances in Learning Classifier Systems (IWLCS '00), pp. 52–69, 2000. View at: Google Scholar
100. P. Gérard, W. Stolzmann, and O. Sigaud, “YACS : a new learning classifier system using anticipation,” Soft Computing-A, vol. 6, no. 3, pp. 216–228, 2002. View at: Google Scholar
101. T. Kovacs, A comparison of strength and accuracy-based fitness in learning classifier systems, Ph.D. thesis, University of Birmingham, Birmingham, UK, 2001.
102. T. Kovacs, “Two views of classifier systems,” in Advances in Learning Classifier Systems, Lecture Notes in Computer Science, pp. 74–87, 2002. View at: Publisher Site | Google Scholar
103. M. Butz, “Biasing exploration in an anticipatory learning classifier system,” in Proceedings of the 4th International Workshop on Advances in Learning Classifier Systems, vol. 2321 of Lecture Notes in Computer Science, pp. 3–22, 2001. View at: Google Scholar
104. M. V. Butz and J. Hoffmann, “Anticipations control behavior: animal behavior in an anticipatory learning classifier system,” Adaptive Behavior, vol. 10, no. 2, pp. 75–96, 2002. View at: Publisher Site | Google Scholar
105. S. Picault and S. Landau, “ATNoSFERES: a Darwinian evolutionary model for individual or collective agent behavior,” Tech. Rep., LIP6, Paris, France, 2001. View at: Google Scholar
106. S. Landau, S. Picault, and A. Drogoul, “ATNoSFERES: a model for evolutive agent behaviors,” in Proceedings of the Symposium on Adaptive Agents and Multi-Agent Systems (AISB '01), vol. 1, 2001. View at: Google Scholar
107. S. Landau, S. Picault, O. Sigaud, and P. Gérard, “A comparison between ATNoSFERES and XCSM,” in Proceedings of the Genetic and Evolutionary Computation Conference, pp. 926–933, 2002. View at: Google Scholar
108. S. Landau, S. Picault, O. Sigaud, and P. Gerard, “Further comparison between ATNoSFERES and XCSM,” in Proceedings of the 5th International Workshop on Learning Classifier Systems, vol. 2661 of Lecture Notes in Computer Science, pp. 99–117, 2003. View at: Google Scholar
109. S. Landau, O. Sigaud, S. Picault, and P. Gerard, “An experimental comparison between ATNoSFERES and ACS,” in Proceedings of the International Workshop on Learning Classifier Systems, vol. 4399 of Lecture Notes in Computer Science, pp. 144–160, 2007. View at: Google Scholar
110. X. Llorà, J. Garrell et al., “Knowledge-independent data mining with fine-grained parallel evolutionary algorithms,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '01), pp. 461–468, Morgan Kaufmann, San Francisco, Calif, USA, 2001. View at: Google Scholar
111. T. Kovacs, Genetic based machine learning using fine-grained parallelism for data mining, Ph.D. thesis, Enginyeria i Arquitectura La Salle, Ramon Llull University, 2002.
112. X. Llorà and J. Guiu, “Coevolving different knowledge representations with fine-grained parallel learning classifier systems,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '02), pp. 934–941, Morgan Kaufmann, San Francisco, Calif, USA, 2002. View at: Google Scholar
113. S. W. Wilson, “Classifiers that approximate functions,” Natural Computing, vol. 1, no. 2, pp. 211–234, 2002. View at: Google Scholar
114. K. Tharakunnel and D. Goldberg, “XCS with average reward criterion in multi-step environment,” Tech. Rep., Illinois Genetic Algorithms Laboratory (IlliGAL), Department of General Engineering, University of Illinois at Urbana-Champaign, 2002. View at: Google Scholar
115. J. Hurst, L. Bull, and C. Melhuish, “TCS learning classifier system controller on a real robot,” in Proceedings of the 7th International Conference on Parallel Problem Solving from Nature (PPSN '02), Lecture Notes in Computer Science, pp. 588–600, Granada, Spain, September 2002. View at: Google Scholar
116. L. Bull and T. O'Hara, “Accuracy-based neuro and neuro-fuzzy classifier systems,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '02), pp. 905–911, 2002. View at: Google Scholar
117. E. Bernadó-Mansilla and J. M. Garrell-Guiu, “Accuracy-based learning classifier systems: models, analysis and applications to classification tasks,” Evolutionary Computation, vol. 11, no. 3, pp. 209–238, 2003. View at: Publisher Site | Google Scholar
118. M. Butz and D. Goldberg, “Generalized state values in an anticipatory learning classifier system,” in Proceedings of the 7th International Conference on Simulation of Adaptive Behavior in Anticipatory Learning Systems, Lecture Notes in Computer Science, pp. 282–302, 2003. View at: Google Scholar
119. M. Butz, K. Sastry, and D. Goldberg, “Tournament selection: stable fitness pressure in XCS,” in Proceedings of the Genetic and Evolutionary Computation Conference, Lecture Notes in Computer Science, pp. 1857–1869, 2003. View at: Google Scholar
120. X. Llorà and D. E. Goldberg, “Bounding the effect of noise in multiobjective learning classifier systems,” Evolutionary Computation, vol. 11, no. 3, pp. 279–298, 2003. View at: Google Scholar
121. L. Bull, “A simple accuracy-based learning classifier system,” Learning Classifier Systems Group Technical Report UWELCSG03-005, University of the West of England, Bristol, UK, 2003. View at: Google Scholar
122. P. W. Dixon, D. W. Corne, and M. J. Oates, “A ruleset reduction algorithm for the XCS learning classifier system,” in Learning Classifier Systems, vol. 2661 of Lecture Notes in Computer Science, pp. 20–29, 2003. View at: Google Scholar
123. L. Bull, “Lookahead and latent learning in a simple accuracy-based classifier system,” in Proceedings of the 8th International Conference on Parallel Problem Solving from Nature, Lecture Notes in Computer Science, pp. 1042–1050, 2004. View at: Google Scholar
124. A. Gaspar and B. Hirsbrunner, “PICS: Pittsburgh immune classifier system,” in Proceedings of the AISB Symposium on the Immune System and Cognition, Leeds, UK, March 2004. View at: Google Scholar
125. A. Gaspar and B. Hirsbrunner, “From optimization to learning in changing environments: the Pittsburgh immune classifier system,” in Proceedings of the 1st International Conference on Artificial Immune Systems (ICARIS '02), September 2002. View at: Google Scholar
126. J. Hurst and L. Bull, “A self-adaptive neural learning classifier system with constructivism for mobile robot control,” in Proceedings of the 8th International Conference on Parallel Problem Solving from Nature (PPSN '04), Lecture Notes in Computer Science, pp. 942–951, Birmingham, UK, September 2004. View at: Google Scholar
127. L. Bull, “A simple payoff-based learning classifier system,” in Proceedings of the 8th International Conference on Parallel Problem Solving from Nature, Lecture Notes in Computer Science, pp. 1032–1041, 2004. View at: Google Scholar
128. J. Bacardit, Pittsburgh genetic-based machine learning in the data mining era: representations, generalization, and run-time, Ph.D. thesis, Enginyeria i Arquitectura La Salle, Ramon Llull University, Barcelona, European Union, Catalonia, Spain, 2004.
129. J. Bacardit, “Analysis of the initialization stage of a Pittsburgh approach learning classifier system,” in Proceedings of the Conference on Genetic and Evolutionary Computation, pp. 1843–1850, 2005. View at: Google Scholar
130. J. Bacardit and M. Butz, “Data mining in learning classifier systems: comparing XCS with GAssist,” in Proceedings of the International Workshop on Learning Classifier Systems (IWLCS '07), vol. 4399 of Lecture Notes in Computer Science, pp. 282–290, 2007. View at: Google Scholar
131. M. Stout, J. Bacardit, J. D. Hirst, R. E. Smith, and N. Krasnogor, “Prediction of topological contacts in proteins using learning classifier systems,” Soft Computing, vol. 13, no. 3, pp. 245–258, 2009. View at: Publisher Site | Google Scholar
132. P. Gérard, J.-A. Meyer, and O. Sigaud, “Combining latent learning with dynamic programming in the modular anticipatory classifier system,” European Journal of Operational Research, vol. 160, no. 3, pp. 614–637, 2005. View at: Publisher Site | Google Scholar
133. A. Hamzeh and A. Rahmani, “An evolutionary function approximation approach to compute prediction in XCSF,” in Proceedings of the 16th European Conference on Machine Learning (ECML '05), vol. 3720 of Lecture Notes in Computer Science, pp. 584–592, Porto, Portugal, October 2005. View at: Publisher Site | Google Scholar
134. S. Landau, O. Sigaud, and M. Schoenauer, “ATNoSFERES revisited,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '05), pp. 1867–1874, 2005. View at: Google Scholar
135. O. Unold, “Context-free grammar induction with grammar-based classifier system,” Archives of Control Science, vol. 15, no. 4, p. 681, 2005. View at: Google Scholar
136. O. Unold and L. Cielecki, “Grammar-based classifier system,” in Issues in Intelligent Systems: Paradigms, pp. 273–286, EXIT, Warsaw, Poland, 2005. View at: Google Scholar
137. H. Dam, H. Abbass, and C. Lokan, “DXCS: an XCS system for distributed data mining,” in Proceedings of the Conference on Genetic and Evolutionary Computation, pp. 1883–1890, 2005. View at: Google Scholar
138. H. Dam, H. Abbass, and C. Lokan, “Investigation on DXCS: an XCS system for distribution data mining, with continuous-valued inputs in static and dynamic environments,” in Proceedings of the IEEE Cogress on Evolutionary Computation, 2005. View at: Google Scholar
139. H. Dam, H. Abbass, and C. Lokan, “The performance of the DXCS system on continuous-valued inputs in stationary and dynamic environments,” in Proceedings of the IEEE Congress on Evolutionary Computation, vol. 1, 2005. View at: Google Scholar
140. Y. Gao, J. Huang, H. Rong, and D. Gu, “Learning classifier system ensemble for data mining,” in Proceedings of the Workshops on Genetic and Evolutionary Computation, pp. 63–66, 2005. View at: Google Scholar
141. Y. Gao, L. Wu, and J. Huang, “Ensemble learning classifier system and compact ruleset,” in Proceedings of the 6th International Conference Simulated Evolution and Learning (SEAL '06), vol. 4247 of Lecture Notes in Computer Science, pp. 42–49, Hefei, China, October 2006. View at: Google Scholar
142. Y. Gao, J. Z. Huang, H. Rong, and D.-Q. Gu, “LCSE: learning classifier system ensemble for incremental medical instances,” in Proceedings of the International Workshop on Learning Classifier Systems (IWLCS '07), vol. 4399 of Lecture Notes in Computer Science, pp. 93–103, 2007. View at: Google Scholar
143. J. H. Holmes and J. A. Sager, “Rule discovery in epidemiologic surveillance data using EpiXCS: an evolutionary computation approach,” in Proceedings of the 10th Conference on Artificial Intelligence in Medicine (AIME '05), vol. 3581 of Lecture Notes in Computer Science, pp. 444–452, Aberdeen, Scotland, July 2005. View at: Google Scholar
144. J. H. Holmes and J. A. Sager, “The EpiXCS workbench: a tool for experimentation and visualization,” in Proceedings of the International Workshop on Learning Classifier Systems (IWLCS '07), vol. 4399 of Lecture Notes in Computer Science, pp. 333–344, 2007. View at: Google Scholar
145. J. H. Holmes, “Detection of sentinel predictor-class associations with XCS: a sensitivity analysis,” in Proceedings of the International Workshop on Learning Classifier Systems (IWLCS '07), vol. 4399 of Lecture Notes in Computer Science, pp. 270–281, 2007. View at: Google Scholar
146. D. Loiacono and P. Lanzi, “Evolving neural networks for classifier prediction with XCSF,” in Proceedings of the Workshop on Evolutionary Computation (ECAI '06), pp. 36–40, 2006. View at: Google Scholar
147. H. Dam, H. Abbass, and C. Lokan, “BCS: a Bayesian learning classifier system,” Tech. Rep. TR-ALAR-200604005, The Artificial Life and Adaptic Robotics Laboratory, School of Information Technology and Electrical Engineering, University of New South Wales, Cardiff, UK, 2006. View at: Google Scholar
148. J. Bacardit and N. Krasnogor, “Biohel: bioinformatics-oriented hierarchical evolutionary learning (Nottingham ePrints),” Tech. Rep., University of Nottingham, Nottingham, UK, 2006. View at: Google Scholar
149. J. Bacardit, M. Stout, J. D. Hirst, K. Sastry, X. Llorà, and N. Krasnogor, “Automated alphabet reduction method with evolutionary algorithms for protein structure prediction,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '07), pp. 346–353, ACM Press, New York, NY, USA, 2007. View at: Publisher Site | Google Scholar
150. A. Hamzeh and A. Rahmani, “Extending XCSFG beyond linear approximation,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '06), pp. 2246–2253, Vancouver, Canada, July 2006. View at: Google Scholar
151. A. Hamzeh and A. Rahmani, “A new architecture of XCS to approximate real-valued functions based on high order polynomials using variable-length GA,” in Proceedings of the 3rd International Conference on Natural Computation (ICNC '07), vol. 3, pp. 515–519, Haikou, China, August 2007. View at: Publisher Site | Google Scholar
152. P. Lanzi and D. Loiacono, “Classifier systems that compute action mappings,” in Proceedings of the 9th Genetic and Evolutionary Computation Conference (GECCO '07), pp. 1822–1829, ACM Press, New York, NY, USA, 2007. View at: Publisher Site | Google Scholar
153. M. Gershoff and S. Schulenburg, “Collective behavior based hierarchical XCS,” in Proceedings of the Conference on Genetic and Evolutionary Computation Conference (GECCO '07), pp. 2695–2700, ACM Press, New York, NY, USA, 2007. View at: Publisher Site | Google Scholar
154. R. E. Smith and M. K. Jiang, “MILCS: a mutual information learning classifier system,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '07), pp. 2945–2952, ACM Press, New York, NY, USA, 2007. View at: Publisher Site | Google Scholar
155. L. Cielecki and O. Unold, “GCS with real-valued input,” in Proceedings of the 2nd International Work-Conference on The Interplay between Natural and Artificial Computation, vol. 4527 of Lecture Notes in Computer Science, pp. 488–497, 2007. View at: Google Scholar
156. J. Casillas and L. Bull, “Fuzzy-XCS: a Michigan genetic fuzzy system,” IEEE Transactions on Fuzzy Systems, vol. 15, no. 4, pp. 536–550, 2007. View at: Publisher Site | Google Scholar
157. A. Orriols-Puig, J. Casillas, and E. Bernadó-Mansilla, “Fuzzy-UCS: preliminary results,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '07), pp. 2871–2874, 2007. View at: Publisher Site | Google Scholar
158. X. Llorà, R. Reddy, B. Matesic, and R. Bhargava, “Towards better than human capability in diagnosing prostate cancer using infrared spectroscopic imaging,” in Proceedings of the 9th Genetic and Evolutionary Computation Conference (GECCO '07), pp. 2098–2105, ACM Press, New York, NY, USA, 2007. View at: Publisher Site | Google Scholar
159. R. S. Sutton, “Introduction: the challenge of reinforcement learning,” Machine Learning, vol. 8, no. 3-4, pp. 225–227, 1992. View at: Publisher Site | Google Scholar
160. R. S. Sutton, “Learning to predict by the methods of temporal differences,” Machine Learning, vol. 3, no. 1, pp. 9–44, 1988. View at: Publisher Site | Google Scholar
161. C. Watkins, Learning from Delayed Rewards, 1989.
162. G. Liepins, M. Hilliard, M. Palmer, and G. Rangarajan, “Alternatives for classifier system credit assignment,” in Proceedings of the 11th International Joint Conference on Artificial Intelligence (IJCAI '89), pp. 756–761, 1989. View at: Google Scholar
163. M. Dorigo and H. Bersini, “A comparison of Q-learning and classifier systems,” in Proceedings of the 3rd International Conference on Simulation of Adaptive Behavior: From Animals to Animats 3, pp. 248–255, MIT Press, Cambridge, Mass, USA, 1994. View at: Google Scholar
164. M. Dorigo, “Genetic and non-genetic operators in ALECSYS,” Evolutionary Computation, vol. 1, no. 2, pp. 151–164, 1993. View at: Google Scholar
165. P. Lanzi and R. Riolo, “A roadmap to the last decade of learning classifier system research(from 1989 to 1999),” in Proceedings of the International Workshop on Learning Classifier Systems, Lecture Notes in Computer Science, pp. 33–61, 2000. View at: Google Scholar
166. P. W. Frey and D. J. Slate, “Letter recognition using Holland-style adaptive classifiers,” Machine Learning, vol. 6, no. 2, pp. 161–182, 1991. View at: Publisher Site | Google Scholar
167. T. Kovacs, A comparison of strength and accuracy-based fitness in learning classifier systems, Ph.D. thesis, University of Birmingham, Birmingham, UK, 2002.
168. P. Lanzi, “Learning classifier systems from a reinforcement learning perspective,” Soft Computing, vol. 6, no. 3, pp. 162–170, 2002. View at: Google Scholar
169. M. Butz, D. Goldberg, and W. Stolzmann, “Introducing a genetic generalization pressure to the anticipatory classier system: part 1-theoretical approach,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '00), 2000. View at: Google Scholar
170. M. Butz, D. Goldberg, and W. Stolzmann, “Investigating generalization in the anticipatory classifier system,” in Proceedings of the 6th International Conference on Parallel Problem Solving from Nature, Lecture Notes in Computer Science, pp. 735–744, 2000. View at: Google Scholar
171. M. Butz, D. Goldberg, and W. Stolzmann, “Probability-enhanced predictions in the anticipatory classifier system,” in Proceedings of the International Workshop on Learning Classifier Systems (IWLCS '00), pp. 37–51, Springer, 2000. View at: Google Scholar
172. M. Butz, Anticipatory Learning Classifier Systems, Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002.
173. J. Bacardit and M. Butz, “Data mining in learning classifier systems: comparing XCS with GAssist,” in Proceedings of the 7th International Workshop on Learning Classifier Systems (IWLCS '04), 2004. View at: Google Scholar
174. T. Kovacs and P. Lanzi, “A learning classifier systems bibliography,” Tech. Rep., CSR Centre, School of Computer Science Research, University of Birmingham, Birmingham, UK, 1999. View at: Google Scholar
175. P. Stalph and M. Butz, Documentation of XCSF-Ellipsoids Java plus Visualization.
176. M. Butz, “Documentation of XCSFJava 1.1 plus visualization,” MEDAL Report 2007008, 2007. View at: Google Scholar
177. M. Butz and O. Herbort, “Context-dependent predictions and cognitive arm control with XCSF,” in Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation, pp. 1357–1364, ACM, New York, NY, USA, 2008. View at: Google Scholar
178. M. Butz, “Combining gradient-based with evolutionary online learning: an introduction to learning classifier systems,” in Proceedings of the 7th International Conference on Hybrid Intelligent Systems (HIS '07), pp. 12–17, 2007. View at: Google Scholar
179. S. Russell, P. Norvig, J. Canny, J. Malik, and D. Edwards, Artificial Intelligence: A Modern Approach, Prentice-Hall, Englewood Cliffs, NJ, USA, 1995.
180. M. Butz, Rule-based Evolutionary Online Learning Systems: A Principled Approach to LCS Analysis And Design, Springer, Berlin, Germany, 2006.
181. J. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection, MIT Press, Cambridge, Mass, USA, 1992.
182. M. Dorigo and T. Stützle, Ant Colony Optimization, MIT Press, Cambridge, Mass, USA, 2004.
183. L. De Castro and J. Timmis, Artificial Immune Systems: A New Computational Intelligence Approach, Springer, New York, NY, USA, 2002.
184. S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice-Hall, Upper Saddle River, NJ, USA, 1998.
185. E. Bernado, X. Llorà, and J. Garrell, “XCS and GALE: a comparative study of two learning classifier systems with six other learning algorithms on classification tasks,” in Proceedings of the 4th International Workshop on Learning Classifier Systems (IWLCS '01), pp. 337–341, 2001. View at: Google Scholar
186. F. Kharbat, L. Bull, and M. Odeh, “Mining breast cancer data with XCS,” in Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation Conference (GECCO '07), pp. 2066–2073, 2007. View at: Publisher Site | Google Scholar
187. O. Unold and K. Tuszyński, “Mining knowledge from data using anticipatory classifier system,” Knowledge-Based Systems, vol. 21, no. 5, pp. 363–370, 2008. View at: Publisher Site | Google Scholar
188. C. Blake and C. Merz, “UCI repository of machine learning databases,” 1998. View at: Google Scholar
189. S. Alayón, J. I. Estévez, J. Sigut, J. L. Sánchez, and P. Toledo, “An evolutionary Michigan recurrent fuzzy system for nuclei classification in cytological images using nuclear chromatin distribution,” Journal of Biomedical Informatics, vol. 39, no. 6, pp. 573–588, 2006. View at: Publisher Site | Google Scholar
190. O. Unold, “Grammar-based classifier system for recognition of promoter regions,” in Proceedings of the 8th International Conference on Adaptive and Natural Computing Algorithms (ICANNGA '07), vol. 4431 of Lecture Notes in Computer Science, pp. 798–805, 2007. View at: Google Scholar
191. T. Kovacs, Evolving optimal populations with XCS classier systems, M.S. thesis, School of Computer Science, University of Birmingham, Birmingham, UK, 1996.
192. T. Kovacs, “What should a classifier system learn?” in Proceedings of the Congress on Evolutionary Computation, vol. 2, 2001. View at: Google Scholar
193. T. Kovacs, “What should a classifier system learn and how should we measure it?” Soft Computing-A, vol. 6, no. 3, pp. 171–182, 2002. View at: Google Scholar
194. M. Butz and M. Pelikan, “Analyzing the evolutionary pressures in XCS,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '01), pp. 935–942, 2001. View at: Google Scholar
195. M. V. Butz, T. Kovacs, P. L. Lanzi, and S. W. Wilson, “Toward a theory of generalization and learning in XCS,” IEEE Transactions on Evolutionary Computation, vol. 8, no. 1, pp. 28–46, 2004. View at: Publisher Site | Google Scholar
196. J. Bassett and K. De Jong, “Evolving behaviors for cooperating agents,” in Proceedings of the 12th International Symposium on Foundations of Intelligent Systems (ISMIS '00), vol. 1932 of Lecture Notes in Computer Science, pp. 157–165, 2000. View at: Google Scholar
197. M. Butz and D. Goldberg, “Bounding the population size in XCS to ensure reproductive opportunities,” in Proceedings of the Conference on Genetic and Evolutionary Computation, Lecture Notes in Computer Science, pp. 1844–1856, 2003. View at: Google Scholar
198. M. Butz, D. Goldberg, P. Lanzi, and K. Sastry, “Bounding the population size to ensure niche support in XCS,” IlliGAl Report 2004033, July 2004. View at: Google Scholar
199. M. Butz, D. Goldberg, and P. Lanzi, “Bounding learning time in XCS,” in Proceedings of Genetic and Evolutionary Computation Conference (GECCO '04), pp. 739–750, Seattle,Wash, USA, June 2004. View at: Google Scholar
200. M. Butz, Rule-based evolutionary online learning systems: learning bounds, classification, and prediction, Ph.D. thesis, 2004.
201. L. Bull, “Learning classifier systems: a brief introduction,” Applications of Learning Classifier Systems, 2004. View at: Google Scholar
202. L. Booker, “Representing attribute-based concepts in a classifier system,” Foundations of Genetic Algorithms, pp. 115–127, 1991. View at: Google Scholar
203. S. Sen, “A tale of two representations,” in Proceedings of the 7th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, pp. 245–254, Gordon and Breach, 1994. View at: Google Scholar
204. R. Riolo, “The emergence of coupled sequences of classifiers,” in Proceedings of the 3rd International Conference on Genetic Algorithms and Their Application, pp. 256–264, Morgan Kaufmann, San Francisco, Calif, USA, 1989. View at: Google Scholar
205. D. Schuurmans and J. Schaeffer, Representational Difficulties with Classifier Systems, Department of Computing Science, University of Alberta, Edmonton, Canada, 1988.
206. C. Stone and L. Bull, “For real! XCS with continuous-valued inputs,” Evolutionary Computation, vol. 11, no. 3, pp. 299–336, 2003. View at: Google Scholar
207. H. Dam, H. Abbass, and C. Lokan, “Be real! XCS with continuous-valued inputs,” in Proceedings of the Workshops on Genetic and Evolutionary Computation, pp. 85–87, ACM, New York, NY, USA, 2005. View at: Google Scholar
208. P. Lanzi and S. Wilson, “Using convex hulls to represent classifier conditions,” in Proceedings of the 8th Genetic and Evolutionary Computation Conference (GECCO '06), vol. 2, pp. 1481–1488, ACM Press, New York, NY, USA, 2006. View at: Google Scholar
209. M. Butz, “Kernel-based, ellipsoidal conditions in the real-valued XCS classifier system,” in Proceedings of the Conference on Genetic and Evolutionary Computation, pp. 1835–1842, 2005. View at: Google Scholar
210. M. Butz, P. Lanzi, and S. Wilson, “Hyper-ellipsoidal conditions in XCS: rotation, linear approximation, and solution structure,” in Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation, pp. 1457–1464, ACM, New York, NY, USA, 2006. View at: Google Scholar
211. L. Booker, “Improving the performance of genetic algorithms in classifier systems,” in Proceedings of the 1st International Conference on Genetic Algorithms, pp. 80–92, Lawrence Erlbaum Associates, Mahwah, NJ, USA, 1985. View at: Google Scholar
212. D. Mellor, “A first order logic classifier system,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '05), pp. 1819–1826, ACM Press, New York, NY, USA, 2005. View at: Publisher Site | Google Scholar
213. P. Lanzi, “Extending the representation of classifier conditions—part I: from binary to messy coding,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '99), vol. 1, pp. 337–344, 1999. View at: Google Scholar
214. P. Tufts, “Dynamic classifiers: genetic programming and classifier systems,” in Proceedings of the Genetic Programming, pp. 114–119, 1995. View at: Google Scholar
215. M. Ahluwalia, L. Bull, W. Banzhaf et al., “A genetic programming-based classifier system,” in Proceedings of the Genetic and Evolutionary Computation Conference, vol. 1, pp. 11–18, 1999. View at: Google Scholar
216. P. Lanzi and A. Perrucci, “Extending the representation of classifier conditions—part II: from messy coding to S-expressions,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '99), vol. 1, pp. 345–352, 1999. View at: Google Scholar
217. P. Lanzi, “Mining interesting knowledge from data with the XCS classier system,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '01), pp. 958–965, 2001. View at: Google Scholar
218. P. Lanzi, “An analysis of generalization in XCS with symbolic conditions,” in Proceedings of IEEE Congress on Evolutionary Computation (CEC '07), pp. 2149–2156, 2007. View at: Publisher Site | Google Scholar
219. L. Bull and J. Hurst, “A neural learning classifier system with self-adaptive constructivism,” in Proceedings of the Congress on Evolutionary Computation (CEC '03), vol. 2, 2003. View at: Google Scholar
220. T. O'Hara and L. Bull, “A memetic accuracy-based neural learning classifier system,” in Proceedings of IEEE Congress on Evolutionary Computation (CEC '05), vol. 3, pp. 2040–2045, 2005. View at: Google Scholar
221. B. Carse and T. Fogarty, “A fuzzy classifier system using the Pittsburgh approach,” in Proceedings of the International Conference on Evolutionary Computation, the 3rd Conference on Parallel Problem Solving from Nature, Jerusalem, Israel, October 1994. View at: Google Scholar
222. M. Butz, K. Sastry, and D. Goldberg, “Tournament selection in XCS,” in Proceedings of the 5th Genetic and Evolutionary Computation Conference (GECCO '02), vol. 1869, 2002. View at: Google Scholar
223. M. V. Butz, D. E. Goldberg, and K. Tharakunnel, “Analysis and improvement of fitness exploitation in XCS: bounding models, tournament selection, and bilateral accuracy,” Evolutionary Computation, vol. 11, no. 3, pp. 239–277, 2003. View at: Publisher Site | Google Scholar
224. F. Kharbat, L. Bull, and M. Odeh, “Revisiting genetic selection in the XCS learning classifier system,” in Proceedings of the IEEE Congress on Evolutionary Computation, vol. 3, 2005. View at: Google Scholar
225. M. V. Butz, K. Sastry, and D. E. Goldberg, “Strong, stable, and reliable fitness pressure in XCS due to tournament selection,” Genetic Programming and Evolvable Machines, vol. 6, no. 1, pp. 53–77, 2005. View at: Publisher Site | Google Scholar
226. B. Widrow and M. E. Hoff, “Adaptive switching circuits,” in IRE WESCON Convention Record, vol. 4, pp. 709–717, 1960. View at: Google Scholar
227. G. Venturini, Apprentissage adaptatif et apprentissage supervise par algorithme genetique, These de Docteur en Science, Universite de Paris-Sud, Paris, France, 1994.
228. M. Butz, T. Kovacs, P. Lanzi, and S. Wilson, “How XCS evolves accurate classifiers,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '01), pp. 927–934, 2001. View at: Google Scholar
229. G. Liepins and L. Wang, “Classifier system learning of Boolean concepts,” in Proceedings of the 4th International Conference on Genetic Algorithms, pp. 318–323, Morgan Kaufmann, San Francisco, Calif, USA, 1991. View at: Google Scholar
230. G. Weiss, The Action oriented Bucket Brigade, Institut für Informatik, 1991.
231. G. Weiss, “Ah action-oriented perspective of learning in classifier systems,” Journal of Experimental and Theoretical Artificial Intelligence, vol. 8, no. 1, pp. 43–62, 1996. View at: Google Scholar
232. M. V. Butz, D. E. Goldberg, and P. L. Lanzi, “Gradient descent methods in learning classifier systems: improving XCS performance in multistep problems,” IEEE Transactions on Evolutionary Computation, vol. 9, no. 5, pp. 452–473, 2005. View at: Publisher Site | Google Scholar
233. P. Lanzi, M. V. Butz, and D. E. Goldberg, “Empirical analysis of generalization and learning in XCS with gradient descent,” in Proceedings of of the 9th Genetic and Evolutionary Computation Conference (GECCO '07), pp. 1814–1821, ACM Press, New York, NY, USA, 2007. View at: Publisher Site | Google Scholar
234. J. Drugowitsch and A. M. Barry, “XCS with eligibility traces,” in Proceedings of the Conference on Genetic and Evolutionary Computation Conference (GECCO '05), pp. 1851–1858, ACM, New York, NY, USA, 2005. View at: Publisher Site | Google Scholar
235. P. Lanzi, D. Loiacono, S. W. Wilson, and D. E. Goldberg, “Prediction update algorithms for XCSF: RLS, Kalman filter, and gain adaptation,” in Proceedings of the 8th Genetic and Evolutionary Computation Conference (GECCO '06), vol. 2, pp. 1505–1512, ACM Press, 2006. View at: Google Scholar
236. J. Horn, D. Goldberg, and K. Deb, “Implicit niching in a learning classifier system: nature's way,” Evolutionary Computation, vol. 2, no. 1, pp. 37–66, 1994. View at: Google Scholar
237. J. Horn, D. Goldberg, J. Koza, D. Goldberg, D. Fogel, and R. Riolo, “Natural niching for cooperative learning in classifier systems,” in Proceedings of the 1st Annual Conference on Genetic Programming, pp. 553–564, MIT Press, 1996. View at: Google Scholar
238. M. V. Butz, M. Pelikan, X. Llorà, and D. E. Goldberg, “Extracted global structure makes local building block processing effective in XCS,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '05), pp. 655–662, ACM, New York, NY, USA, 2005. View at: Publisher Site | Google Scholar
239. M. V. Butz, M. Pelikan, X. Llorà, and D. E. Goldberg, “Automated global structure extraction for effective local building block processing in XCS,” Evolutionary Computation, vol. 14, no. 3, pp. 345–380, 2006. View at: Publisher Site | Google Scholar
240. J. Bacardit and N. Krasnogor, “Smart crossover operator with multiple parents for a pittsburgh learning classifier system,” in Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation (GECCO '06), vol. 2, pp. 1441–1448, ACM Press, New York, NY, USA, 2006. View at: Google Scholar
241. F. Serendynski, P. Cichosz, and G. Klebus, “Learning classifier systems in multi-agent environments,” in Proceedings of the 1st International Conference on Genetic Algorithms in Engineering Systems: Innovations and Applications (GAESIA '95), pp. 287–292, 1995. View at: Google Scholar
242. S. Sen and M. Sekaran, “Multiagent coordination with learning classifier systems,” in Proceedings of the Adaption and Learning in Multi-Agent Systems, Lecture Notes in Computer Science, pp. 218–233, 1996. View at: Google Scholar
243. L. Bull, M. Studley, T. Bagnall, and I. Whittley, “On the use of rule-sharing in learning classifier system ensembles,” in Proceedings of the Congress on Evolutionary Computation (CEC '05), vol. 1, 2005. View at: Google Scholar
244. L. Bull, M. Studley, A. Bagnall, and I. Whittley, “Learning classifier system ensembles with rule-sharing,” IEEE Transactions on Evolutionary Computation, vol. 11, no. 4, pp. 496–502, 2007. View at: Publisher Site | Google Scholar
245. J. Bacardit and N. Krasnogor, “Empirical evaluation of ensemble techniques for a Pittsburgh learning classifier system,” in Proceedings of the 9th International Workshop on Learning Classifier Systems (IWLCS '08), vol. 4998, pp. 255–268, 2008. View at: Publisher Site | Google Scholar
246. H. H. Dam, P. Rojanavasu, H. A. Abbass, and C. Lokan, “Distributed learning classifier systems,” Studies in Computational Intelligence, vol. 125, pp. 69–91, 2008. View at: Publisher Site | Google Scholar
247. C. Lokan, “Distributed learning classifier systems,” in Learning Classifier Systems in Data Mining, 2008. View at: Google Scholar
248. R. Ranawana and V. Palade, “Multi-classifier systems: review and a roadmap for developers,” International Journal of Hybrid Intelligent Systems, vol. 3, no. 1, pp. 35–61, 2006. View at: Google Scholar
249. E. Bernado-Mansilla, X. Llorà, and I. Traus, “Multiobjective learning classifier systems: an overview,” Tech. Rep., University of Illinois at Urbana Champaign, Urbana, Ill, USA, 2005. View at: Google Scholar
250. C. Fu and L. Davis, “A modified classifier system compaction algorithm,” in Proceedings of the Conference on Genetic and Evolutionary Computation Conference (GECCO '02), pp. 920–925, 2002. View at: Google Scholar
251. M. V. Butz, P. L. Lanzi, and S. W. Wilson, “Function approximation with XCS: hyperellipsoidal conditions, recursive least squares, and compaction,” IEEE Transactions on Evolutionary Computation, vol. 12, no. 3, pp. 355–376, 2008. View at: Publisher Site | Google Scholar
252. J. Holmes, J. Sager, and W. Bilker, “A comparison of three methods for covering missing data in XCS,” in Proceedings of the 7th International Workshop on Learning Classifier Systems (IWLCS '04), Seattle, Wash, USA, June 2004. View at: Google Scholar
253. A. Orriols-Puig and E. Bernadó-Mansilla, “Bounding XCS's parameters for unbalanced datasets,” in Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation Conference (GECCO '06), vol. 2, pp. 1561–1568, ACM, New York, NY, USA, 2006. View at: Google Scholar
254. H. Dam, K. Shafi, and H. Abbass, “Can evolutionary computation handle large dataset?” Tech. Rep. TR-ALAR-2005070001, 2005, http://seal.itee.adfa.edu.au/~alar/techreps. View at: Google Scholar
255. L. Booker, “Classier systems, endogenous fitness, and delayed rewards: a preliminary investigation,” in Proceedings of the International Workshop on Learning Classifier Systems (IWLCS '00) in the Joint Workshops of SAB, 2000. View at: Google Scholar
256. J. Hurst and L. Bull, “A self-adaptive classifier system,” in Proceedings of the 3rd International Workshop on Advances in Learning Classifier Systems, pp. 70–79, Springer, 2000. View at: Google Scholar
257. L. Bull and J. Hurst, “Self-adaptive mutation in ZCS controllers,” in Proceedings of the Real-World Applications of Evolutionary Computing, EvoWorkshops, Lecture Notes in Computer Science, pp. 339–346, 2000. View at: Google Scholar
258. L. Bull, J. Hurst, and A. Tomlinson, “Self-adaptive mutation in classifier system controllers,” in From Animals to Animats 6: Proceedings of the 6th International Conference on Simulation of Adaptive Behavior, MIT Press, 2000. View at: Google Scholar
259. J. Hurst and L. Bull, “A self-adaptive XCS,” in Proceedings of the 4th International Workshop on Advances in Learning Classifier Systems, Lecture Notes in Computer Science, pp. 57–73, 2002. View at: Google Scholar
260. W. Browne, “Improving Evolutionary Computation Based Data-Mining for the Process Industry: The Importance of Abstraction,” Learning Classifier Systems in Data Mining, 2008. View at: Google Scholar
261. D. Goldberg, J. Horn, and K. Deb, “What makes a problem hard for a classifier system?” Tech. Rep., Santa Fe Working Paper, 1992. View at: Google Scholar
262. L. B. Booker, D. E. Goldberg, and J. Holland, “Classifier systems and genetic algorithms,” in Machine Learning: Paradigms and Methods, pp. 235–282, 1989. View at: Google Scholar
263. J. Holland, L. Booker, M. Colombetti et al., “What is a learning classifier system?” in Learning Classifier Systems, from Foundations to Applications, Lecture Notes in Computer Science, pp. 3–32, 2000. View at: Google Scholar
264. S. W. Wilson, “State of XCS classifier system research,” in Proceedings of the 3rd International Workshop on Advances in Learning Classifier Systems, Lecture Notes in Computer Science, pp. 63–82, 2000. View at: Google Scholar
265. T. Kovacs, “Learning classifier systems resources,” Soft Computing-A, vol. 6, no. 3, pp. 240–243, 2002. View at: Google Scholar
266. J. Drugowitsch, Design and Analysis of Learning Classifier Systems: A Probabilistic Approach, Springer, Berlin, Germany, 2008.

Copyright

Copyright © 2009 Ryan J. Urbanowicz and Jason H. Moore. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.