Combination of online clustering and Q-value based GA for reinforcement fuzzy system design

Abstract

This paper proposes a combination of online clustering and Q-value based genetic algorithm (GA) learning scheme for fuzzy system design (CQGAF) with reinforcements. The CQGAF fulfills GA-based fuzzy system design under reinforcement learning environment where only weak reinforcement signals such as "success" and "failure" are available. In CQGAF, there are no fuzzy rules initially. They are generated automatically. The precondition part of a fuzzy system is online constructed by an aligned clustering-based approach. By this clustering, a flexible partition is achieved. Then, the consequent part is designed by Q-value based genetic reinforcement learning. Each individual in the GA population encodes the consequent part parameters of a fuzzy system and is associated with a Q-value. The Q-value estimates the discounted cumulative reinforcement information performed by the individual and is used as a fitness value for GA evolution. At each time step, an individual is selected according to the Q-values, and then a corresponding fuzzy system is built and applied to the environment with a critic received. With this critic, Q-1earning with eligibility trace is executed. After each trial, GA is performed to search for better consequent parameters based on the learned Q-values. Thus, in CQGAF, evolution is performed immediately after the end of one trial in contrast to general GA where many trials are performed before evolution. The feasibility of CQGAF is demonstrated through simulations in cart-pole balancing, magnetic levitation, and chaotic system control problems with only binary reinforcement signals

Two-Strategy reinforcement group cooperation based symbiotic evolution for TSK-type fuzzy controller design

“…Because each antibody can match only one antigen, a different population of antibodies is required to effectively defend against a variety of antigens. As shown in the research [24,32] , partial solutions can be characterized as specializations. The specialization property ensures diversity, which prevents a population from converging to suboptimal solutions.…”

“…The evolutionary fuzzy model generates a fuzzy system automatically by incorporating evolutionary learning procedures [13,19,20,[22][23][24][25][26] . One of the most well-known evolutionary learning procedure is the genetic algorithms (GAs).…”

Intelligent Multirobot Navigation and Arrival-Time Control Using a Scalable PSO-Optimized Hierarchical Controller

“…To reduce the training effort, evolutionary algorithms have been used to design FLS. Two popular optimization algorithms are genetic algorithms (GAs) (Chia-Feng, 2005 ; Mansoori et al, 2008 ; Nantogma et al, 2019 ; Pradhan et al, 2019 ) and particle swarm optimization (PSO) (Juang and Lo, 2008 ; Juang and Chang, 2011 ; Ding et al, 2019 ). These two methods can be easily applied to the design of FLS since it can be formulated as an optimization problem by defining a metric for solution performance evaluation.…”