This is an accepted version of a paper published in Knowledge and Information Systems. This paper has been peer-reviewed but does not include the final publisher proofcorrections or journal pagination.Citation for the published paper: verikas, a., guzaitis, j., gelzinis, a., bacauskiene, m. Abstract This paper presents a general framework for designing a fuzzy rule-based classifier. Structure and parameters of the classifier are evolved through a two-stage genetic search. To reduce the search space, the classifier structure is constrained by a tree created using the evolving SOM tree algorithm. Salient input variables are specific for each fuzzy rule and are found during the genetic search process. It is shown through computer simulations of four real world problems that a large number of rules and input variables can be eliminated from the model without deteriorating the classification accuracy. By contrast, the classification accuracy of unseen data is increased due to the elimination.