Scalable decision tree based on fuzzy partitioning and an incremental approach

Abstract

<span>Classification as a data mining materiel is the process of assigning entities to an already defined class by examining the features. The most significant feature of a decision tree as a classification method is its ability to data recursive partitioning. To choose the best attributes for partition, the value range of each continuous attribute should be divided into two or more intervals. Fuzzy partitioning can be used to reduce noise sensitivity and increase the stability of trees. Also, decision trees constructed with existing approaches, tend to be complex, and consequently are difficult to use in practical applications. In this article, a fuzzy decision tree has been introduced that tackles the problem of tree complexity and memory limitation by incrementally inserting data sets into the tree. Membership functions are generated automatically. Then Fuzzy Information Gain is used as a fast-splitting attribute selection criterion and the expansion of a leaf is done attending only with the instances stored in it. The efficiency of this algorithm is examined in terms of accuracy and tree complexity. The results show that the proposed algorithm by reducing the complexity of the tree can overcome the memory limitation and make a balance between accuracy and complexity.</span>

A Consolidated Tree Structure Combining Multiple Regression Trees With Varying Depths, Resulting in an Efficient Ensemble Model

“…Pre-pruning involves setting stopping conditions during tree construction to avoid overfitting, while post-pruning involves removing branches after construction based on statistical measures. Proper stopping conditions can lead to an efficient pre-pruning approach that is more accurate and faster than postpruning [15].…”

“…Decision trees have been extensively researched in the literature, with many applications focusing on classification tasks such as intrusion detection, privacy preservation, power systems, bank marketing, health care and disease diagnosis, and agriculture [1][2][3][4][5][6][7]. Additionally, researchers have investigated regression models based on decision trees, which are typically referred to as regression trees, in fields like psychology, education, urban planning, environmental management, genetics, communication, and economics [8][9][10][11][12][13][14][15].…”

Machine learning based smart weather prediction

“…Decision Tree is one of the most popularly used, workable approaches to supervised machine learning. A decision tree model can be used in regression as well as a classification problem [30]. It works by breaking the data up in a tree like structure into smaller and smaller subsets.…”