Probability estimation for multi-class classification using AdaBoost

Nie, Qingfeng; Jin, Lei; Fei, Shumin

doi:10.1016/j.patcog.2014.06.008

Cited by 11 publications

(3 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The optimised 2LP is a potential base unit for deep learning, like for boosting [11], [16], [20], [43], [44]. The numerical optimisation approach is universal, and it admits any distortion types or types of objects.…”

Section: Discussionmentioning

confidence: 99%

Optimal Training Parameters and Hidden Layer Neuron Number of Two-Layer Perceptron for Generalised Scaled Object Classification Problem

Romanuke

2015

Information Technology and Management Science

View full text Add to dashboard Cite

-The research is focused on optimising two-layer perceptron for generalised scaled object classification problem. The optimisation criterion is minimisation of inaccuracy. The inaccuracy depends on training parameters and hidden layer neuron number. After its statistics is accumulated, minimisation is executed by a numerical search. Perceptron is optimised additionally by extra training. As it is done, the classification error percentage does not exceed 3 % in case of the worst scale distortion.

show abstract

Section: Discussionmentioning

confidence: 99%

Optimal Training Parameters and Hidden Layer Neuron Number of Two-Layer Perceptron for Generalised Scaled Object Classification Problem

Romanuke

2015

Information Technology and Management Science

View full text Add to dashboard Cite

show abstract

“…Models work with the problem of having two classes called binary classifiers [ 54 ]. A natural way to extend these models to apply to multi-class classification problems, which have many different classes, is to use multiple binary classifiers and techniques like one-vs-one [ 55 ]. In a one-on-one, multiple binary classifiers are built for each pair of classes.…”

Section: Methodsmentioning

confidence: 99%

Development of a Neurodegenerative Disease Gait Classification Algorithm Using Multiscale Sample Entropy and Machine Learning Classifiers

Nguyen

Liu

Lin

2020

Entropy

View full text Add to dashboard Cite

The prevalence of neurodegenerative diseases (NDD) has grown rapidly in recent years and NDD screening receives much attention. NDD could cause gait abnormalities so that to screen NDD using gait signal is feasible. The research aim of this study is to develop an NDD classification algorithm via gait force (GF) using multiscale sample entropy (MSE) and machine learning models. The Physionet NDD gait database is utilized to validate the proposed algorithm. In the preprocessing stage of the proposed algorithm, new signals were generated by taking one and two times of differential on GF and are divided into various time windows (10/20/30/60-sec). In feature extraction, the GF signal is used to calculate statistical and MSE values. Owing to the imbalanced nature of the Physionet NDD gait database, the synthetic minority oversampling technique (SMOTE) was used to rebalance data of each class. Support vector machine (SVM) and k-nearest neighbors (KNN) were used as the classifiers. The best classification accuracies for the healthy controls (HC) vs. Parkinson’s disease (PD), HC vs. Huntington’s disease (HD), HC vs. amyotrophic lateral sclerosis (ALS), PD vs. HD, PD vs. ALS, HD vs. ALS, HC vs. PD vs. HD vs. ALS, were 99.90%, 99.80%, 100%, 99.75%, 99.90%, 99.55%, and 99.68% under 10-sec time window with KNN. This study successfully developed an NDD gait classification based on MSE and machine learning classifiers.

show abstract

“…Recently, AdaBoost has been successfully used in many fields of study, and few of them are as follows: cost-sensitive classification, semi supervised learning, tracking and network intrusion detection [45,46]. Assaad et al [47] predicted future values of time series using neural networks as base learners and AdaBoost ensemble method.…”

Section: Ensemble Modelsmentioning

confidence: 99%

Forecasting energy consumption using ensemble ARIMA–ANFIS hybrid algorithm

Barak

Sadegh

2016

International Journal of Electrical Power & Energy Systems

279

113

View full text Add to dashboard Cite

a b s t r a c tEnergy consumption is on the rise in developing economies. In order to improve present and future energy supplies, forecasting energy demands is essential. However, lack of accurate and comprehensive data set to predict the future demand is one of big problems in these countries. Therefore, using ensemble hybrid forecasting models that can deal with shortage of data set could be a suitable solution. In this paper, the annual energy consumption in Iran is forecasted using 3 patterns of ARIMA-ANFIS model. In the first pattern, ARIMA (Auto Regressive Integrated Moving Average) model is implemented on 4 input features, where its nonlinear residuals are forecasted by 6 different ANFIS (Adaptive Neuro Fuzzy Inference System) structures including grid partitioning, sub clustering, and fuzzy c means clustering (each with 2 training algorithms). In the second pattern, the forecasting of ARIMA in addition to 4 input features is assumed as input variables for ANFIS prediction. Therefore, four mentioned inputs beside ARIMA's output are used in energy prediction with 6 different ANFIS structures. In the third pattern, due to dealing with data insufficiency, the second pattern is applied with AdaBoost (Adaptive Boosting) data diversification model and a novel ensemble methodology is presented.The results indicate that proposed hybrid patterns improve the accuracy of single ARIMA and ANFIS models in forecasting energy consumption, though third pattern, used diversification model, acts better than others and model's MSE criterion was decreased to 0.026% from 0.058% of second hybrid pattern. Finally, a comprehensive comparison between other hybrid prediction models is done. IntroductionEnergy is vital important for development of every country from the social, economic and environmental perspective. It has magnificent effect on industrial and agricultural products, health, sanitary, population, education and human life quality [1].As energy is a crucial input to industrial part of country, energy demand increases along the industrial function increase. Rapid changes in industry and economy strongly affect energy consumption. Therefore, energy consumption is an important economical index that represents economic development of a city or a country [2]. According to the international energy agent report, there should be many transformations in amount and type of future energy consumption (year 2030). As over the past decade global energy consumption has increased rapidly because of population and economic growth [3,4]. According to wide growth of energy consumption in the last decade, energy demand management is very important for achieving economic success, environment preservation and suitable planning for existing resources that result in self-sufficiency and economic development. Therefore, various techniques have been used for energy demand management to forecast future energy demands accurately [4]. However, energy forecasting is difficult, because it is affected by rapid development of economy, technology, gove...

show abstract

Probability estimation for multi-class classification using AdaBoost

Cited by 11 publications

References 15 publications

Optimal Training Parameters and Hidden Layer Neuron Number of Two-Layer Perceptron for Generalised Scaled Object Classification Problem

Optimal Training Parameters and Hidden Layer Neuron Number of Two-Layer Perceptron for Generalised Scaled Object Classification Problem

Development of a Neurodegenerative Disease Gait Classification Algorithm Using Multiscale Sample Entropy and Machine Learning Classifiers

Forecasting energy consumption using ensemble ARIMA–ANFIS hybrid algorithm

Contact Info

Product

Resources

About