Design and performance of adaptive systems based on structured stochastic optimization strategies

Abstract

The theory and design of linear adaptive filters based on FIR filter structures is well developed and widely applied in practice. However, the same is not true for more general classes of adaptive systems such as linear infinite impulse response adaptive filters (IIR) and nonlinear adaptive systems. This situation results because both linear IIR structures and nonlinear structures tend to produce multi-modal error surfaces for which stochastic gradient optimization strategies may fail to reach the global minimum. After briefly discussing the state of the art in linear adaptive filtering, the attention of this paper is turned to IIR and nonlinear adaptive systems for potential use in echo cancellation, channel equalization, acoustic channel modeling, nonlinear prediction, and nonlinear system identification . Structured stochastic optimization algorithms that are effective on multimodal error surfaces are then introduced, with particular attention to the Particle Swarm Optimization (PSO) technique. The PSO algorithm is demonstrated on some representative IIR and nonlinear filter structures, and both performance and computational complexity are analyzed for these types of nonlinear systems. Abstract WARREN PHOTOGRAPHIC

BCI meeting 2005-workshop on BCI signal processing: feature extraction and translation

“…Approaches to optimization can be generally categorized into local techniques and global techniques [25]. Local techniques such as variants on gradient ascent/descent are well established, provably convergent, and can be effective for linear and simple nonlinear systems.…”

A New Dual Channel Speech Enhancement Approach Based on Accelerated Particle Swarm Optimization (APSO)

“…To implement the APSO in speech enhancement application, it is required to set some parameters. They are number of iterations ( max t ), number of particles ( p n ) and acceleration constants given in (6).Flow chart for APSO is given in Fig.3.…”

“…Several studies are carried out on PSO and there exists almost two dozens of PSO variants [5]. The stochastic optimization technique of PSO has been studied for adaptive filtering [6]. PSO is introduced to speech enhancement application in 2010 by Laleh Badri Asl and Vahid Majid [7].…”

Detection of the Cardiovascular Diseases by Using a Linearly Modeling System with the PSO-Based Classification Scheme

“…For objective functions with more complexities, the situation will be even worse. As attempts to solve this problem, several techniques were proposed by altering the inertia coefficient [11] and acceleration constants [12] to improve the velocities during evolution process. Simulation results, however, show inconsistent evolution performances for different objective functions by using these techniques.…”