A dai-liao hybrid conjugate gradient method for unconstrained optimization

Abstract

One of todays’ best-performing CG methods is Dai-Liao (DL) method which depends on non-negative parameter and conjugacy conditions for its computation. Although numerous optimal selections for the parameter were suggested, the best choice of remains a subject of consideration. The pure conjugacy condition adopts an exact line search for numerical experiments and convergence analysis. Though, a practical mathematical experiment implies using an inexact line search to find the step size. To avoid such drawbacks, Dai and Liao substituted the earlier conjugacy condition with an extended conjugacy condition. Therefore, this paper suggests a new hybrid CG that combines the strength of Liu and Storey and Conjugate Descent CG methods by retaining a choice of Dai-Liao parameterthat is optimal. The theoretical analysis indicated that the search direction of the new CG scheme is descent and satisfies sufficient descent condition when the iterates jam under strong Wolfe line search. The algorithm is shown to converge globally using standard assumptions. The numerical experimentation of the scheme demonstrated that the proposed method is robust and promising than some known methods applying the performance profile Dolan and Mor´e on 250 unrestricted problems. Numerical assessment of the tested CG algorithms with sparse signal reconstruction and image restoration in compressive sensing problems, file restoration, image video coding and other applications. The result shows that these CG schemes are comparable and can be applied in different fields such as temperature, fire, seismic sensors, and humidity detectors in forests, using wireless sensor network techniques.

Exploring Enhanced Conjugate Gradient Methods: A Novel Family of Techniques for Efficient Unconstrained Minimization

“…According to [13,[19][20][21][22][23][24][25][26], hybrid CGMs have recently been suggested. The novel hybrid CGM, built by convex combination, satisfies the necessary descent condition, according to the author in [19].…”

A New Hybrid Three-Term LS-CD Conjugate Gradient In Solving Unconstrained Optimization Problems

“…Again Djordjevic [17] proposed a new hybrid CG parameter that computed as convex combination of β LS k and β CD k in which satisfied both conjugacy condition and strong Wolfe line search conditions. Recently, Sahilu [37] also used the idea of convex combination proposed by Djordjevic [17] and hybridized by using Secant Equation which given as follows,…”

A sufficient descent hybrid conjugate gradient method without line search consideration and application

“…Recently, ideas of merging different CG formulas to improve their convergence properties have drawn increased attention (Nasiru et al ., 2021). The earlier technique suggested in Touati-Ahmed and Storey (1990) combines PRP and FR methods, where the computational result shows that the technique outperforms each of these strategies separately.…”