Extended Dai-Yuan conjugate gradient strategy for large-scale unconstrained optimization with applications to compressive sensing

Esmaeili, Hamid Reza; Rostami, Majid; Kimiaei, Morteza

doi:10.2298/fil1806173e

Cited by 1 publication

(1 citation statement)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Due to simpler structure and low memory requirements of Dai-Liao conjugate gradient methods; Yao, et al (2019) proposed some three-term Dai-Liao CG algorithms that possess efficient conjugate gradient structures. Esmaeili, et al (2018) suggested a new CG scheme to solve problems emerged from astronomical imaging, file restoration, image video coding and other applications. Similarly, Guo & Wan (2019) developed CG algorithm for sparse engineering signal problem.…”

Section: Extended Conjugacy Condition Of Dai and Liao Cg Methods (Eccdl)mentioning

confidence: 99%

A dai-liao hybrid conjugate gradient method for unconstrained optimization

Salihu

Odekunle

Waziri

et al. 2021

Int. J. Ind. Optim.

View full text Add to dashboard Cite

One of todays’ best-performing CG methods is Dai-Liao (DL) method which depends on non-negative parameter and conjugacy conditions for its computation. Although numerous optimal selections for the parameter were suggested, the best choice of remains a subject of consideration. The pure conjugacy condition adopts an exact line search for numerical experiments and convergence analysis. Though, a practical mathematical experiment implies using an inexact line search to find the step size. To avoid such drawbacks, Dai and Liao substituted the earlier conjugacy condition with an extended conjugacy condition. Therefore, this paper suggests a new hybrid CG that combines the strength of Liu and Storey and Conjugate Descent CG methods by retaining a choice of Dai-Liao parameterthat is optimal. The theoretical analysis indicated that the search direction of the new CG scheme is descent and satisfies sufficient descent condition when the iterates jam under strong Wolfe line search. The algorithm is shown to converge globally using standard assumptions. The numerical experimentation of the scheme demonstrated that the proposed method is robust and promising than some known methods applying the performance profile Dolan and Mor´e on 250 unrestricted problems. Numerical assessment of the tested CG algorithms with sparse signal reconstruction and image restoration in compressive sensing problems, file restoration, image video coding and other applications. The result shows that these CG schemes are comparable and can be applied in different fields such as temperature, fire, seismic sensors, and humidity detectors in forests, using wireless sensor network techniques.

show abstract

Section: Extended Conjugacy Condition Of Dai and Liao Cg Methods (Eccdl)mentioning

confidence: 99%