Line search methods with variable sample size

Abstract

Minimization of unconstrained objective function in the form of mathematical expectation is considered. Sample Average Approximation -SAA method transforms the expectation objective function into a real-valued deterministic function using large sample and thus deals with deterministic function minimization. The main drawback of this approach is its cost. A large sample of the random variable that defines the expectation must be taken in order to get a reasonably good approximation and thus the sample average approximation method assumes very large number of function evaluations. We will present a line search strategy that uses variable sample size and thus makes the process significantly cheaper. Two measures of progress -lack of precision and decrease of function value are calculated at each iteration. Based on these two measures a new sample size is determined. The rule we will present allows us to increase or decrease the sample size in each iteration until we reach some neighborhood of the solution. An additional safeguard check is performed to avoid unproductive sample decrease. Eventually the maximal sample size is reached so the variable sample size strategy generates a solution of the same quality as * Department of Mathematics and Informatics, Faculty of Science, University of Novi Sad, Trg Dositeja Obradovića 4, 21000 Novi Sad, Serbia, e-mail: natasak@uns.ac.rs.

Spomenici i urbanističko planiranje u Senju od 1949. do 1955. godine

“…52 Do 1960., kada se Krklec vratio u grad u društvu Cesarića, Tadijanovića, Frangeša, Slavičeka i Kaleba, bio je dovršen glavni dio radova, obnovljeno je krovište i glavno pročelje s ulaznim stubištem. Tada su stilski restaurirani dvorišni trijem i cisterna: »… uglavnom su osigurana i materijalna sredstva, ali se ukazuje i potreba da općina Senj iz sredstava stambenog fonda osigura znatne dotacije za unutrašnje uređenje zgrade kako bi mnoštvo vrijednih izložaka konačno našlo svoje utočište.« 53 Jedan je događaj morao dodatno potaknuti promišljanje preobrazbe senjskih ruševina u oživjeli grad. Krajem kolovoza 1952.…”

“…Male place«. 69 Do Krajačeva Elaborata iz 1949. trg se nikada nije zamišljao kao cjelina. Uvijek ga se samo spominjalo i ukratko opisivalo po pojedinim atrakcijama.…”