Akcije

The University Thought - Publication in Natural Sciences
kako citirati ovaj članak
podeli ovaj članak

Metrika

  • citati u SCIndeksu: [2]
  • citati u CrossRef-u:[1]
  • citati u Google Scholaru:[]
  • posete u poslednjih 30 dana:6
  • preuzimanja u poslednjih 30 dana:6

Sadržaj

članak: 10 od 13  
Back povratak na rezultate
Determination of accelerated factors in gradient descent iterations based on Taylor's series
(naslov ne postoji na srpskom)
Univerzitet u Prištini sa privremenim sedištem u Kosovskoj Mitrovici, Prirodno-matematički fakultet

e-adresamilena.petrovic@pr.ac.rs
Ključne reči: Line search; gradient descent methods; quasi-Newton method; convergence rate
Sažetak
(ne postoji na srpskom)
In this paper the efficiency of accelerated gradient descent methods regarding the way of determination of accelerated factor is considered. Due to the previous researches we assert that the use of Taylor's series of posed gradient descent iteration in calculation of accelerated parameter gives better final results than some other choices. We give a comparative analysis of efficiency of several methods with different approaches in obtaining accelerated parameter. According to the achieved results of numerical experiments we make a conclusion about the one of the most optimal way in defining accelerated parameter in accelerated gradient descent schemes.
Reference
Andrei, N. (2006) An acceleration of gradient descent algoritham with backtracing for unconstrained optimization. Numer. Algor, 42
Andrei, N. (2008) An unconstrained optimization test functions collection. Advanced Modeling and Optimization, 10(1)
Fletcher, R. (1964) Function minimization by conjugate gradients. Computer Journal, 7(2): 149-154
Petrović, M., Rakočević, V., Kontrec, N., Panić, S., Ilić, D. (2016) Hibridization of accelearted gradient descent method. Numer. Algor, under review
Petrović, M.J., Stanimirović, P.S. (2014) Accelerated Double Direction Method for Solving Unconstrained Optimization Problems. Mathematical Problems in Engineering, 2014: 1-8
Petrović, M.J. (2015) An Accelerated Double Step Size model in unconstrained optimization. Applied Mathematics and Computation, 250: 309-319
Polak, E., Ribiere, G. (1969) Note sur la convergence de méthodes de directions conjuguées. Revue française d'informatique et de recherche opérationnelle. Série rouge, 3(16): 35-43
Polyak, B.T. (1969) The conjugate gradient method in extremal problems. USSR Computational Mathematics and Mathematical Physics, 9(4): 94-112
Stanimirović, P.S., Miladinović, M.B. (2010) Accelerated gradient descent methods with line search. Numer. Algor, 54, pp. 503-520
Stanimirović, P.S., Milovanović, G.V., Petrović, M.J., Kontrec, N.Z. (2015) A Transformation of Accelerated Double Step Size Method for Unconstrained Optimization. Mathematical Problems in Engineering, 2015: 1-8
 

O članku

jezik rada: engleski
vrsta rada: izvorni naučni članak
DOI: 10.5937/univtho7-14337
objavljen u SCIndeksu: 21.07.2017.
metod recenzije: dvostruko anoniman
Creative Commons License 4.0

Povezani članci

Nema povezanih članaka