Global convergence analysis of a new hybrid conjugate gradient method for unconstrained optimization problems
DOI:
https://doi.org/10.11113/mjfas.v13n2.540Abstract
In this paper, we propose a new hybrid conjugate gradient method for unconstrained optimization problems. The proposed method comprises of beta (DY), beta (WHY), beta (RAMI) and beta (New). The beta (New) was constructed purposely for this proposed hybrid method.The method possesses sufficient descent property irrespective of the line search. Under Strong Wolfe-Powell line search, we proved that the method is globally convergent. Numerical experimentation shows the effectiveness and robustness of the proposed method when compare with some hybrid as well as some modified conjugate gradient methods.References
Abdullahi, I., Ahmad, R. 2015. Convergence analysis of a new conjugate gradient method for unconstrained optimization. Applied Mathematical Sciences, 9, 6969-6984.
Abdullahi, I., Ahmad, R. 2016. Global convergence analysis of a nonlinear conjugate gradient method for unconstrained optimization problems. Indian Journal of Science and Technology, 9, 1-9. DOI: 10.17485/ijst/2016/v9i41/90175.
Andrei, N. 2004. Test functions for unconstrained optimization. Research Institute for informatics. Center for Advanced Modeling and Optimization, 8-10, Averescu Avenue, Sector 1, Bucharest, Romania, 1-15.
Andrei, N. 2008. An unconstrained optimization test functions collection. Advanced Modeling and Optimization, 10, 147-161.
Babaie-Kafaki, S. 2013. A hybrid conjugate gradient method based on a quadratic relaxation of the Dai–Yuan hybrid conjugate gradient parameter. Optimization, 62, 929-941.
Babaie-Kafaki, S., Ghanbari, R. 2014. Two hybrid nonlinear conjugate gradient methods based on a modified secant equation. Optimization, 63, 1027-1042.
Dai, Y. H., Yuan, Y. 1999. A nonlinear conjugate gradient method with a strong global convergence property. SIAM Journal on Optimization, 10, 177-182.
Dai, Y., Han, J., Liu, G., Sun, D., Yin, H., Yuan, Y. X. 2000. Convergence properties of nonlinear conjugate gradient methods. SIAM Journal on Optimization, 10, 345-358.
Dai, Y., Yuan, Y. 2001. An efficient hybrid conjugate gradient method for unconstrained optimization. Annals of Operations Research, 103, 33-47.
Dai, Z., Wen, F. 2012. Another improved Wei–Yao–Liu nonlinear conjugate gradient method with sufficient descent property. Applied Mathematics and Computation, 218, 7421-7430.
Dolan, E. D., More, J. J. 2002. Benchmarking optimization software with performance profiles. Mathematical Programming, 91, 201-213.
Du, X., Liu, J. 2011. Global convergence of a spectral hs conjugate gradient method. Procedia Engineering, 15, 1487-1492.
Fletcher, R. 2013. Practical Methods of Optimization. Available from http://onlinelibrary.wiley.com/doi/10.1002/9781118723203.ch2
Fletcher, R., Reeves, C. M. 1964. Function minimization by conjugate gradients. The Computer Journal, 7, 149-154.
Hager, W. W., Zhang, H. 2005. A new conjugate gradient method with guaranteed descent and an efficient line search. SIAM Journal on Optimization, 16, 170-192.
Hager, W. W., Zhang, H. 2006. A survey of nonlinear conjugate gradient methods. Pacific Journal of Optimization, 2, 35-58.
Hestenes, M. R., Stiefel, E. 1952. Methods of conjugate gradients for solving linear systems. Journal of Research of the National Bureau of Standards, 49, 409-436.
Hu, Y., Storey, C. 1991. Global convergence result for conjugate gradient methods. Journal of Optimization Theory and Applications, 71, 399-405.
Jian, J., Han, L., Jiang, X. 2015. A hybrid conjugate gradient method with descent property for unconstrained optimization. Applied Mathematical Modelling, 39, 1281-1290.
Jiang, X. Z., Jian, J. B. 2013. A sufficient descent Dai–Yuan type nonlinear conjugate gradient method for unconstrained optimization problems. Nonlinear Dynamics, 72, 101-112.
Jiang, X., Han, L., Jian, J. 2012. A globally convergent mixed conjugate gradient method with Wolfe line search. Mathematica Numerica Sinica, 34, 103-112.
Jiang, X., Ma, G., Jian, J. 2011. A new global convergent conjugate gradient method with Wolfe line search. Chinese Journal of Engineering Mathematics, 6.
Kaelo, P. 2015. Another hybrid conjugate gradient method for unconstrained optimization problems. Journal of Nonlinear Analysis and Optimization: Theory & Applications, 5, 127-137.
Liu, J., Feng, Y. 2011. Global convergence of a modified LS nonlinear conjugate gradient method. Procedia Engineering, 15, 4357-4361.
Liu, J., Li, S. 2014. New hybrid conjugate gradient method for unconstrained optimization. Applied Mathematics and Computation, 245, 36-43.
Lu, Y., Li, W., Zhang, C., Yang, Y. 2015. A class new hybrid conjugate gradient method for unconstrained optimization. Journal of Information and Computational Science, 12, 1941-1949.
Polyak, B. T. 1969. The conjugate gradient method in extremal problems. USSR Computational Mathematics and Mathematical Physics, 9, 94-112.
Rivaie, M., Abashar, A., Mamat, M., Mohd, I. 2016. The convergence properties of a new type of conjugate gradient methods. Available from http://repository.rsu.edu.sd:8080/jspui/
Shengwei, Y., Wei, Z., Huang, H. 2007. A note about WYL’s conjugate gradient method and its applications. Applied Mathematics and computation, 191, 381-388.
Touti-Ahmed, D., Storey, C. 1990. Efficient hybrid conjugate gradient techniques. Journal of Optimization Theory and Applications, 64, 379-397.
Wei, Z., Li, G., Qi, L. 2006a. New nonlinear conjugate gradient formulas for large-scale unconstrained optimization problems. Applied Mathematics and Computation, 179, 407-430.
Wei, Z., Yao, S., Liu, L. 2006b. The convergence properties of some new conjugate gradient methods. Applied Mathematics and Computation, 183, 1341-1350.
Wei, Z. X., Huang, H. D., Tao, Y. R. 2010. A modified Hestenes-Stiefel conjugate gradient method and its convergence. Journal of Mathematical Research and Exposition, 30. 297-308.
Yang, X., Luo, Z., Dai, X. 2013. A global convergence of LS-CD hybrid conjugate gradient method. Advances in Numerical Analysis, 2013. Available from http://dx.doi.org/10.1155/2013/517452.
Yuhong, D. 2002. A nonmonotone conjugate gradient algorithm for unconstrained optimization. Journal of Systems Science and Complexity, 15, 139-145.
Zhang, Y., Zheng, H., Zhang, C. 2012. Global convergence of a modified PRP conjugate gradient method. Procedia Engineering, 31, 986-995.
Zoutendijk, G. 1970. Nonlinear programming, computational methods. Integer and Nonlinear Programming, 143, 37-86.
