An Improved Numerical Analysis for Solving Nonlinear Equations Using a Hybrid Algorithm Between Newton’s Method and Metaheuristic Approaches

  • Hussein Dhahir Habeeb Alaid Islamic Azad University Isfahan (Khorasgan) Department of Mathematics Numerical Analysis
Keywords: Genetic Algorithm, Nonlinear equations, Metaheuristic optimization, Root-finding methods, Hybrid numerical methods

Abstract

The problem of finding all roots of a system of nonlinear equations is a common difficulty in scientific computing and various engineering disciplines. Classical numerical methods like Newton’s method and Levenberg-Marquardt usually have drawbacks, sensitive to initial guesses, local convergence, etc., and are not able to find multiple solutions. This paper explores the potential of metaheuristic algorithms, and more specifically Genetic Algorithms (GAs), for handling these challenges. The study shows that GAs represents a powerful and versatile solution to solve linear and nonlinear system, with the ability to explore the global solution space, avoiding local minima, and the capability of converging to the correct solution from poor initial guesses. A complementary strength of GA is that it can retrieve multiple solution sets, something deterministic methods cannot do as well (especially in systems where there are multiple physically meaningful equilibria). The behavior of the GA is examined on a series of benchmark problems and compared to traditional methods, i.e., Gaussian Elimination, and Newton's scheme. . It is established that GA will provide the exact solutions for the determination of the global optimum and is superior compared to other optimisation algorithms for the solution of complex and multimodal spaces of solutions. Also, the analysis reveals the possibility of the hybrid form of the metaheuristics with the local refinement for the target of minimising convergence and augmenting precision. The analysis highlights the need for the evolutionary analysis for numerical analysis and suggests the integration of the usage of the methodology of the metaheuristic within the process of the solutions for the complex mathematical problems. The results are especially significant for optimisation, control and computational physics problems where reliability and diversity can be crucial among solutions.

References

S. Odan, "Metaheuristic Method for Solving Systems of Equations," arXiv preprint arXiv:2409.16958, 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2409.16958

R. Sihwail et al., "A Hybrid Approach for Solving Systems of Nonlinear Equations Using Harris Hawks Optimization and Newton’s Method," IEEE Access, vol. 9, pp. 95791–95807, 2021. doi: 10.1109/ACCESS.2021.3094471.

K. Hitti, S. Haddad, J. Sayah, and S. Feghali, "Always-convergent hybrid methods for finding roots of nonlinear equations," Journal of Mathematical and Computational Science, vol. 11, pp. 165–172, 2021. doi: 10.28919/jmcs/5090.

P. Verma and R. Parouha, "Solving Systems of Nonlinear Equations Using an Innovative Hybrid Algorithm," Iranian Journal of Science and Technology, Transactions of Electrical Engineering, vol. 46, pp. 1005–1027, 2022. doi: 10.1007/s40998-022-00527-z.

C. T. Kelley, Solving Nonlinear Equations with Newton's Method. Philadelphia, PA: SIAM, 2003. doi: 10.1137/1.9780898718898.

E. Badr, S. Almotairi, and A. E. Ghamry, "A Comparative Study among New Hybrid Root Finding Algorithms and Traditional Methods," Mathematics, vol. 9, no. 11, p. 1306, 2021. [Online]. Available: https://www.mdpi.com/2075-1680/12/7/684

A. Zein, "A New Family of Optimal Fourth-Order Iterative Methods for Solving Nonlinear Equations With Applications," Journal of Applied Mathematics, vol. 2024, p. 1, 2024. doi: 10.1155/2024/9955247.

E. G. Birgin and J. M. Martínez, "Secant Acceleration of Sequential Residual Methods for Solving Large-Scale Nonlinear Systems of Equations," SIAM Journal on Numerical Analysis, vol. 60, no. 6, pp. 2979–2999, 2022. doi: 10.1137/0719025.

X. Gong and W. Wang, "Nonlinear Equations Solving with Intelligent Optimization Algorithms: A Survey," Tsinghua Science and Technology, vol. 26, no. 4, pp. 464–484, 2021. doi: 10.23919/CSMS.2021.0002.

J. M. Ortega and W. C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables. New York, NY: Academic Press, 1970.

M. T. Darvishi and A. Barati, "A Third-Order Newton-Type Method to Solve Systems of Nonlinear Equations," Applied Mathematics and Computation, vol. 187, no. 2, pp. 630–635, 2007. doi: 10.1016/j.amc.2006.08.090.

X. Li and J. Wang, "A Hybrid of the Newton-GMRES and Electromagnetic Meta-Heuristic Methods for Solving Systems of Nonlinear Equations," Journal of Electromagnetic Waves and Applications, vol. 23, no. 14–15, pp. 1897–1908, 2009. [Online]. Available: https://www.researchgate.net/publication/242923553

M. S. Petković, B. Neta, L. D. Petković, and J. Džunić, Multipoint Methods for Solving Nonlinear Equations. Waltham, MA: Academic Press, 2013.

M. Fragiadakis and N. D. Lagaros, "Review of Evolution Strategies-Based Methodologies for the Performance-Based Design Optimization of Steel Structures," Journal of Structural Engineering, vol. 137, no. 3, pp. 380–388, 2011. doi: 10.1061/(ASCE)ST.1943-541X.0000299.

Y. Yuan, “A Survey of Trust Region Algorithms for Optimization,” Acta Numerica, vol. 24, pp. 1–131, 2015, doi: 10.1017/S096249291500001X.

Published
2025-09-23
How to Cite
Alaid, H. D. H. (2025). An Improved Numerical Analysis for Solving Nonlinear Equations Using a Hybrid Algorithm Between Newton’s Method and Metaheuristic Approaches. CENTRAL ASIAN JOURNAL OF MATHEMATICAL THEORY AND COMPUTER SCIENCES, 6(4), 947-958. Retrieved from https://cajmtcs.casjournal.org/index.php/CAJMTCS/article/view/826
Section
Articles