Abstract
The pursuit of more efficient and reliable numerical methods to solve nonlinear systems of equations has long intrigued many researchers. Among these, the Broyden method has stood out since its introduction, serving as a foundational technique from which various derivative methods have evolved. These derivative methods, commonly referred to as Broyden-like iterative methods, often surpass the traditional Broyden method in terms of both the number of iterations required and the computational time needed. This study aimed to develop new Broyden-like methods by incorporating weighted combinations of different quadrature rules. Specifically, the research focused on leveraging the Composite Trapezoidal rule with n=3n=3, and comparing it against the Midpoint, Trapezoidal, and Simpson quadrature rules. By integrating these approaches, three novel methods were formulated. The findings revealed that several of these new methods demonstrated enhanced efficiency and robustness compared to their established counterparts. In a detailed comparative analysis with the classical Broyden method and other improved versions, the Midpoint–Composite Trapezoidal (MT_3) method emerged as the top performer. This method consistently provided superior numerical outcomes across all benchmark problems examined in the study. The results highlight the potential of these new methods to significantly advance the field of numerical analysis, offering more powerful tools for researchers and practitioners dealing with complex nonlinear systems of equations. Through this innovative approach, the study not only broadens the understanding of Broyden-like methods but also sets the stage for further advancements in the development of efficient numerical solutions.
Keywords
Newton-Raphson Method, Broyden Method, Quadrature Rules, Composite Trapezoidal Rule
1. Introduction
In the realm of mathematical computations, finding solutions to equations is crucial for solving practical problems. These solutions, often represented as the roots of equations, are essential across various fields of study
[1] | Azure, I., Aloliga, G., & Doabil, L. (2020). Comparative Study of Numerical Methods for Solving Non-linear Equations Using Manual Computation. Mathematics Letters, 5(4), 41. https://doi.org/10.11648/j.ml.20190504.11 |
[1]
. Consequently, there's a continuous quest to develop efficient numerical methods to obtain accurate results. This pursuit becomes even more challenging when dealing with systems of nonlinear equations, which are prevalent in engineering and scientific applications.
Despite considerable research efforts, solving nonlinear equations remains a complex task
[2] | Li, Y., Wei, Y., & Chu, Y. (2015). Research on solving systems of nonlinear equations based on improved PSO. Mathematical Problems in Engineering, 2015(1). http://dx.doi.org/10.1155/2015/727218 |
[2]
. One significant challenge is the selection of suitable initial guesses for solutions, as it greatly influences the effectiveness of traditional numerical methods like Newton's method
[3] | Al-Towaiq, M. H., & Abu Hour, Y. S. (2017). Two improved classes of Broyden's methods for solving nonlinear systems of equations. JOURNAL OF MATHEMATICS AND COMPUTER SCIENCE-JMCS, 17(1), 22-31. |
[3]
. To address this, researchers have explored combining traditional methods with intelligent algorithms
[4] | Kou, J., Li, Y., & Wang, X. (2007). A composite fourth-order iterative method for solving non-linear equations. Applied Mathematics and Computation, 184(2), 471-475. |
[4]
. However, such approaches can be complex and computationally demanding, especially when dealing with multiple nonlinear equations simultaneously
[5] | Luo, Y. Z., Tang, G. J., & Zhou, L. N. (2008). Hybrid approach for solving systems of nonlinear equations using chaos optimization and quasi-Newton method. Applied Soft Computing, 8(2), 1068-1073. |
[6] | Mo, Y., Liu, H., & Wang, Q. (2009). Conjugate direction particle swarm optimization solving systems of nonlinear equations. Computers & Mathematics with Applications, 57(11-12), 1877-1882. |
[5, 6]
.
Among the different numerical schemes available, the Newton–Raphson method is widely used but has drawbacks, such as the need to iteratively calculate the inverse Jacobian matrix, making it inefficient for large-scale problems. This limitation has led to the development of alternative methods like the Broyden method, which has undergone significant improvements over time, inspiring further innovations in the field
[7] | Osinuga, I. A., & Yusuff, S. O. (2017). Construction of a Broyden-like method for Nonlinear systems of equations. Annals. Computer Science Series, 15(2), 128-135. |
[7]
.
Researchers have introduced various techniques to enhance the efficiency of solving nonlinear systems of equations. These include using central finite differences to approximate the inverse Jacobian matrix, resulting in improved schemes. Additionally, strategies like the Steepest Descent method have been employed to obtain adequate initial guesses for subsequent Broyden method solutions
[8] | Weerakoon, S., & Fernando, T. G. I. (2000). A variant of Newton's method with accelerated third-order convergence. Applied Mathematics Letters, 13(8), 87-93. |
[9] | Frontini, M. A. R. C. O., & Sormani, E. (2003). Some variant of Newton’s method with third-order convergence. Applied Mathematics and Computation, 140(2-3), 419-426. |
[10] | Dhamacharoen, A. (2014). An efficient hybrid method for solving systems of nonlinear equations. Journal of Computational and Applied Mathematics, 263, 59-68. |
[11] | Mahwash, K. N., & Gyang, G. D. (2018). Numerical Solution of Nonlinear Systems of Algebriac Equations. https://doi.org/10.11648/j.ijdsa.20180401.14 |
[8-11].
A recent trend involves formulating iterative schemes using quadrature rules, reflecting efforts to develop more efficient methods for computing solutions to systems of nonlinear equations. Numerous references are available on methods utilizing quadrature rules, highlighting ongoing efforts to improve computational approaches in this area
[12] | Mohammad, H., & Waziri, M. Y. (2015). On Broyden-like update via some quadratures for solving nonlinear systems of equations. Turkish Journal of Mathematics, 39(3), 335-345. https://doi.org/10.3906/mat-1404-41 |
[13] | Isaac, A., Stephen, T. B., Seidu, B., Maza, D. D. A., Olukotun, S. F., & Akinlade, G. O. (2021). A New Trapezoidal-Simpson 3/8 Method for Solving Systems of Nonlinear Equations. American Journal of Mathematical and Computer Modelling, 6(1), 1-8. https://doi.org/10.11648/J.AJMCM.20210601.11 |
[12, 13]
.
Newton-Cotes quadrature rules encompass techniques for numerical integration that involve evaluating the integrand at uniformly spaced points
[14] | Osinuga, I. A., & Yusuff, S. O. (2018). Quadrature based Broyden-like method for systems of nonlinear equations. Statistics, Optimization & Information Computing, 6(1), 130-138. https://doi.org/10.19139/soic.v6i1.471 |
[14]
. Named after Isaac Newton and Roger Cotes, these rules use polynomial approximations of local order k to fit the data. This method involves assessing the function at k evenly spaced nodes
and assigning weights
to these nodes, the Newton-Cotes quadrature formulas estimate the integral of a function
[15] | Darvishi, M. T., & Shin, B. C. (2011). High-order Newton-Krylov methods to solve systems of nonlinear equations. Journal of the Korean Society for Industrial and Applied Mathematics, 15(1), 19-30. |
[21] | Isaac, A., Stephen, T. B., & Seidu, B. (2021). A Comparison of Newly Developed Broyden–Like Methods for Solving System of Nonlinear Equations. International Journal of Systems Science and Applied Mathematics, 6(3), 77-94. https://doi.org/10.11648/j.ijssam.20210603.11 |
[15, 21]
. Among the commonly known Newton-Cotes quadrature formulas are the Mid-point, Trapezoidal, and Simpson's rules. The general structure of the Newton-Cotes formula is expressed as:
Newton's method can be obtained by expanding a function (which is of a single variable), denoted as , using Taylor's series around a specific point :
(2)
In this scenario, both the function
and its first and second derivatives, denoted as
, and
, respectively, are assessed at the point
. If dealing with a function F that involves multiple variables and maps from
, it can be demonstrated
[20] | Cordero, A., Torregrosa, J. R., & Vassileva, M. P. (2012). Pseudocomposition: a technique to design predictor–corrector methods for systems of nonlinear equations. Applied Mathematics and Computation, 218(23), 11496-11504. |
[20]
that equation (
2) is equivalent.
The array of partial derivatives denoted as
in equation (
3) represents the Jacobian matrix, which is denoted as J. Here, the integral from
, as described in equation (
4), involves multiple integrals.
(4)
An alternative method treats the multiple integral as a sequence of nested one-dimensional integrals, applying a one-dimensional quadrature rule to each variable in turn
[16] | Hafiz, M. A., & Bahgat, M. S. (2012). An efficient two-step iterative method for solving system of nonlinear equations. Journal of Mathematics Research, 4(4), 28. https://doi.org/10.5539/jmr.v4n4p28 |
[16]
. This allows us to estimate
by combining weighted quadrature formulas. Various techniques have been proposed by the authors
[16] | Hafiz, M. A., & Bahgat, M. S. (2012). An efficient two-step iterative method for solving system of nonlinear equations. Journal of Mathematics Research, 4(4), 28. https://doi.org/10.5539/jmr.v4n4p28 |
[17] | Jain, M. K. (2003). Numerical methods for scientific and engineering computation. New Age International. |
[16, 17]
and others cited therein for approximating the integral in equation (
4) using Newton-Cotes formulas ranging from zero to first order. In a related study, a modification of the Broyden-like method was suggested, employing a weighted combination of the Trapezoidal, Simpson, and Midpoint quadrature rules, resulting in the TSMM Broyden-like method
[18] | Kelley, C. T. (1995). Iterative methods for linear and nonlinear equations. Society for Industrial and Applied Mathematics. |
[18]
, as expressed below:
(5)
where:
The TSMM method's performance was assessed in comparison to various existing methods, including Classical Broyden (CB), Trapezoidal-Broyden (TB), and Midpoint-Simpson-Broyden (MSB). The TSMM method showed superior performance over all the others
[19] | Van de Rotten, B., & Lunel, S. V. (2005). A limited memory Broyden method to solve high-dimensional systems of nonlinear equations. In EQUADIFF 2003 (pp. 196-201). |
[19]
. In a follow-up study conducted the next year by the same author, a robust variant of the Broyden-like method was introduced, called the Midpoint-Trapezoidal (MT) method. The iterative process of this method is described as follows:
(6)
for
The MT method was evaluated against other existing methods, including Classical Broyden (CB), Trapezoidal-Broyden, and Midpoint-Simpson-Broyden (MSB). The results showed that the MT method significantly outperformed all the others
[20] | Cordero, A., Torregrosa, J. R., & Vassileva, M. P. (2012). Pseudocomposition: a technique to design predictor–corrector methods for systems of nonlinear equations. Applied Mathematics and Computation, 218(23), 11496-11504. |
[20]
. A significant observation among these Broyden-like methods is their consistent use of three common quadrature rules: Trapezoidal, Midpoint, and Simpson rules. It was suggested that further improvements could be made by refining these quadrature rules.
In another study, the integral in Equation (
4) was approximated using a weighted combination of quadrature rules including Trapezoidal, Midpoint, Simpson, Simpson’s 1/3, and Simpson’s 3/8 quadrature rules, resulting in the development of MS-1/3, MS-3/8, TS-1/3, TS-3/8, SS-1/3, and SS-3/8 methods. Among these, the MS-3/8 method was found to be superior to all existing methods
[21] | Isaac, A., Stephen, T. B., & Seidu, B. (2021). A Comparison of Newly Developed Broyden–Like Methods for Solving System of Nonlinear Equations. International Journal of Systems Science and Applied Mathematics, 6(3), 77-94. https://doi.org/10.11648/j.ijssam.20210603.11 |
[21]
.
This study aims to assess the effectiveness of methods formed through a weighted combination of the composite trapezoidal rule when compared to the midpoint, trapezoidal, and Simpson rules. The table below illustrates how the quadrature rules were combined:
Table 1. Combination of Quadrature Rules to Yield New Broyden-like Methods.
Quadrature rules | Midpoint (M) | Trapezoidal (T) | Simpson (S) |
Composite Trapezoidal () | M | T | |
In a study by the authors
[21] | Isaac, A., Stephen, T. B., & Seidu, B. (2021). A Comparison of Newly Developed Broyden–Like Methods for Solving System of Nonlinear Equations. International Journal of Systems Science and Applied Mathematics, 6(3), 77-94. https://doi.org/10.11648/j.ijssam.20210603.11 |
[21]
, a Broyden-like method named the Trapezoidal-Simpson’s 3/8 method was devised, utilizing a weighted combination of the Trapezoidal and Simpson’s 3/8 quadrature rules. While this method showed superiority in certain benchmark problems compared to other Broyden-like methods, there were instances where alternative methods yielded better results.
This study aims to achieve the following objectives: (i) Develop three new Broyden-like methods by utilizing weighted combinations of quadrature rules; (ii) Evaluate the new methods by comparing their number of iterations, CPU time, and robustness index using selected systems of nonlinear equations as test problems. The paper is structured as follows: Section 2.0 outlines the general formula of the composite trapezoidal quadrature rule, Section 3.0 details the derivation of the newly developed methods, Section 4.0 presents numerical tests and results, and Section 5.0 provides a summary conclusion of the research findings.
2. The General Formula of Composite Trapezoidal Rule
The Composite Trapezoidal Rule is a numerical integration method used to approximate the definite integral of a function over a specified interval. The Composite Trapezoidal Rule is based on approximating the area under the curve of a function by dividing the interval into smaller subintervals and approximating each subinterval's area using trapezoids.
For a function over the interval , the Composite Trapezoidal Rule formula is:
(7)
Where is the width of each subinterval and are the partition points.
For the purpose of this research, the composite trapezoidal rule with is what is considered for the study. This special composite trapezoidal rule is therefore denoted as . This means we are dividing the interval [a, b] into three equal subintervals. Denoting as the width of each subinterval, means . The points where the function is evaluated within each subinterval as:
Using these points, we can apply the composite Trapezoidal rule formula:
(8)
Substituting the expressions in terms of .
(9)
Given that
(10)
(11)
(12)
3. Derivation of New Methods
This section aims to develop a novel Broyden-like method formed through the weighted combination of the composite trapezoidal quadrature rule, compared against the midpoint, trapezoidal, and Simpson quadrature rules. The weighted combinations yield the M, T and S methods as outlined below.
3.1. Derivation of MT3 Method
Given the Composite Trapezoidal ( quadrature rule
(13)
And Midpoint quadrature rule
Approximating the integral in equation (
3) by the average of Midpoint and Composite Trapezoidal (
M) quadrature rules yields:
=(15)
Substituting equation (
15) into (
3), we have
(16)
, hence
(17)
Multiplying through (
17) by
(18)
(19)
(20)
(21)
(22)
Setting
and
in equation (
22), we have
(23)
Setting
(24)
(25)
Which is an implicit equation because the presence of at both sides of the equation, hence to avoid its implicit nature we use the iteration of the Broyden’s method in the right hand side. Thus we have;
(26)
Let
3.2. Derivation of TT3 Method
Given the Composite Trapezoidal (
quadrature rule as in equation (
13).
And Trapezoidal quadrature rule:
Approximating the integral in equation (
3) using the average of the Midpoint and Composite Trapezoidal (
M) quadrature rules results in:
=(29)
Substituting equation (
29) into (
3), we have
(30)
, hence
(31)
Multiplying through (
31) by
(32)
(33)
(34)
(35)
(36)
Setting
and
in equation (
36), we have
(37)
Setting ,
(38)
(39)
Which is an implicit equation because the presence of at both sides of the equation, hence to avoid its implicit nature we use the iteration of the Broyden’s method in the right hand side. Thus we have;
(40)
Let
3.3. Derivation of ST3 Method
Given the Simpson quadrature rule:
(42)
And the Composite Trapezoidal (
quadrature rule as in equation (
13).
Approximating the integral in equation (
3) by the average of Simpson and Composite Trapezoidal quadrature rules yields:
=(43)
Substituting equation (
43) into (
3), we have
(44)
, hence
(45)
Multiplying through (
45) by
(46)
(47)
(48)
(49)
50)
(51)
Setting
and
in equation (
51), we have
(52)
Setting
, equation (
52) becomes
(53)
Which is an implicit equation because the presence of at both sides of the equation, hence to avoid its implicit nature we use the iteration of the Broyden’s method in the right hand side. Thus we have;
(54)
with and
Now replacing
,
and
by
,
and
respectively and use the same procedure as prescribed in
[4] | Kou, J., Li, Y., & Wang, X. (2007). A composite fourth-order iterative method for solving non-linear equations. Applied Mathematics and Computation, 184(2), 471-475. |
[5] | Luo, Y. Z., Tang, G. J., & Zhou, L. N. (2008). Hybrid approach for solving systems of nonlinear equations using chaos optimization and quasi-Newton method. Applied Soft Computing, 8(2), 1068-1073. |
[6] | Mo, Y., Liu, H., & Wang, Q. (2009). Conjugate direction particle swarm optimization solving systems of nonlinear equations. Computers & Mathematics with Applications, 57(11-12), 1877-1882. |
[7] | Osinuga, I. A., & Yusuff, S. O. (2017). Construction of a Broyden-like method for Nonlinear systems of equations. Annals. Computer Science Series, 15(2), 128-135. |
[8] | Weerakoon, S., & Fernando, T. G. I. (2000). A variant of Newton's method with accelerated third-order convergence. Applied Mathematics Letters, 13(8), 87-93. |
[9] | Frontini, M. A. R. C. O., & Sormani, E. (2003). Some variant of Newton’s method with third-order convergence. Applied Mathematics and Computation, 140(2-3), 419-426. |
[4-9]
, we get
(55)
Let
4. Numerical Test
To evaluate the effectiveness of the new methods, they were tested on three benchmark problems described by Osinuga et al. in 2018. These tests involved varying dimensions, ranging from 5 to 1065 variables. The results were compared using three primary metrics: the number of iterations (NI), CPU time in seconds, and the Robustness Index (RI). The computations were conducted using Python (Anaconda Navigator 2.4.0) on a computer with the following specifications: Intel® Core™ i5-3427U CPU @ 1.80GHz 2.30GHz processor, 8.00GB RAM (7.87GB usable), and a 64-bit Operating System, ×64-based processor.
The program was set to stop execution once the number of iterations reached 500. Any method that failed to meet these convergence criteria is denoted by a dash ('-'), as shown in the results
Table 1.
The problems that were used for the test are:
Problem One
,,
Problem Two
,
Problem Three
5. Results and Discussion
The performance of three newly developed methods was evaluated by applying them to solve three benchmark problems. Python code was crafted for each method to compute three key parameters: CPU time, Number of Iterations (NI), and the Robustness Index (RI). CPU time indicates the duration, in seconds, required by the method to solve the problem, while the number of iterations represents how many iterations were necessary to approximate a solution. The Robustness Index indicates the method's consistency in solving the problem.
For the M method, testing it on the first benchmark problem revealed a consistent four (4) iterations required to reach an approximation, irrespective of the value of 'n.' The CPU time ranged from 0.0000 to 0.7856 seconds, with the lowest recorded at 'n=15' and 'n=35' and the highest at 'n=1065.' A Robustness Index of 0.5000 was consistent across all 'n' values, indicating its stability. For the second and third problems, the M method consistently required five (5) iterations for all 'n' values. CPU times ranged from 0.0000 to 1.1484 for problem two and were 0.9542 for problem three. Robustness indices ranged between 0.9357 to 0.9999 for problem two and 0.5015 to 0.8242 for problem three.
The Tmethod, when applied to the first benchmark problem, consistently required five (5) iterations for all 'n' values. CPU times ranged from 0.0000 to 0.9572 seconds, with a Robustness Index ranging from 0.5000 to 0.7417. For the second problem, it required five (5) iterations, and for the third, six (6). CPU times ranged from 0.0156 to 1.0197 for problem two and from 0.0221 to 1.1879 for problem three. The method showed a consistent Robustness Index of 0.5000 for problem two, and for problem three, it recorded 0.9637 for 'n=665' and 0.8852 for 'n=1065' only.
Regarding the S
method, it exhibited a significantly higher number of iterations for all benchmark problems (48, 50, and 49 for problems one, two, and three, respectively). CPU time ranges were 0.0156 to 10.3777, 0.0313 to 9.6954, and 0.0312 to 10.6786 for problems one, two, and three, respectively. The method consistently recorded a Robustness Index of 0.5000 for all 'n' values across all problems.
Table 2 summarizes all results in the study.
Table 2. Comparison of Newly Developed Methods.
Problem | n | 1 | | 2 | | 3 | |
M | | T | | S | |
NI | CPU | RI | NI | CPU | RI | NI | CPU | RI |
1 | 5 | 4 | 0.0156 | 0.5000 | 5 | 0.0000 | 0.5000 | 48 | 0.0156 | 0.5000 |
15 | 4 | 0.0000 | 0.5000 | 5 | 0.0000 | 0.5000 | 48 | 0.0377 | 0.5000 |
35 | 4 | 0.0000 | 0.5000 | 5 | 0.0156 | 0.5000 | 48 | 0.0156 | 0.5000 |
65 | 4 | 0.0156 | 0.5000 | 5 | 0.0000 | 0.5000 | 48 | 0.0468 | 0.5000 |
165 | 4 | 0.0555 | 0.5000 | 5 | 0.0312 | 0.5000 | 48 | 0.1536 | 0.5000 |
365 | 4 | 0.0685 | 0.5000 | 5 | 0.0846 | 0.6024 | 48 | 0.8701 | 0.5000 |
665 | 4 | 0.2944 | 0.5000 | 5 | 0.3542 | 0.7417 | 48 | 3.4445 | 0.5000 |
1065 | 4 | 0.7856 | 0.5000 | 5 | 0.9572 | 0.8403 | 48 | 10.3777 | 0.5000 |
2 | 5 | 5 | 0.0156 | - | 5 | 0.0156 | 0.5000 | 50 | 0.0313 | 0.5000 |
15 | 5 | 0.0000 | 0.9357 | 5 | 0.0000 | 0.5000 | 50 | 0.0221 | 0.5000 |
35 | 5 | 0.0000 | 0.9945 | 5 | 0.0000 | 0.5000 | 50 | 0.0469 | 0.5000 |
65 | 5 | 0.0156 | 0.9957 | 5 | 0.0156 | 0.5000 | 50 | 0.0534 | 0.5000 |
165 | 5 | 0.0156 | 0.9999 | 5 | 0.0156 | 0.5000 | 50 | 0.1784 | 0.5000 |
365 | 5 | 0.1159 | 0.9999 | 5 | 0.0864 | 0.5000 | 50 | 1.1726 | 0.5000 |
665 | 5 | 0.4351 | 0.9999 | 5 | 0.3320 | 0.5000 | 50 | 4.0700 | 0.4999 |
1065 | 5 | 1.1484 | 0.9999 | 5 | 1.0197 | 0.5000 | 50 | 9.6954 | 0.4999 |
3 | 5 | 5 | 0.0000 | 0.5015 | | 0.0221 | - | 49 | 0.0312 | 0.5000 |
15 | 5 | 0.0156 | 0.5023 | | 0.0000 | - | 49 | 0.0377 | 0.5000 |
35 | 5 | 0.0000 | 0.5023 | 6 | 0.0156 | - | 49 | 0.0469 | 0.5000 |
65 | 5 | 0.0156 | 0.5077 | 6 | 0.0156 | - | 49 | 0.0846 | 0.5000 |
165 | 5 | 0.0377 | 0.5335 | 6 | 0.0312 | - | 49 | 0.3363 | 0.5000 |
365 | 5 | 0.1158 | 0.6010 | 6 | 0.1381 | - | 49 | 1.2304 | 0.5000 |
665 | 5 | 0.3320 | 0.7218 | 6 | 0.4825 | 0.9637 | 49 | 3.5947 | 0.5000 |
1065 | 5 | 0.9542 | 0.8242 | 6 | 1.1879 | 0.8852 | 49 | 10.6786 | 0.5000 |
In
Figure 1 below, it is evident that regardless of the values of
, the M
method consistently exhibited the shortest computational time (CPU time), closely trailed by T
. Consequently, it can be inferred that for problem one, M
achieved the lowest CPU time, as depicted in
Figure 1 S
on the other hand, recorded the highest CPT time.
Figure 1. Problem One: Comparison of Methods with Respect to CPU Time.
Regarding problem one,
Figure 2 distinctly illustrates that all methods exhibited robustness, as they demonstrated minimal variation in response to changes in parameters.
Figure 2. Problem One: Comparison of Methods with Respect to Robustness Index (RI).
Similar to
Figure 1 above, both M
and T
methods displayed the lowest recorded CPU time values for problem two, highlighting their efficiency. Conversely, S
once again exhibited significantly higher CPU time, as depicted in
Figure 3.
Figure 3. Problem Two: Comparison of Methods with Respect to CPU Time.
In
Figure 4, it is evident that there was a fluctuation in the robustness index for the initial two values of 'n' when employing the M
method. Nonetheless, the robustness index remained consistent for the subsequent 'n' values. Conversely, the T
and S
methods exhibited a comparable, unchanging robustness index across all 'n' values.
Figure 4. Problem Two: Comparison of Methods with Respect to Robustness Index (RI).
Once more, problem three exhibited notably low and comparable CPU times for M
and T
, whereas S
continued to display elevated CPU time, as depicted in
Figure 5.
Figure 5. Problem Three: Comparison of Methods with Respect to CPU Time.
In
Figure 6, it's noticeable that M
and S
displayed consistent robustness indices, whereas that of T
varied significantly with an increase in the n values for problem three.
Figure 6. Problem Three: Comparison of Methods with Respect to Robustness Index (RI).
6. Conclusion
In this manuscript, we embarked on a journey to enhance the efficacy of numerical methods for solving systems of nonlinear equations, focusing on the development and analysis of Broyden-like iterative schemes. Inspired by the success of methods integrating quadrature rules, we introduced three novel Broyden-like methods M, , and Sformed through weighted combinations of the Composite Trapezoidal rule with the Midpoint, Trapezoidal, and Simpson quadrature rules, respectively.
Through meticulous derivation and performance analysis, we unveiled the potential of these methods in achieving superior convergence rates and computational efficiency compared to established counterparts. Particularly, the M method emerged as the standout performer, consistently outperforming other methods across various benchmark problems. Its robustness and numerical efficacy make it a promising candidate for practical applications in engineering and scientific domains.
The derivation process elucidated the theoretical foundation of these methods, emphasizing the integration of quadrature rules to approximate the Jacobian matrix. By leveraging the Composite Trapezoidal rule alongside other quadrature rules, we effectively balanced accuracy and computational overhead, leading to enhanced convergence behavior.
7. Recommendation
Based on the findings and insights gleaned from this study, several recommendations emerge to guide future research and practical applications in computational mathematics and engineering:
1) Further Theoretical Analysis: Conduct rigorous theoretical investigations into the convergence properties and stability of the proposed methods under varying conditions. Analyze the impact of different weighting schemes and quadrature rule combinations on method performance to deepen our understanding of their behavior.
2) Experimental Validation: Validate the proposed methods through extensive numerical experiments across a diverse range of nonlinear systems. Assess their performance against real-world problems to ascertain their practical utility and robustness in different application scenarios.
3) Algorithm Optimization: Explore optimization strategies to further enhance the computational efficiency of the proposed methods, particularly for large-scale systems. Investigate parallelization techniques and algorithmic refinements to expedite convergence and reduce computational overhead.
4) Extension to Multivariate Systems: Extend the proposed methods to handle multivariate systems of nonlinear equations, catering to a broader range of applications in engineering and scientific computing. Investigate the scalability and efficacy of these methods in high-dimensional problem domains.
5) Integration with Machine Learning Techniques: Explore synergies between iterative numerical methods and machine learning techniques to develop hybrid approaches capable of adaptively adjusting algorithm parameters and improving convergence behavior. Investigate the potential of reinforcement learning and neural network-based approaches in optimizing method performance.
By pursuing these recommendations, researchers can advance the state-of-the-art in numerical methods for solving nonlinear equations, paving the way for more efficient and reliable computational tools with diverse applications across various disciplines.
Abbreviations
M | Midpoint-Composite Trapezoidal Method |
T | Trapezoidal-Composite Trapezoidal Method |
S | Simpson-Composite Trapezoidal Method |
RI | Robustness Index |
CPU Time | Computational Time |
Author Contributions
Isaac Azure is the sole author. The author read and approved the final manuscript.
Conflicts of Interest
The author declares no conflict of interest.
References
[1] |
Azure, I., Aloliga, G., & Doabil, L. (2020). Comparative Study of Numerical Methods for Solving Non-linear Equations Using Manual Computation. Mathematics Letters, 5(4), 41.
https://doi.org/10.11648/j.ml.20190504.11
|
[2] |
Li, Y., Wei, Y., & Chu, Y. (2015). Research on solving systems of nonlinear equations based on improved PSO. Mathematical Problems in Engineering, 2015(1).
http://dx.doi.org/10.1155/2015/727218
|
[3] |
Al-Towaiq, M. H., & Abu Hour, Y. S. (2017). Two improved classes of Broyden's methods for solving nonlinear systems of equations. JOURNAL OF MATHEMATICS AND COMPUTER SCIENCE-JMCS, 17(1), 22-31.
|
[4] |
Kou, J., Li, Y., & Wang, X. (2007). A composite fourth-order iterative method for solving non-linear equations. Applied Mathematics and Computation, 184(2), 471-475.
|
[5] |
Luo, Y. Z., Tang, G. J., & Zhou, L. N. (2008). Hybrid approach for solving systems of nonlinear equations using chaos optimization and quasi-Newton method. Applied Soft Computing, 8(2), 1068-1073.
|
[6] |
Mo, Y., Liu, H., & Wang, Q. (2009). Conjugate direction particle swarm optimization solving systems of nonlinear equations. Computers & Mathematics with Applications, 57(11-12), 1877-1882.
|
[7] |
Osinuga, I. A., & Yusuff, S. O. (2017). Construction of a Broyden-like method for Nonlinear systems of equations. Annals. Computer Science Series, 15(2), 128-135.
|
[8] |
Weerakoon, S., & Fernando, T. G. I. (2000). A variant of Newton's method with accelerated third-order convergence. Applied Mathematics Letters, 13(8), 87-93.
|
[9] |
Frontini, M. A. R. C. O., & Sormani, E. (2003). Some variant of Newton’s method with third-order convergence. Applied Mathematics and Computation, 140(2-3), 419-426.
|
[10] |
Dhamacharoen, A. (2014). An efficient hybrid method for solving systems of nonlinear equations. Journal of Computational and Applied Mathematics, 263, 59-68.
|
[11] |
Mahwash, K. N., & Gyang, G. D. (2018). Numerical Solution of Nonlinear Systems of Algebriac Equations.
https://doi.org/10.11648/j.ijdsa.20180401.14
|
[12] |
Mohammad, H., & Waziri, M. Y. (2015). On Broyden-like update via some quadratures for solving nonlinear systems of equations. Turkish Journal of Mathematics, 39(3), 335-345.
https://doi.org/10.3906/mat-1404-41
|
[13] |
Isaac, A., Stephen, T. B., Seidu, B., Maza, D. D. A., Olukotun, S. F., & Akinlade, G. O. (2021). A New Trapezoidal-Simpson 3/8 Method for Solving Systems of Nonlinear Equations. American Journal of Mathematical and Computer Modelling, 6(1), 1-8.
https://doi.org/10.11648/J.AJMCM.20210601.11
|
[14] |
Osinuga, I. A., & Yusuff, S. O. (2018). Quadrature based Broyden-like method for systems of nonlinear equations. Statistics, Optimization & Information Computing, 6(1), 130-138.
https://doi.org/10.19139/soic.v6i1.471
|
[15] |
Darvishi, M. T., & Shin, B. C. (2011). High-order Newton-Krylov methods to solve systems of nonlinear equations. Journal of the Korean Society for Industrial and Applied Mathematics, 15(1), 19-30.
|
[16] |
Hafiz, M. A., & Bahgat, M. S. (2012). An efficient two-step iterative method for solving system of nonlinear equations. Journal of Mathematics Research, 4(4), 28.
https://doi.org/10.5539/jmr.v4n4p28
|
[17] |
Jain, M. K. (2003). Numerical methods for scientific and engineering computation. New Age International.
|
[18] |
Kelley, C. T. (1995). Iterative methods for linear and nonlinear equations. Society for Industrial and Applied Mathematics.
|
[19] |
Van de Rotten, B., & Lunel, S. V. (2005). A limited memory Broyden method to solve high-dimensional systems of nonlinear equations. In EQUADIFF 2003 (pp. 196-201).
|
[20] |
Cordero, A., Torregrosa, J. R., & Vassileva, M. P. (2012). Pseudocomposition: a technique to design predictor–corrector methods for systems of nonlinear equations. Applied Mathematics and Computation, 218(23), 11496-11504.
|
[21] |
Isaac, A., Stephen, T. B., & Seidu, B. (2021). A Comparison of Newly Developed Broyden–Like Methods for Solving System of Nonlinear Equations. International Journal of Systems Science and Applied Mathematics, 6(3), 77-94.
https://doi.org/10.11648/j.ijssam.20210603.11
|
Cite This Article
-
-
@article{10.11648/j.ajam.20241204.11,
author = {Isaac Azure},
title = {Derivation and Performance Analysis of Composite Trapezoidal Iterative Methods
},
journal = {American Journal of Applied Mathematics},
volume = {12},
number = {4},
pages = {79-90},
doi = {10.11648/j.ajam.20241204.11},
url = {https://doi.org/10.11648/j.ajam.20241204.11},
eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ajam.20241204.11},
abstract = {The pursuit of more efficient and reliable numerical methods to solve nonlinear systems of equations has long intrigued many researchers. Among these, the Broyden method has stood out since its introduction, serving as a foundational technique from which various derivative methods have evolved. These derivative methods, commonly referred to as Broyden-like iterative methods, often surpass the traditional Broyden method in terms of both the number of iterations required and the computational time needed. This study aimed to develop new Broyden-like methods by incorporating weighted combinations of different quadrature rules. Specifically, the research focused on leveraging the Composite Trapezoidal rule with n=3n=3, and comparing it against the Midpoint, Trapezoidal, and Simpson quadrature rules. By integrating these approaches, three novel methods were formulated. The findings revealed that several of these new methods demonstrated enhanced efficiency and robustness compared to their established counterparts. In a detailed comparative analysis with the classical Broyden method and other improved versions, the Midpoint–Composite Trapezoidal (MT_3) method emerged as the top performer. This method consistently provided superior numerical outcomes across all benchmark problems examined in the study. The results highlight the potential of these new methods to significantly advance the field of numerical analysis, offering more powerful tools for researchers and practitioners dealing with complex nonlinear systems of equations. Through this innovative approach, the study not only broadens the understanding of Broyden-like methods but also sets the stage for further advancements in the development of efficient numerical solutions.
},
year = {2024}
}
Copy
|
Download
-
TY - JOUR
T1 - Derivation and Performance Analysis of Composite Trapezoidal Iterative Methods
AU - Isaac Azure
Y1 - 2024/08/06
PY - 2024
N1 - https://doi.org/10.11648/j.ajam.20241204.11
DO - 10.11648/j.ajam.20241204.11
T2 - American Journal of Applied Mathematics
JF - American Journal of Applied Mathematics
JO - American Journal of Applied Mathematics
SP - 79
EP - 90
PB - Science Publishing Group
SN - 2330-006X
UR - https://doi.org/10.11648/j.ajam.20241204.11
AB - The pursuit of more efficient and reliable numerical methods to solve nonlinear systems of equations has long intrigued many researchers. Among these, the Broyden method has stood out since its introduction, serving as a foundational technique from which various derivative methods have evolved. These derivative methods, commonly referred to as Broyden-like iterative methods, often surpass the traditional Broyden method in terms of both the number of iterations required and the computational time needed. This study aimed to develop new Broyden-like methods by incorporating weighted combinations of different quadrature rules. Specifically, the research focused on leveraging the Composite Trapezoidal rule with n=3n=3, and comparing it against the Midpoint, Trapezoidal, and Simpson quadrature rules. By integrating these approaches, three novel methods were formulated. The findings revealed that several of these new methods demonstrated enhanced efficiency and robustness compared to their established counterparts. In a detailed comparative analysis with the classical Broyden method and other improved versions, the Midpoint–Composite Trapezoidal (MT_3) method emerged as the top performer. This method consistently provided superior numerical outcomes across all benchmark problems examined in the study. The results highlight the potential of these new methods to significantly advance the field of numerical analysis, offering more powerful tools for researchers and practitioners dealing with complex nonlinear systems of equations. Through this innovative approach, the study not only broadens the understanding of Broyden-like methods but also sets the stage for further advancements in the development of efficient numerical solutions.
VL - 12
IS - 4
ER -
Copy
|
Download