TY - JOUR
T1 - On the effect of nonlinearity and Jacobian initialization on the convergence of the generalized Broyden quasi-Newton method
AU - Demeester, Toon
AU - Delaissé, Nicolas
AU - van Brummelen, E. Harald
AU - Haelterman, Rob
AU - Degroote, Joris
N1 - Publisher Copyright:
© 2022 John Wiley & Sons Ltd.
PY - 2022/9/15
Y1 - 2022/9/15
N2 - This article investigates two aspects of the generalized Broyden quasi-Newton method that have a major impact on its convergence: the initial approximation of the Jacobian and the presence of nonlinearities in the secant conditions. After reformulating the common representation of generalized Broyden, a straightforward interpretation is given. This leads to a natural extension of the method in which an application-dependent physics-based surrogate model is used as initial approximation of the (inverse) Jacobian. A carefully chosen surrogate has the potential to greatly reduce the required number of iterations. The behavior of generalized Broyden depends strongly on the parameter that determines how many secant conditions are satisfied by the Jacobian approximation. Respecting all secant conditions reduces it to Anderson acceleration; a single one to Broyden's original method. An analysis demonstrates that these two variants behave very differently when nonlinearities are present in the secant conditions: they are ignored by Broyden, but can destabilize Anderson. On the other hand, the analysis shows that Broyden tends to neglect small linear information, possibly reducing convergence speed. To mitigate stability problems with Anderson acceleration, a practical method to detect and remove nonlinear secant information is introduced next. Finally, we solve a steady free-surface-flow problem using several generalized Broyden variants, testing the influence of the surrogate, the nonlinearities and the combination thereof. The results agree with the theoretical predictions, showing large differences in convergence behavior. Furthermore, the proposed method effectively negates the problems related to nonlinearities in this case.
AB - This article investigates two aspects of the generalized Broyden quasi-Newton method that have a major impact on its convergence: the initial approximation of the Jacobian and the presence of nonlinearities in the secant conditions. After reformulating the common representation of generalized Broyden, a straightforward interpretation is given. This leads to a natural extension of the method in which an application-dependent physics-based surrogate model is used as initial approximation of the (inverse) Jacobian. A carefully chosen surrogate has the potential to greatly reduce the required number of iterations. The behavior of generalized Broyden depends strongly on the parameter that determines how many secant conditions are satisfied by the Jacobian approximation. Respecting all secant conditions reduces it to Anderson acceleration; a single one to Broyden's original method. An analysis demonstrates that these two variants behave very differently when nonlinearities are present in the secant conditions: they are ignored by Broyden, but can destabilize Anderson. On the other hand, the analysis shows that Broyden tends to neglect small linear information, possibly reducing convergence speed. To mitigate stability problems with Anderson acceleration, a practical method to detect and remove nonlinear secant information is introduced next. Finally, we solve a steady free-surface-flow problem using several generalized Broyden variants, testing the influence of the surrogate, the nonlinearities and the combination thereof. The results agree with the theoretical predictions, showing large differences in convergence behavior. Furthermore, the proposed method effectively negates the problems related to nonlinearities in this case.
KW - Anderson acceleration
KW - Broyden's method
KW - free-surface flow
KW - quasi-Newton
KW - surrogate model
UR - http://www.scopus.com/inward/record.url?scp=85129863872&partnerID=8YFLogxK
U2 - 10.1002/nme.6998
DO - 10.1002/nme.6998
M3 - Article
AN - SCOPUS:85129863872
SN - 0029-5981
VL - 123
SP - 4054
EP - 4072
JO - International Journal for Numerical Methods in Engineering
JF - International Journal for Numerical Methods in Engineering
IS - 17
ER -