Hybrid neural network framework for efficient solutions of third-order differential equations

Document Type : Original Article

Authors

1 Department of Mathematics, Federal University Lokoja, Nigeria

2 School of Mathematical Sciences, University Sains Malaysia, 11800 USM, Penang, Malaysia.

3 School of Mathematical Sciences, Universiti Sains Malaysia, 11800 USM, Penang, Malaysia.

4 Department of Mathematical Sciences, Osun State University, Osogbo, Nigeria

Abstract
Over the years and across various scientific fields, artificial neural networks (ANN) have achieved remarkable success. Among these is deep feedforward neural networks (FFNNs) which notably enhanced the accuracy of numerous tasks. Despite their capabilities, their potential for solving complex higher-order equations has not been extensively explored. This study introduces an innovative method to improve the accuracy and efficiency of solving third-order differential equations (ODEs) by combining a hybrid block method with feedforward neural networks (FFNNs). In this approach, neural networks which are a subset of neural computing, are utilized to develop a new solution technique for approximating third-order ODEs, leveraging advanced mathematical tools and neural-like computation systems. The hybrid block method divides the problem into manageable segments, while the FFNNs iteratively learn and refine the solutions. This combination harnesses the computational efficiency of block methods and the adaptive learning capabilities of FFNNs to enhance solution accuracy. We provide a detailed methodology for implementing this hybrid approach and validate its effectiveness through numerical experiments and comparisons with existing methods. The results indicate substantial improvements in accuracy and computational efficiency, suggesting that the proposed method is a promising tool for solving complex third-order ODEs in various domains.

Keywords

Subjects


[1] Adams, D., & Omeike, M. (2020). Stability of solutions of certain third order non-autonomous ordinary differential equations. Afrika Matematika, 32(3). 
[2] Adenipekun, A. E., Onanaye, A. S., Adeleke, O. J., & Ogunniran, M. O. (2024). Hybrid shifted polynomial scheme for the approximate solution of a class of nonlinear partial differential equations. Songklanakarin J. Sci. Technol., 46(4), 339–346. 
[3] Admon, M. R., Senu, N., Ahmadian, A., Majid, Z. A., & Salahshour, S. (2023). A new efficient algorithm based on feedforward neural network for solving differential equations of fractional order. Communications in Nonlinear Science and Numerical Simulation, 117, 106968. 
[4] Akram, G. (2012). Quartic spline solution of a third order singularly perturbed boundary value problem. ANZIAM J., 53(E), E44–E58. 
[5] Akram, G., & Rehman, H. (2014). Homotopy perturbation method with reproducing kernel method for third order non linear boundary value problems. J. Basic. Appl. Sci. Res., 4(1), 60–67. 
[6] Al-Said, E. A., & Noor, M. A. (2003). Cubic splines methods for a system of third order boundary value problems. Appl. Math. Comput., 142, 195–204. 
[7] Amodio, P., & Segura, I. (2005). High-order finite difference schemes for the solution of second-order BVPs. J.Comput. Appl. Math., 176, 59–76. 
[8] Arshad, K., & Talat, S. (2012). Non-polynomial quintic spline solution for the system of third order boundary value problems. Numer. Algorithm, 59, 541–559. 
[9] Awoyemi, D. O. (2003). A p-stable linear multistep method for solving general third order ordinary differential equations. Int. J. Comput. Math., 80(8), 985–991. 
[10] Brugnano, L., & Trigiante, D. (1998). Solving Differential Problems by Multistep Initial and Boundary Value Methods. Gordon. 
[11] Calin, O. (2020). Deep learning architectures. Springer. 
[12] Changci, P., Wei, D., & Zhongli, W. (2006). Green’s function and positive solutions of nth order m-point boundary value problem. Applied Mathematics and Computation, 182(2), 1231–1239. 
[13] Clarkson, P. (2003). Painleve equations-nonlinear special functions. Journal of Computational and Applied Mathematics, 153(1–2), 127–140. 
[14] Crank, J. (1984). Free and Moving Boundary Problems. Clarendon Press, Oxford. 
[15] El-Salam, F. A. A., El-Sabbagh, A. A., & Zaki, Z. A. (2010). The numerical solution of linear third order boundary value problems using nonpolynomial spline technique. J. Am. Sci., 6(12), 303–309. 
[16] Emmanuel, S., Sathasivam, S., & Ogunniran, M. O. (2024). Leveraging Feed-Forward Neural Networks to Enhance the Hybrid Block Derivative Methods for System of Second-Order Ordinary Differential Equations. Journal of Computational and Data Science. 
[17] Emmanuel, S., Sathasivam, S., & Ogunniran, M. O. (2024). Multi-derivative hybrid block methods for singular initial value problems with application. Scientific African, 24, e02141.
[18] Ghahramani, Z. (2003). Unsupervised learning. In Summer school on machine learning (pp. 72–112). Springer Berlin Heidelberg. 
[19] Huang, G. B., Zhu, Q. Y., & Siew, C. K. (2004). Extreme learning machine: A new learning scheme of feedforward neural networks. 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No. 04CH37541), 2, 985–990. 
[20] Jator, S., Okunlola, T., Biala, T., & Adeniyi, R. (2018). Direct integrators for the general third-order ordinary differential equations with an application to the Korteweg–de Vries equation. Int. J. Appl. Comput. Math, 4(110).
[21] Karayiannis, N., & Venetsanopoulos, A. N. (2013). Artificial neural networks: learning algorithms, performance evaluation, and applications (Vol. 209). Springer Science & Business Media. 
[22] Kochenderfer, M. J., & Wheeler, T. A. (2019). Algorithms for optimization. MIT Press. 
[23] Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998). Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks, 9(5), 987–1000. 
[24] Lambert, J. D. (1991). Computational Methods in Ordinary Differential Equations, John Wiley and Sons, New York. 
[25] Lambert, J. D., & Watson, I. A. (1976). Symmetric multi-step methods for periodic initial value problems. J. Inst. Math. Appl., 18, 189. 
[26] Liu, B.-A., & Jammes, B. (1999, June 1). Solving ordinary differential equations by neural networks. Proceeding of 13th European Simulation Multi-Conference Modelling and Simulation: A Tool for the Next Millennium. 
[27] Liu, Z., Wang, X., Kang, S. M., & Kwun, Y. C. (2015). Positive solutions for a third order nonlinear neutral delay difference equation. Abstract and Applied Analysis, 33.
[28] Lorenzo, C. (2013). Metodos de Falkner en mode predictor-corrector para la resolucion de problemas de valor inicial de segundo orden (analisis e implementacion) [Phdthesis]. Universidad de Salamanca. 
[29] Lü, X., & Cui, M. (2010). Existence and numerical method for non-linear third-order boundary value problem in the reproducing kernel space. Bound. Value Probl., 19.
[30] Malek, A., & Beidokhti, R. S. (2006). Numerical solution for high order differential equations using a hybrid neural network—optimization method. Applied Mathematics and Computation, 183(1), 260–271. 
[31] Momoniat, E. (2009). Symmetries, first integrals and phase planes of a third-order ordinary differential equation from thin film flow. Math. Comput. Model., 49, 215–225. 
[32] Ogunniran, M. O., Aljohani, A., Shokri, A., Tijani, K. R., & Wang, Y. (2024). Enhanced rational multi-derivative integrator for singular problems with application to advection equations. Ain Shams Engineering Journal. 
[33] Ogunniran, M. O., Olaleye, G. C., Taiwo, O. A., Shokri, A., & Nonlaopon, K. (2023). Generalization of a Class of Uniformly Optimized k-step Hybrid Block Method for Solving Two-point Boundary Value Problem. Results in Physics, 44, 106147. 
[34] Ogunniran, M. O., Tijani, K. R., Moshood, L. O., Ojo, R. O., Yakusak, N. S., Muritala, F., Kareem, K. O. & Oluwayemi, M. O. (2025). Harnessing neural networks in hybrid block integrator for efficient solution of boundary value problems. Thermal Advances.
[35] Pakdaman, M., Ahmadian, A., Effati, S., Salahshour, S., & Baleanu, D. (2017). Solving differential equations of fractional order using an optimization technique based on training artificial neural network. Appl. Math. Comput., 293, 81–95. 
[36] Pei, M., & Chang, S. K. (2007). Existence and uniqueness of solutions for third-order nonlinear boundary value problems. J. Math. Anal. Appl., 327(1), 23–35.
[37] Pue-on, P., & Viriyapong, N. (2012). Modified Adomian decomposition method for solving particular third-order ordinary differential equations. Appl. Math. Sci., 6(30), 1463–1469.
[38] Ramos, H., Mehta, S., & Vigo-Aguiter, J. (2016). A unified approach for the development of k-step block Falkner type methods for solving general second-order initial value problems in ODEs. Journal of Computational and Applied Mathematics.
[39] Ramos, H., & Rufai, M. (2022). A two-step hybrid block method with fourth derivatives for solving third-order boundary value problems. Journal of Computational and Applied Mathematics, 404, 113419.
[40] Schalkoff, R. J. (1997). Artificial Neural Networks. McGraw-Hill. 
[41] Snoek, L., & Scholte, S. (2017). Artificial neural networks as models of information processing in biological neural networks. 
[42] Thanoon, T., & Al-Azzawi, S. (2008). Stability Conditions of Zero Solution for Third Order Differential Equation in Critical Case. CSMJ. 
[43] Tirmizi, A., Twizell, E. H., & Siraj-Ul-Islam. (2005). A numerical method for third non-linear boundary value problems in engineering. Int. J. Comput. Math., 82, 103–109. 
[44] Tokmak, F., & Karaca, I. (2012). Existence of Positive Solutions for Third-Order m-Point Boundary Value Problems with Sign-Changing Non-linearity on Time Scales. Abstract and Applied Analysis. 
[45] Valasoulis, K., Fotiadis, D. I., Lagaris, I. E., & Likas, A. (2002). Solving differential equations with neural networks: implementation on a DSP platform. Proceeding of 14th International Conference on Digital Signal Processing, 1265–1268.
Volume 6, Issue 3
Summer 2025
Pages 104-124

  • Receive Date 03 October 2024
  • Revise Date 27 September 2025
  • Accept Date 27 September 2025