Design of Gudermannian Neuroswarming to solve the singular Emden-Fowler nonlinear model numerically.

The current investigation is related to the design of novel integrated neuroswarming heuristic paradigm using Gudermannian artificial neural networks (GANNs) optimized with particle swarm optimization (PSO) aid with active-set (AS) algorithm, i.e., GANN-PSOAS, for solving the nonlinear third-order Emden-Fowler model (NTO-EFM) involving single as well as multiple singularities. The Gudermannian activation function is exploited to construct the GANNs-based differential mapping for NTO-EFMs, and these networks are arbitrary integrated to formulate the fitness function of the system. An objective function is optimized using hybrid heuristics of PSO with AS, i.e., PSOAS, for finding the weights of GANN. The correctness, effectiveness and robustness of the designed GANN-PSOAS are verified through comparison with the exact solutions on three problems of NTO-EFMs. The assessments on statistical observations demonstrate the performance on different measures for the accuracy, consistency and stability of the proposed GANN-PSOAS solver.

Introduction

The singular nonlinear models are of great significance in the variety of fields, i.e., biology, technology, applied mathematics, engineering and physics. The typical mathematical representation of the singular Emden–Fowler equation is written as [1-5]:where is constant, represents the shape factor and X shows the singular point. The singular model (1) has been applied to mathematically development of the numerous model arising in broad fields like stellar structure, astrophysics, isothermal gas spheres and mathematical physics [6-8]. It is always considered tough to solve the singular nonlinear models due to singular points at the origin. Few numerical/analytical techniques available in the literature to solve the singular models. Parand et al. [9] introduced meshfree numerical computing procedure for Emden–Fowler system, and Singh et al. [10] used Haar wavelet quasi linearization method for numerical solution of Emden–Fowler model. Bencheikh [11] applied Bernstein polynomial method for nonlinear singular Emden–Fowler equations. Parand et al. [6] implemented Hermite functions based collocation scheme for solving the singular models. Sabir et al. [12] solved third-order nonlinear singular functional differential model using the differential transformation scheme. Sadaf et al. [13] introduced Legendre-homotopy method for boundary value problems (BVPs) with higher order terms. Dizicheh et al. [14] present a Legendre wavelet spectral technique to solve the Lane–Emden differential systems. Parand et al. [15] solved singular astrophysics problems using the rational Chebyshev based collocation procedures.

The said approaches have their specific potential, exactness, sensitivity and competence as well as accountabilities and defects over another. The present study is related to solve the third-order Emden–Fowler model using the Gudermannian neural network (GNN) as an activation function along with the optimization of global search with particle swarm optimization (PSO) and local search with active set (AS) scheme, i.e., GANN-PSOAS approach. The general form of the nonlinear third-order Emden–Fowler model (NTO-EFM) is written as [16]:

The above model clearly indicates the double singular points at X = 0 and X2 = 0. Few current applications of the stochastic solvers are seen in broad fields [17-21] and particularly, in plasma physics problems [22], financial model [23], dusty plasma models [24], bioinformatics problem of HIV infection spresd [25], Thomas–Fermi atom's models [26, 27], nonlinear reactive transport model [28], fin model [29], neuro-fuzzy model [30], nonlinear singular models [16, 31], doubly singular nonlinear models [32], prey-predator models [33], nonlinear models [34], model of heartbeat dynamics [35], corneal shape model [36], multi-point boundary value problems [37], atomic physics model [38], temperature distribution dynamics of human head [39], singular functional differential system [40] and novel COVID-19 dynamics with nonlinear SITR system [41]. These motivations demonstrated the worth of the stochastic numerical solvers due to their better precision/accuracy and convergence. Thus, we are interested to exploit/explore the stochastic computing paradigm to design a reliable methodology based on GANN, trained with PSO and AS scheme to solve the NTO-EFM including single/multi singularities.

The innovative characteristics of the GANN-PSOAS scheme are listed as follows:

A new continuous differential mappings of GANN models are presented for the solution of singular NTO-EFMs by construction of merit function in mean square sense and optimization is performed with combined heuristics of PSOAS.

The proposed GANN-PSOAS scheme is efficiently implemented to solve three problems of the NTO-EFM with singularity at origin with reasonable precision.

The achieved numerical outcomes of proposed GANN-PSOAS approach matched with the reference exact solutions for each variant of singular NTO-EFM that indicates the exactness, precision and consistency.

The outcome of statistics for proposed GANN-PSOAS approach of on sufficient large multiple execution through performance measures on median, mean, standard deviation, Nash–Sutcliffe efficiency (NSE), semi-interquartile range (S.IR), and Theil's inequality coefficient (TIC) further certify the worth.

The remaining portions of the present investigation are described as: Sect. 2 shows the proposed structure and optimization schemes. Section 3 represents the performance indices. Section 4 indicates the details of the numerical outcomes. The conclusions along with future research studies are shown in Sect. 5.

Proposed methodology

In this section, the differential operators of GNN are designed along with the necessary description for solving the NTO-EFM. The mathematical modeling, the objective function and its learning process are provided here for proposed solver GANN-PSOAS.

Gudermannian Function based Mathematical Modeling

The capability of GNN systems is presented for consistent, reliable and trustworthy results for the optimization of the proposed problem. represents the continuous mapping results, and its derivatives are written as:where k and Z represent the number of neurons and activation function, whereas , and are the unknown weight vectors ‘ given as: , for , and .

The Gudermannian-based NN is given as:Using the Gudermannian-based activation function provided in Eq. (3), the continuous mapping of differential operators takes the form as

To solve the NTO-EFM, an objective function using the sense of mean squared error becomes as:where is an error function associated with NTO-EFM, and denote the fitness functions of the model differential form and boundary conditions, written aswhere and .

Optimization of the network

The optimization of the parameters is performed for the solution of NTO-EFM by incorporating the strength of hybrid-computing infrastructure based on swarm intelligence global technique PSO along with local AS approach.

PSO is an effective search scheme used as an alternate optimization procedure of genetic algorithms. PSO ascertained by Eberhart and Kennedy at the end of the nineteenth century [42-44] and applied as an easy technique with less memory requirements. In the system of search space, a single candidate outcome of decision variables for the optimization is called a particle and the set of these particles form a swarm. For the adaptation of optimization variables, PSO works through the optimization process based on the local and global positions and in the swarm. It metaheuristic technique and capable of searching very large spaces of candidate solutions. Particle swarm optimization does not require too many assumptions in optimization. The mathematical notations of the position and velocity are given as:where is the inertia weight vector lie between [0, 1], is the flight index, and are the social/global and cognitive/local constants of the accelerations, whereas and are the vectors lie between 0 and 1. Recently, a wide-ranging review on hypothetical and experimental studies on PSO has been discussed by the research community in various dimensions, i.e., geotechnical modeling [45], optimize the performance of induction generator [46], traveling salesman problem [47], nonlinear electric circuits [48], mobile robot in a complex dynamic environment [49], physical model systems [50], combinatorial optimization problems [51] and permanent magnets optimization of synchronous motor [52].

The quick performance of PSO is the rapid convergence due to the hybridization with a suitable local search approach by taking the best values of PSO as a primary weight. Therefore, an appropriate local search active-set (AS) approach is applied for fast refinements of the results obtained by the PSO algorithm. Recently, AS approach is used in the scalable elastic net subspace clustering [53], nonlinear fluid mechanic models [54], multistage nonlinear nonconvex problems [55], symmetric eigenvalue complementarity problem [55] and embedded model predictive control [56].

The hybrid of PSOAS algorithm trains the GNNs as well as vital parameter setting for PSOAS scheme provided in Algorithm 1. The parameter setting is a crucial and critical step in the optimization process of the algorithms, i.e., PSO and AS, a slight variation of the parameter setting of these algorithm results in premature convergence, so all these parameters are adjusted with extensive care, after exhaustive experimentation, experience and knowledge of both optimization procedures and problem under consideration etc.

Performance matrices

The performance processes of two different measures of the system (1) based on TIC and NSE are presented. The global presentations of G.TIC and NSE are used to examine the proposed methodology for solving the NTO-EFM. The mathematical representations of these indices are provided as follows:

Simulation and results

In this section, the detail results are presented for the numerical outcomes to solve three problems of the NTO-EFM using the GANN-PSOAS approach.

Problem 1:

Consider the NTO-EFM-based example is shown as:

The exact result of the above equation is , and the error function becomes as:

Problem 2:

Consider the NTO-EFM including multi-singularities is shown as:

The exact result of the above equation is along with the fitness/error function provided below:

Problem 3:

Consider the NTO-EFM including multi-singularities at the origin is shown as:

The exact result of the above equation is , and the error function becomes as:

Problem 4:

Consider the NTO-EFM including multi-singularities at the origin is shown as:

The exact result of the above equation is , while the error-based fitness is expressed as:

Optimization of the NTO-EFM-based examples 1–4 is accomplished by manipulating the PSOAS approach using the Gudemannian function as an objective function for fifty independent executions to find the parameters of the system. A set of best weights are provided to authenticate the projected numerical values of the model given in Eq. (1) for 10 neurons. The mathematical notations of the projected numerical outcomes are written as:

The best set of weights and result comparison based on the reference exact/proposed outcomes for all the problems of the NTO-EFM are illustrated in Fig. 1. It can be seen that the proposed results from the GANN-PSOAS approach and reference/exact solutions matched over one another for all four problems of the NTO-EFM. This matching of the numerical results indicates the perfection, correctness and excellence of the projected GANN-PSOAS approach. Figure 2 shows the absolute error (AE) values and performance investigations through GANN-PSOAS approach for three problems of the NTO-EFM and similar trend is observed for problem 4. Figure 2(a) depicts the AE values that have been found for higher decimal places of accuracy, i.e., 10–5 to 10–6, 10–4 to 10–5 and 10–6 to 10–7 for problems 1, 2 and 3 of the NTO-EFM. Figure 2(b) indicates the performance studies based on , ENSE and TIC for the problems 1–3 of the NTO-EFM. One may clearly observed that the closely lie 10–7 to 10–8, 10–6 to 10–7 and 10–8 to 10–9, for examples 1, 2 and 3 of the NTO-EFM, respectively. The ENSE values lie in the domain from 10–9 to 10–10 for problems 1 and 3, while for problem 2, ENSE lie 10–8 to 10–9. TIC metric, for examples, 1 and 2 lie in the interval 10–8 to 10–9, while for problem 3 in the interval between 10–9 and 10–10.

Fig. 1

Set of weights and proposed/true solutions for all the problems of the NTO-EFM model

Fig. 2

AE values and performance measures based on GANN-PSOAS approach for all the problems of the NTO-EFM

Statistical studies for the GANN-PSOAS scheme through Fitness using the histogram/boxplots for all the problems of the NTO-EFM

Statistical studies for the GANN-PSOAS scheme through ENSE using the histogram/boxplots for all the problems of the NTO-EFM

Statistical studies for the GANN-PSOAS scheme through TIC using the histogram/boxplots for all the problems of the NTO-EFM

The performance operators plots/illustrations based on fitness, ENSE and TIC have been drawn together with the boxplots and histogram values for all the problems of the NTO-EFM are given in Figs. 3, 4, 5. The values of the fitness for Problems 1 and 2 lie in 10–2 to 10–6, whereas for problem 3, mostly fitness lies in 10–06 to 10–08. The ENSE for problems 1 and 3 lie in range of 10–3 to 10–7, while for third problem, the ENSE lie in 10–7 to 10–10. The TIC values for problems 1 and 2 lie in 10–4 to 10–8, while for problem 3 lie in 10–8 to 10–10. In view of these statistical results, one can accomplish that the near to optimal levels of ENSE and TIC have been attained.

The statistical assessments studies have been described using the GANN-PSOAS approach to solve all the problems of the NTO-EFM for 50 independent executions using the measure of central tendency and variation including the minimum (Min), mean, median (Med), semi-interquartile range (S.IR) and standard deviation (SD). The obtained statistical outcomes have been provided in Table 1. These statistical performances for all the problems of the NTO-EFM are calculated and presented, which describe the accuracy/precision of the proposed GANN-PSOAS approach. The convergence investigations of GANN-PSOAS approach are further showed on the global performance measures based on G.FIT, G. ENSE and G-TIC for 50 independent executions are given in Table 2. The mean/average levels of the G.FIT, G.ENSE as well as of G.TIC lie in 10−5 to 10−8, 10−8 to 10−9, 10−7 to 10−8, respectively, while the S.IR of G.FIT, G.ENSE as well as G.TIC lie in 10−4 to 10−7, 10−7 to 10−9 and 10−5 to 10−8, respectively, for problems 1 to 3. The close optimal values of these global level presentations supplementary authenticate the precision of the projected GANN-PSOAS solver.

Table 1

Statistics investigation via designed GANN-PSOAS approach for all the problems of the NTO-EFM

	Mode	The solution U^(X) between [0,1] using the step size 0.1
		0	0.1	0.2	0.3	0.4	0.5	0.6	0.7	0.8	0.9	1
P 1	Min	6 × 10–6	2 × 10–6	1 × 10–8	1 × 10–5	3 × 10–7	3 × 10–6	2 × 10–6	6 × 10–6	1 × 10–5	1 × 10–5	8 × 10–6
	Mean	7 × 10–2	7 × 10–2	7 × 10–2	7 × 10–2	8 × 10–2	7 × 10–2	7 × 10–2	7 × 10–2	6 × 10–2	5 × 10–2	4 × 10–2
	SD	2 × 10–1	2 × 10–1	2 × 10–1	2 × 10–1	2 × 10–1	1 × 10–1	1 × 10–1	1 × 10–1	1 × 10–1	1 × 10–1	1 × 10–1
	Med	7 × 10–4	9 × 10–4	9 × 10–4	9 × 10–4	9 × 10–4	8 × 10–4	5 × 10–4	6 × 10–4	5 × 10–4	3 × 10–4	4 × 10–4
	S.IR	1 × 10–3	3 × 10–3	7 × 10–3	7 × 10–3	6 × 10–3	6 × 10–3	5 × 10–3	3 × 10–3	2 × 10–3	9 × 10–4	3 × 10–3
P 2	Min	5 × 10–6	1 × 10–6	1 × 10–5	6 × 10–6	1 × 10–5	3 × 10–5	3 × 10–5	3 × 10–5	3 × 10–5	4 × 10–5	5 × 10–5
	Mean	5 × 10–2	7 × 10–2	1 × 10–1	1 × 10–1	1 × 10–1	1 × 10–1	1 × 10–1	2 × 10–1	2 × 10–1	3 × 10–1	4 × 10–1
	SD	2 × 10–1	2 × 10–1	2 × 10–1	3 × 10–1	3 × 10–1	3 × 10–1	4 × 10–1	5 × 10–1	6 × 10–1	7 × 10–1	1 × 10–1
	Med	1 × 10–4	1 × 10–4	2 × 10–4	1 × 10–4	2 × 10–4	2 × 10–4	2 × 10–4	2 × 10–4	2 × 10–4	3 × 10–4	4 × 10–4
	S.IR	9 × 10–5	2 × 10–4	2 × 10–4	3 × 10–4	3 × 10–4	4 × 10–4	5 × 10–4	6 × 10–4	7 × 10–4	9 × 10–4	1 × 10–3
P 3	Min	2 × 10–1	1 × 10–7	1 × 10–6	1 × 10–6	1 × 10–7	1 × 10–7	1 × 10–7	3 × 10–7	6 × 10–7	9 × 10–7	1 × 10–6
	Mean	3 × 10–3	3 × 10–3	3 × 10–3	3 × 10–3	3 × 10–3	3 × 10–3	3 × 10–3	3 × 10–3	3 × 103	3 × 10–3	3 × 10–3
	SD	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2	2 × 10–2
	Med	1 × 10–8	9 × 10–6	1 × 10–5	1 × 10–5	9 × 10–6	8 × 10–6	9 × 10–6	9 × 10–6	1 × 10–5	1 × 10–5	1 × 10–5
	S.IR	3 × 10–8	6 × 10–6	7 × 10–6	6 × 10–6	6 × 10–6	7 × 10–6	7 × 10–6	7 × 10–6	7 × 10–6	7 × 10–6	7 × 10–6

Table 2

Global presentations for all the problems of the NTO-EFM

Problem	G.FIT		G.TIC		G.ENSE
	Mean	S.IR	Mean	S.IR	Mea	S.IR
1	3.4375E−5	1.3305E−4	7.7371E−8	5.2754E−7	8.5371E−7	7.7933E−5
2	1.2812E−5	2.6652E−5	2.5886E−8	5.7705E−8	1.7059E−7	1.7387E−6
3	6.5333E−8	1.1351E−7	1.2358E−9	1.3528E−9	3.3940E−8	4.6050E−8

The computational bourdon of the proposed GANN-PSOAS scheme is perceived via completed generations, parameter adaptation’s execution time and executed counts of the function under the procedure to get the decision variables of the GANNs. Complexity examinations for each problem of the NTO-EFM mathematical models are evaluated, and the results based on numerical data are provided in Table 3. One may notice that the average generations, execution of time as well as function counts are 1962.8067 and 76,713.32, for all three problems of the NTO-EFM, respectively, of the proposed GANN-PSOAS scheme. These complexity index can be used in future for necessary comparison studies with state-of-the-art computing procedures based on exploitation of artificial intelligence methodologies. Beside the accurate and efficient solutions obtained from GANN-PSOAS, other advantages include ease of the concept with smooth implementation, provision of continuous solutions, reliable, stable, extendable and applicable to different nonlinear systems.

Table 3

Complexity performance for all the problems of the NTO-EFM

Problem	Generations		Execution time		Function Counts
	Mean	SD	Mean	SD	Mean	SD
1	27.973692	5.1925867	1793.08	893.78	78,090.82	14,423.597
2	26.653853	4.812006	1628.54	601.73	75,292.48	10,900.807
3	25.883937	10.179233	2466.8	1707.84	76,756.66	32,558.828

Conclusions

A new design of neuroswarming heuristics is presented to solve the third-order nonlinear singular Emden–Fowler model by introducing Gudermannian activation function for the formulation of Gudermannian artificial neural networks which is used for the modeling of the equation by the construction of the objective function. The fitness/merit function of the nonlinear singular system is optimized with optimization ability of global search with particle swarm optimization combined with quick/rapid local search strength of active-set approach. The designed intelligent solver GANN-PSOAS is effectively implemented to solve three variants of NTO-EFMs by exploiting in 10 neurons in hidden layer structure of the networks. The convergence, precision and accuracy of the stochastic numerical solver are estimated by accomplishing the overlapping results with the true/exact solutions having an acceptable level of accuracy for solving the NTO-EFMs. Moreover, statistical amplifications based on 50 executions/runs have been performed to solve the NTO-EFM on the basis of mean, standard deviation, semi-interquartile range and median scales which evidently authenticate the trustworthiness, accurateness, exactness and robustness of the proposed Gudermannian activation function based neural network models trained with hybrid of particle swarm optimization with active set scheme. The proposed methodology GANN-PSOSA is stochastic in nature, therefore have limitation better performance cannot be given guarantee/assurance that algorithm converges in each independent trial. Additionally, a slight change in parameters settings of the optimization algorithms also results in premature convergence.

In the future, the designed GANN-PSOAS scheme can be applied to investigate the dynamics of nonlinear fluidic systems, bioinformatics models, computer virus propagation models, nonlinear circuit theory problem, systems in energy and power sector.