Threshold image segmentation based on improved sparrow search algorithm.

Threshold segmentation based on swarm intelligence optimization algorithm is a research hotspot in image processing, because of its good segmentation effect and easy implementation. This paper proposes an image threshold segmentation method based on an improved sparrow search algorithm and 2-D maximum entropy method. In the proposed algorithm, the nonlinear inertia weight is introduced into the entrants' update formula to improve the local exploration ability of the algorithm, and Levy flight is introduced into the vigilant sparrows' update formula to prevent the algorithm from falling into the local optimal solution in the later stage of iteration. In addition, improved sparrow search algorithm is tested on fifteen benchmark functions. The results represent the merit of the proposed algorithm with respect to other algorithms. Finally, the proposed algorithm is applied to entropy based image segmentation. Experiment results on classical images and medical images show that the proposed method improves the segmentation effect in terms of peak signal-to-noise ratio and feature similarity.

Introduction

Threshold image segmentation is a widely used segmentation technology that performs image segmentation based on the information contained in the image gray-level histogram. The gray value difference between the target area and the background area in the image is compared, an appropriate threshold is given to judge the gray value of each pixel in the image belongs to the target region or the background region, so as to segment the image. Nowadays, there are many threshold image segmentation methods, while maximum entropy method [17, 47], inter class variance method(OTSU) [4, 41], cross entropy method [10, 25, 50] and minimum error method [5, 22] are divided according to the selection criteria of threshold. Image segmentation based on entropy is very popular, and entropy can be divided into Shannon entropy [39], tsallis entropy [13], exponential entropy [42, 51] and arimoto entropy [30], etc. According to the dimension of image histogram, it also can be classified into one-dimensional (1-D) histogram, two-dimensional (2-D) histogram [1, 6, 45] and so on.

In the process of image threshold segmentation, the effects of some factors on segmentation results are summarized as follows:

The separation between peaks. It is assumed that the gray level of the image composed of target and background has unimodal distribution characteristics. The gray levels of adjacent pixels in the target or background are highly correlated, but the gray levels of pixels at the junction of target and background are very different. Then the image gray histogram can be regarded as a mixture of two single peak histograms corresponding to the target and background respectively. At this time, if the number of the two distributions is close, the standardized mean difference is far enough and the mean square deviation is small enough, the histogram is bimodal, the pixel value that can be used as the bottom of the valley is found as the threshold between the two peaks. Therefore, the farther the wave crest is away, the greater the chance of separating the target from the background.

Noise content in the image. Noise will change the gray value of some pixels in the histogram, resulting in imbalance, such as filling the bottom of the histogram and generating new peaks.

Relative size of objects and background. When the target is small or large, the peak of the target and the background in the histogram will be quite different, so it is difficult to distinguish the valley bottom, which affects the selection of threshold.

The uniformity of illumination and reflection. When the illumination or the image reflection is uneven, the brightness of the target and background will change, and shadow areas may appear around the target. These factors will affect the change of image gray value, thus affecting the distribution of histogram, resulting in poor segmentation effect.

Using entropy as texture feature is an important research theme, many scholars have used entropy as the basis of threshold image segmentation. Liu et al. proposed a novel image thresholding based on 2-D Arimoto Entropy (TDAE), called Ellipsoid Region Search Strategy (ERSS) [30]. Li et al. proposed a parameter adaptive hybrid model for image segmentation, the image’s local entropy was used to establish the index for measuring the image’s gray-level information [26]. Chakraborty et al. proposed an improved version of Fractional Order Darwinian PSO (IFODPSO) for segmenting 3D histogram-based color images at multiple levels of Berkley Segmentation Dataset (BSDS500), Multi-level Massi Entropy (MME) had been chosen as the objective function for finding the threshold values in combination with IFODPSO [7]. Nejad et al. proposed a multi-level thresholding method based on imperialist competition algorithm and Kapur’s entropy [40]. Yan et al. proposed a image segmentation method based on whale optimization algorithm (WOA) and Kapur’s entropy [57]. Lei et al. defined a new form of square rough entropy to measure the roughness in an image, and proposed a corresponding threshold image segmentation algorithm [23]. Moreover, Lin et al. adopted the Tsallis cross-entropy in threshold image segmentation [29].

Only when the most appropriate threshold is found accurately, can the image segmentation be more accurate. Therefore, how to find the appropriate threshold quickly and accurately becomes the key of threshold image segmentation research.

Optimization algorithm based on the swarm intelligence is a bionic algorithm which simulates the behaviors of insects, birds, fish and other wild animals foraging and hunting. There are many well-known algorithms such as particle swarm optimization (PSO) [20], artificial bee colony algorithm (ABC) [18], fruit fly optimization algorithm (FOA) [44], grey wolf optimizer (GWO) [49], chicken swarm optimization (CSO) [36] and the WOA [37] and so on.

In recent years, more and more scholars have used intelligence optimization algorithm to solve image segmentation problems and achieved good results. Some algorithms used in image segmentation are listed in Table 1.

Table 1

The summary of image segmentation based on intelligent optimization algorithms

Works	Algorithm
Khairuzzaman [21]	Moth flame optimization algorithm
Kalyani [16]	Exchange market algorithm
Mahajan [34]	Marine predators algorithm
Duan [9]	Cuckoo search algorithm
Liang [27]	Chicken swarm optimization algorithm
Huang [12]	Fruitfly optimization algorithm
Jiang [15]	Teaching-learning-based optimization

Sparrow search algorithm (SSA) is a new swarm intelligence optimization algorithm proposed by Xue and Shen [56], it is inspired by the foraging behavior and vigilance behavior of sparrows. The algorithm has strong optimization ability and fast convergence speed. It has been widely investigated by scholars. Yuan et al. proposed a DMPPT control of photovoltaic microgrid based on improved SSA [58]. Liu et al. proposed a modified SSA with application in 3-D route planning for UAV [32]. Zhang et al. proposed a semi-supervised ensemble classifier with an improved SSA and applied it to pulmonary nodule detection [59]. Wang et al. conducted a research on economic optimization of microgrid cluster based on chaos SSA [53]. Gai et al. proposed a parameter-optimized deep belief network (DBN) based on SSA for gear fault severity detection [11]. Kathiroli et al. presented an efficient cluster-based routing model using Sparrow search algorithm derives a fitness function to perform clustering process [19]. Tuerxun et al. used the SSA to optimize the penalty factor and kernel function parameter of SVM and constructed the SSA-SVM wind turbine fault diagnosis model [52].

However, the SSA still has the disadvantage of easy to fall into the local optimal solution in the late iteration. Some scholars have put forward different solutions. Yuan et al. proposed a improved SSA based on the center of gravity reverse learning mechanism, learning coefficient and mutation operator [58]. Zhang et al. adopted sine cosine algorithm and new labor cooperation structure to increase the global optimal solution and convergence performance of SSA [59]. Wang et al. proposed a chaos SSA, which combines Bernoulli chaotic mapping, dynamic adaptive weighting, Cauchy mutation, and reverse learning [53]. Li et al. combined the SSA with direction learning strategy and metropolis criterion of simulated annealing algorithm [24]. Lv et al. improved the SSA by combining with the flight behavior in bird swarm algorithm [33]. Zhou et al. proposed a modified SSA by introducing crossover and mutation [60]. This algorithm has higher convergence rate than the original SSA. Liang et al. modified SSA with combining a homogeneous chaotic system, adaptive inertia weight, and improved boundary constraint [28].

In this research, an improved sparrow search algorithm (ISSA) is proposed which combines Levy flight and nonlinear inertia weight. Nonlinear inertia weight would enhance the local exploration ability and Levy flight would help the algorithm escaping from the local optimum. Then a new image threshold segmentation method is proposed based on ISSA. The gray value of each pixel in the graph and the mean of gray in its field are considered, the 2-D entropy is used as the evaluation function, and the entropy optimization is carried out by ISSA to obtain the threshold corresponding to the maximum entropy. In order to verify the feasibility and effectiveness of ISSA, it is tested on fifteen benchmark functions. Results are compared with some well-known algorithms such as SSA, PSO, GWO, ABC, WOA, CSO, and FOA. In the last, state-of-the-art approaches including ISSA, gold eagle optimizer (GEO) [38], rat swarm optimizer (RSO) [8], transient search optimization (TSO) [46], CRSSA [35], MSCA [48], HHO-PCNN [14], 2D-OTSU [31] and 1D-Exponential entropy [43] are applied to image segmentation. Peak signal-to-noise ratio (PSNR) and feature similarity (FSIM) are used as evaluation indexes for comparison. Experimental results demonstrate the effectiveness of the proposed method.

The main contributions of this paper are:

An improved sparrow search algorithm combining Levy flight and nonlinear inertia weight factor is proposed.

Compared with PSO, GWO, ABC, WOA, CSO, FOA and SSA, ISSA has better convergence speed, accuracy and robustness.

The experimental results show that compared with segmentation methods by GEO, RSO, TSO, CRSSA, MSCA and HHO-PCNN, 2D-OTSU and 1D-Exponential entropy, the segmented images obtained by ISSA and 2-D entropy have excellent peak signal-to-noise ratio and feature similarity.

The remainder of this paper is organized as follows. Section 2 introduces the SSA and the improved method. Section 3 analyzes the convergence of the ISSA. Section 4 proposes the threshold image segmentation based on ISSA and 2-D maximum entropy. Section 5 evaluates the performance of the ISSA and compares the segmentation results for different type of images. Finally, the paper is concluded in Section 6.

Improved sparrow search algorithm

Sparrow search algorithm

Sparrow search algorithm is proposed according to the predatory behavior and vigilant behavior of sparrow population. According to the role of each sparrow in the population, it can be divided into discoverer, entrant and vigilant sparrow.

The discoverers have more energy reserves in the whole population. They are responsible for exploring food for the whole population and guiding the entrants to search for foods. The fitness of the discoverers is better than entrants. In the process of searching for food, if the discoverer detects the danger, it will call to remind other members of the population and move to a new safe area to continue search for foods. In the algorithm, if the fitness of entrant is better than discoverer, the entrant will become discoverer to search for food. The location update formula of the discoverers is described as follows: Where t represents the current iteration, j = 1, 2, 3, ... d, itermax represents the maximum number of iterations, X represents the position information of the i-th sparrow in the j-th dimension, α∈[0,1] represents a random number, R2 ∈[0,1] represents the warning value, ST∈[0.5,1] represents the safety value, Q represents a random number following normal distribution, L represents a 1 × d matrix, and each element in the matrix is 1.

When the warning value is less than the security value, the discoverers can explore in a large range, and the range gradually decreases with the increase of iterations. When the warning value is bigger than the safety value, the discoverers detect the danger, and then the discoverers randomly go to other safe areas to search for food.

Entrants are the sparrows with the low energy in the population. The sparrows with lower energy are more difficult to find food in their area, so they have to fly to other areas or follow the discoverers to search for foods. Discoverers and entrants will replace each other with the amount of energy stored. The specific location update formula of the entrant is computed as follows: Where X is the best position of the current population, X is the worst position of the current population, A is the 1 × d matrix, each element in the matrix is randomly 1 or − 1, and A+ = AT(AAT)−1. When i is greater than n/2, it means that it is very difficult for the sparrows with low energy to find foods, so they need to fly to other places to find foods, otherwise they will fly to the vicinity of the discoverers to get more energy.

In the sparrow population, some sparrows are called vigilant sparrows, which usually account for 10% - 20% of the total population. When they realize the danger, the sparrows near the edge of the group will quickly move towards the safest area to avoid the danger. While the sparrows at the optimal position of the population, it will randomly walk near other sparrows to avoid the danger. The specific vigilant sparrow’s position update formula is calculated as follows: Where X is the optimal position of the current population, β is the step size, which is a normal distribution random number with mean value of 0 and variance of 1, K∈[−1,1], it represents a random number, f represents the fitness of the current sparrow, f represents the fitness of the current best sparrow, f represents the fitness of the current worst sparrow, and ε is a small constant to prevent the denominator from being 0.

If the fitness of the current sparrow is greater than the best sparrow, which means that the sparrow is at the edge of the population and is vulnerable to attack, so it needs to move to the most secure central area. If the fitness of the current sparrow is equal to the best sparrow, which means that the sparrow is in the most secure area. At this time, it needs to move close to the nearby sparrows to avoid danger.

The algorithm flowchart is shown in Fig. 1.

Fig. 1

Flowchart of the SSA

Step 1 Initialize population and algorithm parameters.

Step 2 Calculate the fitness values and sort them from small to large, then divided the population into discoverers and entrants according to the proportion.

Step 3 Update the discoverers’ position via Eq.(1).

Step 4 Update the entrants’ position use via Eq.(2).

Step 5 Select some sparrows randomly from the population according to the proportion of vigilant sparrows, and use Eq.(3) to update the position.

Step 6 Recalculate the new position’s fitness. If the fitness is better than that of the previous iteration, update its position, otherwise give up.

Step 7 Judge whether the stop condition is satisfied. If it is satisfied, exit and output the best position. Otherwise, return to Step 2.

Improved methods

According to the position updating formula Eq. (2), when the entrants move towards the optimal region, the direction is only 1 or − 1, which makes it easy to fall into the local optimal solution in the late iteration, and the population diversity is poor. Therefore, a new position updating formula is obtained by Eq. (4) with a nonlinear inertia weight of cosine function. Where w is the inertia weight, w and w are the maximum and minimum values of the weight, T is the number of current iterations, G is the maximum number of iterations. By introducing the nonlinear inertia weight of the cosine function, it can make the entrants explore more carefully and accurately near the current optimal position to make the local exploration ability stronger.

Levy flight was proposed by French mathematician Paul Levy in the 1930s. It is a probability distribution, a random step size that obeys Levy distribution. It is also a walking mode that can transform between a large number of short-distance search and occasional long-distance search. Mantegna algorithm is usually used to simulate, and the specific formula is as follows: Where u and v are random numbers of normal distribution, Levy is step size random number of Levy distribution, β is a constant, usually 1.5.

According to the vigilant sparrow’s position update formula, if the current sparrow’s fitness is not optimal, it will move towards the optimal position. The step size control parameter β is a random number of normal distribution with mean value of 0 and variance of 1, which is easy to make the algorithm fall into the local optimal solution in the late iteration. Therefore, the Levy flight random number is introduced to replace β, it will make the algorithm easy to jump out of the local optimal solution, improve the local exploration ability, population diversity, and the optimization performance of the algorithm.

Convergence analysis

Convergence criteria

The ISSA belongs to random search algorithm. Therefore, this paper determines the convergence behavior of ISSA through the convergence criterion of random algorithm [54, 55]. For the optimization problem, there are the random optimization algorithm D, the result of the k-th iteration Xk, and the result of the next iteration Xk + 1 = D(Xk, ζ), ζ is the searched solution in the iteration of the algorithm D.

The infimum of the search is defined as follows: Where V(x) is the Lebesgue measure on the set x, A is the feasible solution space, f(x) is the fitness function.

The optimal solution region can be defined as follows: Where ε > 0, C is a sufficiently large positive number. If algorithm D finds a point in the optimal solution region, then the algorithm finds an acceptable global optimal solution.

Condition 1: f (D (x, ζ)) ≤ f (x), if ζ∈A, then f (D (x, ζ)) ≤ f (ζ).

Condition 2: for B∈A, s.t. V(B) > 0, there is , where is the probability measure of the k-th iterative search solution of algorithm D on set B.

Let f be measurable, measurable space A be a subset of upper measurable, and algorithm D satisfy condition 1 and condition 2, is the sequence generated by algorithm D. Then probability measure, Rε, Mis the optimal solution region, and D is the global convergence.

Convergence analysis of ISSA

The position states of all sparrows in the population constitute the sparrow state, which can be recorded as s = (x1, x2,.... xN), where x is the position state of the i-th sparrow, N is the number of sparrow population, and all possible states in the sparrow population constitute a state space, which can be recorded as S = {s = (x1, x2,... xN) | x ∈A, 1 ≤ i ≤ N}, and A is the feasible solution state space.

In the ISSA, the transition probability of sparrow position state from x to x is P (T(x) = x), while the transition probability of sparrow population state from s to s can be expressed as follows:

From the above formula, we can know that the transition probability is obtained by multiplying the transition probability of each sparrow, so if s(t)∈S, then s(t + 1)∈S. The transition probability P (T(x(t)) = x(t + 1)) of each sparrow is only related to the state x(t), the number of sparrows i, the maximum iteration number iter, the optimal sparrow position x, the worst sparrow position x, and the random number Q at time t, but not related to time t. It can be concluded that the sparrow population position sequence s(t) generated by ISSA has Markov property and homogeneity, and the sparrow population state space s is a finite space. So ISSA’s sparrow population sequence {s(t), t ≥ 0} constitutes a finite homogeneous Markov chain.

In the ISSA, after each iteration, if the fitness value of a new position is better than the current best position, the new position will replace it and become the current best position. The best position of the algorithm is constantly changing and getting better in the iterative process. Therefore, the ISSA satisfies condition 1 of the convergence criterion.

If the optimal solution is x*, then the optimal state set of sparrow population is G = {s = {x} | f (x) = f (x *), s∈S}, and G∈S. for any optimal state set s and non optimal state set s, the transition probability from s to s is as follows:

In the optimal state set G, if at least one state reaches the optimal x, then there is a transition probability P (T (x) = x) = 0, then P (T (s) = s) = 0, then we can conclude that the optimal state set G of sparrow population is a closed set on the state space S.

Suppose that there is a nonempty closed set M in the state space S, and M ∩ G = ∅, then for the state s = (x) in G and the state s = (x) in M, we can get f (x*) < f (x), and the transition probability of state s to s can be known to be greater than 0, so M is not a closed set, so the hypothesis is not true. That is, there is only one closed set in the sparrow population state space S, which is the optimal state set G. That is, the Markov chain of the sparrow population state is irreducible.

Moreover, if there is a nonempty closed set E and there is no other nonempty closed set O to makeE ∩ O = ∅, So when j ∈ E, , when j ∉ E, , it can be concluded that when the iteration number of the ISSA tends to infinity, the sparrow population state must enter the optimal state set G, the probability that the ISSA can not find the global optimal solution is 0, so the condition 2 of convergence criterion is satisfied, it can be concluded that the ISSA is a global convergence algorithm.

Threshold image segmentation

Maximum entropy method was proposed by Kapur in 1985. The threshold selection standard of maximum entropy method is to maximize the total entropy of the segmented target and background (the largest amount of information).

Compared with the 2-D segmentation method, the 1-D segmentation method only considers the gray information of each pixel in the image, so the segmentation speed is faster. In 2-D methods, not only the gray information of each pixel, but also the gray information of its neighborhood is considered. The threshold t and region threshold s are selected to segment the image into four parts. The target and background (A and B in Fig. 2) are mainly concentrated in the two regions near the diagonal, and the other two regions are mainly the image edge and noise interference, we should makes full use of the gray information of the target and background areas, and more efficient and accurate to find the best threshold (t, s). Although the processing time of this 2-D method is long, the segmentation quality is better and the anti noise ability is superior.

Fig. 2

2-D histogram

Here we take a pixel and its surrounding 3 × 3 area as a calculation area to calculate the regional gray mean value of a pixel: Where P is the probability when the current pixel gray level is i and its field gray level average is j, n is the number of pixels whose gray level value is i and field gray level value is j, M × N is the pixel size of the image, w0 and wb are the probability sum of target class and background class respectively, L is the gray level, L = 256.

The image edge and noise interference area information is little and the probability is very small. Thus, we only consider the diagonal target area and background area and set the following formula:

For the threshold (t, s), the entropy expressions of target class and background class are described as follows:

2-D maximum entropy is calculated using Eq. (22).

The best threshold is determined as follows:

In the 2-D maximum entropy threshold image segmentation, the ISSA is used to find the best threshold:

In the ISSA, the lower the fitness, the better it is, so - fun {t, s} is taken as the fitness function.

The specific segmentation flowchart is shown in Fig. 3, and steps are explained as follows:

Fig. 3

Image segmentation based on ISSA

Step 1 Read the image to be segmented.

Step 2 Read the gray histogram of the image.

Step 3 Initialize the population and parameters.

Step 4 Calculate the fitness of all sparrows according to the Eq. (22).

Step 5 Implement the ISSA.

Step 6 Judge whether the stop condition is satisfied. If it is satisfied, exit and output the best threshold. Otherwise, return to Step 4.

Step 7 Use the best threshold {t *, s *} to segment the image and output the segmented image.

Tests and analysis

Benchmark test

In order to verify the convergence and robustness of the ISSA, fifteen benchmark functions are used to test ISSA and other optimization algorithms such as PSO [29], ABC [20], FOA [18], GWO [44], CSO [49] and WOA [36]. The parameters of these algorithms are shown in Table 2 and the benchmark functions are listed in Table 3. The experiments were performed on the platform of MATLAB R2018a, using a Dell Laptop with an Intel Core i5 processor and 8 GB memory, running the Windows 10 operating system. The number of population is 50 and the iterations is 300, and each algorithm runs 30 times independently.

Table 2

Algorithm parameters

Algorithm	Parameter	Value or range
SSA	Early warning value (ST)	0.6
	Proportion of discoverers (PD)	0.3
	Proportion of vigilant sparrows (PV)	0.2
PSO	Learning factor (C1,C2)	2
	Weight (w)	0.8
ABC	Acceleration coefficient upper bound (a)	1
	Abandonment Limit Parameter (L)	0.6*dimension*Population size
CSO	Proportion of roosters (Pr)	0.15
	Proportion of hens (Ph)	0.7
	Proportion of mother hens (Pm)	0.5
ISSA	Early warning value (ST)	0.6
	Proportion of discoverers (PD)	0.3
	Proportion of vigilant sparrows (PV)	0.2
	Weight (w)	[0.5,1.5]

Table 3

Test functions

Test function	Range	fmin
F_1x=∑i=1nX_i^2	[−100,100]	0
F_2x=∑i=1nX_i+∏i=1nX_i	[−10,10]	0
F_3x=∑i=1n∑j=1iX_j^2	[−100,100]	0
F_4x=∑i=1n−1100X_i+1−Xi2^2+X_i−1^2	[−30,30]	0
F_5x=∑i=1nX_i+0.5^2	[−100,100]	0
F_6x=∑i=1nXi2−10cos2πX_i+10	[−5.12,5.12]	0
F_7x=−20exp−0.21n∑i=1nXi2−exp1n∑i=1ncos2πX_i+20+e	[−32,32]	0
F_8x=14000∑i=1nXi2−∏i=1ncosX_ii+1	[−600,600]	0
F_9x=πn10sinπy_1+∑i=1n−1y_i−1^21+10sin^2πy_i+1+y_n−1^2+∑i=1nuX_i10,100,4 y_i=1+X_i+14uX_iakm={kX_i−a^m,X_i>a0,−a<X_i<ak−X_i−a^m,X_i<−a	[−50,50]	0
F_10x=0.1{sin^23πx_1+∑i=1nx_i−1^21+sin^23πx_i+1+ x_n−1^21+sin^22πx_n}+∑i=1nux_i5,100,4	[−50,50]	0
F_11x=∑i=111a_i−x_ibi2+b_ix_2bi2+b_ix_3+x_4^2	[−5,5]	0.0003
F_12x=4x12−2.1x14+13x16+x_1x_2−4x22+4x24	[−5,5]	−1.0316
F_13(x)=[1+(x_1+x_2+1)^2(19−14x_1+3x12−14x_2+6x_1x_2+3x22)]×[30+(2x_1−3x_2)^2×(18−32x_1+12x12+48x_2−36x_1x_2+27x22)]	[−2,2]	3
F_14x=−∑i=14c_iexp−∑j=13a_ijx_j−p_ij^2	[1,3]	−3.86
F_15x=x_2−5.1⋅x124π^2+5π⋅x_1−6^2+10⋅1−18πcosx_1+10	lb = [−5,0] ub= [10,15]	0.39789

Table 4 shows the statistical results, it can be seen from Table 4 that for single-mode test functions F1-F5, the average value, best value and variance of ISSA are smaller than other algorithms, and the global optimal value can be found accurately. For multi-mode test functions F6-F10, other algorithms are easy to fall into the local optimal value, but ISSA can accurately find the global optimal solution, which fully reflects excellent optimization ability of ISSA algorithm. For multi-mode test function with fixed dimension F11-F15, most algorithms can accurately find the global optimal solution, but the variance of ISSA is the smallest, which fully reflects excellent robustness of ISSA algorithm.

Table 4

Test results

Function	Algorithm	Mean	Best	Variance
F1(x)	ISSA	1.2226E-86	0	4.4807E-171
	SSA	1.5136E-81	0	3.1084E-161
	PSO	44.6809	7.5008	504.2381
	GWO	1.5306E-18	4.5467E-20	2.0749E-36
	ABC	222.4236	107.5375	5097.9128
	WOA	1.0761E-49	2.6661E-57	2.5306E-97
	CSO	2.265E-11	2.282E-15	4.9677E-21
	FOA	0.0010302	0.00072754	2.141E-8
F2(x)	ISSA	5.0332E-48	0	7.5295E-94
	SSA	3.2717E-47	0	3.2112E-92
	PSO	2.9053	0.81536	0.73694
	GWO	2.0277E-11	6.3843E-12	1.1796E-22
	ABC	64.3686	23.4021	437.8437
	WOA	1.8813E-32	1.245E-36	4.6361E-63
	CSO	2.4061E-11	5.8686E-13	2.3071E-21
	FOA	1.69	1.4194	0.01227
F3(x)	ISSA	3.577E-61	0	1.8531E-120
	SSA	8.8859E-56	0	2.3671E-109
	PSO	3756.6214	1305.0142	3,070,620.8807
	GWO	0.0030164	5.3608E-5	7.2254E-5
	ABC	70,342.7496	42,937.5191	161,232,308.1177
	WOA	52,860.2692	45,967.0147	16,225,636.2084
	CSO	3838.9673	146.721	3,083,323.408
	FOA	0.28502	0.18773	0.0028213
F4(x)	ISSA	0.00027408	3.0093E-8	3.5113E-7
	SSA	0.00053083	3.5673E-8	2.2185E-6
	PSO	2251.1682	250.9756	11,340,764.6264
	GWO	26.991	25.9835	0.35944
	ABC	1,669,754.7519	756,222.3756	5.41E+11
	WOA	27.9734	27.0766	0.165509
	CSO	27.9994	27.1388	0.19073
	FOA	28.8964	28.5524	0.017629
F5(x)	ISSA	1.7978E-6	5.3044E-12	1.1683E-11
	SSA	5.6235E-6	7.6199E-10	1.6175E-10
	PSO	45.3186	14.282	345.9587
	GWO	0.58243	0.00013016	0.11614
	ABC	198.8354	133.544	1497.052
	WOA	0.29549	0.06514	0.045438
	CSO	3.2061	2.1171	0.17996
	FOA	7.6668	7.6504	0.00010473
F6(x)	ISSA	0	0	0
	SSA	0	0	0
	PSO	39.7484	2.2821	709.5471
	GWO	5.1237	2.2737E-13	20.278
	ABC	249.8306	227.1439	210.8104
	WOA	3.7896E-15	0	2.0798E-28
	CSO	4.9734E-11	0	5.7483E-20
	FOA	72.7537	57.4909	94.9618
F7(x)	ISSA	8.8818E-16	8.8818E-16	0
	SSA	8.8818E-16	8.8818E-16	0
	PSO	3.8735	1.5212	0.5504
	GWO	2.3434E-10	6.8547E-11	2.792E-20
	ABC	7.3415	5.9637	0.73105
	WOA	4.7962E-15	8.8818E-16	4.657E-30
	CSO	6.4677E-7	1.8957E-8	6.8784E-13
	FOA	0.089619	0.066601	6.4997E-5
F8(x)	ISSA	0	0	0
	SSA	0	0	0
	PSO	1.4116	1.0747	0.74327
	GWO	0.0066637	0	0.00033015
	ABC	2.9671	2.1263	0.18277
	WOA	0.016993	0	0.0044624
	CSO	0.024023	1.3634E-13	0.0098685
	FOA	1.5729E-6	1.026E-6	7.5754E-14
F9(x)	ISSA	2.407E-7	1.6502E-12	2.4871E-13
	SSA	3.778E-7	7.3558E-11	5.9342E-13
	PSO	5.0619	0.41142	11.498
	GWO	0.034517	0.0065126	0.00056068
	ABC	2,226,731.0306	148,783.2411	2.9E+12
	WOA	0.02544	0.0017426	0.00066507
	CSO	1.2112	0.1207	4.6412
	FOA	1.7192	1.7138	1.8251E-5
F10(x)	ISSA	2.5115E-6	2.1726E-9	4.5865E-11
	SSA	3.1115E-6	8.9332E-10	5.2814E-11
	PSO	12.7892	0.85318	128.7476
	GWO	0.49511	0.044972	0.058927
	ABC	7.13E+6	861,494.8983	2.1E+13
	WOA	0.33761	0.057764	0.037903
	CSO	456.177	1.2452	5,859,909.135
	FOA	2.8666	2.8314	0.0002996
F11(x)	ISSA	0.0003076	0.00030749	8.2362E-14
	SSA	0.0003120	0.00030749	1.1009E-10
	PSO	0.0003761	0.00030749	1.5625E-8
	GWO	0.014444	0.00035003	8.4609E-5
	ABC	0.0011008	0.00097179	4.7719E-9
	WOA	0.0005307	0.00030764	4.8799E-8
	CSO	0.0007175	0.00032418	8.7768E-8
	FOA	0.0003892	0.00031135	3.0392E-8
F12(x)	ISSA	−1.0316	−1.0316	3.4003E-31
	SSA	−1.0316	−1.0316	2.6182E-31
	PSO	−1.0316	−1.0316	1.0935E-6
	GWO	−1.0316	−1.0316	1.7009E-15
	ABC	−1.0316	−1.0316	7.3744E-17
	WOA	−1.0316	−1.0316	1.5004E-17
	CSO	−1.0316	−1.0316	1.4171E-15
	FOA	−0.8853	−0.9496	0.0057484
F13(x)	ISSA	3	3	4.2068E-29
	SSA	3	3	5.9913E-29
	PSO	3	3	3.4277E-21
	GWO	3	3	1.2815E-9
	ABC	3	3	6.9683E-18
	WOA	3	3	3.178E-9
	CSO	3	3	1.4306E-8
	FOA	150.7587	84.0352	32,915.0614
F14(x)	ISSA	−3.8628	−3.8628	6.4945E-30
	SSA	−3.8628	−3.8628	6.2624E-27
	PSO	−3.8609	−3.8628	1.5917E-6
	GWO	−3.8614	−3.8628	5.7635E-6
	ABC	−3.8628	−3.8628	1.9454E-28
	WOA	−3.8594	−3.8628	3.0401E-5
	CSO	−3.8611	−3.8628	5.1263E-5
	FOA	−3.6738	−3.8033	0.043112
F15(x)	ISSA	0.39789	0.39789	0
	SSA	0.39789	0.39789	2.9391E-31
	PSO	0.39789	0.39789	4.0688E-28
	GWO	0.3985	0.39789	1.078E-5
	ABC	0.39789	0.39789	1.19536E-12
	WOA	0.39789	0.39789	8.4979E-12
	CSO	0.39789	0.39789	1.9755E-11
	FOA	21.5722	4.5802	248.406

In order to further verify the convergence speed and accuracy of ISSA, the convergence curves of different algorithms are demonstrated in Fig. 4. For the convenience of observation, the ordinate of partial convergence curve is in the form of log.

Fig. 4

Convergence curves. a F1 convergence curve b F2 convergence curve c F3 convergence curve d F4 convergence curve e F5 convergence curve f F6 convergence curve g F7 convergence curve h F8 convergence curve i F9 convergence curve j F10 convergence curve k F11 convergence curve l F12 convergence curve m F13 convergence curve n F14 convergence curve o F15 convergence curve

It can be seen from Fig. 4 that, for single-mode test function F1-F5, the convergence of ISSA is obviously better than other algorithms, and the accuracy is higher, especially in the middle and late iteration of ISSA algorithm. For multi-mode test functions F6-F10, the convergence performance of ISSA is still better, especially for the F7 test function. The convergence speed of ISSA is obviously faster than other algorithms in the early iteration. In the F10 test function, although the convergence speed of ISSA is not the fastest in the early and middle stages, the convergence accuracy in the later stage is better than other algorithms. For multi-mode test function with fixed dimension F11-F15, although there is little difference in the convergence of each algorithm, and they all converge to the optimal value in the early stage, the convergence speed of ISSA is slightly faster than other algorithms.

In the complexity test of the algorithm, five single-mode functions with the optimal value of 0 were selected for test. Within 2000 iterations, we recorded the number of iterations and running time when error of the best fitness value is less than 10−5. If the algorithm did not find a solution less than 10−5 within 2000 iterations, we recorded the running time of 2000 iterations.

From Table 5, we can see that ISSA can converge below 10−5 with the least number of iterations on the five test functions, and in general, ISSA has lower computation complexity, except F2. It can be concluded that under the same number of iterations, ISSA will spend a longer running time, but it makes up for this drawback with an excellent optimization ability.

Table 5

Complexity test results

Function	Algorithm	Number of iterations	Running time (s)
F1(x)	ISSA	3	0.037
	SSA	11	0.045
	PSO	>2000	>0.566
	GWO	69	0.059
	ABC	1390	3.925
	WOA	85	0.058
	CSO	155	0.051
	FOA	>2000	0.675
F2(x)	ISSA	22	0.066
	SSA	38	0.083
	PSO	>2000	0.574
	GWO	77	0.071
	ABC	1459	4.139
	WOA	73	0.057
	CSO	145	0.519
	FOA	>2000	>0.672
F3(x)	ISSA	11	0.061
	SSA	42	0.119
	PSO	>2000	>1.673
	GWO	338	0.354
	ABC	>2000	>7.813
	WOA	>2000	>2.015
	CSO	>2000	>2.474
	FOA	>2000	>1.705
F4(x)	ISSA	10	0.052
	SSA	72	0.127
	PSO	>2000	>0.715
	GWO	>2000	>0.969
	ABC	>2000	>5.914
	WOA	>2000	>0.829
	CSO	>2000	>1.549
	FOA	>2000	>0.822
F5(x)	ISSA	23	0.066
	SSA	42	0.087
	PSO	>2000	>0.559
	GWO	>2000	>0.848
	ABC	1358	3.881
	WOA	>2000	>0.669
	CSO	>2000	>1.369
	FOA	>2000	>0.673

From the above test results, we can draw a conclusion that the convergence speed, convergence accuracy and robustness of ISSA algorithm are superior to other seven algorithms, and it has better optimization ability.

Application to threshold image segmentation

In this section, the ISSA is applied to threshold image segmentation, the optimal threshold and image segmentation quality are compared with image segmentation results based on GEO [38], RSO [8], TSO [46], CRSSA [35], MSCA [48], HHO-PCNN [14], 2D-OTSU method [31] and 1D-Exponential entropy method [43]. The maximum number of iterations is 30, the population size is 20. The parameters to be set for algorithms are shown in Table 6.

Table 6

Parameters of the partial algorithms

Algorithms	Parameters	Value or range
GEO	Attack Propensity (Pa)	[0.5,2]
	Cruise propensity (Pc)	[1,0.5]
CRSSA	Early warning value (ST)	0.6
	Proportion of discoverers (PD)	0.7
	Proportion of vigilant sparrows (PV)	0.2
MSCA	Proportion of main groups (PM)	0.5
HHO-PCNN	Boundary range	[0.001,200]

Application to classical images

We selected three gray images, six color images and three images with different noises for experiments. The test images and their resolutions and gray histograms are shown in Fig. 5.

Fig. 5

The test images and corresponding histograms. a Lena(512 × 512) b Boat(720 × 576) c Zelda(512 × 512) d Aircraft(512 × 512) e Monkey(500 × 480) f Flower(512 × 480) g Butterfly(768 × 512) h Parrot(768 × 512) i Bear(394 × 600) j Gaussian noise(512 × 512) k Salt pepper noise(512 × 480) l Poisson noise(768 × 512)

From the results in Table 7, we can see that the proposed method is obviously superior to other methods. In twelve images, the threshold values sought by eleven images have higher entropies, which reflects the good convergence and high robustness of the ISSA-based segmentation method. Although MSCA-based segmentation method has also obtained a good threshold, on the whole, the performance of the ISSA-based segmentation method is more prominent.

Table 7

Comparison of the threshold and 2-D maximum entropy by different algorithm

Images	ISSA	GEO	RSO	TSO	CRSSA	MSCA
Lena	203.8,113.4	103.0,1.0	108.1,177.5	111.7,166.8	112.4,154.6	183.1,113.4
	13.5245	13.4806	13.5108	13.5196	13.5196	13.5245
Boat	172.9,113.5	102.4,140.3	108.1,177.5	113.4,161.2	112.8,254.5	247.9,112.9
	14.3852	14.3355	14.3666	14.3769	14.3769	14.3852
Zelda	167.6,90.3	255.0,69.5	233.6,81.5	90.0,220.6	240.0,89.7	89.6,199.9
	13.7856	13.7854	13.7757	13.7856	13.7856	13.7856
Aircraft	224.9,155.5	145.9,103.4	161.6,173.4	238.0,155.2	202.2,155.3	234.9,154.5
	14.1608	14.1494	14.1402	14.1608	14.1607	14.1608
Monkey	92.8,127.3	242.4,30.3	139.9,100.6	183.5,94.5	93.7,180.6	95.3,189.9
	15.7505	15.7405	15.7176	15.7449	15.7610	15.7610
Flower	123.2,123.3	189.8,156.8	108.1,177.5	126.8,121.9	118.3,247.2	120.4,118.5
	13.3982	13.3928	13.3889	13.3955	13.3936	13.3976
Butterfly	141.2,140.5	141.4,96.3	134.3,135.9	141.2,142.1	141.2,245.2	139.5,140.2
	14.1197	14.0986	14.0961	14.1179	14.0954	14.1190
Parrot	141.9,141.8	237.9,171.1	167.5,149.7	142.3,143.3	255.0,140.3	141.9,142.7
	13.9767	13.9426	13.9197	13.9755	13.9451	13.9755
Bear	137.2,137.2	133.2,244.7	108.1,177.5	138.0,136.7	139.2,135.2	135.5,134.8
	15.3526	15.3288	15.2805	15.3523	15.3474	15.3520
Gaussian	254.5,164.4	155.5,123.1	163.0,242.1	161.7,239.9	162.4,236.9	255.0,163.0
	17.3528	17.2974	17.3411	17.3413	17.3413	17.3528
Salt pepper	128.3,128.1	191.4,234.4	204.8,123.0	134.1,124.8	205.7,122.5	128.6,127.0
	15.1855	15.1730	15.1736	15.1806	15.1737	15.1851
Poisson	146.5,143.3	141.3,87.2	162.2,148.5	144.6,143.8	141.6,145.0	145.1,144.2
	16.7802	16.7599	16.7539	16.7792	16.7721	16.7801

Tables 8 and 9 show the PSNR and FSIM of the nine methods for twelve images. It can be seen that the threshold obtained by ISSA is used for image segmentation, although the PSNR and FSIM of some images are not ideal, the overall performance of ISSA-based segmentation is better. The segmented images are shown in Fig. 6.

Table 8

Comparison of the PSNR

Images	ISSA	GEO	RSO	TSO	CRSSA	MSCA	HHO-PCNN	2D OTSU	1D-Exponential entropy
Lena	8.6121	8.2058	8.5733	8.5890	8.3434	8.4879	5.1967	5.2056	5.2682
Boat	8.5029	8.2671	8.3332	8.4565	8.4542	8.2940	5.9079	5.9105	5.9871
Zelda	8.8047	8.4057	8.7959	8.5545	8.7099	8.4973	8.2054	8.2061	8.2918
Aircraft	11.3807	11.2832	10.7475	10.8704	10.6266	10.5807	2.8095	2.8283	2.8683
Monkey	8.9211	8.6151	8.8474	8.6235	8.9220	8.9233	7.1941	7.1913	7.2740
Flower	10.1489	9.523	10.1306	10.1436	10.0597	10.1129	6.9952	6.9961	7.0573
Butterfly	8.8844	8.7701	8.8790	8.8517	8.4690	8.8701	7.0546	7.0608	7.1038
Parrot	9.1388	8.6748	8.7554	9.1132	8.3418	9.1028	6.6706	6.6554	6.7189
Bear	10.5302	10.3558	10.5004	10.5261	10.4259	10.5097	7.5177	7.5036	7.5676
Gaussian	8.3671	8.3119	8.1361	8.2558	8.2616	8.1982	2.5837	5.0494	5.1293
Salt pepper	10.3875	8.3756	9.2679	9.5360	10.0583	10.3839	6.6713	6.6719	6.7511
Poisson	8.9017	8.7533	8.5923	8.7897	8.8071	8.8905	7.0177	6.9889	7.0656

Table 9

Comparison of the FSIM

Images	ISSA	GEO	RSO	TSO	CRSSA	MSCA	HHO-PCNN	2D-OTSU	1D-Exponential entropy
Lena	0.6276	0.6120	0.6175	0.6189	0.5953	0.6086	0.5314	0.5495	0.5484
Boat	0.5839	0.5109	0.5156	0.5248	0.5236	0.5128	0.4767	0.4710	0.4421
Zelda	0.5353	0.5225	0.5351	0.5176	0.5080	0.5184	0.5437	0.5447	0.5442
Aircraft	0.6843	0.6361	0.6579	0.6716	0.6580	0.6582	0.5095	0.5308	0.4481
Monkey	0.5526	0.5388	0.5450	0.5531	0.5574	0.5610	0.3341	0.3430	0.3342
Flower	0.6215	0.5699	0.6009	0.6088	0.5918	0.6209	0.5365	0.5477	0.5217
Butterfly	0.6518	0.6101	0.6356	0.6484	0.6475	0.6461	0.4792	0.4784	0.4562
Parrot	0.6686	0.6610	0.6638	0.6711	0.6500	0.6473	0.6185	0.6480	0.6528
Bear	0.4514	0.4129	0.4494	0.4473	0.4278	0.4301	0.3089	0.2850	0.2874
Gaussian	0.5985	0.4978	0.4838	0.4850	0.4849	0.5926	0.3379	0.3130	0.3090
Salt pepper	0.6593	0.5614	0.5603	0.5679	0.5835	0.6587	0.3179	0.3131	0.3199
Poisson	0.6071	0.5595	0.5935	0.5927	0.5911	0.6061	0.4105	0.4423	0.3812

Fig. 6

Segmented images. a Lena b Boat c Zelda d Aircraft e Monkey f Flower g Butterfly h Parrot i Bear j Gaussian noise k Salt pepper noise l Poisson noise

Application to medical images

The outbreak of COVID-19 has brought great harm to people all over the world, and countless people have lost their lives. Image segmentation is also widely used in the medical field. For medical images, how to segment accurately is particularly important [3]. For lung CT images, the primary task of image segmentation is to segment the lung organs and nodules in the lung, which can enable doctors to judge the situation of the lung more accurately and prevent wrong judgment caused by blurred images [2]. Therefore, we used five lung CT images of COVID-19 patients to verify the effectiveness of the proposed method. The CT images, as well as the corresponding resolution and gray histogram are shown in Fig. 7 [2].

Fig. 7

Lung CT images and corresponding histograms. a Lung 1(725 × 551) b Lung 2(570 × 436) c Lung 3(563 × 437) d Lung 4(556 × 398) e Lung 5(457 × 285)

Tables 10, 11, 12 show a comparison of the thresholds, optimal entropy, PSNR and FSIM of different methods for five lung images. It is noted from the tables that other algorithms can find the threshold corresponding to the maximum entropy, but the effect of segmentation using these obtained threshold is not very ideal. Since ISSA can not only find the threshold of maximum entropy, but also the segmented images based on the found threshold have larger PSNR and FSIM.

Table 10

Comparison of the threshold and 2-D maximum entropy

Images	ISSA	GEO	RSO	TSO	CRSSA	MSCA
Lung1	108.1,177.5	108.4,54.6	108.1,114.2	108.2,141.5	108.1,247.4	108.1,244.8
	11.5342	11.5342	11.5267	11.5341	11.5342	11.5342
Lung2	108.2,202.5	106.2,134.6	108.1,177.5	112.3,184.8	108.1,247.4	107.8,228.4
	12.6203	12.6202	12.6203	12.6202	12.6203	12.6202
Lung3	205.9,165.6	165.2,48.1	244.2,167.5	186.4,165.8	164.6,250.4	253.2,165.9
	13.9072	13.9028	13.9068	13.9070	13.9028	13.9065
Lung4	131.1,173.9	172.4,96.4	108.1,177.5	215.1,129.0	131.4,254.5	131.3,181.2
	10.8967	10.8966	10.8935	10.8967	10.8967	10.8967
Lung5	22.5,114.5	49.3,86.7	23.9,101.7	50.9,85.8	47.6,105.9	22.7,146.8
	11.1086	11.0683	11.0485	11.0365	11.0686	11.1084

Table 11

Comparison of the PSNR

Images	ISSA	GEO	RSO	TSO	CRSSA	MSCA	HHO-PCNN	2D-OTSU	1D-Exponential entropy
Lung1	13.6623	13.3973	13.5342	13.6315	12.8215	11.8053	2.3953	2.3994	2.4437
Lung2	16..0535	16.0065	15.1025	16.0093	15.1347	14.7924	2.3581	2.3636	2.4053
Lung3	11.7959	11.0640	10.2886	10.4384	11.0714	11.0640	3.8973	3.9088	3.9530
Lung4	16.9460	16.4824	16.2028	16.6810	16.8129	16.5475	2.9154	2.9218	2.9604
Lung5	14.1732	13.0654	13.7156	13.1242	13.8251	14.1640	3.5104	3.5112	3.5615

Table 12

Comparison of the FSIM

Images	ISSA	GEO	RSO	TSO	CRSSA	MSCA	HHO-PCNN	2D-OTSU	1D-Exponential entropy
Lung1	0.6994	0.6682	0.6711	0.6808	0.7148	0.6929	0.5628	0.5655	0.5793
Lung2	0.7064	0.7044	0.6968	0.6967	0.7053	0.7021	0.4855	0.4883	0.4682
Lung3	0.5949	0.5351	0.5324	0.4929	0.5332	0.5351	0.4118	0.4305	0.4065
Lung4	0.7309	0.7191	0.7084	0.7244	0.7279	0.7208	0.5291	0.5315	0.5295
Lung5	0.6835	0.6118	0.6423	0.6395	0.6484	0.6798	0.5067	0.5142	0.5155

Figure 8 shows the segmented images obtained by ISSA method. It can be seen from Fig. 8 that the lung organs are completely segmented, and the nodules and diseased tissues in the lung are clearly distinguished, which plays a certain role in the diagnosis of COVID-19 patients.

Fig. 8

Lung CT segmentation images. a Lung 1 b Lung 2 c Lung 3 d Lung 4 e Lung 5

Conclusion

This paper proposes an ISSA by combining the nonlinear inertia weight and Levy flight and applies the ISSA to threshold image segmentation based on 2-D maximum entropy. The experimental results deliver several conclusions. First, compared with other algorithms, ISSA has faster convergence speed, more accurate convergence results and stronger robustness. Second, Through the threshold obtained by ISSA optimization for classical images segmentation, the maximum entropy is obtained, and higher PSNR and FSIM are achieved. The quality of segmented images is better. Third, the segmentation results for lung CT images show that in medical application, ISSA can still obtain better performance, including higher PSNR and FSIM. The nodules and diseased tissues on lung organs can be clearly segmented.

Tables 13 and 14 list algorithms that obtained the highest PSNR and FSIM in experiments, and record number of times to obtain the optimal values when segmented different images. The statistical results show the ISSA performs better in image segmentation of different types of images. Since in most tests, PSNR and FSIM obtained using ISSA method are the best.

Table 13

Number of times to get the highest PSNR

Methods	3 gray images	6 color images	3 noise images	5 medical images
ISSA	3	5	3	5
MSCA	0	1	0	0

Table 14

Number of times to get the highest FSIM

Methods	3 gray images	6 color images	3 noise images	5 medical images
ISSA	2	4	3	4
TSO	0	1	0	0
CRSSA	0	0	0	1
MSCA	0	1	0	0
2D-OTSU	1	0	0	0

The experiment results confirm the effectiveness of the proposed method, but there are some drawbacks. The running time of the ISSA increases compared with SSA, and in test function F7, ISSA cannot converge to the global optimal 0.

Image segmentation remains one of the main issues in image processing, this study deserves further methodological, algorithmic and numerical investigations. And as a newly proposed swarm intelligence optimization algorithm, the SSA has strong robustness, fast convergence speed, and can be applied to optimization problems in other areas, so it has great research significance. In future work, we will continue to focus on improvement of swarm intelligence optimization algorithm, and combine with deep learning method to solve image processing problems.