Abstract
Image segmentation plays an important part of image processing, and is also the premise and basis of image analysis and image understanding and recognition. Among the level set based methods, the original Local Binary Fitting (LBF) algorithm is a successful deterministic algorithm that suffers from sensitization to size of the local minimum, image contours, shapes, and initial positions. Among them, Level Set method promotes the two-dimensional problem to the three-dimensional one and then solves it using implicit method to express closed curve of plane. In this article, a novel Level Set model aided by PSO was proposed to solve automated medical image segmentation. The experimental result of segmentations on the benchmark shows that our proposed method is effective to both simple and complex medical images.
Highlights
- The Gaussian filtering is used to smooth the level set rather than the penalty term
- As the import of the Lévy Flights, the noise disturbance is greatly reduced.
- The proposed algorithm could reach high SPM, i.e., achieve desired initialization insensitive segmentation performance for both simple and complex medical images.
1. Introduction
Image segmentation plays an important part of image processing, and is also the premise and basis of image analysis and image understanding and recognition. As the split structure is surrounded by other ones with similar structural strength, many existing classic segmentation techniques [1] (multi-threshold technology, regional growth and morphological filtering, etc.) just get general effect of segmentation.
Among them, Level Set method [2] promotes the development of the initiative geometric active contour model greatly as the mainstream direction of the methods based on energy functional theory. However, there are also some problems and/or shortcomings: for example, it requires the whole updates for the level set function values of all points of the entire image in the topology changes of adaptive evolution curve, which consume a lot of calculation; numerical convolution and partial differential equations also spend abundant computing time. Therefore, the overall efficiency of level set method is not high and difficult to be applied into practical applications. Especially, some level set methods, such as LBF method [3, 4], are sensitive to size of the local image contours, shapes, and initial positions. In addition, the most current level set models are usually non-convex energy functionals, whose solutions are the local minima rather than global ones. So it is difficult to achieve the desired segmentation results, but also affects the effectiveness of the algorithm.
In recent years, with the search ability, fast convergence speed and other characteristics, particle swarm optimization has been becoming the in-fact standard optimization algorithm. One important stream of research on particle swarm itself includes multi-population co-evolution, space partition and contraction. One most common and effective type is the cooperative particle swarm algorithm (Cooperarive PSO, CPSO) proposed by Fans Van den Bergh [5], which starts at the partition on the dimension of the particles of standard particle swarm optimization, and lets the multiple groups optimize respectively, and then calculates the fitness totally and updates by rules. In our previous work [6, 7], we developed an algorithm combining the Lévy flights and dynamic areas and then applied it in the realistic problems.
The current study shows that the particle swarm optimization has not been deeply embedded in the level set method as an organic integrity. It is possible to use PSO to replace some unnecessary convolution operations and take the advantages of strong searching capability and fast convergence speed. Moreover, most research also not combine the regularization model into it and promote the global performance. On the other side, the image segmentation algorithm based on level set is essentially an optimization problem, which minimizing the energy functional. Hence, the variational level set model of energy functional minimization problem could be formalized into meta-heuristic optimization problem, and by using the particle swarm optimization method and level set competitive image segmentation method. In this article, we embed the particle swarm optimization into the LBF model and algorithm to implement the inner optimization operation and test it on the medical image segmentation.
2. Review of LBF algorithm
2.1. The classic LBF algorithm
In LBF, the complete curve evolution equation is as follows:
where and are defined as follows:
Heaviside function is approximated by a smooth function which is defined by the following formula:
The fitting functions and will be updated according to the following equations:
where is a positive constant which is often set to 1.0 to equal to the fixed space steps is the Dirac function and the corresponding derivative of could be the smoothed Dirac function with the below form:
The main procedure of classic LBF can be summarized as following Algorithm 1 (Table 1). Firstly, the initial level set function is simply defined as a binary function:
where is a constant and is an arbitrarily given subset in the image domain.
Table 1Algorithm 1
Algorithm 1. The pseudo-code of LBF Initialization: Read the input image . Build the initial level set function . Initialize the iteration number . Scale parameter in Gaussian kernel. Repeat: Compute Heaviside function according to Eq. (3); Compute Dirac function according to Eq. (5); Compute according to Eq. (2); Update the value of and using Eq. (4); Update the level set function as according to Eq. (1); Until ; Output the segmentation result . |
3. Our proposed algorithms
3.1. CQPSO-LF algorithm
Based on our previous work in [6, 7], we have presented the proposed CQPSO-LF algorithm in steps in Algorithm 2 (Table 2).
Table 2Algorithm 2
Algorithm 2. The pseudo-code of CQPSO-LF Initialization: Generate the positions randomly. Repeat SubSwarm Evaluation: Evaluate the fitness values of particles in sub-swarms according to the fitness function, and get , , and . SubSwarm Disturbance: Obtain the values , , by Lévy flights disturbance. Overall Evaluation: Elect the compositional global best position . Overall Disturbance: Obtain the by Lévy flights disturbance. Update Position: Renovate the positions of particles . Until iteration > TH. |
3.2. CQPSO-LF aided LBF algorithm (LBF-CQPSO-LF)
The original LBF algorithm is a deterministic algorithm that is also sensitive to size of the local image contours, shapes, and initial positions. In light of this shortcoming of the algorithm, we propose a new hybrid model in this article to utilize a population based swarm intelligence algorithm to select the good candidate contours with the global minimum of the fitting energy functional. Meanwhile, the level set method is also used to evolve the candidate contours and also get the cost function. During the iterations, the initial seeds are elected by the CQPSO-LF algorithm to achieve the best performance segmentation of the image. The whole framework of the CQPSO-LF aided LBF Algorithm (LBF-CQPSO-LF) is described in the Algorithm 3 (Table 3).
4. Experimental results and analysis
The aim of the experiment is to evaluate the effectiveness of LBF-CQPSO-LF method. At first, we choose one simple blood vessel image to test the validity of the method. The 3D landscape of the blood vessel image is shown in Fig. 1. As shown in Fig. 2, the method could not only segment out the desired objects increasingly, but also is stable to initial contours. Meanwhile, the preprocessing of the image is considered to make the level set regularized as much as possible. To achieve this purpose, we use the Gaussian filtering process to smooth the level set rather than the penalty term proposed by Li et al. [3, 4], which has been verified as a good substitute in literature [10, 11].
Table 3Algorithm 3
Algorithm 3. The pseudo-code of LBF-CQPSO-LF Initialization: Read the input image . Build the initial level set function . Initialize the iteration number . Scale parameter in Gaussian kernel. While iteration < TH For 1 to Compute Heaviside function according to Eq. (3); Compute Dirac function according to Eq. (5); Compute according to Eq. (2); Upate the value of and using Eq. (4); Upate the level set function as according to Eq. (1); Until; Output the segmentation result . End For For1 to SubSwarm Evaluation: Evaluate the fitness values of particles in sub-swarms according to the fitness function, and get , , and . SubSwarm Disturbance: Obtain the values , , by Lévy flights disturbance. Overall Evaluation: Elect the compositional global best position . Overall Disturbance: Obtain the by Lévy flights disturbance. Update Position: Renovate the positions of particles . End For End While |
Fig. 13D landscape of the blood vessel image
In the sequent experiment, we utilized the LBF-CQPSO-LF in the real application scenario, i.e., an endocrine system medical image. To show the details explicitly, we transformed the image into pseudo-color in the view of Matlab. The initial contour and ones in the iterations are as shown in Fig. 3. The initial rectangular region is fixed in the center of the image, which is not sensitive to the final result any more. Due to the stochastic characteristic of this algorithm, some targets with weak boundaries could be well identified at Fig. 3(b-d).
The final segmentation results of endocrine system medical image after post-processing can be found in Fig. 4(a, b). Totally, the proposed algorithm can avoid the trapping in the local minima when the energy functional evolves. Moreover, as the import of the Lévy Flights, the noise disturbance is greatly reduced. Especially, after removing trivial edges, the refined segmentation can be seen in the Fig. 4(b) with the integrated and clean topological structures, which could be the input of the further analysis.
Fig. 2Iterations of segmentation of blood vessel image
Fig. 3Iterations of segmentation of endocrine system medical image
a)
b)
c)
d)
Fig. 4Final segmentation results of endocrine system medical image
a)
b)
Table 4Performance of LBF-CQPSO-LF
Test run | Iterations No. | SPM (%) | Time taken (s) | ||
Blood vessel | Endocrine system | Blood vessel | Endocrine system | ||
1 | 250 | 99.2579 | 97.3581 | 186.51 | 347.26 |
2 | 200 | 99.1547 | 98.156 | 157.03 | 291.08 |
3 | 300 | 99.3768 | 98.8245 | 201.65 | 414.73 |
4 | 150 | 98.6287 | 97.0689 | 86.49 | 156.4 |
To evaluate the performance of proposed algorithm, LBF-CQPSO-LF, we adopted an index called Segmentation Performance Measure (SPM) imported in literature [12] as an benchmark, where the Automatically Segmented Image (ASI) is used to compare with the Manually Segmented Image (MSI) to calculate the similarity by Eq. (7). Table 4 presents the quantitative segmentation performance of blood vessel and endocrine system sample images by SPM and running time. It can be seen that the proposed algorithm could reach high SPM, i.e., achieve desired initialization insensitive segmentation performance for both simple and complex medical images:
5. Conclusions
In this article, a novel level set model aided by PSO was proposed to solve automated medical image segmentation. In our algorithm, the variational level set model of energy functional minimization problem has been formalized into the meta-heuristic optimization problem. Hence, we embed the particle swarm optimization with Lévy flights into the classic LBF to implement the inner optimization operation in order to accelerate convergence. According to the state of art, our method is novel and unique in this research field of world. The experimental result of segmentations on the benchmark shows that our proposed method is effective to both simple and complex medical images. As our future studies, we will investigate how to expand this method to the three-dimension case and consider multi-phase level sets circumstance. Moreover, as the limitation of slow convergence, we aim to promote the rate of convergence according to some approximate methods. Additionally, we will also explore more effective models to evolution of the level set curves of medical images according to their characteristics.
References
-
Gonzalez C. R., Woods R. E. Digital Image Processing. Prentice Hall, 2001.
-
Li C., Xu C., Gui C., Fox M. D. Level set evolution without re-initialization: a new variational formulation. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005.
-
Li C., Kao C., Gore J., Ding Z. Implicit active contours driven by local binary fitting energy. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2007.
-
Li C., Kao C., Gore J. C., Ding Z. Minimization of region-scalable fitting energy for image segmentation. IEEE Transaction on Image Process, Vol. 17, Issue 10, 2008, p. 1940-1949.
-
Bergh F. V. D. A Cooperative approach to particle swarm optimization. IEEE Transaction on Evolutionary Computation, Vol. 8, Issue 3, 2004, p. 225-239.
-
Li D., He Q., Chen Y. Velocity control of longitudinal vibration ultrasonic motor using improved Elman neural network trained by CQPSO with Lévy flights. Journal of Vibroengineering, Vol. 16, Issue 2, 2014, p. 735-747.
-
Li D. Cooperative quantum-behaved particle swarm optimization with dynamic varying search areas and Lévy flight disturbance. The Scientific World Journal, Vol. 2014, 2014, p. 370691.
-
Coelho L. D. S. Novel Gaussian quantum-behaved particle swarm optimiser applied to electromagnetic design. IET Science, Measurement and Technology, Vol. 1, Issue 5, 2007, p. 290-294.
-
Liu J., Sun J., Xu W. B. Design IIR digital filters using quantum-behaved particle swarm optimization. Advances in Natural Computation, Lecture Notes in Computer Science, Springer, Berlin, Heidelberg, Vol. 4222, 2006, p. 637-640.
-
Zhang K. H., Song H. H., Zhang L. Active contours driven by local image fitting energy. Pattern Recognition, Vol. 4, Issue 43, 2010, p. 1199-1206.
-
Liu S., Peng Y. A local region-based Chan-Vese model for image segmentation. Pattern Recognition, Vol. 45, 2012, p. 2769-2779.
-
Mandal D., Chatterjee A., Maitra M. Robust medical image segmentation using particle swarm optimization aided level set based global fitting energy active contour approach. Engineering Applications of Artificial Intelligence, Vol. 35, Issue 2, 2014, p. 199-214.
Cited by
About this article
This research was supported by Natural Science Foundation of Anhui Province under Grant 1708085MF161, in part by Key Project of Natural Science Research of Universities in Anhui under Grant KJ2015A236, Philosophical and Social Sciences Research Project of Hubei Education Department under Grant 19Q054, and Research Foundation for Advanced Talents of the Hubei University of Technology under Grant BSQD12131.