- Research article
- Open Access
- Open Peer Review
Modification of the mean-square error principle to double the convergence speed of a special case of Hopfield neural network used to segment pathological liver color images
© Sammouda and Sammouda; licensee BioMed Central Ltd. 2004
- Received: 14 March 2004
- Accepted: 12 December 2004
- Published: 12 December 2004
This paper analyzes the effect of the mean-square error principle on the optimization process using a Special Case of Hopfield Neural Network (SCHNN).
The segmentation of multidimensional medical and colour images can be formulated as an energy function composed of two terms: the sum of squared errors, and a noise term used to avoid the network to be stacked in early local minimum points of the energy landscape.
Here, we show that the sum of weighted error, higher than simple squared error, leads the SCHNN classifier to reach faster a local minimum closer to the global minimum with the assurance of acceptable segmentation results.
The proposed segmentation method is used to segment 20 pathological liver colour images, and is shown to be efficient and very effective to be implemented for use in clinics.
- Energy Function
- Segmentation Result
- Random Initialization
- Segmentation Problem
- Hopfield Neural Network
Segmentation is an important step in most applications that use medical image data. For example, segmentation is a prerequisite for quantification of morphological disease manifestations and for radiation treatment planning [1, 2], for construction of anatomical models , for definitions of flight paths in virtual endoscopies , for content-based retrieval by structure , and for volume visualization of individual objects .
A Number of algorithms based on approaches such as histogram analysis, regional growth, edge detection and pixel classification have been proposed in other articles of medical image segmentation. In recent years, Artificial Neural Networks (ANNs) have been proposed as an attractive alternative solution to a number of pattern recognition problems. In our previous works , we have explored the potential of a Special Case of Hopfield Neural Network (SCHNN) in segmenting cerebral images obtained using the Magnetic Resonance Imaging (MRI) technique.
Hopfield network for the optimization applications consists of many interconnected neuron elements. The network minimizes an energy function of the form:
where N is the number of neurons, V k is the output of the k th neuron, I k is the bias term, and T kl is the interconnection weight between the k th and l th neurons. The energy function used in the segmentation problem is slightly different from the one defined by Hopfield and the arguments are given in .
The results that have been obtained in  were preferable to those obtained using Boltzmann Machine (BM) and the conventional ISODATA clustering technique. Also, in  we have shown that SCHNN is also able to make crisp segmentation of pathological liver colour images. However, during our study attempt to improve the segmentation process, we found that SCHNN segmentation results depend strongly on some parameters in the energy function formulating the classification problem. A summery of this study follows.
The segmentation problem of an image of N pixels is formulated in  as a partition of the N pixels among M classes, such that the assignment of the pixels minimizes a criterion function. The SCHNN classifier structure consists of a grid of N × M neurons with each row representing a pixel and each column representing a cluster. The network classifies the image of N pixels of P features among M classes, in a way that the assignment of the pixels minimizes the following criterion function:
where R kl is the Mahalanobis distance measure between the k th pixel and the centroid of class l, R kl is also equivalent to the error committed when a pixel k is assigned to a class l. The index n in is the power or weight of the considered error in the energy function of the segmentation problem, and V kl is the output of the kl th neuron. N kl is a N × M vector of independent high frequency white noise source used to avoid the network being trapped in early local minimums. The term c(t) is a parameter controlling the magnitude of noise which is selected in a way to provide zero as the network reaches convergence. The minimization is achieved by using SCHNN and by solving the motion equations satisfying:
where U kl is the input of the k th neuron, and μ(t) is a scalar positive function of time, used as heuristically motivated stopping criterion of SCHNN, and is defined as in  by:
β(t) = t(T s - t) (4)
where t is the iteration step, and T s is the pre-specified convergence time of the network which has been found to be 120 iterations . The network classifies the feature space, without teacher, based on the compactness of each cluster calculated using Mahalanobis distance measure between the k th pixel and the centroid of class l given by:
where X k is the P-dimensional feature vector of the k th pixel (here P = 3 with respect to the RGB color space components), is the P-dimensional centroid vector of class l, and Σ l is the covariance matrix of class l. The segmentation algorithm is described as follows .
Step 1 Initialize the input of the neurons to random values.
Step 2 Apply the following input-output relation, establishing the assignment of each pixel to only and only one class.
Step 3 Compute the centroid and the covariance matrix Σ l of each class l as follows:
where n l is the number of pixels in class l, and the covariance matrix is then normalized by dividing each of its elements by .
Step 4 Update the inputs of each neuron by solving the set of differential equations in (2) using Eulers approximation:
Step 5 if t <T s , repeats from Step 2, else terminated.
In order to study the effect of the weight of the Mahalanobis distance R kl in the cost function (2), we have provided a simple modification to the above algorithm as follows:
Step 1 Use the same random initialization N × M matrix, as input of the neurons, when minimizing the energy function (1) with different error's weight n.
This condition is added to the algorithm in order to make sure that the random field does not have any effect on the generated results.
Step 2 trough Step 5 remain the same.
Analysis of the pre-specified convergence time effect
Analysis of the SCHNN random initialization effect
We analyzed the effect of considering the mean-square error in formulating the segmentation problem of multidimensional medical images. We have shown, empirically, that considering an integer power equal to six, of the error in the energy function of the problem, helped SCHNN to converge twice as fast as the same optimal solution obtained with the mean-square error algorithm. This result is promising to make our segmentation method useful for a Computer Aided Diagnosis (CAD) system for liver cancer and the like. In our future work, we will study deeply the effect of the random initialization and its effect on the segmentation result and on the SCHNN classifier.
The authors want to thank the Research Center at the University of Sharjah for supporting this work. Also the authors thank Dr. Maher Moussa in the English Department of the University of Sharjah for editing this paper.
- Chaney E, Pizer S: Defining anatomical structures from medical images. Semin Radiat Oncol. 1992, 2: 215-225.View ArticlePubMedGoogle Scholar
- Tracton G, Chaney E, Rosenman J, Pizer S: Mask: Combining 2-D and 3-D segmentation methods to enhance functionality. SPIE Conf Medical Imaging Bellingham, WA. 1994, 98-109.Google Scholar
- Brinkley JF: A flexible, generic model for anatomic shape: Application to intyeractive two-dimensional medical image segmentation and matching. Computer Biomed Res. 1993, 26 (2): 121-142. 10.1006/cbmr.1993.1008.View ArticleGoogle Scholar
- Lorensen W, Ferenc A, Kikinis R: The exploration of cross-sectional data with a virtual endoscope. Interactive Technology and the New Paradigm for Health Care, Japan. 1995, IOS Press, 221-230.Google Scholar
- Orphanoudakis SC, Chronaki C, Kostomanolakis S: I/Sup 2/C: A system for the indexing, storage, and retrieval of medical images by content. Med Inform. 1994, 19: 109-122.View ArticleGoogle Scholar
- Sammouda R, Niki N, Nishitani H: A Comparison of Hopfield Neural Network and Boltzmann Machine in Segmenting MR Images of the Brain. IEEE Transactions on Nuclear Science. 1996, 43 (6): 3361-3368. 10.1109/23.552753.View ArticleGoogle Scholar
- Amartur SC, Piraino D, Takefuji Y: "Optimization neural networks for the segmentation of magnetic resonance images,". IEEE Transactions on Medical Imaging. 1992, 11 (2):Google Scholar
- Sammouda M, Sammouda R, Niki N: Liver cancer detection system based on the analysis of digitized color images of tissue samples obtained using needle biopsy. International Journal of Information Visualization. 2002, Pagrave Press, 1 (2): 130-138. 10.1057/palgrave.ivs.9500012.Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6947/4/22/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.