- Research article
- Open Access
- Open Peer Review
Quantitative evaluation of binary digital region asymmetry with application to skin lesion detection
BMC Medical Informatics and Decision Makingvolume 18, Article number: 50 (2018)
The performance of Computer Aided Diagnosis Systems for early melanoma detection relies mainly on quantitative evaluation of the geometric features corresponding to skin lesions. In these systems, diagnosis is carried out by analyzing four geometric characteristics: asymmetry (A), border (B), color (C) and dimension (D). The main objective of this study is to establish an algorithm for the measurement of asymmetry in biological entities.
Binary digital images corresponding to lesions are divided into 8 segments from their centroid. For each segment, the discrete compactness value is calculated using Normalized E-Factor (NEF). The asymmetry value is obtained from the sum of the square difference of each NEF value and corresponding value of its opposite by the vertex. Two public skin cancer databases were used. 1) Lee’s database with 40 digital regions evaluated by fourteen dermatologists. 2) The PH2 database which consists of 200 images in an 8-bit RGB format. This database provides a pre-classification of asymmetry carried out by experts, and it also indicates if the lesion is a melanoma.
The measure was applied using two skin lesion image databases. 1) In Lee’s database, Spearman test provided a value of 0.82 between diagnosis of dermatologists and asymmetry values. For the 12 binary images most likely to be melanoma, the correlation between the measurement and dermatologists was 0.98. 2) In the PH2 database a label is provided for each binary image where the type of asymmetry is indicated. Class 0–1 corresponds to symmetry and one axis of symmetry shapes, the completely asymmetrical were assigned to Class 2, the values of sensitivity and specificity were 59.62 and 85.8% respectively between the asymmetry measured by a group of dermatologists and the proposed algorithm.
Simple image digital features such as compactness can be used to quantify the asymmetry of a skin lesion using its digital binary image representation. This measure is stable taking into account translations, rotations, scale changes and can be applied to non-convex regions, including areas with holes.
A Computer Aided Diagnosis System (CADS) requires a priori information to improve its analytical process and performance in the diagnosis of a variety of diseases. This leads to better decision making and improved patient care.
One of the main components of many CADS is the quantification of the asymmetrical shape of the biological entity under study. The measured degree of asymmetry is very important in several areas of medical biology, where the variation in the morphology of a biological entity can be related to the presence of a pathology. For example, Karnan and Thangavel  used geometric asymmetry to detect microcalcifications in breast cancer. Additionally, in the area of jaw correction, asymmetry is used to measure the progress of orthodontic treatment , while Ercan measured young people’s health using the asymmetry of their faces .
The quantitative evaluation of this feature is crucial in dermatology, in which the CAD system is used as the highest criterion for diagnosing a malignant lesion . There are different approaches for measuring the asymmetry of biological entities, the most common being the approach that computes the asymmetry over a binary digital image. All approaches are based on first locating the digital region centroid, and then calculating the major axis of that region.
It is common that the shape appears rotated on the major axis angle, with the major axis fixed horizontally, the minor axis bisecting the major axis , and the digital region divided into four sections.
An algorithm was used to calculate the computational load required to transform an irregular polygon to a regular polygon, asymmetry to symmetry transformation was used as an asymmetry parameter. However, as the algorithm relies on image resolution, it is not invariant to scale transformations.
Several authors [6,7,8] define asymmetry measurement where asymmetry is evaluated by using the difference in area among N sub-regions. These are obtained from a digital region variance of M segments. The main drawback of these methods is their dependence of the resolution related to digital region.
In the Stoecker’s proposal  shape was shifted so that x and y coordinates of the image coincide with the centroid of image, then the shape is rotated to align with centroidal principal axes. Finally, the shape was divided in four sub-regions, rotation angle of digital region. The asymmetry value is given by subtracting shape area on one side of the axis from the reflected shape which results in two area differences,
where ∆A min is the lowest absolute value difference between subregions and A total is the area of shape. A similar method is presented in , in which major and minor axes are used to generate eight sub-regions to extract three shape descriptors: perimeter, area and classic compactness or thinness ratio.
Following the procedure described above, a set of 24 features is used to create a description vector of the digital region. Each feature is calculated by Eq. 2:
where R i is ratio of features and Q i is vector feature in quadrant i.
In  a color image rotation of a skin lesion on the major axis and grid is superimposed onto the color image, producing a new image; however, each new pixel or cell contains the mean value of the pixel found inside in the area of the cell grid. The distance between opposite cells on the border and the major axis is then calculated, while the sum of the difference between these distances is used as an asymmetry measurement.
In contrast, Santiago-Montero  avoids the pro-cess of finding the major axis and rotating the digital region, instead using the centroid position to segment the digital region into four sectors and then calculating a compactness value, which is expressed by using perimeter ratios.
The combinatorial sum of the quadratic differences of these four values is used to measure asymmetry. Other studies have focused on finding the best axes of asymmetry that could be used to obtain a better subdivision of the digital region [8, 13, 14].
For instance, Clawson et al.  performed a transformation of the digital region to frequency domain and applied the Fourier transform to calculate the major axis in the space domain. Cudek exhaustively searched and tested all possible axes at intervals of 1, 2 and 4 degrees [13, 14]. The digital region is classified into three possible categories according to the clinical criteria for regions with 1, 2 or 0 asymmetry axes.
Liu et al.  use a color image to produce a 3D intensity map, while the region asymmetry is deter-mined by the qualitative evaluation of the regularity of a 3D surface. Ma et al.  undertake a digital region transformation by using a function called Relative Radial Distance. In this representation, the axes are obtained to subdivide the region into four sectors, after which, the fractal relationship is used to calculate the differences between them.
It should be noted that, with the exception of [11, 15], color is the main variable used to calculate asymmetry. In general, the reported approaches work with the binary representation of the skin lesion contained in a digital region, obtained without the complete automatic process used in many approaches. In addition, several papers do not explain the process of generating binary image databases, such as Lee and PH2 database [17, 18], in that studied the binary representation of the skin lesion was usually hand made. This way to process the segmentation of skin lesion generates smoothing borders, and the regions are adjusted to a convex region. These drawbacks are the causes different measurements would not to work correctly.
On the other hand, several CAD systems use the Total Dermatoscopic Value (TDV) to calculate whether or not a skin lesion is a melanoma, in which the evaluation of the asymmetry of a binary digital region plays a major role. The most common expression of TVD is given by:
where the asymmetry, A, is more important than the border (B), color (C) and dimension(D) .
This study presents a digital topology-based approach which is used to obtain a quantitative value for the asymmetry of the binary digital regions. This method confirms that a robust description of the asymmetry can be generated using only the eight subdivisions generated by the eight adjacencies. A simple shape descriptor for region compactness is used to both show the above and illustrate how the method is able to measure the degree of asymmetry. This study applied this approach to two sets of skin lesions in the interest of showing how it can be used, The first group is a recurrent binary shape  for which no diagnosis has been made. The second is a set of color images of classified as skin lesions . The experiments show a good correlation both with the prognoses made by a group of dermatologists in the first database, and with a statistical percentage of classification obtained by a second group; in addition, matches the measurements reported in the literature [19, 20].
The quantitative measurement of the geometric property known as asymmetry is very similar to that classically used for symmetry. Hence, the first step is to define symmetry in the continuous space, which will be used as the initial point to describe asymmetry in this study.
Taking A and B as two sections of a region C, p and q as two points where p belongs to A and q belongs to B. it can be said that both points are symmetric if, under a mirror transformation relative to one point or plane inside C, both points have the same position. If the overall points of both partitions satisfy the same condition, it can be said that A and B are symmetric and C has a symmetry plane . In the continuous space, a region can have zero, one or several symmetric planes, i.e. a circle. Nevertheless, if a point in the partition does not meet the symmetry condition, it can be said that A and B are asymmetrical.
However, in the digital space, the regions are composed of a set of regular polygons called pixels. There are only three regular polygons that can be used to cover the space: square, hexagon or triangle. Due to technical requirements, the most commonly used polygon is square. Because of the nature of the type of polygon used and according to the definition of symmetry, only rectangular regions can be symmetrical in this space.
The approach used in this research to measure asymmetry begins with the knowledge of the shape, as a digital binary region, which will theoretically be asymmetric. By adhering to the latter condition, the process for finding the major axis is avoided, because the region must be convex and many biological entities do not fulfill this requirement. Nevertheless, if the major axis is found and the digital region is rotated, this would generate small modification in its structure.
This section presents the process for calculating asymmetry, comprising, firstly, the application of one of two methods for calculating the centroid of a digital region either Hu moments or the mean position of the pixels .
In some cases, it is necessary to find the angle of the major axis, for which the use of Hu moments is recommended; however, the mean pixel position is adequate for this study. The centroid position can be found using Eqs. 4 and 5.
where r and c are the mean row and column in region R respectively, A represents the area of the shape.
It should be noted that digital binary images follow the rules of digital topology, which state that a set of discrete elements can create a digital region .
The element used by the proposed topology is known as connectivity, and is the rule that determines the existence of a region. In the digital space, there are two kinds of connectivity, known as eight and four connectivity. The method proposed in this study uses eight connectivity, which states that, from one position, there are only eight possible directions. Thus, for the objectives of this study, only four axes are possible. Figure 1 shows both connectivity cases, specifically the axes set used for measuring the asymmetry. These four axes are used in the process of segmenting the digital region, in which eight segments or sub-regions are generated. Figure 2 shows the result of this process when it is applied to the digital binary region of a malignant skin lesion. Each sub-region is evaluated in order to produce a compactness value using the Normalised E-Factor (NEF) of Santiago-Montero et al. .
Identifying the most compact shape in the digital space, NEF is a shape descriptor that uses the information contained in the border of the digital region, applying a perimeter ratio with a square and the same area. This descriptor is robust to scale, rotation and translation transformation .
where P is the digital region perimeter and n is its area.
Once the compactness values are obtained, these are applied to Eq. 7 with the objective of producing the asymmetry value (Asymmetry_NEF).
The asymmetry value is 0.2499 for the region of Fig. 2.
where NEF Ri is NEF value in region i.
Figure 3 shows that the asymmetric value decreases asymptotically as the resolution increases in geometric forms, such as squares and circles. Fig. 4a shows that these digital forms have a low degree of asymmetry.
Asymmetry measurements show their robustness to resolution variations when tested with an irregular melanoma shape (Fig. 4b). This Figure shows that, in the case of digital regions with a low pixel number, the perimeter contribution made by each pixel is significant.
Figure 5 shows the behavior of the asymmetry values obtained from a malignant skin lesion at different resolutions.
The second experiment applied on the images in Fig. 6 shows how asymmetry increases and then decreases, a result which provides evidence of a correlation between measurements and the concept of asymmetry. Table 2 shows the test set for the second experiment with its asymmetric values. The experiment was repeated, but with the set of regions that have an irregular border, as shown in Fig. 7. Table 3 shows the set of regions and the asymmetry values obtained by the measurement used in this research, the results of which, once again, show a correspondence with asymmetry shape perception.
This section reports the results obtained for the proposed method using two skin lesion image databases.
Test 1: A set of 40 digital regions of skin lesions was used as an initial benchmark. This set has become a reference point in the literature on melanoma evaluation because it had been previously evaluated qualitatively by 14 dermatologists using only the appearance of the shape of the lesion . Forty regions were ranked using the proposed asymmetry value; with these ranked values then tested with the average clinical evaluations using the Spearman coefficient obtaining a result of 0.82 (p < 0.001). However, the correlation was of 0.98 (p < 0.001) for the 12 regions which implies a higher risk of developing melanoma. The set for these regions is shown in Fig. 8, and their asymmetry values are plotted in Fig. 9.
Table 4 shows the Spearman correlation coefficients and the p-value of the asymmetry values obtained with the proposed method as compared to the assessments of the 14 dermatologists for both sets of images. In addition, the asymmetric value correlation statistics proposed by Golston et al.  (Irrigularity index), Smaoui et al. , (Asymmetry index), Cudek et al.  (SFA) and Stoecker et al.  (Asymmetry_Ref) are presented. Furthermore, with the objective of comparing the predictive potential of the Asymmetry_NEF values with the indices proposed by Golston, Smaoui, Cudek and Stoeker, Table 5 shows, for the five algorithms, the Sensitivity, Specificity and Area under the ROC (Receiver, Operating Characteristic) curve values suggested by Tronstad & Pripp  for diagnostic studies. Additionally, Column 4 presents the p-values obtained from Fisher’s exact test, in each of which, the sensitivity and specificity values were compared with those values evaluated under the classification criteria of the dermatologists.
Test 2: This test used the PH2 database reported by Mendonca et al. . Which consists of 200 images in an 8-bit RGB format and an average resolution of 768 × 560 pixels and 20× magnification. There is a binary representation, handmade, for each image in this set. Eighty images were classified by experts as common nevus, eighty as atypical nevus and forty as melanoma. Each image has an asymmetry measurement in one of three classes: 0 representing fully symmetric; 1 representing symmetric on one of its axis; 2 representing fully asymmetric. As there were 117, 31 and 52 samples, respectively; the cases with greater asymmetry values turned out to be the most malignant lesions belonging to Class 2. This classification was used to compare the asymmetry values of the class comprising the images classified by experts as 0 and 1, with the asymmetry values conformed by the images classified as 2.
The purpose of this test was to evaluate our proposal considering two threshold method techniques. In the first, the manual method, 14 dermatologists segmented the skin lesion area by hand to obtain the asymmetry borders. In the second, the automatic method, the segmentation method was used to obtain the segmented images and automatically evaluate the asymmetry values . A visual practical comparison between both methods is shown in Fig. 10, which shows that the mean Asymmetry_NEF values are greater than Class 2 with both the manual and automatic threshold methods.
Table 6 shows the mean values for Class 0–1 and Class 2 with manual and automatic threshold methods. It is important to note the significant difference between the average values for both methods of classification.
Table 7(rows 2 and 3) shows the Wilcoxon rank-sum test values for Class 0–1 and 2, which is labeled Class 2, taking into account the method proposed, as well as those proposed by Golston et al. , Smaoui et al. , (Asymmetry index), Cudek et al.  (SFA) and Stoecker et al.  (Asymmetry_Ref). It is important to note that the most significant p-value corresponds to the average Asymmetry NEF values, which enables a better classification of the Class 0–1 images compared to Class 2.
This criterion was applied because the most malignant lesion belongs to Class 2. The main goal of this experiment is to show the potential of the approach proposed. To summarize, two thresholding methods were used, a manual method taken from the PH2 database and the automatic method described in .
Alternatively, the statistical values for comparing the means of both data groups are shown in Table 7 (Rows 4–7), generated by using the Irregularity Index and Asymmetry Index methods.
A similar analysis of the predictive potential of the index proposed, undertaken with the Lee database, is shown in Table 8, taking into account the PH2 database. Moreover, it is possible to note that the Asymmetry_NEF has a better relationship with the dermatologists’ classification criteria than the indices proposed by Golston, Smaoui, Cudek and Stoecker.
It can be seen that, for the databases used in this study, the p-value obtained via Fisher’s exact test indicates that the specificity of the diagnosis achieved using the Asymmetry_NEF value does not significantly differ from the diagnosis made by the dermatologists that participated in the classification of melanoma in each of the images from the two databases.
In order to show the utility of this measurement technique, two sets of digital images of skin lesions were tested.
The Spearman coefficient obtained once the 40 asymmetry values were compared with the average clinical evaluation was slightly less than the Spearman coefficient reported by Lee et al. , who compared the Overall Irregularity Index (OII) with the average clinical evaluation obtaining 0.82 and 0.88, respectively. In the case of the Most Significant Irregularity Index (MSII), Lee et al. reported a.
Spearman coefficient of 0.81. However, the Spearman coefficient obtained in this paper, once the 12 regions with a higher risk of developing melanoma were analyzed, was 0.98; which implies that the asymmetry value proposed here strongly correlates with the evaluation undertaken by experienced dermatologists. In addition, the proposed asymmetry value had higher correlation values when compared with the Irregularity index for cases comprising 40 and 12 images. However, when compared to the Asymmetry index, it presented a correlation coefficient value when both indices were compared with the 40 images while presenting a significantly lower value, when it was compared to the 12 images with the highest asymmetry value (see Table 4).
With regard to the PH2 database, the descriptive statistics (Table 5) and the Wilcoxon median test (Table 6) both showed that the Asymmetry_NEF values correlated well with both human perception in evaluating the asymmetry of skin lesions and the asymmetry values automatically obtained using the method proposed by Abuzaghleh et al. . Cohen’s d values presented a significant difference between the medians of the two classes using two threshold methods, thus demonstrating the potential of the approach proposed in this study. Regarding to the Irregularity Index, the average scores obtained were very similar to both the Manual and Automatic methods. However, in the case of the Asymmetry Index, it was not possible to determine significant differences between the two groups in terms of both methods (Table 6).
Esteva et al.  used a CNN as a machine-based learning for the classification of skin lesions based on the texture rather than the shape of the images. Moreover, as this approach cannot be naturally implemented in the actual CAD systems, the classification system needs to be changed completely. As a result, there has been a tendency to implement this CAD system on mobile devices, which due to the high computational cost of the CNN has, it seems been difficult. However, the proposed method is more likely to able to be implemented on mobile applications due to the reduced computational cost. Consequently, the proposed asymmetry measure could be an input variable for the learning machine reported by Esteva et al. , making a more efficient and effective system for skin lesion classification.
It is the author’s opinion that the proposed method can be extended to other shape descriptors in the space or frequency domain, which would be able to increase their efficiency and effectiveness. Research is underway in those areas, and will be reported in subsequent papers.
The measurement proposed in this study is dominated by the rules of digital topology and symmetry definition. The method proposed demonstrates the adequate correlation between its quantitative values and the concept of asymmetry. Moreover, it has a suitable tolerance to scale transformation in the digital space. This study demonstrates that, with a lack of digital space and applied under eight connectivity, the digital shapes with an irregular border can be symmetrical.
Hence, in accordance with the symmetry definition of digital space, the square and rectangular shapes present the lowest grade of asymmetry. Therefore, it can be concluded that the proposed method is a simple but effective way to parameterize the concept of asymmetry.
Experiments with geometric shapes (squares and circles) and melanoma images with higher asymmetry values showed that, for melanoma images, the Asymmetry_NEF value did not vary significantly in terms of resolution.
Finally, the sensitivity, specificity, ROC area and p-value measurements in Tables 5 and 8 show a significant relationship between the dermatologists’ classification criteria and the NEF asymmetry values. The advantages of the method proposed by this study are highlighted in comparison with the methods by Golston et al. , Smaoui & Bessassi , Score For Axis (SFA) reported by Cudek et al.  and Asymmetry_Ref proposed by Stoecker et al. . This proposes the possibility for using the Asymmetry_NEF as a reliable asymmetry measure for the classification of various biological tissues.
Computer Aided Diagnosis System
Total Dermatoscopic Value
Karnan M, Thangavel K. Automatic detection of the breast border and nipple position on digital mammograms using genetic algorithm for asymmetry approach to detection of microcalcifications. Comput Methods Prog Biomed. 2007;87(1):12–20.
Edler R, Wertheim D, Greenhill D. Outcome measurement in the correction of mandibular asymmetry. Am J Orthod Dentofac Orthop. 2004;125(4):435–43.
Ercan I, Ozdemir ST, Etoz A, Sigirli D, Tubbs RS, Loukas M, Guney I. Facial asymmetry in young healthy subjects evaluated by statistical shape analysis. J Anat. 213(6):663–9.
d'Amico M, Ferri M, Stanganelli I. Qualitative asymmetry measure for melanoma detection. In: Biomedical imaging: Nano to macro, 2004. IEEE international symposium on; 2004. p. 1155–11582.
Vasconcelos MJM, Rosado L, Ferreira M. In: Bebis G, Boyle R, Parvin B, Koracin D, McMahan R, Jerald J, Zhang H, Drucker SM, Kambhamettu C, El Choubassi M, Deng Z, Carlson M, editors. Principal Axes-Based Asymmetry Assessment Methodology for Skin Lesion Image Analysis. Cham: Springer; 2014. p. 21–31.
Messadi M, Bessaid A, Taleb-Ahmed A. Extraction of specific parameters for skin tumour classification. J Med Eng Technol. 2009;33(4):288–95.
Ng V, Cheung D. Measuring asymmetries of skin lesions. In: Systems, man, and cybernetics, 1997. Computational cybernetics and simulation, 1997 IEEE international conference on, vol. 5; 1997. p. 4211–6.
Clawson KM, Morrow PJ, Scotney BW, McKenna DJ, Dolan OM. Determination of optimal axes for skin lesion asymmetry quantification. In: 2007 IEEE international conference on image processing, vol. 2; 2007. p. 453–6.
Stoecker WV, Li WW, Moss RH. Automatic detection of asymmetry in skin tumors. Comput Med Imaging Graph. 1992;16(3):191–7.
Ganster H, Pinz P, Rohrer R, Wildling E, Binder M, Kittler H. Automated melanoma recognition. IEEE Trans Med Imaging. 2001;20(3):233–9.
Seidanaiand S, Pellacani G, Grana C. Asymmetry in dermoscopic melanocytic lesion images: a computer description based on colour distribution. Acta Derm Venereol. 2006;86(2):123–8.
Santiago-Montero R, Asael D, Hernandez G. Border and asymmetry measuring of skin lesion for diagnostic of melanoma using a perimeter ratio. Asian J Comput Sci and Inf Technol. 2016;6(2)
Cudek P, Grzymala-Busse JW, Hippe ZS. In: Burduk R, Kurzynski M, Wozniak M, Zolnierek A, editors. Asymmetry of Digital Images Describing Melanocytic Skin Lesions. Berlin, Heidelberg: Springer; 2011. p. 605–11.
Cudek P, Grzyma La-Busse JW, Hippe ZS. In: Hippe ZS, Kulikowski JL, Mroczek T, editors. Further research on automatic estimation of asymmetry of melanocytic skin lesions. Berlin, Heidelberg: Springer; 2012. p. 125–9.
Liu Z, Smith L, Sun J, Smith M, Warr R. In: Fichtinger G, Martel A, Peters T, editors. Biological indexes based Reectional asymmetry for classifying cutaneous lesions. Berlin, Heidelberg: Springer; 2011. p. 124–32.
Ma L, Guo A, Zou S, Xu W. Irregularity and asymmetry analysis of skin lesions based on multi-scale local fractal distributions. In: Image and signal processing, 2009. CISP '09. 2nd international congress on, pp. 1–5; 2009.
Lee TK, McLean DI, Atkins MS. Irregularity index: a new border irregularity measure for cutaneous melanocytic lesions. Med Image Anal. 2003;7(1):47–64.
Mendonca T, Ferreira PM, Marques JS, Marcal ARS, Rozeira J. Ph2 - a dermoscopic image database for research and benchmarking. In: 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC); 2013. p. 5437–40.
Smaoui N, Bessassi S. A developed system for melanoma diagnosis. International journal of computer vision and. Signal Process. 2013;3(1):10–7.
Golston JE, Stoecker WV, Moss RH, Dhillon IPS. Automatic detection of irregular borders in melanoma and other skin tumors. Comput Med Imaging Graph. 1992;16(3):199–203. Digital Imaging in Dermatology
Klette R, Rosenfeld A. Chapter 6 - topology. In: Klette R, Rosenfeld A, editors. Digital geometry. The Morgan Kaufmann series in computer graphics. San Francisco: Morgan Kaufmann; 2004. p. 193–230.
Stockman G, Shapiro LG. Computer vision. 1st ed. upper Saddle River, NJ: Prentice hall PTR; 2001.
James RC. Mathematics dictionary. Netherlands: Springer; 1992.
Santiago-Montero R, Lopez-Morales MA, Sossa JH. Digital shape compactness measure by means of perimeter ratios. Electron Lett. 2014;50(3):171–3.
Tronstad C, Pripp AH. Statistical methods for bioimpedance analysis. J Electrical Bioimpedence. 2014;5(1):14–27.
Abuzaghleh O, Barkana BD, Faezipour M. Noninvasive real-time automated skin lesion analysis system for melanoma early detection and prevention. IEEE J Transl Eng Health Med. 2015;3:1–12.
Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S. Dermatologist-level classi cation of skin cancer with deep neural networks. Nature. 2017;542(7639):115–8.
The authors would like to acknowledgement to the following organizations: CONACYT (Project 65, Fronteras de la ciencia), Instituto Tecnológico de Celaya, Instituto Tecnológico de León and Instituto Politécnico Nacional for the financial and technical support.
The study was funded by CONACYT under scholarship 449144 and had not any role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Availability of data and materials
The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The data used were obtained from the public research database PH 2 https://www.dropbox.com/s/k88qukc20ljnbuo/PH2Dataset.rar database.html and from Tim K. Lee research database available under request in http://www.medicalimageanalysisjournal.com/article/S1361-8415(02)00090-7/ppt.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.