 Research article
 Open Access
 Published:
Effective diagnosis of Alzheimer’s disease by means of large marginbased methodology
BMC Medical Informatics and Decision Making volume 12, Article number: 79 (2012)
Abstract
Background
Functional brain images such as SinglePhoton Emission Computed Tomography (SPECT) and Positron Emission Tomography (PET) have been widely used to guide the clinicians in the Alzheimer’s Disease (AD) diagnosis. However, the subjectivity involved in their evaluation has favoured the development of Computer Aided Diagnosis (CAD) Systems.
Methods
It is proposed a novel combination of feature extraction techniques to improve the diagnosis of AD. Firstly, Regions of Interest (ROIs) are selected by means of a ttest carried out on 3D Normalised Mean Square Error (NMSE) features restricted to be located within a predefined brain activation mask. In order to address the small samplesize problem, the dimension of the feature space was further reduced by: Large Margin Nearest Neighbours using a rectangular matrix (LMNNRECT), Principal Component Analysis (PCA) or Partial Least Squares (PLS) (the two latter also analysed with a LMNN transformation). Regarding the classifiers, kernel Support Vector Machines (SVMs) and LMNN using Euclidean, Mahalanobis and Energybased metrics were compared.
Results
Several experiments were conducted in order to evaluate the proposed LMNNbased feature extraction algorithms and its benefits as: i) linear transformation of the PLS or PCA reduced data, ii) feature reduction technique, and iii) classifier (with Euclidean, Mahalanobis or Energybased methodology). The system was evaluated by means of kfold crossvalidation yielding accuracy, sensitivity and specificity values of 92.78%, 91.07% and 95.12% (for SPECT) and 90.67%, 88% and 93.33% (for PET), respectively, when a NMSEPLSLMNN feature extraction method was used in combination with a SVM classifier, thus outperforming recently reported baseline methods.
Conclusions
All the proposed methods turned out to be a valid solution for the presented problem. One of the advances is the robustness of the LMNN algorithm that not only provides higher separation rate between the classes but it also makes (in combination with NMSE and PLS) this rate variation more stable. In addition, their generalization ability is another advance since several experiments were performed on two image modalities (SPECT and PET).
Background
Alzheimer’s Disease (AD)
Alzheimer’s Disease (AD) is the most common cause of dementia in the elderly and affects approximately 30 million individuals worldwide[1]. Its prevalence is expected to triple over the next 50 years due to the growth of the older population. To date there is no single test that can predict whether a particular person will develop the disease. With the advent of several effective treatments of AD symptoms, current consensus statements have emphasized the need for early recognition[2].
Functional brain imaging
Single Positron Emission Computed Tomography (SPECT) is a widely used technique to study the functional properties of the brain[3]. After the reconstruction and a proper normalization of the SPECT raw data, taken with Tc99m ethyl cysteinate dimer (ECD) as a tracer, one obtains an activation map displaying the local intensity of the regional cerebral blood flow (rCBF). Therefore, this technique is particularly applicable for the diagnosis of neurodegenerative diseases like AD[4, 5]. On the other hand, Positron Emission Tomography (PET) measures the rate of glucose metabolism with the tracer [^{18} F] Fluorodeoxyglucose. In AD, characteristic brain regions show decreased glucose metabolism, specifically bilaterally regions in the temporal and parietal lobes, posterior cingulate gyri and precunei, as well as frontal cortex and whole brain in more severely affected patients[6]. SPECT modality has lower resolution and higher variability than PET, but the use of SPECT tracers[7] is relatively cheap, and the longer halflives when compared to PET tracers makes SPECT well suited, if not required, when biologically active radiopharmaceuticals have slow kinetics.
Computer Aided Diagnosis (CAD)
In order to improve the prediction accuracy especially in the early stage of the disease, when the patient could benefit most from drugs and treatments, computer aided diagnosis (CAD) tools are desirable[8].
Several approaches for designing CAD systems of the AD can be found in the literature[9]. Univariate methodology is based on the analysis of regions of interest (ROIs) by means of some discriminant functions, whereas the second approach (multivariate) is related to statistical analysis techniques. Regarding the first, the most common and used approach is named Statistical Parametric Mapping (SPM)[10] software tool and its numerous variants. It was not developed specifically to study a single image, but for comparing groups of images. Regarding multivariate techniques, it is remarkable MANCOVA, which considers as one observation all the voxels in a single scan and requires a higher number of available samples than the one of features. This fact reports the wellknown small sample size problem that is very common in nuclear medicine studies since the number of images is limited. In this work context, with the clear goal to solve the dimensionality issue, some techniques of feature space reduction were used and combined.
Firstly, a 3D binary mask is obtained from the average of control subjects which contains a set of activated voxels in certain brain regions characterized by an intensity level above half of the maximum intensity of the mean image. The use of activation masks and the automatic selection of spatial image components reports improved discrimination ability and reduces the complexity of the direct voxel as feature (VAF) approach[6]. The system was developed by exploring the masked brain volume in order to identify discriminant ROIs using different shaped subsets of voxels or components.
ROIs are defined as blocks of voxels represented by the so called Normalized Mean Square Error (NMSE) (further explanation in section Feature extraction) and are selected by means of a ttest[11]. These ROIs act as inputs for obtaining kernel Principal Component Analysis (KPCA), Partial Least Squares (PLS) or Large Margin Nearest Neighbours using a rectangular matrix (LMNNRECT) in order to reduce the dimension of the feature vector to address the small sample size problem. In addition, it can be transformed the PLS or PCA space using a linear transformation matrix (denoted by L) that is built through the Euclidean distance based on the LMNN method that learns a linear transformation which attempts to make input neighbours share the same labels. This is achieved by minimizing a loss function (see section Loss function).
Finally, the classification task of the supervised learner is to predict by using several paradigms the class of an unknown pattern after a training procedure based on a subset of samples.
On the one hand, Support Vector Machines (SVMs) have achieved general success in the last decade[12–14] in the learning from examples paradigm and it can be considered as a special kind of large margin classifier. Recent developments in the definition and training of statistical classifiers make it possible to build reliable classifiers in very small sample size problems since SVM circumvents the curse of dimensionality, and even may find nonlinear decision boundaries for small training sets. On the other hand, LMNN classifier[15, 16] aims to improve the Euclidean distance metric (which learns a linear transformation L, see section Large Margin Nearest Neighbors (LMNN)) by a new Mahalanobis one (which is described by the matrix M = L ·L ^{T}, see also section Large Margin Nearest Neighbors (LMNN)) through linear transformations. In addition, Energybased method is also analysed for LMNN, leading to further improvements in test error rates over the ones obtained with Euclidean or Mahalanobis distances as shown in Results and discussion Section. These transformations can improve significantly[17] in k Nearest Neighbors (KNN)[15] which are aimed to be organised to the same class, while examples from different classes are separated by a large margin[18, 19].
Methods
Subjects and preprocessing
SPECT database
Baseline SPECT data from 97 participants were collected from the Virgen de las Nieves hospital in Granada (Spain). The patients were injected with a gamma emitting ^{99m}TcECD radiopharmeceutical and the SPECT raw data was acquired by a three head gamma camera Picker Prism 3000. A total of 180 projections were taken with a 2degree angular resolution. The images of the brain cross sections were reconstructed from the projection data using the filtered backprojection (FBP) algorithm in combination with a Butterworth noise removal filter. The SPECT images are first spatially normalized using the SPM software, in order to ensure that voxels in different images refer to the same anatomical positions in the brain allowing us to compare the voxel intensities of different subjects. In this work, the images have been normalized using a general affine model, with 12 parameters ([20–22]). After the affine normalization, the resulting image is registered using a more complex nonrigid spatial transformation model[21]. The deformations are parameterized by a linear combination of the lowest frequency components of the threedimensional cosine transform bases[23]. A smalldeformation approach is used, and regularization is by the bending energy of the displacement field. Then, we normalize the intensities of the SPECT images with respect to the maximum intensity, which is computed for each image individually by averaging over 3% of the highest voxel intensities, similarly as in[24]. After the spatial normalization, one obtains a 95 × 69 × 79 voxel representation of each subject, where each voxel represents a brain volume of 2 × 2 × 2mm ^{3}. The database is built up of imaging studies of subjects following the protocol of an hospitalbased service. First, the neurologist evaluated the cognitive function, and those patients with findings of memory loss or dementia were referred to the nuclear medicine department in the Virgen de las Nieves hospital (Granada, Spain), in order to acquire complementary screening information for diagnosis^{b}. Experienced physicians evaluated the images visually. The images were assessed using 4 different labels: Control (CTRL) for subjects without scintigraphic abnormalities and mild perfusion deficit (AD1), moderate deficit (AD2) and severe deficit (AD3), to distinguish between different levels of presence of hypoperfusion patterns compatible with AD. In total, the database consists of N = 97 subjects: 41 CTRL, 30 AD1, 22 AD2 and 4 AD3 (see Table1(a) for demographic details). Since the patients are not pathologically confirmed, the subject’s labels possess some degree of uncertainty, as the pattern of hypoperfusion may not reflect the underlying pathology of AD, nor the different classification of scans necessarily reflect the severity of the patients symptoms. However, when pathological information is available, visual assessments by experts have been shown to be very sensitive and specific labeling methods, in contrast to neuropsychological tests[25, 26]. Given that this is an inherent limitation of ’in vivo’ studies, our workingassumption is that the labels are true, considering the subject label positive when belonging to any of the AD classes, and negative otherwise. This work does not imply any experimental intervention and has been performed under the approval and supervision of the Clinical and Investigation Ethical Commission of the University Hospital Virgen de las Nieves (CEIC).
PET database
PET data was obtained from the ADNI^{a} Laboratory on NeuroImaging (LONI, University of California, Los Angeles) website (http://www.loni.ucla.edu/ADNI/). The ADNI was launched in 2003 by the National Institute on Aging (NIA), the National Institute of Biomedical Imaging and Bioengineering (NIBIB), the Food and Drug Administration (FDA), private pharmaceutical companies and nonprofit organizations, as a 60 million, 5year public private partnership. The primary goal of ADNI has been to test whether serial magnetic resonance imaging (MRI), PET, other biological markers, and clinical and neuropsychological assessment can be combined to measure the progression of mild cognitive impairment (MCI) and early AD. Determination of sensitive and specific markers of very early AD progression is intended to aid researchers and clinicians to develop new treatments and monitor their effectiveness, as well as lessen the time and cost of clinical trials. The Principal Investigator of this initiative is Michael W. Weiner, MD, VA Medical Center and University of California – San Francisco. ADNI is the result of efforts of many co investigators from a broad range of academic institutions and private corporations, and subjects have been recruited from over 50 sites across the U.S. and Canada. The initial goal of ADNI was to recruit 800 adults, ages 55 to 90, to participate in the research, approximately 200 cognitively normal older individuals to be followed for 3 years, 400 people with MCI to be followed for 3 years and 200 people with early AD to be followed for 2 years. For uptodate information, see www.adniinfo.org. FDG PET scans were acquired according to a standardized protocol. A 30min dynamic emission scan, consisting of 6 5min frames, was acquired starting 30 min after the intravenous injection of 5.0 ±0.5 mCi of ^{18}FFDG, as the subjects, who were instructed to fast for at least 4 h prior to the scan, lay quietly in a dimly lit room with their eyes open and minimal sensory stimulation. Data were corrected for radiationattenuation and scatter using transmission scans from Ge68 rotating rod sources and reconstructed using measuredattenuation correction and image reconstruction algorithms specified for each scanner. Following the scan, each image was reviewed for possible artifacts at the University of Michigan and all raw and processed study data was archived. Subsequently, the images were normalized through a general affine model, with 12 parameters[27] using the SPM5 software. After the affine normalization, the resulting image was registered using a more complex nonrigid spatial transformation model. The nonlinear deformations to the Montreal Neurological Imaging (MNI) Template were parameterized by a linear combination of the lowestfrequency components of the threedimensional cosine transform bases[28]. A smalldeformation approach was used, and regularization was by the bending energy of the displacement field, ensuring that the voxels in different FDGPET images refer to the same anatomical positions in the brains. After spatial normalization, an intensity normalization was required in order to perform direct images comparisons between different subjects. The intensity of the images was normalized to a value I _{ max }, obtained averaging the 0.1% of the highest voxel intensities exceeding a threshold. The threshold was fixed to the 10th bin intensity value of a 50bins intensity histogram, for discarding most low intensity records from outsidebrain regions, and preventing image saturation. Participant’s enrolment was conditioned to some eligibility criteria. General inclusionexclusion criteria were as follows:

Normal control subjects: Mini Mental State Examination (MMSE) scores between 24−30 (inclusive), a Clinical Dementia Ratio (CDR) of 0, non depressed, non MCI, and non demented. The age range of normal subjects will be roughly matched to that of MCI and AD subjects. Therefore, there should be minimal enrolment of normals under the age of 70.

Mild AD: MMSE scores between 20−26 (inclusive), CDR of 0.5 or 1.0, and meets NINCDS/ADRDA criteria for probable AD.
The PET database collected from ADNI consists of 150 labeled PET images: 75 control subjects and 75 AD patients (see Table1(b) for demographic details). ADNI patient diagnostics are not pathologically confirmed, introducing some uncertainly on the subject’s labels. Using these labels, allows to test the robustness of the classifier. This should be also considered when comparing to other methods tested on autopsy confirmed AD patients, on which every classifier is expected to improve its performance[6].
Written informed consent was obtained from all ADNI participants before protocolspecific procedures were performed. The informed consent not only covers consent for the trial itself, but for the genetic research, biomarker studies, biological sample storage and imaging scans as well. The consent for storage includes consent to access stored data, biological samples, and imaging data for secondary analyses. By signing the consent, ADNI participants authorize the use of the data for large scale, multicenter studies that combine data from similar populations.
Feature extraction
In this article, we propose to apply a combination of different extraction methods in order to obtain the most important features in the early diagnosis of AD. In this way, we can save the memory space and reduce the system complexity removing those useless and harmful noisy components. We are also able to deal with data set of few samples and high dimensions and thus weakening the disadvantages caused by the socalled curseofdimensionality problem[16].
As detailed in Figure1, first of all the masking process is done. Control subjects are averaged in a tridimensional image sm(x,y,z). In functional imaging, each voxel carries a grey intensity level I(x _{ j }), which is related to the regional cerebral blood flow, glucose metabolism, etc. in the brain of a patient, depending on the image acquisition modality. Secondly, it is obtained a 3D mask(x,y,z) that consists of all the voxels with sm(x,y,z)> a _{ T }. The threshold a _{ T } is equivalent to the 50% of the maximum intensity in sm(x,y,z).
Secondly the Block Division is done as shown in Figure1. Baseline VAF is a way of including in vaf(x,y,z) all the voxels inside the obtained mask(x,y,z) and considering them as features. Therefore, voxels outside the brain and poorly activated regions are excluded from this analysis. The main problem to be faced up by these techniques is the wellknown small sample size problem, that is, the number of available samples is much lower than the number of features used in the training step. However in this work, the combination of feature reduction techniques does not only solve this problem, but also helps to reach better results of classification.
Finally, instead of using directly all the voxels, the regions are considered in 3D because not all the brain regions provide the same discriminant value for detecting the early AD. In fact, the posterior cingulate gyri and precunei, as well as the temporoparietal region are typically affected by hypoperfusion in the AD[14]. That is the reason why, each functional image is processed by means of 3D v × v × v cubic voxels defining ROIs, or block(x,y,z) centered in (x,y,z) coordinates which belong to vaf(x,y,z). Then, it is calculated the Normalized Minimum Squared Error or NMS E _{ p } (x,y,z) defined as:
It is obtained for each subject and block (see Figure1) where f(x y z) is the mean voxel intensity of all the control subjects and g _{ p }(x y z) is the voxel intensity of the pth subject at (x y z) coordinates. The most discriminant ROIs are obtained by means of an absolute value twosample ttest with pooled covariance estimate on NMSE features as in[14].
Widely used methods for the analysis of data sets are PCA[29, 30] and projections to latent structures (PLS)[31, 32], that work computationally well for many variables and observations. By contrast, LMNN algorithm is aimed at the organization of the knearest neighbors to the same class, while examples from different classes are separated by a large margin[15, 17, 33, 34].
In this work we propose and compare several feature extraction methods (shown in Figure1) that includes on the one hand the combination of NMSE with PCA (see section Large Margin Nearest Neighbors (LMNN)) or PLS (see section Partial Least Squares (PLS)) plus the LMNN transformation. On the other hand, NMSE is directly combined with a LMNNRECT reduction (see section LMNNRECT as feature reduction technique).
Principal Component Analysis: PCA
PCA is a multivariate approach often used in neuroimaging to significantly reduce the original highdimensional space of the brain images to a lower dimensional subspace[35]. PCA generates an orthonormal basis vector that maximizes the scatter of all the projected samples, which is equivalent to find the eigenvalues from the covariance matrix. PCA can be used in combination with the socalled kernel methods[36]. The basic idea of the kernel PCA[37] method (further details in appendix 1: Kernel PCA) is to first pre process the data by some nonlinear mapping and then to apply the same linear PCA.
Partial Least Squares (PLS)
PLS can model the observed variables X (representing the feature space of input) and Y (representing the labels) by means of linear latent variables (not directly observed or measured) according to the regression models[38, 39]:
where T, U are the score matrices; E _{ x }, E _{ y } are the error matrices and P, Q are the loading matrices with number of columns being the number of PLS components. The score matrices result from projection of the data matrices X and Y on loading matrices. The fundamental goal of PLS is to maximize the covariance between the scores of X and Y. PLS can be used as a regression tool or as a dimension reduction technique similar to PCA. The main difference between PLS and PCA is that the former creates orthogonal weight vectors by maximizing the covariance between the variables X and Y, thus, PLS does not only consider the variance of the samples but also the class label[40]. Partial least squares modeling[40] is an effective method for feature extraction that has shown improved results over other conventional feature extraction methods such as PCA in classification problems. In this work, PLS is implemented by means of SIMPLS algorithm (further details in Appendix 2: Partial Least Squares SIMPLS algorithm).
Large Margin Nearest Neighbors (LMNN)
Distance metric[41] is a key issue in many machine learning algorithms. LMNN is used in this work in different ways: i) as a transformation of the feature space obtained by means of PLS or PCA in order to better separate the control subject and AD patient classes, ii) as feature reduction technique by performing the transformation as a rectangular matrix (LMNNRECT), and iii) as a classifier as reported in section Large margin nearest classifier.
The objective of LMNN is to obtain a family of metrics over the feature space. Let {(x _{ i },y _{ i })} denote a training set of n labeled examples with inputs{\mathbf{x}}_{\mathbf{i}}\epsilon {\mathbb{R}}^{d} and associated class labels y _{ i }. Our goal is to learn a linear transformation L:{\mathbb{R}}^{d}\to {\mathbb{R}}^{d}. These metrics compute squared distances as:
Equation 4 is commonly used to express squared distances in terms of the squared matrix:
On the other hand, the squared distances are denoted as Mahalanobis metrics in terms of M:
A Mahalanobis distance can be parameterized in terms of the matrix L or the matrix M[15]. The first is unconstrained, whereas the second must be positive semidefinite.
The main idea of LMNN consists of minimizing the loss function (see the following section Loss function) that is able to learn a distance metric under which inputs and their target neighbours are closer together.
Loss function
In LMNN, target neighbours are defined as input patterns of the same class that are wanted to be closer. The loss function to be minimized consists of two terms. One acts to pull target neighbours closer together penalizing large distances between each input and its target neighbours. The other term acts to push differently labeled examples further apart. It penalizes small distances between differently labeled examples. The pull term is represented by the following equation:
where j → i means that input x _{ j } is a target neighbour of input x _{ i }. A new indicator variable is introduced to define the push term of the loss function:
so that:
where []_{+} = max(z,0) denotes the standard hinge loss[15].
Finally, we combine the two terms ε _{ pull }(L) and ε _{ push }(L) into a single loss function for distance metric learning. The two terms can have competing effects, to attract target neighbours and to repel impostors. Impostors are defined as the inputs with different labels. A weighting parameter μ ∈[0,1] balances these goals.
LMNNRECT as feature reduction technique
The loss function needs to be optimized in order to obtain the distance metric transforms in terms of the explicitly lowrank linear and rectangular matrix transformation L. The optimization over L is not convex unlike the original optimization over M, but a (possibly local) minimum can be computed by standard gradientbased methods. We call this approach LMNNRECT[42], in which L is a matrix with a size equal to the number of features selected by the ttest. In particular, in this work the matrix L is multiplied by the matrix consisting of the NMSE features selected by the ttest and defined above in order to obtain a new space of features that better separates control subjects from AD patients. This fact is experimentally demonstrated in the Results and discussion Section.
Kernel LMNN
It is interesting to consider the case where x _{ i }are mapped into a high dimensional feature space ϕ(x _{ i }) and a Mahalanobis distance is sought in this space. We focus on the case where dot products in the feature space may be expressed via a kernel function, such that
for some kernel k[19]. When we use the Kernel PCA trick framework (appendix 1), the original LMNN can be immediately used as Kernel LMNN (KLMNN) as it is explained in[43]. The new KPCA trick framework offers several practical advantages over the classical kernel trick framework, e.g. no mathematical formulas and no reprogramming are required for a kernel implementation, a way to speed up an algorithm is provided with no extra work, the framework avoids troublesome problems such as singularity.
Feature/model selection
The number of features used is a tradeoff between ROIs that are really important and that do not worsen the computational time of the CAD. We demonstrated experimentally that 200 NMSE features (ROIs) is a number high enough to guarantee the quality of the image in posterior classification. However, this number must be reduced in order to improve the computational time of the system with strategies such as PCA, PLS or LMNNRECT. The final number of features used has been experimentally tuned by the observation of Figure2 in which the percentage of variance explained for features (PCA or PLS) chosen are drawn as bars and a line represents the cumulative Variance Explained. In the case, Variance Explained accounts for the variation of a feature subset when PCA or PLS strategies are applied. In this graphic, we can observe that up to six components, the variance explained for PCA and PLS does not change significantly.
Classification
LMNN and SVM classifiers were used in this work to build the AD CAD system. They present many similarities, for example its potential to work in nonlinear feature spaces by using the kernel trick. On the other hand, features can be extracted by means of the kernel trick and PCA (kernel PCA, KPCA) or LMNN (kernel LMNN, KLMNN)[43]. LMNN can be viewed as the logical counterpart to SVMs in which kNN classification replaces linear classification. However, LMNN contrasts with classification by SVMs, in that it requires no modification for multiclass problems that involve combining the results of many binary classifiers, that is there is no explicit dependence in the number of classes.
Large margin nearest classifier
Some techniques were developed to learn feature weights to manage the change of distance structure of samples in nearest neighbour classification. Euclidean distance, the most commonly used, assumes that each feature is equally important and independent from others. By contrast, a distance metric with good quality such as Mahalanobis, should identify relevant features assigning different weights or importance factors to the extracted ROIs[44]. Only when the features are uncorrelated, the distance under a Mahalanobis distance metric is identical to that under the Euclidean distance metric. On the other hand, our work has been inspired by energybased metric (EBC) learning, obtaining with it the best results in terms of accuracy, specificity and sensitivity[33, 45]. EBC consists of computing the loss function for every possible label y _{ i }. We compute the minimization of three terms. The first one term is defined to be the squared distances to the k target neighbours of x _{ i }. The second term accumulates the hinge loss over all impostors (that is differently labeled) which invade the perimeter around x _{ i } determined by its target neighbours. The third term is the accumulation of the hinge loss for differently labelled examples whose perimeters are invaded by x _{ i }.
Support vector machines classifier
SVMs[46, 47] let to build reliable classifiers in very small sample size problems[48] and even may find nonlinear decision boundaries for small training sets. SVM[13] separates a set of binarylabeled training data by means of a maximal margin hyperplane, building a decision function{\mathbb{R}}^{N}\to \left\{\pm 1\right\}. The objective is to build a decision function f:{\mathbb{R}}^{N}\to \left\{\pm 1\right\} using training data that is, l Ndimensional patterns x _{ i }and class labels y _{ i }: (x _{1} y _{1}), (x _{2} y _{2}), …, (x _{ l } y _{ l }), so that f will correctly classify new unseen examples (x y). Linear discriminant functions define decision hyperplanes in a multidimensional feature space: g(x) = w ^{T}· x + w _{0} where w is the weight vector to be optimized that is orthogonal to the decision hyperplane and w _{0} is the threshold. The optimization task consists of finding the unknown parameters w _{ i }, i = 1, …, N and w _{0} that define the decision hyperplane. When no linear separation of the training data is possible, SVM can work effectively in combination with kernel techniques such as quadratic, polynomial or radial basis function (RBF), so that the hyperplane defining the SVM corresponds to a nonlinear decision boundary in the input space[14].
Results and discussion
Several experiments were conducted in order to evaluate the proposed LMNNbased feature extraction algorithms and its benefits as: i) linear transformation of the PLS or PCA reduced data, ii) feature reduction technique, and iii) classifier (with Euclidean, Mahalanobis or Energybased methodology). SVM classification including transformation of the input space by means of linear, polynomial, quadratic or rbf kernels, which define nonlinear decision surfaces, was adopted for the first two approaches. The classification performance of our approach was tested by means of kfold cross validation (instead of LeaveOneOut), which is widely used to compare the performances of different predictive modelling procedures as in[49].
Although there are studies that consider k independent training and test splits (for instance in[50, 51]), we focus on the standard kfold crossvalidation that is widely used ([6, 51, 52]). In kfold procedure, there is no overlap between test sets: each example of the original data set is used once and only once as a test example. In kfold crossvalidation, sometimes called rotation estimation, the dataset D is randomly split into k mutually exclusive subsets (the folds) D _{1}, D _{2},…,D _{ k }of approximately equal size. The inducer is trained and tested k times; each time t ε{t _{1} t _{2},…,t _{ N }}, it is trained on D{D _{ t }} and tested on D _{ t }[53]. 10 folds were used in each experiment which yielded accurate estimates of the error rates. For each iteration (t = 1,…,10), the algorithm returns randomly generated indices for a kfold crossvalidation of D observations. Testing rate is mostly equal to the integer of the fraction 100/number of folds, that is 10% in our experiments, but it can vary randomly one or two samples in each iteration if the number of observations is a prime number. These indices are used for testing and the rest (approximately 90%) for training. Statistical results obtained in each iteration are averaged.
Thus, by using crossvalidation, several feature extraction and classification methods were objectively compared in terms of their respective fractions of misclassified samples. In this way, the classifier was evaluated in depth as a tool for the early detection of AD in terms of the accuracy (Acc), sensitivity (Sen) and specificity (Spe), which are defined as:
respectively, where TP is the number of true positives: number of AD patients correctly classified; TN is the number of true negatives: number of control subjects correctly classified; FP is the number of false positives: number of control subjects classified as AD patients; FN is the number of false negatives: number of AD patients classified as control subjects.
For posterior analysis, the data was arranged in two different Groups: AD subjects were labeled as positive and controls as negative. The motivation of doing that is to test our method with all the available stages of the disease, keeping the database as balanced as possible (41 CTRL versus 56 AD for SPECT and 75 CTRL versus 75 AD for PET) and to include several types of patterns in the classification task (training and test).
In the feature reduction process, there are certain parameters to tune such as the number of NMSEBlocks, the number of PCA, PLS or LMNN reduced features and the selection of the kernel shape (linear, polynomial, quadratic or RBF) which define better decision surfaces in SVM classification. The NMSE features were computed using 5 × 5 × 5 voxel blocks since reduced size cubic NMSE features yield better results as shown in[14]. Furthermore, 200 discriminant features were selected by means of ttest reduction (a higher number of NMSE blocks means a decrease of the classification method effectiveness). The posterior reduction of the size of the feature vector is achieved by means of PCA, PLS or LMNNRECT.
Experiments with SPECT database
In a first experiment, the different feature extraction techniques considered in this work (PCA+LMNN, PLS+LMNN and LMNNRECT) were compared in Figure3(a)3(c). All the feature extraction methods were found to be very robust to the selection of the number of input features to the classifier. To conclude, when six features were used for classification, PCALMNN yielded Acc = 91.75%, Sen = 91.07% and Spe = 92.68%, while PLSLMNN outperformed these values yielding Acc = 92.78%, Sen = 91.07% and Spe = 95.12%. As LMNNRECT is concerned, the best results were obtained when 18 features are transformed: Acc = 90.72%, Sen = 96.43%, Spe = 82.93%. The advantage of the last method is its speed since it does not need the combination with another reduction technique nor space transformation LMNN.
The second experiment analyzes classification using LMNN using Euclidean, Mahalanobis and Energybased models when NMSEPCA or NMSEPLS features are considered. Figures4(a)and4(b) show the accuracy obtained by LMNN classification as a function of the number of PCA coefficients and PLS coefficients, respectively. The results show that LMNN classification using energybased models and Mahalanobis distances performs better than when the Euclidean distance is considered, which suffers a decrease in the accuracy as the number of features increases. LMNN classification using energybased models and Mahalanobis distances were found to be very robust against the selection of the dimension of the feature vector yielding peak values of the accuracy of 91.76% and 90.87%, respectively, when NMSEPCA features are used. If PLS technique is used instead of PCA, the accuracy results improved yielding accuracy values of 91.78% and 89.78% for energybased models and Mahalanobis distance, respectively. In all these cases, energybased models outperformed the others.
Since PLS feature extraction in combination with a LMNN transformation reported the best results and, aimed at further improving the accuracy of the classification, the selection of the best kerneltransformation of the input space by means of kernels and SVM was analyzed. Figure5(a) shows the accuracy of the system as a function of the number of PLS coefficients for linear, polynomic and RBF kernelbased SVM classification. In conclusion, linear kernel outperformed the others with a 92.7% of accuracy.
It is remarkable the fact that when using the combination of 3D NMSE blocks as input features and afterwards transformed them with LMNN algorithm in its multiple possibilities (both as reduction technique, linear transformer or classifier) adds a valuable robustness to the system. This can be proven in view of the experiments shown in Figures3(a),3(b),3(c),4(a),4(b),5(a). In Figure5(b), PCA was used directly over the voxels reduced to the half (because of the high computational cost) and treated with the same type of mask as explained in this work. The results in Figure5(b) showed that the variation of accuracy increases when voxels are used as features. By contrast, in this work the advantage of the combination of the methods proposed, is that they maintain stable around the 90%. We can conclude that the fact of obtaining the ROIs by using the combination of NMSE Blocks with LMNN algorithm favors the stability in all the range of reduced features, thus promoting the robustness of the algorithm.
Finally, Table2 shows the accuracy, sensitivity and specificity rates of the proposed methods and compares them with other recently reported techniques including VAF, Gaussian Mixture Models (GMM) and PCA[36, 54–56]. Based on the analysis shown in section Feature/model selection regarding the feature selection model, PCA and PLS feature extraction considered up to six features that retain most of the variance of the data. It can be concluded from the Table2 that the LMNN transformation when combined with PCA or PLS yields the best results and reports benefits when compared to other reference methods.
To sum up, LMNN was presented as a valid solution to make broader the margin between the classes. It was developed an effective CAD system in which it is not necessary to incorporate an a priori knowledge about the pathology, since up to its first feature extraction step, all the voxels with a considerable activation (that is, those voxels that are located inside the calculated mask) are considered. The analysis shown in this papers reports clear advantages in the following ROIselection steps as well, because they were computed in an automatic way for the early diagnosis of Alzheimer’s disease. The best combination of feature reduction techniques yielded an accuracy value of 92.72%, thus outperforming other recently and consolidated reported methods such as VAF, PCA and GMM (Table2). Finally, in order to study in depth the AD classification with LMNNbased techniques , we have also included additional information about the classification of AD1 subjects versus CTRL. This set up is more difficult to be classified since AD1 pattern is still a challenge to be diagnosed. If we only consider the case CTRL versus AD1 the precision rates of the method are for PCA plus LMNN: Acc = 84.51%, Sen = 73.33%, Spe = 92.68%, for PLS plus LMNN transformation: Acc = 83.10%, Sen = 70%, Spe = 92.68% and for LMNNRECT: Acc = 84.51%, Sen = 76.67%, Spe = 90.24%. These results still represent a great advance in the field in comparison with the baseline VAF: Acc = 77.46%, Sen = 70%, Spe = 82.93%.
Experiments with PET database
Additionally, several experiments were performed on a PET database in order to highlight the generalization ability of the proposed method. The same parameters such as voxel size or number of NMSE Blocks than for SPECT data were used. Figure6(a)shows the different feature extraction techniques of this work, that is, PCA or PLS plus LMNN transformation and LMNNRECT in comparison with PCA or VAF baseline when a linear SVM classification is performed. In the light of the graphic, this manuscript technique reaches a maximum accuracy rate of 90.67% (88% sensitivity and 93.33% specificity) for both PCA and PLS plus LMNN transformation and when used LMNNRECT, accuracy 87.33% (82.67% sensitivity and 92% specificity), thus outperforming the PCA (Acc = 85.33%) or baseline VAF (Acc = 81.18%) techniques.
Figure6(b) shows LMNN classification using energybased models, Mahalanobis and Euclidean distances for PCA and PLS features. Maxima accuracy rates were obtained for Energybased classifier (90.11% for PCA and 89.99% for PLS).
ROC analysis
Figures7(a) and7(b) show the receiver operating characteristic (ROC) curves of the proposed systems and other methods that were considered as a reference for SPECT and PET databases respectively. Several experiments were carried out on the different image modalities (SPECT and PET) in order to highlight the generalization ability of the proposed method. The analysis shows that the presented CAD system based on LMNN algorithm and SVM yields the best tradeoff between sensitivity and specificity by shifting the operating point up and to the left in the ROC space[57] in comparison with other reported methods such as VAF SVM, PCA SVM and GMM SVM. As shown in Figure7(a), PLS plus LMNN transformation provides an operation point located in the upper left than other approaches on the ROC space. In addition, the improvement of the proposed LMNNbased technique is also supported by the AUC analysis for SPECT/PET databases respectively: PLS plus LMNN transformation: 0.9424/0.9437, PCA plus LMNN transformation 0.9411/0.9505, LMNNRECT: 0.9076/0.9325 that outperform the AUC of other reported methods such as VAF SVM: 0.8993/0.8500 and PCA SVM: 0.9177/0.9006.
Conclusions
Kernel Distance Metric Learning Methods were investigated for SVMbased classification of SPECT brain images in order to improve the early AD’s diagnosis. Several experiments were conducted in order to evaluate the proposed LMNNbased feature extraction algorithms and its benefits as: i) linear transformation of the PLS or PCA reduced data, ii) feature reduction technique, and iii) classifier (with Euclidean, Mahalanobis or Energybased methodology). LMNN classification using energybased models and Mahalanobis distances performs better than when the Euclidean distance is considered, which suffers a decrease in the accuracy as the number of features increases. Aiming at further improving the accuracy of the classification, SVM was also compared to LMNNbased classification yielding improved results. Thus, the proposed methods yielded Acc rates of 92.7% for SPECT and 90.11% for PET when an advanced feature extraction technique consisting of NMSE feature selection, PLS feature reduction and LMNN transformation in combination with linear SVM classification was considered, thus outperforming other recently and consolidated reported methods such as VAF, PCA or GMM. One of the principal advantages of our techniques is the robustness and stability of the proposed methods shown in this work as stated in the Results. Another property is its generalization ability in the light of the results obtained with an PET database.
Endnotes
^{a} Data used in preparation of this article were obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database (adni.loni.ucla.edu). As such, the investigators within the ADNI contributed to the design and implementation of ADNI and/or provided data but did not participate in analysis or writing of this report. A complete listing of ADNI investigators can be found at:http://adni.loni.ucla.edu/wpcontent/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf
^{b} Clinical information is unfortunately not available for privacy reasons, but only demographic information.
Appendix
Appendix 1: Kernel PCA
In kernel PCA, each vector x is projected from the input space,{\mathbb{R}}^{n}, to a high dimensional feature space{\mathbb{R}}^{f} by a nonlinear mapping function where ϕ:{\mathbb{R}}^{n}\to {\mathbb{R}}^{f} with f > n. Note that the dimensionality of the feature space can be arbitrarily large[56]. In{\mathbb{R}}^{f}, the corresponding eigenvalue problem is
where C ^{ϕ} is a covariance matrix. All solutions ω ^{ϕ}with λ ≠ 0 lie in the space spanned by ϕ(x _{1}),…, ϕ(x _{ N }) where N is the number of samples, and there exist coefficients α _{ i }such that
Denoting an N × N matrix K by
the kernel PCA problem becomes[58]
where α denotes a column vector with entries α _{1},…,α _{ N }. The above derivation assumes that all the projected samples ϕ(x) are centered in{\mathbb{R}}^{f}. In this work, we have used the Gaussian kernel PCA:
We found two advantages of nonlinear kernel PCA: first, nonlinear principal components afforded better recognition rates and second, the performance for nonlinear components can be further improved by using more components than possible in the linear case[59].
Appendix 2: Partial Least Squares SIMPLS algorithm
The SIMPLS algorithm[60] was proposed by Sijmen de Jong in 1993 as an alternative to the NIPALS algorithm for PLS. The main difference to NIPALS is the kind of deflation. In SIMPLS, no deflation of the centered data matrices X and Y is made, but the deflation is carried out for the covariance matrix, or more precisely, the crossproduct matrix S = X ^{T} Y between the xdata and ydata[61]. SIMPLS algorithm can be described as follows:

1.
initialize S _{0} = X ^{T} Y and iterate steps 2 to 8 for j = 1,…,n

2.
if j = 1, S _{ j }= S _{0} else, {\mathbf{S}}_{j}={\mathbf{S}}_{j1}{\mathbf{P}}_{j1}{\left({\mathbf{P}}_{j1}^{T}{\mathbf{P}}_{j1}\right)}^{1}{\mathbf{P}}_{j1}^{T}{\mathbf{S}}_{j1}

3.
compute w _{ j }as the first singular vector of S _{ j }

4.
{\mathbf{w}}_{j}=\frac{{\mathbf{w}}_{j}}{\parallel {\mathbf{w}}_{j}\parallel}

5.
t _{ j }= X w _{ j }

6.
{\mathbf{t}}_{j}=\frac{{\mathbf{t}}_{j}}{\parallel {\mathbf{t}}_{j}\parallel}

7.
{\mathbf{p}}_{j}={\mathbf{X}}_{j}^{T}{\mathbf{t}}_{j}

8.
P _{ j }= [p _{1},p _{2},…,p _{ j−1}]
The resulting weights w _{ j }and scores t _{ j } are stored as columns in the matrix W and T respectively.
The nonlinear kernel PLS method is based on mapping the original input data into a high dimensional feature space[62]. SIMPLS needs to be reformulated into its kernel variant (in this work Gaussian kernel PLS pls LMNN transformation Acc result is shown in Table2), assuming a zero mean nonlinear kernel PLS.
References
Petrella JR, Coleman RE, Doraiswamy PM: Neuroimaging and Early Diagnosis of Alzheimer’s Disease: A Look to the Future. Radiology. 2003, 226: 315336. 10.1148/radiol.2262011600.
Ramírez J, Górriz JM, SalasGonzalez D, Romero A, López M, Illán IA, GómezRío M: Computeraided diagnosis of Alzheimer’s type dementia combining support vector machines and discriminant set of features. Inf Sci. 2009, doi:10.1016/j.ins.2009.05.012
English RJ, Childs J (Eds): SPECT: SinglePhoton Emission Computed Tomography: A Primer. 1996, Society of Nuclear Medicine
Hellman RS, Tikofsky RS, Collier BD, Hoffmann RG, Palmer DW, Glatt S, Antuono PG, Isitman AT, Papke RA: Alzheimer disease: quantitative analysis of I123iodoamphetamine SPECT brain imaging. Radiology. 1989, 172: 183188.
Holman BL, Johnson KA, Gerada B, Carvalho PA, Satlin A: The Scintigraphic Appearance of Alzheimer’s Disease: A Prospective Study Using Technetium99mHMPAO SPECT. J Nucl Med. 1992, 33 (2): 181185.
Illán IA, Górriz JM, López MM, Ramírez J, Gonzalez DS, Segovia F, Chaves R, Puntonet CG: Computer aided diagnosis of Alzheimer’s disease using component based SVM. Appl Soft Comput. 2011, 11: 23762382. 10.1016/j.asoc.2010.08.019.
Ramírez J, Górriz JM, Chaves R, López M, SalasGonzález D, Alvarez I, Segovia F: SPECT image classification using random forests. Electron Lett. 2009, 45 (12): 604605. 10.1049/el.2009.1111.
Górriz JM, Ramírez J, Lassl A, SalasGonzález D, Lang EW, Puntonet CG, Alvarez I, Río MG: Automatic computer aided diagnosis tool using componentbased SVM. IEEE Nucl Sci Symp Conference Record. 2008, 4774255: 43924395.
Fung G, Stoeckel J: SVM feature selection for classification of SPECT images of Alzheimer’s disease using spatial information. Knowledge Inf Syst. 2007, 11 (2): 243258. 10.1007/s1011500600435.
Friston KJ, Ashburner J, Kiebel SJ, Nichols TE, Penny WD (Eds): Statistical Parametric Mapping: The Analysis of Functional Brain Images. 2007, San Diego: Academic Press
Schechtmana E, Shermanb M: The twosample ttest with a known ratio of variances. Stat Methodology. 2007, 4: 508514. 10.1016/j.stamet.2007.03.001.
Cristianini N, ShaweTaylor J: An Introduction to Support Vector Machines and Other KernelBased Learning Methods. 2000, Cambridge University Press
Burges C: A tutorial on support vector machines for pattern recognition. Data Min Knowledge Discovery. 1998, 2 (2): 121167. 10.1023/A:1009715923555.
Chaves R, Ramírez J, Górriz J, López M, SalasGonzalez D, Alvarez I, Segovia F: SVMbased computeraided diagnosis of the Alzheimer’s disease using ttest NMSE feature selection with feature correlation weighting. Neurosci Lett. 2009, 461: 293297. 10.1016/j.neulet.2009.06.052.
Weinberger KQ, Blitzer J, Saul LK: Distance Metric Learning for Large Margin Nearest Neighbor Classification. J Machine Learning Res. 2009, 10: 207244.
Chai J, Liu H, Chen B, Bao Z: Large margin nearest local mean classifier. Signal Process. 2010, 90: 236248. 10.1016/j.sigpro.2009.06.015.
Goldberger J, Roweis S, Hinton G, Salakhutdinov R: Neighbourhood components analysis. Adv Neural Inf Process Syst, Cambridge MA. 2005, 17: 513520.
Xing EP, Ng AY, Jordan MI, Russell S: Distance metric learning, with application to clustering with sideinformation. T. G. Dietterich, S. Becker, and Z. Ghahramani, editors, Adv Neural Inf Process Syst; Cambridge, MA. 2002, 15: 505512.
Globerson A, Roweis ST: Metric learning by collapsing classes. Adv Neural Inf Process Syst. 2005, 18: 451458.
Hill D, Batchelor PG, Holden M, Hawkes DJ: Medical image registration. Phys Med Biol. 2001, 46: R145. 10.1088/00319155/46/3/201.
SalasGonzalez D, Górriz JM, Ramírez J, López M, Alvarez I, Segovia F, Chaves R, Puntonet CG: Computeraided diagnosis of Alzheimer’s disease using support vector machines and classification trees. Phys Med Biol. 2010, 55: 28072817. 10.1088/00319155/55/10/002.
Woods RP, Grafton ST, Holmes CJ, Cherry SR, Mazziotta JC: Automated image registration: I. General methods and intrasubject, intramodality validation. J Comput Assist Tomogr. 1998, 22: 139152. 10.1097/0000472819980100000027.
Ashburner J, Friston KJ: Nonlinear spatial normalization using basis functions. Hum Brain Mapp. 1999, 7: 254266. 10.1002/(SICI)10970193(1999)7:4<254::AIDHBM4>3.0.CO;2G.
Saxena P, Pavel FG, Quintana JC, Horwitz B: An automatic thresholdbased scaling method for enhancing the usefulness of TcHMPAO SPECT in the diagnosis of Alzheimer’s disease. Med Image Comput ComputAssisted Intervention  MICCAI. 1998, 1496: 623630.
Jobst KA, Barnetson LP, Shepstone BJ: Accurate prediction of histologically confirmed, Alzheimer’s disease and the differential diagnosis of dementia: the use of NINCDSADRDA and DSMIIIR criteria, SPECT, xray, CT, and apo e4 in medial temporal lobe dementias. Oxford Project to Investigate Memory and Aging, Int Psychogeriatrics. 1998, 10 (3): 271302.
Dubois B, Feldman HH, Jacova C, DeKosky ST, BarbergerGateau P, Cummings J, Delacourte A, Galasko D, Gauthier S, Jicha G, Meguro K, O’Brien J, Pasquier F, Robert P, Rossor M, Salloway S, Stern Y, Visser PJ, Scheltens P: Research criteria for the diagnosis of Alzheimer’s disease: revising the NINCDS ADRDA criteria. Lancet Neurology. 2007, 6 (8): 734746. 10.1016/S14744422(07)701783.
SalasGonzalez D, Górriz JM, Ramírez J, Lassl A, Puntonet CG: Improved gaussnewton optimization methods in affine registration of SPECT brain images. IET Electron Lett. 2008, 44 (22): 12911292. 10.1049/el:20081838.
Ashburner J, Friston KJ: Nonlinear spatial normalization using basis functions. Human Brain Mapping. 1999, 7 (4): 254266. 10.1002/(SICI)10970193(1999)7:4<254::AIDHBM4>3.0.CO;2G.
Jackson JE (Ed): A Users Guide to Principal Components. 1991, New York: Wiley
Wold S, Esbensen K, Geladi P: Principal components analysis. Chemometr Intell Lab Syst. 1987, 2: 3752. 10.1016/01697439(87)800849.
Wold H: Soft modeling. The basic design and some extensions. Joreskog, K.G., Wold, H. (Eds.), Syst. Under Indirect Observation. 1982, 2: 589591.
Tenenhaus M (Ed): La Regression PLS: Theorie et Pratique. 1998, Paris: Technip
Chopra S, Hadsell R, LeCun Y: Learning a similiarty metric discriminatively, with application to face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR05) San Diego, CA. 2005, 349356.
Tsochantaridis I, Joachims T, Hofmann T, Altun Y: Large margin methods for structured and interdependent output variables. J Machine Learning Res. 2005, 6: 14531484.
Andersen A, Gash DM, Avison MJ: Principal component analysis of the dynamic response measured by fMRI: a generalized linear systems framework. J Magn Reson Imaging. 1999, 17: 795815. 10.1016/S0730725X(99)000284.
López M, Ramírez J, Górriz JM, SalasGonzalez D, Alvarez I, Segovia F, Puntonet CG: Automatic tool for the Alzheimer’s disease diagnosis using PCA and bayesian classification rules. IET Electron Lett. 2009, 45 (8): 389391. 10.1049/el.2009.0176.
Jadea AM, Srikantha B, Jayaramana VK, Kulkarnia BD: Feature extraction and denoising using kernel PCA. Chem Eng Sci. 2003, 58: 44414448. 10.1016/S00092509(03)003403.
Ramírez J, Górriz J, Segovia F, Chaves R, SalasGonzalez D, López M, Illán I, Padilla P: Computer aided diagnosis system for the Alzheimer’s disease based on partial least squares and random forest SPECT image classification. Neurosci Lett. 2010, 472: 99103. 10.1016/j.neulet.2010.01.056.
Bastien P, Vinzi VE, Tenenhaus M: PLS generalised linear regression. Comput Stat Data Anal. 2005, 48: 1746. 10.1016/j.csda.2004.02.005.
Wold S, Ruhe H, Wold H, Dunn W: The colinearity problem in linear regression. The Partial Least squares (PLS) approach to generalized inverse. J Sci Stat Computations. 1984, 5: 735743. 10.1137/0905052.
Yang L, Jin R: Distance metric learning: a comprehensive survey. 2006, Michigan State University
Weinberger K, Saul LK: Fast Solvers and Efficient Implementations for Distance Metric Learning. 2008, Helsinki, Finland, 11601167.
Chatpatanasiri R, Korsrilabutr T, Tangchanachaianan P, Kijsirikul B: A new kernelization framework for Mahalanobis distance learning algorithms. Neurocomputing. 2010, 73: 15701579. 10.1016/j.neucom.2009.11.037.
Xiang S, Nie F, Zhang C: Learning a Mahalanobis distance metric for data clustering and classification. Pattern Recognit. 2008, 41: 36003612. 10.1016/j.patcog.2008.05.018.
Pérez P, Chardin A, Laferte J: Noniterative manipulation of discrete energybased models for image analysis. Pattern Recognit. 2000, 33: 573586. 10.1016/S00313203(99)000734.
Vapnik V (Ed): Estimation of Dependences Based on Empirical Data. 1982, New York: SpringerVerlag
SalasGonzález D, Górriz JM, Ramírez J, López M, Illán IA, Segovia F, Puntonet CG, GómezRío M: Analysis of SPECT brain images for the diagnosis of Alzheimer’s disease using moments and support vector machines. Neurosci Lett. 2009, 461: 6064. 10.1016/j.neulet.2009.05.056.
Duin RPW: Classifiers in almost empty spaces. Int Conference Pattern Recognit (ICPR). 2000, 2 (2): 43924395.
Wiens TS, Dale BC, Boyce MS, Kershaw GP: Three way kfold crossvalidation of resource selection functions. Original Res Art Ecol Modell. 2008, 212 (34): 244255.
Nadeau C, Bengio Y: Inference for the generalization error. Machine Learning. 2003, 52 (3): 239281. 10.1023/A:1024068626366.
Bengio Y, Grandvalet Y: No Unbiased Estimator of the Variance of KFold CrossValidation. J Machine Learning Res. 2004, 5: 10891105.
Westman E, Simmons A, Zhang Y, Muehlboeck JS, Tunnard C, Liu Y, Collins L, Evans A, Mecocci P, Vellas B, Tsolaki M, Kloszewska I, Soininen H, Lovestone S, Spenger C, Wahlund L: Multivariate analysis of MRI data for Alzheimer’s disease, mild cognitive impairment and healthy controls. Neuroimage. 2011, 54 (2): 11781187. 10.1016/j.neuroimage.2010.08.044.
Kohavi R: A Study of CrossValidation and Bootstrap for Accuracy Estimation and Model Selection. 1995, Montreal, Quebec, Canada, 11371143.
Górriz JM, Segovia F, Ramírez J, Lassl A, SalasGonzalez D: Automatic Selection of ROIs in functional imaging using gaussian mixture models. Appl Soft Comput. 2011, 11 (2): 23762382. 10.1016/j.asoc.2010.08.019.
Stoeckel J, Ayache N, Malandain G, Koulibaly PM, Ebmeier KP, Darcourt J: Automatic Classification of SPECT Images of Alzheimer’s Disease Patients and Control Subjects. Med Image Comput ComputAssisted Intervention  MICCAI. 2004, 3217: 654663. Lecture Notes in Computer Science Springer
López M, Ramírez J, Górriz JM, Alvarez I, SalasGonzalez D, Segovia F, Chaves R: SVMbased CAD System for Early Detection of the Alzheimer’s Disease using Kernel PCA and LDA. Neurosci Lett. 2009, 3 (464): 233238.
Metz C: Basic Principles of ROC Analysis. Seminars Nucl Med. 1978, 4 (8): 283298.
Scholkopf B, Müller KRM, Smola A: Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Comput. 1998, 10 (5): 12991319. 10.1162/089976698300017467.
Scholkopf B, Müller KRM, Smola A: Kernel Principal Component Analysis. Artif Neural Networks — ICANN’97. Lecture Notes in Comput Sci. 1997, 1327: 583588. 10.1007/BFb0020217.
de Jong S: Simpls: An alternative approach to partial least squares regression. Chemom Intell Lab Syst. 1993, 18 (3): 251263. 10.1016/01697439(93)85002X.
Varmuza K, Filzmoser P (Eds): Introduction to Multivariate Statistical Analysis in Chemometrics. 2009, FL: Taylor and Francis  CRC Press, Boca Raton
Rosipal R: Kernel Partial Least Squares for Nonlinear Regression and Discrimination. Neural Network World. 2003, 13 (3): 291300.
Prepublication history
The prepublication history for this paper can be accessed here:http://www.biomedcentral.com/14726947/12/79/prepub
Acknowledgements
This work was partly supported by the MICINN of Spain under the TEC200802113 and TEC201234306 project and the Consejeria de Innovacion, Ciencia y Empresa (Junta de Andalucia, Spain) under the Excellence Projects P07TIC02566, P09TIC 4530 and P11TIC7103.
The PET data collection and sharing for this project was funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: Abbott, Alzheimer’s Association, Alzheimer’s Drug Discovery Foundation, Amorfix Life Sciences Ltd., AstraZeneca, Bayer HealthCare; BioClinica, Inc., Biogen Idec Inc., BristolMyers Squibb Company, Eisai Inc., Elan Pharmaceuticals Inc., Eli Lilly and Company, F. HoffmannLa Roche Ltd and its affiliated company Genentech, Inc., GE Healthcare, Innogenetics, N.V., IXICO Ltd., Janssen Alzheimer Immunotherapy Research and Development, LLC., Johnson and Johnson Pharmaceutical Research and Development LLC., Medpace, Inc., Merck and Co., Inc., Meso Scale Diagnostics, LLC., Novartis Pharmaceuticals Corporation, Pfizer Inc., Servier, Synarc Inc., and Takeda Pharmaceutical Company. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (http://www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer’s Disease Cooperative Study at the University of California, San Diego. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of California, Los Angeles. This research was also supported by NIH grants P30 AG010129 and K01 AG030514.
Author information
Authors and Affiliations
Consortia
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Author’s contributions
The authors contributed to the selection and discussion of the literature reviewed in this work. The authors participated in the conception and preparation of the final manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Chaves, R., Ramírez, J., Górriz, J.M. et al. Effective diagnosis of Alzheimer’s disease by means of large marginbased methodology. BMC Med Inform Decis Mak 12, 79 (2012). https://doi.org/10.1186/147269471279
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/147269471279
Keywords
 Partial Little Square
 Normalize Mean Square Error
 Kernel Principal Component Analysis
 Small Sample Size Problem
 Target Neighbour