Combining dissimilarity based classifiers for cancer prediction using gene expression profiles
© Blanco et al; licensee BioMed Central Ltd. 2007
Published: 20 November 2007
DNA Microarrays allow us to monitor the expression level of thousands of genes simultaneously across a collection of related samples. This technology has been applied to the prediction of cancer considering the gene expression profiles in both, normal and cancer samples.
Support Vector Machines (SVM) have been applied to identify cancer samples considering the gene expression levels with encouraging results. This kind of techniques are able to deal with high dimensional and noisy data which is an important requirement in our practical problem.
However, common SVM algorithms rely on the use of the Euclidean distance which does not reflect accurately the proximities among the sample profiles .
This feature favors the misclassification of cancer samples (false negative errors) which is a serious drawback in our application. The SVM has been extended to incorporate non-Euclidean dissimilarities .
Nevertheless, no dissimilarity can be considered superior to the others because each one reflects just different features of the data and misclassifies a different set of patterns.
The false negative errors of individual classifiers can be reduced by combining non-optimal classifiers . To this aim, different versions of the classifier are usually built by bootstrap sampling the patterns or the features.
However, resampling techniques reduce the size of the training set increasing the bias of individual classifiers and consequently the error of the resulting combination .
To avoid the bias introduced by resampling techniques, we propose a combination strategy that builds the diversity of classifiers considering a set of dissimilarities that reflect different features of the data. In order to incorporate the dissimilarities into the SVM, they are first embedded in an Euclidean space such that the inter-pattern distances reflect the original dissimilarity matrix. Next, for each dissimilarity a C-SVM is trained. Finally, the resulting classifiers are properly combined using a voting strategy. Our method is able to work directly from a dissimilarity matrix.
In this paper, we have proposed an ensemble of classifiers based on a diversity of dissimilarities. Experimental results suggest that the method proposed improves both, misclassification errors and false negative errors of classifiers based on a single dissimilarity.
- Jiang D, Tang C, Zhang A: Cluster Analysis for Gene Expression Data: A Survey. IEEE Transactions on Knowledge and Data Engineering 2004, 16(11):1370–1386. 10.1109/TKDE.2004.68View ArticleGoogle Scholar
- Pekalska E, Paclick P, Duin R: A generalized kernel approach to dissimilarity-based classification. Journal of Machine Learning Research 2001, 2: 175–211. 10.1162/15324430260185592Google Scholar
- Kittler J, Hatef M, Duin PW, Matas J: On Combining Classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998, 20(3):226–239. 10.1109/34.667881View ArticleGoogle Scholar
- Valentini G, Dietterich T: Bias-variance analysis of support vector machines for the development of svm-based ensemble methods. Journal of Machine Learning Research 2004, 5: 725–775.Google Scholar
- West M, et al.: Predicting the Clinical Status of Human Breast Cancer by using Gene Expression Profiles. PNAS 2001, 98(20):11462–11467. 10.1073/pnas.201162998PubMed CentralView ArticlePubMedGoogle Scholar
- Golub TR, et al.: Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring. Science 1999, 286(15):531–537. 10.1126/science.286.5439.531View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd.