 Methodology article
 Open access
 Published:
Kernel based methods for accelerated failure time model with ultrahigh dimensional data
BMC Bioinformatics volume 11, Article number: 606 (2010)
Abstract
Background
Most genomic data have ultrahigh dimensions with more than 10,000 genes (probes). Regularization methods with L_{1} and L_{ p } penalty have been extensively studied in survival analysis with highdimensional genomic data. However, when the sample size n ≪ m (the number of genes), directly identifying a small subset of genes from ultrahigh (m > 10, 000) dimensional data is timeconsuming and not computationally efficient. In current microarray analysis, what people really do is select a couple of thousands (or hundreds) of genes using univariate analysis or statistical tests, and then apply the LASSOtype penalty to further reduce the number of disease associated genes. This twostep procedure may introduce bias and inaccuracy and lead us to miss biologically important genes.
Results
The accelerated failure time (AFT) model is a linear regression model and a useful alternative to the Cox model for survival analysis. In this paper, we propose a nonlinear kernel based AFT model and an efficient variable selection method with adaptive kernel ridge regression. Our proposed variable selection method is based on the kernel matrix and dual problem with a much smaller n × n matrix. It is very efficient when the number of unknown variables (genes) is much larger than the number of samples. Moreover, the primal variables are explicitly updated and the sparsity in the solution is exploited.
Conclusions
Our proposed methods can simultaneously identify survival associated prognostic factors and predict survival outcomes with ultrahigh dimensional genomic data. We have demonstrated the performance of our methods with both simulation and real data. The proposed method performs superbly with limited computational studies.
Background
Survival prediction and prognostic factor identification play a very important role in medical research. Survival data normally include the censoring variable that indicates whether some outcome under observation (like death or recurrence of a disease) has occurred within some specific followup time. The modeling procedures must take into account such censoring. It is even more difficult to develop a proper statistical learning method for survival prediction.
Several models for survival predictions have been proposed in statistical literature. The most popular one is the Cox proportional hazards model [1–3], in which model parameters are estimated with partial log likelihood maximization. Another one is the accelerate failure time (AFT) model [4–6]. AFT is linear regression model in which the response variable is the logarithm or a known monotone transformation of a failure (death) time. There are mainly two approaches in literature for fitting a AFT model. One is the the BuckleyJames estimator which adjusts censored observations using the Kaplan Meier estimator [7, 8], and the other is a semiparametric estimation of AFT model with an unspecific error distribution [9–11]. However, the semiparametric Bayesian approach based on complex MCMC procedures is computationally intensive and tends to have inaccurate results, and the Stute's weighted least squares (LS) estimator only implicitly accounts for the censored time. The model has not been widely used in practice due to the difficulties in computing the model parameters [12], and there is no nonlinear AFT model in the literature.
Kernel based methods such as support vector machines (SVM) have been extensively studied recently in the framework of classification and regression [13] in the area of pattern recognition and statistical learning. The concept of kernel formulated as an inner product in the feature space allows us to build nonlinear extensions of many linear models [14]. It would have been a potential alternative if it were not for the complexity of censoring. Moreover, LASSO type penalty and its generalized versions have been proposed for gene (variable) selection with high dimensional genomic profiles with censored survival outcomes [15–18]. However, since the sample size n ≪ m (the number of variables), methods based the primary formulation with a huge m (m > 40, 000) are not efficient. Consequently, in current microarray analysis, what people really do is select a couple of thousands (or hundreds) of genes using filterbased methods (such as Ttest) and then apply the LASSOtype penalty to further reduce the number of disease associated genes. This twostep procedure will lead to missing biologically important genes and introducing bias. The dual solution with kernel proposed in this article attempts to resolve these inadequacies by solving a much smaller n × n matrix.
In this paper, we propose a nonlinear kernel ridge regression for censored survival outcome prediction under the framework of AFT model. We also develop an efficient dual solution with adaptive kernel ridge regression for ultrahigh dimensional genomic data analysis.
Unlike the weighted least square method, our model explicitly accounts for censoring. The proposed models are evaluated with simulation and real data and the prediction error of the test data.
Results and Discussion
Simulation Data
Simulation studies are conducted to evaluate the performance of the proposed methods under different assumptions. The following describes a method to generate input data with censored survival outcomes that emulates the mechanisms presented by the actual data.

1.
Sample 12 dimensional input data x with 100 training and test samples respectively from a multivariate normal distribution with mean zero and variancecovariance matrix Σ. The pairwise correlation between the i th and the j th input variables in Σ is r^{ij}and different correlations (r = 0.2, 0.4, 0.6, and 0.8) will be chosen to assess the performance of the proposed method.

2.
Choose the model parameters w = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]^{T}, and generate the event time from log T = w^{t} x^{k} + ε, where ε ~ N(0, σ^{2}) and σ is determined by the signal to noise ratio (SNR = μ_{ surv }/σ). For instance, with the mean log survival time of 3, and SNR = 3 : 1, we have σ = 1. SNR = 3 : 1 is used in all of our simulations. Finally, k indicates the k th power of input variables, so the log survival time is associated with the input variables nonlinearly.

3.
The censoring variables are generated as uniformly distributed and independent of the events. Letting d_{ i } = (rand + C)T_{ i }, the censoring status will be δ_{ i } = T_{ i } < d_{ i }. Different Cs give a different portion of censored data. Roughly 40%  60% censored data are produced in our simulations.
We analyze the simulation data with the proposed DKRR algorithm and build the model with training data, evaluate the performance of the model with the test data. The performance of the DKRR algorithm with different kernels and different correlation structures are shown in Figure 1. As shown in the upper panels of Figure 1, when the the survival data are simulated with k = 1 and the true model is linear, the linear model has the best performance with the the average relative root mean squared error (RRMSE) around 0.1. Models with the radial basis function (rbf) kernel have the second best performance with different correlation structures (r = 0.2 0.8). Models with the third order polynomial have the worst performance with the mean RRMSE around 0.4. On the other hand, when the survival data are generated with a quadratic model with k = 2 as shown in the lower panels of Figure 1, Model with second order polynomial kernel and rbf kernel are the two top performers with the average test RRMSE around 0.2, and the linear model performs the worst with the largest average test RRMSE around 0.6. These results indicate that model specification is very important. A misspecified model may lead to inaccurate predictions. Finally, there are no statistical significant differences for input variables with different correlations (r = 02 0.8).
To evaluate the performance of AKRR method, the survival data are generated from linear model with r = 0.4, and different w s. The generated input data have the dimensions of 100, 1000, 10000, 50000, and 100000, but only 12 variables at the positions of 1, 11, 21, 31, ..., 101, 111 are nonzero with the values of [w_{1}, w_{11}, w_{21}, ..., w_{101}, w_{111}]^{T} = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]^{T} , [0.2, 0.2, 0.2, 0.2, 0.2, 0.2, 0.2, 0.2, 0.2, 0.2, 0.2, 0.2]^{T}, or [0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1, 0.1]^{T} respectively. The rest coefficients are set to 0. The random noise and rest of the variables are generated from the distribution of N(0, σ^{2}), and σ is determined by the mean survival time and the signal to noise ratio (SNR = 3:1). The test RRMSEs with different input dimensions are shown in Figure 2. Figure 2 shows that the test RRMSEs have not changed significantly when the input dimension increases from 100 to 100000, which indicates that AKRR method performs well even with a huge number of variables. The frequencies of first 12 component variables being selected out of 100 random simulations with different w are given in Table 1. Table 1 shows that AKRR can correctly identify the survival associated variables with high accuracy. AKRR identifies all 12 variables with over 88% ratios and identifies 10 out of 12 variables with over 96% ratios when w_{ i } = 1. Moreover, the performances are still very impressive when the associations between survival time and covariates are weak. AKRR identifies 10 out of 12 variables with over 95% and 94% ratios when w_{ i } = 0.2 and w_{ i } = 0.1 respectively. Table 2 gives more details about the average number of variables being selected and the ratios of correctlydetected, overfitting, and underfitting. The optimal parameters in the parenthesis are decided by 10fold crossvalidation with the training data only. p* is chosen from the values of 0.6, 0.7, 0.8, 0.9, 1, since our computational experiments show that AKRR seems to converge to the same solution when p ≥ 0.6 with different initializations for the same data set. λ* is chosen from 0:0.001:1. The average number of selected variables varies from 11.4312.61 around the true number 12. AKRR identifies exactly the same 12 variables with the ratios of 75%, 54%, and 52% for w_{ i } = 1, 0.2, and 0.1 respectively. In all three cases, AKRR chooses the number of variables in the range of 1113 with over 90% ratio.
For comparison purposes, we also implement the primal version of LASSO for AFT model with GaussSeidel method to optimize w directly. The computational time for different input dimensions is listed in Table 3. Table 3 shows that AKRR is so computational efficient that it only takes 17.5 seconds for one run to identify variables from 100,000 candidate variables, while LASSO might take days. With 50000 variables, AKRR only needs 7.5 seconds on average to converge, while LASSO fails to converge after 2 hours. When the input dimension is large, AKRR is much more efficient. This is reasonable since the computational time of AKRR is mainly associated with the sample size and dual variables. This method will be fast even with ultrahigh dimensional input as long as the sample size is small, which is common in genomic data analysis.
Diffuse Large Bcell Lymphoma Data
We now consider one diffuse large Bcell lymphoma (DLBCL) data [19] evaluating gene expression profiles associated with the patient's survival. In this study, tumorbiopsy specimens and clinical data were obtained retrospectively from 240 patients with untreated diffuse largeBcell lymphoma who had no previous history of lymphoma, according to a protocol approved by the National Cancer Institute institutional review board. The median followup time was 2.8 years overall (7.3 years for survivors), and 57 percent of patients died during this period. The median age of the patients was 63 years, and 56 percent were men. CDNA microarray data with 7,399 probes were collected. We divide the data into two equal parts with 120 training data and 120 test data. We utilize the twofold cross validation scheme to choose the optimal λ and evaluate our method. We randomly split the data into two roughly equalsized subsets and build the model with one subset and test it with the other. To avoid the bias arising from a particular partition, the procedure is repeated 100 times, each time we split the data randomly into two folds and do cross validation. The relevance count is utilized to count how many times a gene is selected in the cross validation. Clearly the maximum relevance count for a gene is 200 with the twofold cross validation and 100 repeating. The optimal λ* is in the range of 0.260.3, and the optimal p* is set to 0.7 in all the experiments. The test RRMSE is 0.07 on average, which is better than the average test RRMSE (0.101) with LASSO based primal model. This is reasonable, since AKRR has one additional parameter p. Genes associated with survival time are shown in Table 4. We identify 23 probes with over 100 relevant counts. Those 23 probes are corresponding to 21 known genes. All of the selected genes play important roles in apoptotic processes and/or the development and progress of various cancers. 17 out of 21 genes are associated with different lymphoma according to PubMed. For example, BMP6 is the top gene in other category associated with poor outcome and HLAC gene is from the major histocompatibility class (MHC) II family, both genes were also identified by Rosenwald et al. 2002. Moreover, CD86, CD79a, and CD19 are well known antigens and MHC II signatures associated with favorable survival outcomes. We then perform pathway analysis using DAVID (david.abcc.ncifcrf.gov) and identify 5 lymphoma associated pathways: NODlike Receptor Signaling Pathway, Pathways in Cancer, Allograft Rejection, Focal Adhesion, and Graftversushost Disease. Four out 5 pathways (except for NODlike Receptor Signaling Pathway) are known to be associated with DLBCL from PubMed.
Follicular Lymphoma (FL) Data
Follicular lymphoma is a common type of NonHodgkin Lymphoma (NHL). It is a slow growing lymphoma that arises from Bcells, a type of white blood cell. It is also called an "indolent" or "lowgrade" lymphoma for its slow nature, both in terms of its behavior and how it looks under the microscope. A study was conducted to predict the survival probability of patients with gene expression profiles of tumors at diagnosis [20]. Freshfrozen tumor biopsy specimens and clinical data were obtained from 191 untreated patients who had received a diagnosis of follicular lymphoma between 1974 and 2001. The median age of patients at diagnosis was 51 years (range 23  81) and the median follow up time was 6.6 years (range less than 1.0  28.2). The median follow up time among patients alive was 8.1 years. Four records with missing survival information were excluded from the analysis. Affymetrix U133A abd U133B microarray genechips were used to measure gene expression levels from RNA samples. A log 2 transformation was applied to the Affymetrix measurement. Detailed experimental protocol can be found from the original paper. There are total of 42928 probes. It is time consuming to directly apply standard LASSO methods to this problem without an initial reduction of dimensions. Our method takes less than 10 seconds for one run. Similar twofold cross validation scheme with 100 random partitions is utilized to this data. The optimal λ* is in the range of 0.1  0.12 with the optimal p* = 0.6. The test RRMSE is 0.09. The final results are shown in Table 5.
Thirteen probes with over 100 relevance counts are identified. Those 13 probes are corresponding to 11 known genes associated with lymphoma and related diseases. For instance, gene C4A localizes to the major histocompatibility complex (MHC) class III region on chromosome 6. It plays a central role in the activation of the classical pathway of the complement system. C4A anaphylatoxin is a mediator of local inflammatory process. It induces the contraction of smooth muscle, increases vascular permeability, and causes histamine release from mast cells and basophilic leukocytes. C4A is on the pathway of Systemic Lupus Erythematosus (SLE). Patients with SLE can increase the risk of certain cancers, including nonHodgkin's lymphoma. We find that C4A is negatively associated with survival time according the estimated coefficient of C4A. ALDH2 is another well studied gene which is significantly associated with acetaldehydeinduced micronuclei and alcoholinduced facial flushing. Defects in ALDH2 are a cause of acute alcohol sensitivity and alcohol induced cancers. There are accumulating evidences that ALDH2deficient individuals are at much higher risk of esophageal cancer and malignant lymphoma. Our study indicates that the upregulated ALDH2 is positively associated with patient survival outcomes. Six other genes are also associated with different cancers including follicular lymphoma.
Conclusions
We proposed kernel based methods for nonlinear AFT model and variable selection for ultrahigh dimensional data. Our evaluations with simulation and real data illustrate that the proposed methods can effectively reduce the dimension of the covariates with sound prediction accuracy. In many studies, both clinical and genomic data are available. Due to the ultrahigh dimension in genomic data, directly applying LASSO based methods to genomic data is usually not feasible. Our proposed method provides an efficient solution for it. Kernel based nonparametric methods have been well studied in statistical learning, but there are not many studies for survival analysis. In this paper, we provide a basis for further explorations in this field.
Methods
To formulate the model, consider a set of n independent observations {\{{T}_{i},{\delta}_{i},{\mathbf{x}}_{i}\}}_{i=1}^{n}, where δ_{ i } is the censoring indicator, T_{ i } is the survival time (event time) if δ_{ i } = 1 or censoring time if δ_{ i } = 0, and x_{ i } = (x_{i 1}, x_{i 2}, ..., x_{ im })^{t} is the mdimensional input vector of the i th sample. Letting w = (w_{1}, w_{2}, ..., w_{ m })^{t} be a vector of regression coefficients and ϕ(x_{ i }) is the nonlinear transform of x_{ i } in feature space, the AFT model is defined as
where M(x_{ i }) > log T_{ i } if δ_{ i } = 0 and M(x_{ i }) = log T_{ i } if δ_{ i } = 1. Because there are both equality and inequality constraints in the model, new methods need to be developed.
Kernel Ridge Regression (KRR)
The kernel ridge regression for right censored survival data is as follows:
When ties in the event times are presented, variables associated with each tied time appear in the constraints independently. We can define an index function I(δ_{ i }) = 1 if δ_{ i } = 1, and for censored data with δ_{ i } = 0, I(δ_{ i }) is defined as I(δ_{ i }) = 1 if log T_{ i } ≥ w^{t}ϕ(x_{ i }) and 0 otherwise. Then equation (2) is equivalent to the following quadratic function:
where λ ≥ 0. If we set the gradient of J(w) with respect to w to zero, then the solution for w is a linear combination of the vectors ϕ(x_{ i }):
where Φ is the design matrix, whose i^{th} row is given by ϕ(x_{ i })^{t}, and a = (a_{1}, a_{2}, ..., a_{ n })^{t} are the dual variables, defined by
Substituting w = Φ^{t}a into a_{ i }, we obtain
where K = (K(x_{ i }, x_{ j }))_{ n × n } = (ϕ(x_{ i })^{t}ϕ(x_{ j }))_{ n × n } is a kernel matrix which can be defined explicitly and K(x_{ i },.) = ϕ(x_{ i })^{t}Φ^{t} is the ith row of the kernel matrix. Popular kernels include:

Linear kernel:
K\left({\mathbf{x}}_{i},{\mathbf{x}}_{j}\right)={\mathbf{x}}_{i}^{t}{\mathbf{x}}_{j}, 
Radial basis function (Gaussian) kernel:
K\left({\mathbf{x}}_{i},{\mathbf{x}}_{j}\right)=\mathrm{exp}\left(\frac{{\mathbf{x}}_{i}{\mathbf{x}}_{j}{}^{2}}{{\sigma}^{2}}\right), 
Polynomial kernel:
K\left({\mathbf{x}}_{i},{\mathbf{x}}_{j}\right)={\left({\mathbf{x}}_{i}^{t}{\mathbf{x}}_{j}+{p}_{2}\right)}^{{p}_{1}}, 
Sigmoid kernel:
K\left({\mathbf{x}}_{i},{\mathbf{x}}_{j}\right)=\mathrm{tanh}\left(\beta {\mathbf{x}}_{i}^{t}{\mathbf{x}}_{j}\right).
Our kernel ridge regression algorithm based on the dual equation (DKRR) (6) is as follows:
The Dual Kernel Ridge Regression (DKRR) Algorithm
Given λ, training data {\left\{{\mathbf{x}}_{i},\mathrm{log}{T}_{i},{\delta}_{i}\right\}}_{i=1}^{n}, test data {\left\{{\mathbf{x}}_{k},\mathrm{log}{T}_{k},{\delta}_{k}\right\}}_{k=1}^{{n}_{k}}, and a small ε.
Calculate the kernel matrices K={\left[K\left({\mathbf{x}}_{i},{\mathbf{x}}_{j}\right)\right]}_{n\times n} and {K}_{te}={\left[K\left({\mathbf{x}}_{k},{\mathbf{x}}_{i}\right)\right]}_{{n}_{k}\times n}.
Center the kernels and the survival times: K=\left({I}_{n}\frac{1}{n}{1}_{n}{1}_{n}^{t}\right)K\left({I}_{n}\frac{1}{n}{1}_{n}{1}_{n}^{t}\right) and {K}_{te}=\left({K}_{te}\frac{1}{n}{1}_{{n}_{k}}{1}_{n}^{t}K\right)\left({I}_{n}\frac{1}{n}{1}_{n}{1}_{n}^{t}\right), where 1_{ n }: a vector with n 1's. and I_{ n }: an identity matrix, and \mathrm{log}{T}_{k}=\mathrm{log}{T}_{k}\frac{{\sum}_{k=1}^{{n}_{k}}\mathrm{log}{T}_{k}}{{n}_{k}}. Let a^{0} = [0, ..., 0, 0]^{t}, and j = 0
WHILE 1,

FOR i = 1 to n,
I\left({\delta}_{i}\right)=\{\begin{array}{ll}1\hfill & \text{if}{\delta}_{i}0,\hfill \\ 1\hfill & \text{if}{\delta}_{i}=0,\hfill \\ K\left({\mathbf{x}}_{i},.\right){\mathbf{a}}^{j}\le \mathrm{log}{T}_{i},\hfill \\ 0\hfill & \text{otherwise}.\hfill \end{array}
{a}_{i}^{j+1}=\frac{I\left({\delta}_{i}\right)}{n\lambda}\left\{K\left({\mathbf{x}}_{i},.\right){\mathbf{a}}^{j}\mathrm{log}{T}_{i}\right\}
{\mathbf{a}}^{j+1}={\left[{a}_{1}^{j+1},...,{a}_{i}^{j+1},{a}_{i+1}^{j}...,{a}_{n}^{j}\right]}^{t}
END

j = j + 1

IF a^{j+1} a^{j} < ε, BREAK.

a^{j}= a^{j+1}
END
This dual kernel ridge regression (DKRR)algorithm designed for a quadratic error function with linear constraints is a convex function with convex constraints. Theoretically this algorithm will always converge and global optimal solution is guaranteed irrelevant to initial value a^{0}. In our computational experiments, the differences of the estimated parameters with different initial values are very small (less than 0.01 with the infinity norm).
Adaptive Kernel Ridge Regression
When the number of variables is greater than the sample size n, regularization is needed to obtain a stable estimator w. We propose a {L}_{p}={\displaystyle {\sum}_{i=1}^{n}{w}_{i}{}^{p}(p<1)} penalty for variable selection and estimation simultaneously. Unlike LASSO, L_{ p } penalty and its different approximation schemes (i.e., adaptive LASSO) possess the oracle property [21, 22]. Here the oracle property of a method means that it can correctly identify the nonzero coefficients with probability converging to one and that the estimators of nonzero coefficients are asymptotically normal with the same means and covariances as what they would have the zero coefficients be known in advance. We therefore propose the following penalized AFT model:
where λ ≥ 0. With n ≪ m, linear kernel is more appropriate, since model with linear kernel has less overfitting. We will take ϕ(x_{ i }) = x_{ i }, introduce an auxiliary (latent) variable vector u = [u_{1}, u_{2}, ..., u_{ m }]^{t}, and develop an adaptive procedure based on equation (7). Equation (7) can be rewritten as:
With equation (8) and (9), we will find the first order derivative for w with a fixed u and then update u = w. After taking the first order derivative, we have the following equation:
where ⊙ represents the componentwise product of two vectors and
and
We substitute \mathbf{w}={X}_{\mathbf{u}}^{t}\mathbf{a} and define a new kernel function {K}_{\mathbf{u}}=X{X}_{\mathbf{u}}^{t}. Then we have {K}_{\mathbf{u}}\left({x}_{i},.\right)={x}_{i}^{t}{X}_{\mathbf{u}}^{t}, which is the ith row of K_{ u }. So,
The adaptive kernel ridge regression algorithm based on dual variables a with equation (10) and (12) is as follows:
Adaptive Kernel Ridge Regression (AKRR) Algorithm
Given a λ, p ∈ (0.1], training data {\left\{{\mathbf{x}}_{i},\mathrm{log}{T}_{i},{\delta}_{i}\right\}}_{i=1}^{n}, and a small ε and η.
Initializing w = u = rand(m, 1), and a = [0, ..., 0]^{t}
Setting u(u_{ i } == 0) = 10e  5 and j = 1.
While w  u > ε

u = w,

{K}_{\mathbf{u}}=X{X}_{\mathbf{u}}^{t}

FOR i = 1 to n,
I({\delta}_{i})=\{\begin{array}{ll}1\hfill & \text{if}{\delta}_{i}0\hfill \\ 1\hfill & \text{if}{\delta}_{i}=0,\hfill \\ K\left({\mathbf{x}}_{i},.\right){\mathbf{a}}^{j}\le \mathrm{log}{T}_{i},\hfill \\ 0\hfill & \text{otherwise}.\hfill \end{array}
{a}_{i}^{j+1}=\frac{I\left({\delta}_{i}\right)}{n\lambda}\left\{{K}_{\mathbf{u}}\left({\mathbf{x}}_{i},.\right){\mathbf{a}}^{j}\mathrm{log}{T}_{i}\right\}
{\mathbf{a}}^{j+1}={[{a}_{1}^{j+1},...,{a}_{i}^{j+1},{a}_{i+1}^{j}...,{a}_{n}^{j}]}^{t}
END

j = j + 1

\mathbf{w}={X}_{\mathbf{u}}^{t}\mathbf{a}
.
END
w(w < η) = 0
Unlike other LASSO based methods which seek to find optimal w directly, AKRR algorithm updates the mdimensional w through updating a much smaller ndimensional dual variable a. This method is computationally highly efficient when n ≪ m, which is common in genomic data. Although the proposed method is based on the dual problem, the primal variable w is explicitly updated in the computation. Theoretically AKRR algorithm will always converge to global optimal solution when p = 1 irrelevant to initial values of w, u, and a, as the error function is convex under L_{1} penalty, but only local optimal solution is guaranteed when p < 1. However, in our computational experiments with simulation and real data, even though we may have different optimal solutions with different initializations only when p ≤ 0.5, most selected features are still the same in different runs. AKRR always reach the same optimal solution in all of our experiments when p ≥ 0.6. One possible explanation is that the error function may still be near convex or convex almost everywhere when p is large. Therefore it may be possible that we enjoy both the oracle property with less bias and the global optimal solution with larger p (0.6 ≤ p < 1). Theoretical study for the near convex error function, however, is out of the scope of this paper. To prevent the results stick to a local optimal solution when p ≤ 0.5, we run AKRR 30 times and the best solution is chosen from the run with smallest test error. Even though AKRR does choose different variables with different p s, a small subset (≥ 5) of most important genes are always selected in our experiments. The model performance can be evaluated with crossvalidation and the relative root mean squared error (\text{RRMSE}=\sqrt{\frac{{\displaystyle {\sum}_{i}{(({y}_{i}{\widehat{y}}_{i})/{y}_{i})}^{2}}}{n}}) of the test data. There are two parameters p and λ for the adaptive kernel ridge regression (AKRR) algorithm. One efficient way is to set p = 0.1, 0.2, ..., 1 alternatively, and then search for the best λ through crossvalidation. The range of can be determined by the path of the optimal solution. λ_{min} = 0 and λ_{max} is set to be the smallest value with all zero estimated parameters by multiple trials. We search the optimal λ from λ ∈ (0, 1] in this paper. Usually we have a larger λ_{max} for p = 1, and smaller λ_{max} when p is smaller.
References
Cox D: Regression models and lifetables (with discussion). Journal of Royal Statistical Society, Series B 1972, 34: 187–220.
Gui J, Li H: Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties. Journal of the American Statistical Association, Theory and Methods 2001, 96: 456.
Van Houwelingen H, Bruinsma T, Hart A, Van't Veer L, Wessels L: Crossvalidated Cox regression on microarray gene expression data. Stat Med 2006, 25: 3201–3216. 10.1002/sim.2353
Kalbfleisch J, Prentice R: The Statistical Analysis of Failure Time Data. New York: John Wiley; 1980.
Wei L: The accelerated failure time model. a useful alternative to the Cox regression model in survival analysis. Statistics in Medicine 1992, 11: 1871–1879. 10.1002/sim.4780111409
Ying Z: A large sample study of rank estimation for censored regression data. Annals of Statistics 1993, 21: 76–99. 10.1214/aos/1176349016
Stute W, Wang J: The strong law under random censorship. Annals of Statistics 1993, 14: 1351–1365.
Stute W: Distributional convergence under random censorship when covariables are present. Scandinavia Journal of Statistics 1996, 23: 461–471.
Christensen R, Johnson W: Modelling accelerated failure time with a Dirichlet process. Biometrika 1988, 75: 693–704. 10.1093/biomet/75.4.693
Kuo L, Mallick B: Bayesian semiparametric inference for the accelerated failure time model. Canadian J Stat 1997, 25: 457–472. 10.2307/3315341
Bedrick E, Christensen R, Johnson W: Bayesian accelerated failure time analysis with application to veterinary epidemiology. Stat Med 2000, 19: 221–237. 10.1002/(SICI)10970258(20000130)19:2<221::AIDSIM328>3.0.CO;2C
Jin Z, Lin D, Wei L, Ying Z: Rankbased inference for the accelerated failure time model. Biometrika 2003, 90: 341–353. 10.1093/biomet/90.2.341
Vapnik V: Statistical Learning Theory. New York: Wiley and Sons; 1998.
ShaweTaylor J, Cristianini N: Kernel Methods for Pattern Analysis. London: Cambridge University Press; 2004.
Ma S, Huang J: Additive risk survival model with microarray data. BMC Bioinformatics 2007, 8: 192. 10.1186/147121058192
Sha N, Tadesse M, Vannucci M: Bayesian variable selection for the analysis of microarray data with censored outcomes. Bioinformatics 2006, 22(18):2262–2268. 10.1093/bioinformatics/btl362
Liu Z, Gartenhaus R, Chen X, Howell C, Tan M: Survival Prediction and Gene Identification with Penalized Global AUC Maximization. Journal of Computational Biology 2009, 16(12):1661–1670. 10.1089/cmb.2008.0188
Liu Z, Jiang F: Gene identification and survival prediction with Lp Cox regression and novel similarity measure. Int J Data Min Bioinform 2009, 3(4):398–408. 10.1504/IJDMB.2009.029203
Rosenwald A, Wright G, Chan W, Connors J, Campo E, Fisher R, Gascoyne R, MullerHermelink H, Smeland E, Giltnane J, Hurt E, Zhao H, Averett L, Yang L, Wilson W, Jaffe E, Simon R, Klausner R, Powell J, Duffey P, Longo D, Greiner T, Weisenburger DD, DBLJVJAJMELGAGTMTLM, Sanger WG, Ott G, Kvaloy S, Delabie J, Holte H, Krajci P, Stokke T, Staudt L: The use of molecular profiling to predict survival after themotheropy for diffuse largeBcell lymphoma. The New England Journal of Medicine 2002, 346: 1937–1947. 10.1056/NEJMoa012914
Dave S, Wright G, Tan B, Rosenwald A, Gascoyne R, Chan W, Fisher R, Braziel R, Rimsza L, Grogan T, Miller T, LeBlanc M, Greiner T, Weisenburger D, Lynch J, Vose J, Armitage J, Smeland E, Kvaloy S, Holte H, Delabie J, Connors J, Lansdorp P, Ouyang Q, Lister T, Davies A, Norton A, MullerHermelink H, Ott G, Campo E, Montserrat E, Wilson W, Jaffe E, Simon R, Yang L, Powell J, Zhao H, Goldschmidt N, Chiorazzi M, Staudt L: Prediction of survival in follicular lymphoma based on molecular features of tumorin filtrating immune cells. N Engl J Med 2004, 351(21):2159–2169. 10.1056/NEJMoa041869
Knight K, Fu W: Asymptotics for Lassotype estimators. Annals of Statistics 2000, 28: 1356–1378. 10.1214/aos/1015957397
Fan J, Peng H: On Nonconcave Penalized Likelihood With Diverging Number of Parameters. The Annals of Statistics 2004, 32: 928–961. 10.1214/009053604000000256
Acknowledgements
We thank the Associate Editor and the two anonymous referees for their constructive comments, which improve this manuscript significantly. This work was partially supported by the 1R03CA133899 grant from the National Cancer Institute and by the National Science Foundation CCF0729080 grant.
Author information
Authors and Affiliations
Corresponding author
Additional information
Authors' contributions
ZL conceptualized and designed method, developed the software, and wrote the manuscript. FJ and RG analyzed and interpreted the data on its biological contents. DC and MT helped in method design and manuscript writing and revised the manuscript critically. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Liu, Z., Chen, D., Tan, M. et al. Kernel based methods for accelerated failure time model with ultrahigh dimensional data. BMC Bioinformatics 11, 606 (2010). https://doi.org/10.1186/1471210511606
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1471210511606