# A novel approach to detect hot-spots in large-scale multivariate data

- Jianhua Wu
^{1}, - Keith M Kendrick
^{2}and - Jianfeng Feng
^{1, 3}Email author

**8**:331

https://doi.org/10.1186/1471-2105-8-331

© Wu et al; licensee BioMed Central Ltd. 2007

**Received: **02 November 2006

**Accepted: **11 September 2007

**Published: **11 September 2007

## Abstract

### Background

Progressive advances in the measurement of complex multifactorial components of biological processes involving both spatial and temporal domains have made it difficult to identify the variables (genes, proteins, neurons etc.) significantly changed activities in response to a stimulus within large data sets using conventional statistical approaches. The set of all changed variables is termed hot-spots. The detection of such hot spots is considered to be an NP hard problem, but by first establishing its theoretical foundation we have been able to develop an algorithm that provides a solution.

### Results

Our results show that a first-order phase transition is observable whose critical point separates the hot-spot set from the remaining variables. Its application is also found to be more successful than existing approaches in identifying statistically significant hot-spots both with simulated data sets and in real large-scale multivariate data sets from gene arrays, electrophysiological recording and functional magnetic resonance imaging experiments.

### Conclusion

In summary, this new statistical algorithm should provide a powerful new analytical tool to extract the maximum information from complex biological multivariate data.

## Background

Increasingly, experiments in many areas of biological research simultaneously record activity changes in hundreds or even thousands of variables (i.e. channels, cells, genes, proteins etc) over a time window **T** [1–5]. Due to both internal and external noise, the recorded activity is stochastic. Traditionally all collected data variables are subjected to statistical analysis although, in most cases, not all of them change in response to applied stimuli [6]. Including large numbers of non-responsive variables in the analysis can simply bury the true information carried by a small number of responsive ones leading to the erroneous conclusion that no changes have occurred. In other words, due to the current technology development in biology we often face too much rather than too little data and paradoxically this may sometimes actually impose constraints which prevent us from detecting important information patterns contained within it [7]. In this way important information can be lost. It is therefore of crucial importance to find a way of first filtering out non-responsive variables before performing any further statistical analysis [8].

In [3] we have already proposed a way to handle this problem. MANOVA [9] is applied to analyze data collected from multi-electrode array electrophysiological recordings of activity changes in ensembles of 100 or more different neurons. To assess whether there are significant changes in activity during exposure to a defined sensory stimulus, it is proposed that we have to look at the significance score (a quantitative value corresponding to the significance of the data) of each subset of all of them. Intuitively, it is argued in [3] that the highest value of the significance score corresponds to the area where changes occur. It can readily be seen that this approach could be easily generalized to other types of multivariate biological data such as from gene microarrays or from brain imaging experiments where application of conventional statistical approaches may seriously limit identification of important significant changes. It could also play an important role in the development of systems biology approaches to modeling and understanding complex functional units of biological activity.

- 1.
Does the area (set of variables) containing the highest values of significance scores correspond to that where actual changes occur?

- 2.
Does the significance score vanish when more and more non-responsive units are included in the analysis?

- 3.
Can we avoid calculating the significance score of all subsets, i.e. solve the NP hard problem?

- 4.
Can the solution to the problem offer more effective analysis of complex biological multivariate data sets?

We first address these issues in a theoretically treatable model. In general, the set with the highest significance score does not coincide with, but is a subset of, the changed area. However, a single variable exhibits different properties dependent upon whether it belongs to the changed area or not. Based upon this difference in properties exhibited by variables we propose the application of an easily implemented algorithm. This algorithm, which we have called HOTTOR (**hot**-spot detec**tor**), enables us to find the hot-spot and its complexity is only proportional to the total number of variables. Increasing the number of non-responsive variables does not reduce the significance score.

Another interesting finding from our results is the advantage of a system which contains negatively correlated variables compared with one that is positively correlated. It is concluded that the significance score is a decreasing function of the correlation between variables, i.e. it is easier to detect the changes in spatio-temporal patterns if the system is negatively correlated. This also supports one of our long-term working hypotheses that brain neural networks are negatively correlated [10, 11] and which we have recently confirmed using multi-array recording approaches in sensory systems [12].

Our approach is first tested on simulated data. It is shown that the HOTTOR algorithm can successfully single out hot-spot variables. We have then applied it to a few examples of biological data sets, including multi-electrode array recording of local field potentials from the brain, gene microarray data and functional magnetic resonance imaging (fMRI) of the brain. In all cases we find that the HOTTOR algorithm outperforms the conventional ANOVA algorithm or, the most commonly used statistical software *Statistical Parametric Mapping* (SPM) for the case of fMRI data.

## Results

*ρ*< 0. The significance score increases when we complete our calculation of 41 variables. We then compare the significance score of each newly picked variable with that of our reference. It is clearly seen that we have successfully found all the changed variables. We have also tested our algorithm with

*ρ*> 0 and

*ρ*= 0 cases (bottom left and bottom right panel).

When dealing with real-world data, we have to use statistic quantities to check whether adding a variable will increase or decrease the overall score. This is not easily done analytically but we can resort to numerical calculations.

*x*

_{ 1 }follow a multivariate normal distribution with mean = 0.3. The first 30 variables of

*x*

_{ 2 }are multivariate normal distributed with mean = 1. The rest of the variables of both

*x*

_{ 1 }and

*x*

_{ 2 }follow a multivariate normal distribution with mean = 0. The covariance matrix is given by

*S*(

*q*)

*< S*(

*q+1*) or

*S*(

*q*) >

*S*(

*q+1*). This is simply carried out in the following way: the confidence intervals for

*S*(

*q*) and

*S*(

*q+1*) are constructed at a (

*1-α*)% significant level. By comparing the upper limit or lower limit of the confidence intervals of

*S*(

*q*) and

*S*(

*q+1*), we can determine whether

*S*(

*q*) <

*S*(

*q+1*) or

*S*(

*q*) >

*S*(

*q+1*) attain a (

*1-α*)% significance level. Now the HOTTOR algorithm is directly applicable to the data set. The following figure shows the detection process. In Fig. 2 upper panel, two variables (indicated by arrows), whose significance scores are smaller than the maximum of all the previous variables, are also statistically different (

*P*< 0.05) from them. Hence these two variables are included in

*A*

_{ q }. In the second step, one variable (indicated by arrow) increases the score, but it is not statistically significant and is not included in

*A*

_{q+}. At the end of the process, the hot-spot (total of 30 variables) could be detected by using HOTTOR algorithm.

In all the examples above, the covariance matrix is fixed in advance. We now consider the case that the covariance matrix is generated randomly. In Fig. 2 upper panel right, we depict the detected results for 100 trials. It is readily seen that the detection is an unbiased algorithm, with a variance as indicated in the figure. The bottom left panel shows the variables which are not significant, but wrongly picked up by the HOTTOR algorithm. Fig. 2 bottom right panel is a receiver operating characteristic (ROC) curve [13, 14] for true positive rate against false negative rate. It is obvious that the algorithm has very good performance to detect the significantly changed variables. All our results above confirm that HOTTOR is capable of picking up changed variables in a complex spatio-temporal data set.

Finally we have applied our algorithm to biological data collected from electrophysiological microelectrode array recording and gene microarray experiments to assess whether it is more successful in identifying areas of significant change in comparison with conventional approaches (in all cases, *P <* 0.05 was considered significant).

*μ*m. These multi-electrode arrays were implanted chronically under anaesthesia in both hemispheres of the brain in the infero-temporal cortex region. Local event-related LFPs are recorded simultaneously from 128 chronically implanted electrodes. LFP time series data are sampled at 2000 samples/s from around 3 seconds prior to stimulus onset to 3.5 seconds after the stimulus onset in each trial of a session, and stored as 16-bit numbers. Experiments were carried out in accordance with the UK 1986 Animals (Scientific Procedures) Act. A conventional ANOVA test failed to show significant stimulus related changes in any of the 128 electrodes; the maximum computed F-value is 1.12, which is far less than the significance value 1.65. However when HOTTOR analysis was applied significant changes were found in 5 of the 64 channels in the right brain hemisphere (Fig. 3 left panel) and 4 of the 64 channels in the left.

In a second example a set of microarray data [15–17] was obtained from a web source [18]. Microarray data derived from immune B-cells of normal and abnormal human patients were again compared using ANOVA and the HOTTOR algorithm. For simplicity, only 196 genes were analyzed and whereas ANOVA failed to identify significant changes in any of them (the obtained maximum F-value is 0.85 and the significance value is 1.37, the obtained P-value is 0.079) the HOTTOR algorithm identified changes in eight of them (Fig. 3 right panel). The genes showing significant changes can be found in the file [19].

In a final example we analyzed data from a functional magnetic resonance imaging (fMRI) experiment [20, 21]. The study chosen aimed to identify brain regions showing activation changes while women and men viewed images of people they were romantically in love with [22]. The MRI images were taken every 6 seconds from 20 different slices for 30 s before and during exposure to the test pictures. This gives 72 images before and during the stimulus with each image captured at 79 × 95 pixel resolution. For the purposes of analysis each image pixel was treated as a variable, so we had 7505 variables with 72 replications. To do this we first divided the image into smaller pieces (groups of around 72 pixels). An analysis of the data using the algorithm revealed a number of significant changes associated with seeing the image of the loved-one (Fig. 4). It confirmed significant alterations in activity in the right amygdala, the caudate nucleus and the right retrosplenial cortex as had been reported in the original paper using a standard statistical approach (SPM), although the sizes of the areas were slightly different [22]. However, the HOTTOR algorithm also identified a new area that was changed significantly, the medial thalamus, which is consistent with patterns of changes reported in other regions.

## Discussion and conclusion

We have developed a novel statistical algorithm to detect hot-spots in complex spatio-temporal data sets derived from biological experiments which avoids the problems inherent with current statistical tests where only small numbers of variables are changing within large scale data sets. Such conditions are increasingly encountered in biological experiments that now have the capacity to measure many thousands of variables simultaneously. The algorithm is based upon our theoretical results which found that hot-spots in data are characterized by the non-continuity of the derivative of the significance score. It has been applied successfully to both artificially generated data and real biological data from multi-array electrophysiology, gene array and fMRI experiments. The algorithm is particularly effective in identifying changes in spatio-temporal patterns where variable activity is negatively correlated such as we have found recently using multi-array recordings from brain sensory networks [11, 12].

In all of the cases where real biological data has used the algorithm is successful in identifying more significant changes than current standard statistical approaches. Changes of a spatio-temporal pattern in a system of negative correlations between units can be more easily detected than that of positive correlations.

When analyzing the local field potentials data, it requires the data to be stationary; at least the data is stationary in a short time interval. The minimum value for sample size *N* should be larger than the total number of variables. In the present model, the proposed algorithm does not take into account spatio-temporal dependences among the data. The model could include possible geometric or temporal relationships in the data, which would improve the performance and reduce the time cost. The more general case for this method will be investigated in the later publications.

In summary, this new statistical algorithm should provide a powerful new analytical tool to extract the maximum information from complex biological multivariate data.

## Methods

*X*

_{ 1 }= (

*x*

_{ 11 }, ...,

*x*

_{ 1m }),

*X*

_{ 2 }= (

*x*

_{ 21 }, ...,

*x*

_{ 2m }) be two random vectors with

*m*variables in each vector (population). Sampling of the vectors represents their temporal dynamics (electrophysiological recordings) or replications of the experiment (gene microarray data and fMRI images). For population 1, the first

*n*variables have a mean of 1, and the rest have a mean of 0. For population 2, the first

*n*variables have a mean of

*c*, and the rest have a mean of 0. In other words,

*n*random variables take different values due to, say, different treatments or stimuli. The hot-spot is {

*1*,

*2*, ...,

*n*}. In the literature [9], the most common way of comparing the difference between two populations is MANOVA. In MANOVA, we first construct a statistical quantity called Wilks' lambda. The hypothesis that

*μ*

_{1}: = EX

_{1}(the mean activity of population 1) =

*μ*

_{2}: = EX

_{2}(the mean activity of population 2) or not is assessed depending on Wilks lambda. More specifically, let us assume that the covariance matrix is

In the matrix, we assume that |*ρ*_{
1
}| << |*ρ*|, reflecting the structure in means.

*N*is the number of samplings, and the sampling covariance as:

*N*is large enough, so that we do not distinguish between the sampling covariance matrix (mean) and the covariance (mean). Then we introduce Wilks' lambda

*Λ*as a function of continuous variables of (

*m, n*). As in [3], the significance score of

*A*= {

*1*, ...,

*m*} is given by

where *χ*^{2}_{
m
}(*α*) is the upper (100*α*)th percentile of a chi-square distribution with *m* degrees. For any subset A ⊂ {*1*, ..., *m*}, we can define its significant score *S*(*A*) accordingly. Intuitively, as in statistical textbooks, a subset *A* is significantly changed if its score *S*(*A*) is larger than the unity. We arrive at the following conclusions (see additional file 1 for the proof detail of theorem 1).

**Theorem 1**

*For fixed n, Wilks lambda is an increasing function of m > n, it increases to a constant Λ*

_{ ∞ }

*(c) and is given by*

*The significant score S*(*m*) *decreases as m increases and the hot-spot can be detected using the derivative of Wilks' lambda. In other words, a first-order phase transition occurs and n is the critical point. For fixed value of m, the significance score is an increasing function of n. Furthermore, it is a decreasing function of ρ when all other parameters are fixed*.

*N*= 200. In Fig. 5, we plot the significance score vs.

*c*and

*A*, with

*n*= 30 (upper panel). The projection of the score onto two dimensions is shown on the middle panel and bottom panel, right. In bottom panel, left, a specific case of

*c*= 0.7 with

*ρ*> 0 is depicted. As we claim in Theorem 1, the significance score is a decreasing function of

*ρ*. With a fixed

*c*, it will increase first and then decrease. The hot-spot is not the maximum point of the significance score and changes suddenly when it passes through the point

*n*= 30 (Bottom panel, left, indicated by the vertical dotted line). It is easily seen from Fig. 5 that when

*m*>

*n*= 30, the significance score is a decreasing function. In other words, including data from all the variables in our MANOVA could be misleading in some cases, as we conjectured in [3]. For example, in Fig. 5,

*c*= 0.7, if we only include the activity of the first 30 variables in our analysis, we could conclude that there is significant change within the two populations. However, when we include all 100 variables in our analysis we have to say that there is none. Not surprisingly, the significance score is larger when

*c*is smaller since the difference between the two populations is greater. From Fig. 5 (upper panel), we see that, unfortunately, the significance score is not always an increasing function of

*i*when

*i*<

*n*= 30. This implies that we cannot detect the hot-spot; here it is {

*1*, ...,

*n*}, according to the maximum values of the significance score.

From Fig. 5 we observe that the significance score is a decreasing function of *ρ* confirming that it is indeed much easier to detect the changes in a system with negatively correlated variables than with positively correlated or independent ones. Fig. 5 also tells us the difference between using a statistical test of a single variable, which is independent of the covariance matrix, and MANOVA, which is sensitive to the covariance matrix. For example, Fig. 5, bottom left, *c* = 0.7 indicates that if we only test the changes based upon each single variable, then the significance score is always smaller than one. Nevertheless, based upon a group activity (MANOVA), we could assess that there are significant changes between two populations for a subset of all units. This result confirms the benefit of using MANOVA compared with a statistical test based upon a single variable.

Finally detecting the discontinuity of the derivative of the significance score based upon statistical data is not an easy task since the stochastic fluctuations always result in an irregularity in the score. In other words, it is hardly possible to detect the discontinuity of the derivative. We will next consider how to develop a statistical approach to detect the hot-spot.

All results above are established for general case (refer to our homepage for details [23]).

## Algorithm

As we mentioned, the method is developed for the specified biological data, but it is not readily applicable to such data. Because our purpose is not to test the whole set of variables but to detect the variables with significance change. So the first problem we encounter is the representation problem.

Assume we have m variables {*x*_{
1
}, *x*_{
2
}, ..., *x*_{
m
}} with sample size *N*. One option we have is to enumerate all possible combinations of these m variables. For *m* is large, this is known as a NP hard problem. We could have

Total number of combinations = *2*^{
m
}

Suppose *m* > 20, then total number of combinations will exceed one million, which is impossible for us to calculate and compare all significance scores. In order to detect the Hot-spot from the whole data set, we have to try other options.

- 1.
The significance score is an increasing function of a subset of the hot-spot. In other words, we can detect part of the all changed set according to whether adding a variable increases or decreases the score.

- 2.
The decreasing rate is different for a changed one compared with an unchanged one. The latter will cause the significance score to decrease faster than the former.

Based upon the observations above we are able to develop the following HOTTOR algorithm. Algorithm and relevant programs can be downloaded freely from [23].

### First Step: Monotonic step

Selecting a variable, say *i*_{
1
}, from the whole set {*1*, *2*, ..., *m*}, we then randomly select another one *i*_{
2
}and calculate *S*({*i*_{
1
},*i*_{
2
}}). If *S*({*i*_{
1
}}) <*S*({*i*_{
1
},*i*_{
2
}}), then *i*_{
2
}is one of the changed variables. We continue this procedure and keep the variable if the significance score increases and discard it if it decreases. The monotonic step stops when the significance score reaches its maximum. The obtained set is denoted by *A*_{
q
}.

### Second Step: Reference step

After finding the variables which contribute positively to the significance score, we now have to deal with those which do not, but do change their mean values. At this step, we assume that at least one variable which does not change its activity is picked up, say *i*_{
r
}. We use the score of this variable as a reference to assess whether a remaining one, say *i*, changes its activity or not. The obtained set is denoted by *A*_{q+}⊃ *A*_{
q
}. If it changes, i.e., *S*(*A*_{q+}∪ {*i*_{
r
}}) <*S*(*A*_{q+}∪ {*i*}), we then add it to the changed set *A*_{q+}= *A*_{q+}∪ {*i*}, and continue with our selection. If it does not change, which means *S*(*A*_{q+}∪ {*i*_{
r
}}) ≥ *S*(*A*_{q+}∪ {*i*}), we then simply choose a new variable to check. The above procedure is continued until all the variables are checked. We then have *A*_{q+}= {*1*, *2*, ..., *n*}.

## Declarations

### Acknowledgements

J.F. was partially supported by grants from UK EPSRC (GR/R54569), (GR/S20574), and (GR/S30443) and KMK by the BBSRC. We thank Lucy Brown, Helen Fisher and Art Aron for allowing us access to their raw fMRI data published in [13].

## Authors’ Affiliations

## References

- Brown M, Grundy W, Lin D, Cristianini N, Sugnet C, Furey T, Ares M, Haussler D: Knowledge-based analysis of microarray gene expression data using support vector machines. Proc Nat Acad of Sci 1999, 97: 262–267. 10.1073/pnas.97.1.262View ArticleGoogle Scholar
- Feng JF, (editor): Computational Neuroscience: A Comprehensive Approach. Chapman and Hall/CRC: Boca Raton; 2004.Google Scholar
- Horton PM, Bonny L, Nicol A, Kendrick K, Feng JF: Applictions of multi-variate analysis of variances (MANOVA) to multi-electrode array data. J Neurosci Meth 2005, 146: 22–41. 10.1016/j.jneumeth.2005.01.008View ArticleGoogle Scholar
- Marchini JL, Ripley BD: A new statistical approach to detect significant activation in functional MRI. Neuoimage 2000, 12: 366–380. 10.1006/nimg.2000.0628View ArticleGoogle Scholar
- Mehring C, Rickert J, Vaadia E, Oliveira S, Aertsen A, Rotter S: Inference of hand movements from local field potentials in monkey motor cortex. Nat Neurosci 2003, 6: 1253–1254. 10.1038/nn1158View ArticlePubMedGoogle Scholar
- Destexhe A, Contreras D, Steriade M: Spatiotemporal Analysis of Local Field Potentials and Unit Discharges in Cat Cerebral Cortex during Natural Wake and Sleep States. J Neurosci 1999, 19: 4595–4608.PubMedGoogle Scholar
- Li WT: The-more-the-better and the-less-the-better. Bioinformatics 2006, 18: 2187–2188. 10.1093/bioinformatics/btl189View ArticleGoogle Scholar
- Nielsen K, Logothetis N, Rainer G: Dissociation between Local Field Potentials and Spiking Activity in Macaque Inferior Temporal Cortex Reveals Diagnosticity-Based Encoding of Complex Objects. J Neurosci 2006, 26: 9639–9645. 10.1523/JNEUROSCI.2273-06.2006View ArticlePubMedGoogle Scholar
- Johnson RA, Wichern DW: Applied Multivariate Statistical Analysis. Fifth edition. Prentice Hall: New Jersey; 2002.Google Scholar
- Feng JF: Correlated Neuronal Computation, in Unsolved Problems of Noise in Biology. AIP conference proceedings 2003, 516–534.Google Scholar
- Durrant S, Feng JF: Negatively-correlated firing: the functional meaning of lateral inhibition within cortical columns. Biol Cybern 2006, 95: 431–453. 10.1007/s00422-006-0096-2View ArticlePubMedGoogle Scholar
- Nicol AU, Magnusson MS, Segonds-Pichon A, Tate A, Feng JF, Kendrick KM: Local and global encoding of odor stimuli by olfactory bulb neural networks. Society for Neuroscience Abstracts 2005, 6: 476.Google Scholar
- Lasko TA, Bhagwat JG, Zou KH, Ohno-Machado L: The use of receiver operating characteristic curves in biomedical informatics. Journal of Biomedical Informatics 2005, 38: 404–415. 10.1016/j.jbi.2005.02.008View ArticlePubMedGoogle Scholar
- Mason SJ, Graham NE: Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. QJR Meteorol Soc 2002, 128: 2145–2166. 10.1256/003590002320603584View ArticleGoogle Scholar
- Lock C, Hermans G, Pedotti R, Brendolan A, Schadt E, Garren E, Langer-Gould A, Strober S, Cannella B, Allard J, Klonowski P, Austin A, Lad N, Kaminski N, Galli S, Oksenberg J, Raine C, Heller R, Steinman L: Gene-microarray analysis of multiple sclerosis lesions yields new targets validated in autoimmune encephalomyelitis. NatureMedicine 2002, 8(5):500–508.Google Scholar
- Qin J, Lewis D, Noble W: Kernel hierarchical gene clustering from microarray expression data. Bioinformatics 2003, 19: 2097–2104. 10.1093/bioinformatics/btg288View ArticlePubMedGoogle Scholar
- Yeung KY, Bumgarner RE, Raftery AE: Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data. Bioinformatics 2005, 21: 2394–2402. 10.1093/bioinformatics/bti319View ArticlePubMedGoogle Scholar
- Microarray dataset[ftp://ftp.afcs.org/pub/datacenter/microarray]
- Gene name[http://www.dcs.warwick.ac.uk/~jianhua/doc/genename.xls]
- Belliveau JW, Kennedy DNJ, McKinstry RC, Buchbinder BR, Weisskoff RM, Cohen MS, Vevea JM, Brady TJ, Rosen BR: Functional mapping of the human visual cortex by magnetic resonance imaging. Science 1991, 254: 716–719. 10.1126/science.1948051View ArticlePubMedGoogle Scholar
- Thulborn KR, Chang SY, Shen GX, Voyvodic JT: High resolution echo-planar fMRI of human visual cortex at 3.0 Tesla. NMR Biomed 1997, 10: 183–190. 10.1002/(SICI)1099-1492(199706/08)10:4/5<183::AID-NBM469>3.0.CO;2-WView ArticlePubMedGoogle Scholar
- Aron A, Fisher H, Mashek D, Strong G, Li HF, Brown L: Reward, motivation, and emotion systems associated with early-stage intense romantic love. J Neurophysiol 2005, 94: 327–337. 10.1152/jn.00838.2004View ArticlePubMedGoogle Scholar
- Hottor homepage[http://www.dcs.warwick.ac.uk/~jianhua/doc/hottor.html]

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.