# 3D time series analysis of cell shape using Laplacian approaches

- Cheng-Jin Du
^{1}Email author, - Phillip T Hawkins
^{2}, - Len R Stephens
^{2}and - Till Bretschneider
^{1}

**14**:296

https://doi.org/10.1186/1471-2105-14-296

© Du et al.; licensee BioMed Central Ltd. 2013

**Received: **15 March 2013

**Accepted: **15 July 2013

**Published: **4 October 2013

## Abstract

### Background

Fundamental cellular processes such as cell movement, division or food uptake critically depend on cells being able to change shape. Fast acquisition of three-dimensional image time series has now become possible, but we lack efficient tools for analysing shape deformations in order to understand the real three-dimensional nature of shape changes.

### Results

We present a framework for 3D+time cell shape analysis. The main contribution is three-fold: First, we develop a fast, automatic random walker method for cell segmentation. Second, a novel topology fixing method is proposed to fix segmented binary volumes without spherical topology. Third, we show that algorithms used for each individual step of the analysis pipeline (cell segmentation, topology fixing, spherical parameterization, and shape representation) are closely related to the Laplacian operator. The framework is applied to the shape analysis of neutrophil cells.

### Conclusions

The method we propose for cell segmentation is faster than the traditional random walker method or the level set method, and performs better on 3D time-series of neutrophil cells, which are comparatively noisy as stacks have to be acquired fast enough to account for cell motion. Our method for topology fixing outperforms the tools provided by SPHARM-MAT and SPHARM-PDM in terms of their successful fixing rates. The different tasks in the presented pipeline for 3D+time shape analysis of cells can be solved using Laplacian approaches, opening the possibility of eventually combining individual steps in order to speed up computations.

## Background

Cell migration is a highly complex process that integrates many spatial and temporal cellular events [1]. It plays important roles in embryonic development, tissue repair, cancer invasion and atherosclerosis [2]. Recent advances in live-cell imaging yield vast amounts of image data [3], and a number of image analysis algorithms with high throughput capability have been developed [4, 5]. These were applied for example to characterize mutants that lack the ability to sense gradients of a chemoattractant, or contract their cell body less efficiently while moving.

Our current view of moving cells is mostly based on 2D cross-sections through the centre of cells or evanescent wave imaging of the substrate attached cell surface. Similarly, software developed for cell migration studies focuses primarily on migration in 2D. Although treating cells as 2D entities has proven effective in understanding some aspects of cell locomotion and in identifying defects in a variety of mutants [6], neglecting the third dimension [7] results in several misconceptions [6]. Two-dimensional cross-sections give the wrong impression of cells being flat and uniformly attached, which in first approximation is adopted in many models of cell polarity and organization, although it is clear that the differences between the front and rear of a cell are as big as those between the ventral and dorsal sides. Secondly, we falsely tend to assume that small shape changes in 2D cross-sections are accompanied by similarly small changes in the third dimension. Thirdly, we often ignore that *in vivo* cells may crawl through complex 3D environments which can dramatically change cell behavior and the way that cells polarize when compared to 2D movement in a dish [7].

Recent advances in live cell microscopy have made it possible to acquire high quality 3D+time volumetric images of cell migration. Currently, the most widely applied 3D fluorescence imaging technique is fast spinning disk confocal microscopy which can typically acquire a stack of 30 slices within a few seconds and is therefore capable of imaging cellular deformations on the second timescale [8]. Since large and complex data sets typically consist of 5,000-10,000 single images [9], analysis tools with high throughput capability are needed.

Although cell images can be visualized by methods of volume and surface rendering, both lack descriptive power. Ideally we want to characterize global and local shape features by a manageable number of parameters. A concise description should allow for accurate comparison of object shapes in order to find dissimilarities, and for matching objects to predefined models, as well as for efficient reconstruction and manipulation of objects [10]. The ultimate goal is to develop automated, efficient and objective methods that can create spatio-temporal maps of signaling transduction and corresponding cell surface deformations in order to further our functional understanding of cell motility in a quantitative way.

The most advanced software for analysing cell shape and motility of amoeboid cells such as neutrophils or *Dictyostelium* is 3D-DIAS [11], which is commercially available. Models of cell surfaces are mathematically reconstructed by beta-spline functions. 3D-DIAS allows visualization of 3D dynamics of cell surfaces, but since it works with lower contrast DIC images and not fluorescence the resolution of the generated surface models is not optimal. Also, it lacks automated analysis of cell surface deformations and fluorescence. Current commercial software for quantifying 3D fluorescence images include Meta-Morph (Molecular Devices, Sunnyvale, USA), Volocity (Perkin-Elmer, Waltham, USA) and Imaris (Andor Technology, Belfast, Northern Ireland), but they offer little in terms of cell shape analysis. Advanced software has recently become available for analyzing simple cell shape changes of plants in 3D [12].

Inspired by the previous works of [4] and [11], we present a new framework for 3D shape analysis of highly dynamic cells. In [4], 2D time-lapse images of moving cells were mapped onto the unit disk, which served as a reference frame both for registering cells across time and comparing different cells with varying shapes. Here, we use spherical parameterization to map cell surfaces onto the unit sphere. Spherical parameterization has been used extensively for brain cortex shape analysis [13, 14]. Several open source software toolboxes are available such as SPHARM-PDM (Point Distribution Models) [15] and SPHARM-MAT (Modeling and Analysis Toolkit) [16]. Since brain images from different time points or even from different individuals are quite similar, a normalized template is often used for shape analysis. In our application, however, cell shapes of moving cells usually vary greatly between different time points, and there is no common template. Although spinning disk confocal microscopy allows acquiring time series of 3D stacks within seconds, short exposure times result in low signal-to-noise ratios. Further complications can be inhomogeneous labelling (e.g. the intensity of the cell interior is similar to that of the background), and ambiguous boundaries, making segmentation non-trivial.

## Methods

### Segmentation

*N*voxels, a weighted undirected graph

*G*

^{ S }= (

*V*,

*E*,

*A*

^{ S }) with vertices

*v*∈

*V*and edges

*e*∈

*E*is constructed. Each voxel corresponds to a vertex

*v*, and each pair of neighbouring vertices is connected by an edge

*e*. The connectivity is 6 or 26 for 3D images.

*A*

^{ S }∈

*R*

^{N×N}is a weighted adjacency matrix, which maps changes in the image structure to edge weights. The weighting function is defined as

where *I*_{
i
} is the image intensity value at vertex *v*_{
i
}, and *S*_{
i
} indicates its spatial position. The graph Laplacian matrix is then given by *L*^{
s
} = *D*^{
s
} - *A*^{
s
} where *D*^{
s
} is a diagonal matrix with elements given by the degree of vertices ${d}_{i}^{s}={\displaystyle {\sum}_{j\in V}{A}_{\mathit{\text{ij}}}^{s}}$.

Care should be taken if the voxel spacing in z is different from that in x and y, and any anisotropy should be corrected by appropriate scaling factors. As we work with images which are downsampled in x and y (as detailed below) voxel spacings in x, y and z are almost identical and no correction is applied. When imaging dynamic processes, voxels within a given z-plane are theoretically more likely to be correlated since planes are acquired sequentially with some delay. In principle this could result in higher affinity values within a single plane, but as it is unclear how to quantify this effect we ignore it for now.

It is worth to note that the graph Laplacian matrix *L* plays a key role in our framework. By building problem specific *L*, such as *L*^{
s
} the Laplacian matrix for segmentation, and exploring its intrinsic eigenstructures, not only segmentation but also the subsequent steps including topology fixing, spherical parameterization, and shape representation can be performed.

#### Random walker method

*x*

_{ i }represents the probability of pixel

*i*being foreground or background. Based on the provided seeds, Eq. (2) can be decomposed into

*L*

^{ s }and

*x*are ordered such that seed nodes come first and unseeded nodes second,

*x*

_{ M }and

*x*

_{ U }correspond to the probabilities of seeded and unseeded nodes respectively,

*B*is a submatrix of

*L*

^{ s }. The optimization problem of Eq. (3) can be solved by the following linear equation:

This is a large linear system for 3D segmentation of a cell image. Although Eq. (4) is a sparse, symmetric and diagonally dominant system, solving it directly will still be slow requiring *O*(*U*) running time, *U* representing the total number of unseeded nodes.

#### Downsampling

Obviously, if we reduce the number of unseeded nodes, the time for solving Eq. (4) can be reduced. The problem is how to reduce the number of equations without sacrificing accuracy. We first downsample the image using the bilinear method to make it substantially smaller. Since the resolution in z is much lower than in x and y, we do not downsample in z. The random walker method is then applied to the downsampled stack, with many fewer equations to be solved.

#### Automatic seeds detection

Both the original random walk [18] and our previous method [17] require manual seeds for segmentation. Here we propose an automatic seeding method, which is inspired by the recent advances on saliency detection via Fourier domain analysis [19, 20]. Working in the frequency domain is simple and fast, but more importantly these methods usually involve downsampling the image which is in line with our segmentation approach.

*I*

_{ d }is firstly transformed into the Fourier domain

*F*(

*I*

_{ d }). Amplitude

*A*

_{ I }(

*F*(

*I*

_{ d })) = |

*F*(

*I*

_{ d })| and phase

*P*(

*F*(

*I*

_{ d })) =

*angle*(

*F*(

*I*

_{ d })) spectra are then calculated. The log spectrum is obtained by

*h*is used to smooth out the spikes in the log spectrum

*I*

_{ d }can then be computed as

where the smoothed log spectrum in Eq. (6) and the original phase spectrum are combined to compute the inverse Fourier transform.

The motivation behind the above approach is that if we divide the image into small patches, the majority of them will consist of background with similar patterns, which show up as spikes in the log spectrum after transforming the image into the frequency domain [19]. These spikes, and with it the background, are suppressed by applying a low-pass Gaussian filter.

which are used as the input of seeds for the cell segmentation in Eq. (4).

The above method for seed detection works well for cell images with only one stain. We threshold the saliency map by estimating an initial foreground and background as deviations from the mean intensity and then refine these estimates. Instead of using a single threshold value for the segmentation, we use two clearly separated threshold values, one for foreground and the other for background to be on the safe side. This is used as input for a more accurate segmentation employing the random walker method. The threshold selection is not sensitive in our algorithm. Using Otsu’s method [21] for the initial estimation of foreground and background of Eqs. (10 and 11) similar results were obtained.

The proposed method has also been applied to a different cell type (*Dictyostelium* cell with LimE tagged by mRFP, and Coronin fused to GFP, combining two channels in one, see Additional file 1: Figure S1, volume size: 389 × 292 × 73). In this case we need to slightly tune the second level threshold values of Eqs. (12 and 13) as the standard deviation of the combined two channel images is much bigger than that of the single labelled neutrophil images.

#### Edge-preserved upsampling

*I*

_{ d }with automatically detected seeds. The obtained downsampled probability is extrapolated by a cubic method to the original image size. The upsampled probability ${q}_{i}^{c}$ at pixel

*i*is calculated in the following form:

*c*is the class indication of cell or background,

*I*

_{ i }is the intensity at pixel

*i*of the original image, ${\mu}_{\mathit{\text{seed}}}^{c}$ is the mean intensity of seeds, ${p}_{i}^{c}$ is the extrapolated probability of class

*c*at pixel

*i*, and

*η*is a scalar parameter to balance the importance of the weight $w\left({I}_{i},{\mu}_{\mathit{\text{seed}}}^{c}\right)$ given by

where *τ* is a scale parameter in the intensity domain to control the influence of *I*_{
i
}. Eq. (17) gives higher weight to pixels with intensities similar to the mean intensity of seeds. If the intensity difference is bigger than *τ*, the weight is set to zero. The final segmentation is obtained by assigning the pixel *i* to the class corresponding to ${max}_{c}\left({q}_{i}^{c}\right)$.

where *t* is the time step, the constant *α* is a scalar value that determines the rate of diffusion, and *g*(∙) is an edge-stopping function. The choice of *g*(∙) can greatly affect the extent to which discontinuities are preserved. A variety of edge-stopping functions have been used such as Lorentz, Gauss, and Tukey’s biweight function [22], which are plotted in Additional file 2: Figure S2. It is helpful to understand how an edge-stopping function deals with outliers. We can see that the Lorentz function gives more influence to outliers than the Gauss and the Tukey functions. More robust results can be achieved by Tukey’s biweight function, as it completely prevents diffusion across edges.

*i*and its neighbouring pixels as seen in Eq. (18). For regions of piecewise constant intensity, anisotropic diffusion is equivalent to averaging intensities of neighbour pixels. For an image region that includes boundaries, the influence of "outliers" is low as the value of

*g*(∙) is small for large intensity differences. However, our method computes intensity differences between pixel

*i*and the mean of seeded pixels, instead of its neighbouring pixels. To make it more clear, Eq. (16) can be rewritten as

where |*seed*^{
c
}| is the cardinality of the set *seed*^{
c
}, the seeds of class *c*. Here, the edge-stopping property is nicely kept, and "outliers" can be explained explicitly as pixels belonging to a class other than *c*.

The final segmentation result will contain some small spurious objects due to a few high intensity pixels in the background. The morphological close operator can be used to remove those falsely detected small objects.

### Topology fixing

The subsequent step of spherical parameterization requires cell surfaces to have spherical topology, i.e. a genus zero surface [23], the value of a surface’s genus is equal to the number of "holes" it has. The surface of an ideal cell can be considered as genus zero. Limitations in practice are that cells often exhibit thin protrusions, which can cross, or fluorescent markers are not distributed evenly, each of which can result in holes in the segmentation.

The two open-source SPHARM softwares, SPHARM-PDM [15] and SPHARM-MAT [16] provide tools for fixing the topology of 3D binary objects. Our results show however that these tools fail to fix the topology of cells with complex protrusions. We also tried morphological operators such as dilation and close, which can fix topology to some extent, but at the expense of altering the original binary volume significantly. All the methods mentioned above fix topology based on binary volumes.

Here we present a new method for fixing cell topology which minimizes aliasing artefacts. Instead of operating on the binary volume directly, we treat it as a set of hard constraints imposed on the separating surface that encompasses the centres of all foreground voxels. A non-binary underlying embedding function is obtained by solving a constrained convex optimization problem. Based on the embedding function, protrusions are detected and those causing ill topology are identified. The identified ill protrusions are then fixed, while leaving other parts of the volume unaffected. Such a strategy has several advantages over using the binary volume directly, including the ease of fixing topology as well as minimizing aliasing artefacts.

#### Non-binary embedding

*G*

^{ t }from the discrete grid domain of the binary image. A graph Laplacian matrix

*L*

^{ t }of

*G*

^{ t }is constructed in a similar way to the last section. However, each element ${A}_{\mathit{\text{ij}}}^{t}$ of the adjacency matrix

*A*

^{ t }of the graph

*G*

^{ t }is computed differently as

### First-order embedding

*F*with first-order smoothness minimizes the following p-Dirichlet integral functional

where *f*_{
ijk
} ∈ *R* denotes the value of *F* on each vertex of the graph. The value on each vertex *v*_{
ijk
} is +1 if it belongs to foreground, otherwise -1. Minimizing the integral of the p-power of the variation forces the embedding function to remain smooth. The set of hard constraints enforces its fidelity, so that the function is compatible with the original binary volume. The different values of *p* lead to different formulations for optimizing the energy of Eq. (21).

where $\left|\nabla F\right|=\sqrt{{\left(\partial F/\partial x\right)}^{2}+{\left(\partial F/\partial y\right)}^{2}+{\left(\partial F/\partial z\right)}^{2}}$ is the *L*_{l} norm of the gradient magnitudes. Eq. (22) corresponds to the total variation minimization of the embedding function *F* in a domain *Ω*. In this case, the area of the zero-isosurface is minimized, leading to "shrinking bias", i.e. bias towards smaller surfaces [25]. Eventually, the optimizer converges to an empty surface, which is the unique global solution of such regularization.

*L*

^{ t }has the following form

*F*≡ 0. We use a similar method as in [25] where we add a margin

*m*

_{ ijk }to separate the resulting embedding function from the zero solution. Thus, Eq. (24) changes to

*m*

_{ ijk }is calculated as the Euclidean distance to the set

*B*of boundary nodes in

*V*:

### Implementation

*L*

^{ t }is factorized into the diagonal part

*D*

^{ t }, where ${D}_{\mathit{\text{ii}}}^{t}={L}_{\mathit{\text{ii}}}^{t}$, and ${D}_{\mathit{\text{ij}}}^{t}=0$ for

*i*≠

*j*, and the off-diagonal part

*C*

^{ t }=

*D*

^{ t }-

*L*

^{ t }with zero diagonals. The iterations are based on the following formula:

*λ*is the step length set to 0.5 in our experiments, parameters

*l*and

*h*are the lower and higher bounds on the values of

*f*derived from the margin inequality that are taken element-wise. To speed up the algorithm, we define a narrow band

*S*of vertices obtained by thresholding the margin

*m*

_{ ijk }:

where the threshold *t* is the half-width of the band. The computation is confined to the narrow band *S*, i.e. only those vertices near the surface within a certain distance are considered instead of performing the computation on the full grid.

#### Fixing ill topology

The goal of the non-binary embedding is to estimate a continuous function from binary segmented data that retains fine details presented in the original segmentation. To fix any ill topology, we suggest to proceed in a reverse manner with respect to the non-binary embedding. We treat the binary volume as a threshold of a discrete sampling of the obtained embedding function *F*, and recover it in a divide and conquer approach. Here, we first propose a method for protrusion detection based on the embedding function *F*, and then those protrusions that cause the ill topology are fixed.

### Protrusion detection

The assumption we make here is that ill topologies are caused by cellular protrusions. We observe cells that undergo spreading, which mean they are initially spherical when attaching to a coverslip, and correspondingly the segmented binary volumes have a well defined spherical topology. However, when cells start adhering more firmly to the substrate and start migrating they develop thin protrusions, more precisely filopodia and retraction fibres. These often create holes when crossing each other so that topology fixing is required before one can proceed with further processing, such as spherical parameterization.

*F*we obtained is similar to that in [24], where the constrained minimal area optimization problem is solved in the implicit level-set framework. As seen in Figure 2, the estimated embedding function

*F*is in the form of a level set of a grey-scale volume. The benefit of interpreting the embedded function as level-set implicit representation is the elegant handling of changes in topology such as detecting or filling-in of holes. Thus, we are able to evaluate the topology of a given cell from inner layers (levels with high value) to outer layers (levels with low value). The basic idea is to march through the level sets and progress towards a desired one whose thresholded binary volume has a spherical topology.

We start initially outside, with low level sets, where *F* is thresholded with a value of 1.5 yielding a binary volume. To ensure it has spherical topology, its topology is evaluated by computing the Euler-Poincaré characteristic. If not, we increase the threshold and repeat the above procedure. We obtain a binary volume *A* that can be considered as a shrunk version of the original volume. After that we gradually enlarge the surfaces of the binary volume *A* via simple morphological dilation. The size of the structuring element is related to the narrow band width *S* as defined in Eq. (28), initially set as (t + 1) × (t + 1) × (t + 1), and could be changed adaptively. Protrusions are detected by simply subtracting the dilated binary volume from the original one. We only keep subtracted results with values higher than 0 to make it consistent with the original binary volume. Besides protrusions, we also obtain the remaining binary volume *B*, which consists of the main cell body.

The above procedure in some ways mimics low-pass filtering, such as Gaussian filtering. The volume *B* can be considered as low frequency content, while protrusions represent high frequencies. However, our method is fundamentally different from the Gaussian filtering approach. It is unknown how to choose the kernel size for the Gaussian filtering approach, so that the filtered binary volume has spherical topology. Furthermore, since the filtered result is incompatible with the original binary volume, it is unlikely that the fine details smoothed out by the filtration contain all portions that cause ill topology.

### Fixing ill protrusions

In general, only a few protrusions contribute to ill topologies. We evaluate them one by one by adding them back to the binary volume *B*. If a protrusion does not violate the genus zero topology requirement, we merge it back into the binary volume *B*. In this way, we identify those protrusions that cause the topology change and a binary volume *C* that is the combination of the binary volume *B* and those protrusions with spherical topology.

After the identification of ill protrusions, we treat each individual one as a single binary volume. Again, we embed each protrusion into a non-binary function using the method detailed before. Thanks to the level set form of the obtained embedding function it is easy to fix the topology. We simply expand each protrusion by using a low level set, -0.1-sets to start with. We check the topology of the expanded binary volume, and decrease the threshold value if the binary volume still violates spherical topology.

As protrusions are usually very small compared to the original volume, the fixing procedure is very efficient. Once protrusions are fixed, we merge them back to the binary volume *C*. Finally, we obtain a binary volume with spherical topology, where only a small portion containing fixed protrusions has been modified, while the majority of the binary volume is unchanged.

### Spherical parameterization

The objective of spherical parameterization is to embed the cell surface in the unit sphere while minimizing the distortion of the surface net in the mapping. Generally, a good mapping attempts to either minimize length, angle, or area distortions. For comparisons between cell shapes acquired at sufficiently close enough time points we assume the total cell surface area to change only minimally, and consider an equiareal mapping as justifiable: Here, a particular region on one cell surface is always compared with the corresponding region at a subsequent point in time, where both regions have the same area [27].

**p**on the cell surface

*M*and a pair of spherical coordinates:

where the polar angle *θ* ∈ [0,*π*] is the angle between the positive z-axis (north pole) and the vector corresponding to **p**. *φ* ∈ [0,2*π*] is the azimuthal angle between the positive x-axis and the projection of **p** onto the x-y plane. We have tried to use several different spherical parameterization methods [10, 27-29], among them the method presented in [10] turned out to perform best for our application. Here we briefly describe the key idea behind the algorithm and highlight that the method is closely related to the graph Laplacian matrix *L*.

The topology fixed binary volume is converted into a voxel surface, which is the input for the spherical parameterization. Based on the surface graph, two Laplacian matrixes are constructed for initial parameterization of two polar coordinates, latitude *θ* and longitude *φ*, respectively. After the initial parameterization of latitude and longitude, a non-linear constrained optimization method is used to minimize the area and topology distortions of the surface net in the mapping. Additional file 3: Figure S3 shows how a distinctly labelled protrusion is mapped onto the sphere.

### Shape representation

*Ω*be a unit sphere, embedded in

*ℝ*

^{ 3 }. The spherical Laplacian

*Δ*

_{ Ω }operator on

*Ω*satisfies

where ${Y}_{l}^{m}$ are spherical harmonics (SPHARM). Eq. (30) indicates that SPHARM are the eigenfunctions of *Δ*_{
Ω
} with eigenvalue of *λ*_{
l
} = - *l*(*l* + 1) [30]. Denote the space of square integrable functions with respect to *Ω* as *L*^{2}(*Ω*). Define ${\mathit{\text{Spharm}}}_{l}=\mathit{span}{\left\{{Y}_{l}^{m}\right\}}_{m=-l}^{l}$ as a subspace of all SPHARM of the same degree *l*, and let ${\mathit{\text{Spharm}}}_{0,\dots n}={\oplus}_{l=0}^{n}{\mathit{\text{Spharm}}}_{l}$. Then it can be rigorously proven that the closure of *Spharm*_{0,…n} converges to the space *L*^{2}(*Ω*) as *n* → ∞ [31]. Therefore, SPHARM form a complete set of orthonormal basis functions in space *L*^{2}(*Ω*), analogue to unit basis vectors. Similarly as vectors can be described by projections onto each axis (scalar product between vectors), expansion coefficients (scalar product between functions) can be used for the description of functions [32]. Any spherical function can be expressed by an infinite series of SPHARM coefficients.

*M*defined on

*L*

^{2}(

*Ω*) can be expressed as a set of SPHARM coefficients. Each function on the right side of Eq. (29) can be independently decomposed in terms of SPHARM as

This expansion is exact, but errors are introduced when restricting *Spharm*_{0,…n} to a finite space with a certain degree of *l*, which is required in numerical implementations. A truncated SPHARM series can be effectively used to fit relatively smooth functions and model surface protrusions and intrusions [14].

In constructing the SPHARM representation of Eqs. (31, 32 and 33), we need to estimate the coefficients ${c}_{\mathit{\text{lx}}}^{m}$, ${c}_{\mathit{\text{ly}}}^{m}$, and ${c}_{\mathit{\text{lz}}}^{m}$. There are three major techniques for estimating those coefficients: The simplest method is to numerically integrate the Fourier coefficients over a high resolution triangle mesh [33], which is computational expensive. The second method is based on the fast Fourier transform [34], in which a predefined regular grid system is required. The most widely used method is based on solving a system of linear equations that minimize the least square problem [35]. The estimated coefficients approximate the full underlying surface, and can be used to represent and reconstruct the surface.

### Shape comparison

The concise representation of cell shape using SPHARM allows for local measurements of cell membrane deformation. However, there are two additional issues to be addressed, one is registration, and the other is re-sampling. In order to obtain more accurate results, it is usually necessary to register two cell surfaces before the comparison can be conducted. The registration process removes arbitrary rigid motions and brings each cell into the same coordinate system. The surface registration step is an optional one depending on the application, which can be performed before the segmentation, directly on the intensities of image voxels, or after the shape representation on the mesh. There are a variety of registration methods available in the literature [10, 36].

Normally, the size of the cell mesh varies. It needs to be re-sampled to make the number of vertices in the model for each cell the same. This can be achieved by using the regular mesh in the parameter space for reconstruction. Subsequently, pairwise comparisons between different surface models can be conducted. The correspondence between SPHARM models is implied by the underlying parameterization: two points with the same parameter pair (*θ*, *φ*) on two surfaces define a corresponding pair.

SPHARM allows cell shapes to be well-characterized, both in a static and a dynamic manner [37], and is able to extract a wide range of qualitative and quantitative parameters, such as individual outliers, most commonly occurring shapes, and spatiotemporal patterns of surface deformations. Temporal analysis of SPHARM coefficients has been used to detect major deformation phases, and to identify temporal events of interest such as the formation of blebs as well as patterns of deformation [37]. Fundamental features of cell shape dynamics can be extracted from time series images, which is essential to understand the biophysical mechanisms of cell migration. For the purpose of illustration, we use coefficients to identify five major phases of deformation as shown in Additional file 4: Figure S4, and estimate the temporal local deformations (Additional file 5: Figure S5) of the cell membrane by subtracting cellular models at different time points.

## Results

The experiments were performed using unoptimized Matlab code running on an Intel(R) Core(TM) 2.3 GHz with 6 GB of RAM. In principle, the proposed framework can be used for any 3D cell shape analysis. To demonstrate its performance, ten neutrophil cell sequences were acquired, which were labelled with cell mask orange dye to stain the plasma membrane. The neutrophils are quiescent, then stimulated by application of fMLP which prompts cell spreading and movement. Cell movements are imaged by spinning disk confocal microscopy. The acquisition speed is about 80 ms per slice (4 secs/stack). The size of the stack is 180×283×24, and its scale is 0.16x0.16x0.5 microns per voxel.

### Cell segmentation

We use raw data to test our segmentation method, which are more challenging than deconvolved data. Although deconvolution usually generates smoother data, it is prone to generate artefacts. We compared both the segmentation quality and the time complexity of our method with the random walker [18] and the level set method [38]. For the random walker method, the seeds are detected automatically similarly to the method described in Section 2.3 using the original image without downsampling. We extended the code from [18] to 3D image segmentation. For the level set method, we manually set a region of interest with a right prism and then run the algorithm with 50 iterations using the code from [38]. We use the subsampling rate of 1/4 for all the test image stacks.

The global F-measure [39] is calculated to evaluate the segmentation results quantitatively. The ground truth of the whole cell was obtained by using the semi-automatic software ITK-SNAP. Firstly, we imported a real cell image into the software for semi-automatic segmentation. An initial segmentation result was obtained by using the active contour method. The binary segmentation was subjected to manual post-processing to fill holes and remove artefacts. Ten segmented cell stacks and corresponding original images are available on the authors’ website [40]. As the random walker method cannot segment the entire cell, we only compare our approach with the level set method. Our method achieves a better F-measure value of 0.9, when compared with the level set method (0.83). Visual inspection of more than 10 sequences with 230 time points each, showed that the obtained automated segmentation is well within the limits of expected interobserver error.

### Topology fixing

Theoretically, the p value in Eq. (21) can be varied from 1 to ∞. However, the *p* = ∞ case is more complex and computational expensive, and will be a matter of future work. In this paper, we fix the p value to 2 since it has been demonstrated in [18] that the p=2 case achieves better results with less "shrinking bias". Furthermore, the convex quadratic problem of Eq. (25) can be solved easily and efficiently by using a number of convex optimization algorithms. The final result of topology fixing should be similar with respect to the choice of different p values. We also employed the embedding function with second-order smoothness in our experiments, and find that there is not much difference for the current application.

Figure 5(b) shows the binary volume *A* that is 1.5-sets of the embedding function *F*. Our experiments show that the choice of the threshold value of the level is not sensitive in this application. The remaining binary volume *B* without fine protrusions is shown in Figure 5(c). It has spherical topology. Initially, protrusions that possibly violate topology are not detected accurately and contain many false positives as shown in Figure 5(d). However, that will not affect the final result of topology fixing in our application. Nevertheless, it might serve as a good starting point for protrusion detection. The key point here is that the detected protrusions must contain everything that causes a topology violation. Figure 5(e) can be considered as the largest volume we can obtain, which has spherical topology without fixing. In comparison with the original volume of Figure 5(a), it can be seen that only a very small portion of the volume contributes to topology violation. We will leave Figure 5(e) as it is, and only modify a few small protrusions. As demonstrated in Figure 5(f), the modification is almost negligible in the final result with only 0.42% difference between the fixed and the original volume.

Figure 5(g-h) shows the topology fixing results obtained by two open-source softwares, SPHARM-PDM [15] and SPHARM-MAT [16]. The SPHARM-MAT method introduced 0.06% artefacts, which is better than our method (0.42%) and the SPHARM-PDM method (0.83%). However, none of the holes has been filled by the SPHARM-MAT method (Figure 5(h)), while only two of them were filled by the SPHARM-PDM method (Figure 5(g)). We compare the average rates for successful topology fixing of the 64 binary volumes without spherical topology, which are 69%, 4%, and 95%, for SPHARM-MAT, SPHARM-PDM and our proposed method, respectively. The amount of introduced artefacts are 0.21%, 0.96% and 0.94%, respectively.

### Spherical parameterization and shape representation

where *M* indicates a true cell surface and $\tilde{M}$ its SPHARM representation, which is evaluated at N sampling points ${\left\{{\mathbf{p}}_{i}\right\}}_{i=1}^{N}$. The average error for all the tested cell images is reported for each method.

An important aspect of measuring a cell’s migratory behaviour is the quantification of local cellular protrusions and retractions. In order to evaluate our method’s ability as regards to what extent small local shape variations can be detected, we artificially synthesized a cell by introducing a controlled local shape deformation using the open source software ITK-SNAP [42]. We imported the ground truth segmentation of a real cell image into the software and manually added a ball to simulate a cellular protrusion by using the paintbrush tool of ITK-SNAP (see Additional file 6: Figure S6).

**Average RMSE values and average running times for shape representation of cell images using SPHARM**

SPHARM | RMSE | Expansion time(s) | Reconstruction time(s) | Total time(s) |
---|---|---|---|---|

degree10 | 0.81 | 3.88 | 0.41 | 4.29 |

degree20 | 0.53 | 16.38 | 2.29 | 18.67 |

degree30 | 0.44 | 61.43 | 6.67 | 68.09 |

degree42 | 0.39 | 199.78 | 16.35 | 216.12 |

## Discussion

In this paper, we develop algorithms for different steps in our framework in a formalized way using Laplacian approaches. Each method can be viewed from the perspective of exploring eigenfunctions of the Laplacian matrix. Although different affinity matrices are used for the first three steps, i.e. the weights defined are application-driven, all of them are symmetric (*A*(*i*, *j*) = *A*(*j*, *i*)), positive preserving (*A*(*i*, *j*) ≥ 0) and positive semi-definite (for all x in *R*^{
N
}, *x*^{′}*Ax* ≥ 0). In addition all minimize a quadratic distortion measure, naturally leading to the eigenfunctions of Laplacian-type operator [43]. In the fourth step, we use SPHARM for shape representation, which are eigenfunctions of the spherical Laplacian *Δ*_{
Ω
}. Therefore, all the techniques used in the first four steps are closely connected. Indeed, it was shown in [44] that the Laplacian of a graph is the discrete analogue of the Laplace-Beltrami operator on manifolds. The spherical Laplacian *Δ*_{
Ω
} is the Laplace-Beltrami operator on the unit sphere *Ω*.

As the affinity matrix for cell segmentation satisfies the conditions of symmetry and pointwise positivity, the pairwise similarities can be interpreted as edge flows in a Markov random walk on the graph [45]. To perform the random walk segmentation, instead of solving the linear system of Eq. (4), one may precompute several eigenvectors of the Laplacian matrix and use this information to produce an approximation of the random walker segmentation algorithm [46]. The approximation can be viewed from the standpoint of distance in the "spectral coordinates" space defined by the weighted generalized eigenvectors.

Furthermore, all the methods used in the four separate steps are closely related to the problem of heat diffusion. The random walk segmentation method can be considered as a diffusion approach [47], where the seeded pixels are treated as the heat sources and the background acts as a sink. After reaching equilibrium the image can be segmented according to the temperature at each pixel.

The top eigenfunctions of Markov matrices (describing local transitions, or affinities in the system) permit a low-dimensional embedding, so that the ordinary Euclidean distance in the embedding space measures intrinsic diffusion metrics on the data [43]. The non-binary embedding approach for the topology fixing can be viewed as a diffusion process subject to the hard constraints. An iterative scheme is used, where the constraints are enforced and diffusion restarted using the new solution.

The initial parameterization of the latitude and longitude are obtained from heat diffusion [10]. Latitude grows smoothly from 0 at the north pole to *π* at the south pole. In a physical analogy, the south pole is heated up to temperature *π*, while the north pole is cooled down to temperature 0. The parameterization results are obtained as the stationary temperature distribution on the heat conducting surface.

Fourier series have long been used for solving diffusion problems analytically. Similarly, the spherical diffusion equation *kΔ*_{
Ω
}*u*(*φ*, *θ*, *t*) = ∂ _{
t
}*u*(*φ*, *θ*, *t*) can be solved by expressing *u*(*φ*, *θ*, *t*) as SPHARM expansion. SPHARM can be used in isotropic heat diffusion via the Fourier transform on a unit sphere as a means of hierarchical surface representation [34].

Such a perspective can help the reader to better understand the commonalities behind seemingly different techniques. It can also open a door for further improvement of the methods. By exploiting structural similarities of the different approaches, it should be possible to integrate for example the topology fixing step into the cell segmentation process, which will be a future work of our research.

As an illustration of the technique, we have applied it to neutrophil cell shape analysis. The presented methods can be used for modelling arbitrarily shaped but simply connected 3D objects. They are suitable for surface comparison and are able to detect protrusions and invaginations, and quantify their dynamics. Shape plays important roles in many biological processes, such as bimolecular recognition and the problem of protein binding pocket and ligand comparison [32], where the presented methods have potential to extract functional information from protein structures, locally and globally.

One of the limitations of the framework is that it can only be used to represent genus-zero objects, which is true for the cell surface, but not for more complex intracellular structures like the endoplasmatic reticulum. As of now segmentation and spherical parameterization of our method are unable to cope with very thin protrusions.

Currently, we process every frame independently irrespectively of prior knowledge of previous time points, which could be used to initialize segmentation of the current frame. However, since in our application cells moves quite fast, the overlap between the membrane marker at consecutive time points is too low.

## Conclusions

This report presents a framework for 3D+time cell shape analysis, which includes five major steps: cell segmentation, topology fixing, spherical parameterization, shape representation, and shape comparison. We formalize the algorithms for the first four steps using Laplacian approaches. All the methods can be viewed from the perspective of exploring eigenfunctions of the Laplacian matrix, and are closely related to the problem of heat diffusion. We developed a fast random walker method for cell segmentation, which is based on the Laplacian matrix generated from the discrete grid domain and the affinities defined by a Gaussian kernel. It is faster than the other two popular methods with comparable segmentation quality. The novel topology fixing method we proposed is also based on the Laplacian matrix generated from the discrete grid domain, but the affinity matrix contains unit weights. It is able to fix the topology of complex cells with a high success rate while introducing only minor artefacts. The spherical parameterization method we applied is based on the Laplacian matrix generated from the surface graph and unit weights are assigned to each entry of the affinity matrix with some special modifications. For the shape representation, we directly explore the eigensystems of spherical Laplacian without constructing the Laplacian matrix explicitly. The spherical parameterization and the shape representation methods are used for both simulated and real cells, achieving satisfactory results. By analyzing the temporal Fourier spectrum, we are able to identify major deformation phases. The temporal local deformations of the cell membrane can be estimated by subtracting cellular models at different time points. In the future, we will apply our framework for 3D+time neutrophil cell shape analysis to study in detail how dynamic distributions of phospholipids correlate with membrane dynamics.

## Declarations

### Acknowledgements

The authors would like to thank the associate editor and the anonymous reviewers for their time and efforts. This work was supported by the Biotechnology and Biological Sciences Research Council (grant numbers: BBI0082091, BB/I008489/1, and BB/J004456/1).

## Authors’ Affiliations

## References

- Lauffenburger DA, Horwitz AF: Cell migration: A physically integrated molecular process. Cell. 1996, 84 (3): 359-369. 10.1016/S0092-8674(00)81280-5.View ArticlePubMedGoogle Scholar
- Ridley AJ, Schwartz MA, Burridge K, Firtel RA, Ginsberg MH, Borisy G, Parsons JT, Horwitz AR: Cell migration: Integrating signals from front to back. Science. 2003, 302 (5651): 1704-1709. 10.1126/science.1092053.View ArticlePubMedGoogle Scholar
- Kherlopian AR, Song T, Duan Q, Neimark MA, Po MJ, Gohagan JK, Laine AF: A review of imaging techniques for systems biology. BMC Syst Biol. 2008, 2: 74-10.1186/1752-0509-2-74.PubMed CentralView ArticlePubMedGoogle Scholar
- Eichorst JP, Lu S, Xu J, Wang Y: Differential RhoA dynamics in migratory and stationary cells measured by FRET and automated image analysis. PLoS One. 2008, 3 (12): e4082-10.1371/journal.pone.0004082.PubMed CentralView ArticlePubMedGoogle Scholar
- Shariff A, Kangas J, Coelho LP, Quinn S, Murphy RF: Automated image analysis for high-content screening and analysis. J Biomol Screen. 2010, 15 (7): 726-734. 10.1177/1087057110370894.View ArticlePubMedGoogle Scholar
- Soll DR, Wessels D, Heid PJ, Voss E: Computer-assisted reconstruction and motion analysis of the three-dimensional cell. TheScientificWorldJOURNAL. 2003, 3: 827-841.View ArticlePubMedGoogle Scholar
- Rangarajan R, Zaman MH: Modeling cell migration in 3D: Status and challenges. Cell Adh Migr. 2008, 2 (2): 106-109. 10.4161/cam.2.2.6211.PubMed CentralView ArticlePubMedGoogle Scholar
- Gerlich D, Ellenberg J: 4D imaging to assay complex dynamics in live specimens. Nat Cell Biol. 2003, Suppl: S14-S19.PubMedGoogle Scholar
- Eils R, Athale C: Computational imaging in cell biology. J Cell Biol. 2003, 161 (3): 477-481. 10.1083/jcb.200302097.PubMed CentralView ArticlePubMedGoogle Scholar
- Brechbuhler C, Gerig G, Kubler O: Parametrization of closed surfaces for 3D shape description. Comput Vis Image Und. 1995, 61 (2): 154-170. 10.1006/cviu.1995.1013.View ArticleGoogle Scholar
- Soll DR: Computer-assisted three-dimensional reconstruction and motion analysis of living, crawling cells. Comput Med Imaging Graph: the official J Comput Med Imaging Soc. 1999, 23 (1): 3-14. 10.1016/S0895-6111(98)00058-5.View ArticleGoogle Scholar
- Kierzkowski D, Nakayama N, Routier-Kierzkowska AL, Weber A, Bayer E, Schorderet M, Reinhardt D, Kuhlemeier C, Smith RS: Elastic domains regulate growth and organogenesis in the plant shoot apical meristem. Science. 2012, 335 (6072): 1096-1099. 10.1126/science.1213100.View ArticlePubMedGoogle Scholar
- Chung MK, Worsley KJ, Nacewicz BM, Dalton KM, Davidson RJ: General multivariate linear modeling of surface shapes using SurfStat. NeuroImage. 2010, 53 (2): 491-505. 10.1016/j.neuroimage.2010.06.032.PubMed CentralView ArticlePubMedGoogle Scholar
- Shen L, Kim S, Saykin AJ: Fourier method for large scale surface modeling and registration. Comput Graph. 2009, 33 (3): 299-311. 10.1016/j.cag.2009.03.002.PubMed CentralView ArticlePubMedGoogle Scholar
- SPHARM-PDM. http://www.nitrc.org/projects/spharm-pdm,
- SPHARM-MAT. http://www.nitrc.org/projects/spharm-mat,
- Du CJ, Ferguson JG, Hawkins PT, Stephnes LR, Bretschneider T: Fast Random Walker for Neutrophil Cell Segmentation in 3d. Ieee Int Symp Biomed Imaging. 2012, 2012: 190-193.Google Scholar
- Grady L: Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell. 2006, 28 (11): 1768-1783.View ArticlePubMedGoogle Scholar
- Li J, Levine MD, An X, Xu X, He H: Visual saliency based on scale-space analysis in the frequency domain. IEEE Trans Pattern Anal Mach Intell. 2013, 35 (4): 996-1010.View ArticlePubMedGoogle Scholar
- Hou XD, Zhang LQ: Saliency detection: A spectral residual approach. Proc Cvpr Ieee. 2007, 2007: 2280-2287.Google Scholar
- Otsu N: Threshold selection method from gray-level histograms. Ieee T Syst Man Cyb. 1979, 9 (1): 62-66.View ArticleGoogle Scholar
- Black MJ, Sapiro G, Marimont DH, Heeger D: Robust anisotropic diffusion. IEEE Trans Image Process: a publication of the IEEE Signal Process Soc. 1998, 7 (3): 421-432.View ArticleGoogle Scholar
- Genus zero surface. http://en.wikipedia.org/wiki/Genus_%28mathematics%29,
- Whitaker RT: Reducing aliasing artifacts in iso-surfaces of binary volumes. IEEE Volume Visualization and Graphics Symp. 2000, 23-32.Google Scholar
- Lempitsky V: Surface extraction from binary volumes with higher-order smoothness. Ieee Conference on Computer Vision and Pattern Recognition (Cvpr). 2010, 2010: 1197-1204.Google Scholar
- Kolev K, Cremers D: Integration of multiview stereo and silhouettes via convex functionals on convex domains. Lect Notes Comput Sc. 2008, 5302: 752-765. 10.1007/978-3-540-88682-2_57.View ArticleGoogle Scholar
- Shen L, Makedon F: Spherical mapping for processing of 3D closed surfaces. Image Vision Comput. 2006, 24 (7): 743-761. 10.1016/j.imavis.2006.01.011.View ArticleGoogle Scholar
- Friedel I, Schröder P, Desbrun M: Unconstrained spherical parameterization. J Graphics Tools. 2006, 12 (1): 17-26.View ArticleGoogle Scholar
- Gu X, Wang Y, Chan TF, Thompson PM, Yau ST: Genus zero surface conformal mapping and its application to brain surface mapping. IEEE Trans Med Imaging. 2004, 23 (8): 949-958. 10.1109/TMI.2004.831226.View ArticlePubMedGoogle Scholar
- Ballard DH, Brown CM: Computer Vision. 1982, Englewood Cliffs, NJ: Prentice-HallGoogle Scholar
- Hobson EW: The theory of spherical and ellipsoidal harmonics. 1955, New York: Chelsea Pub. CoGoogle Scholar
- Morris RJ, Najmanovich RJ, Kahraman A, Thornton JM: Real spherical harmonic expansion coefficients as 3D shape descriptors for protein binding pocket and ligand comparisons. Bioinformatics. 2005, 21 (10): 2347-2355. 10.1093/bioinformatics/bti337.View ArticlePubMedGoogle Scholar
- Chung MK: Heat kernel smoothing on unit sphere. Ieee Int Symp Biomed Imaging. 2006, 2006: 992-995.Google Scholar
- Bulow T: Spherical diffusion for 3D surface smoothing. IEEE Trans Pattern Anal Mach Intell. 2004, 26 (12): 1650-1654. 10.1109/TPAMI.2004.129.View ArticlePubMedGoogle Scholar
- Shen L, Farid H, McPeek MA: Modeling three-dimensional morphological structures using spherical harmonics. Evol; int J of organic evol. 2009, 63 (4): 1003-1016. 10.1111/j.1558-5646.2008.00557.x.View ArticleGoogle Scholar
- Yeo BT, Sabuncu MR, Vercauteren T, Ayache N, Fischl B, Golland P: Spherical demons: Fast diffeomorphic landmark-free surface registration. IEEE Trans Med Imaging. 2010, 29 (3): 650-668.PubMed CentralView ArticlePubMedGoogle Scholar
- Ducroz C, Olivo-Marin JC, Dufour A: Characterization of cell shape and deformation in 3d using spherical harmonics. Ieee Int Symp Biomed Imaging. 2012, 2012: 848-851.Google Scholar
- Zhang Y, Matuszewski BJ, Shark LK, Moore CJ: Medical image segmentation using new hybrid level-set method. Medivis 2008: Fifth International Conference Biomedical Visualization - Information Visualization in Medical and Biomedical Informatics, Proceedings. 2008, 2008: 71-76.Google Scholar
- Martin D, Fowlkes C, Tal D, Malik J: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Eighth Ieee International Conference on Computer Vision, Vol Ii, Proceedings. 2001, 2001: 416-423.View ArticleGoogle Scholar
- Du , et al: BMC Bioinformatics. 2013, http://go.warwick.ac.uk/bretschneider/data/, : supporting data,
- Styner M, Oguz I, Xu S, Brechbuhler C, Pantazis D, Levitt JJ, Shenton ME, Gerig G: Framework for the statistical shape analysis of brain structures using SPHARM-PDM. The insight journal. 2006, 1071: 242-250.PubMedGoogle Scholar
- Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G: User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability. NeuroImage. 2006, 31 (3): 1116-1128. 10.1016/j.neuroimage.2006.01.015.View ArticlePubMedGoogle Scholar
- Coifman RR, Lafon S, Lee AB, Maggioni M, Nadler B, Warner F, Zucker SW: Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps. P Natl Acad Sci USA. 2005, 102 (21): 7426-7431. 10.1073/pnas.0500334102.View ArticleGoogle Scholar
- Belkin M, Niyogi P: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 2003, 15 (6): 1373-1396. 10.1162/089976603321780317.View ArticleGoogle Scholar
- Lafon S, Lee AB: Diffusion maps and coarse-graining: A unified framework for dimensionality reduction, graph partitioning, and data set parameterization. IEEE Trans Pattern Anal Mach Intell. 2006, 28 (9): 1393-1403.View ArticlePubMedGoogle Scholar
- Grady L, Sinop AK: Fast approximate random walker segmentation using eigenvector precomputation. Ieee Conference on Comput Vision and Pattern Recognition. 2008, 1-12: 1119-1126.Google Scholar
- Zhang JY, Zheng JM, Cai JF: A Diffusion Approach to Seeded Image Segmentation. Ieee Conference on Comput Vision and Pattern Recognition (Cvpr). 2010, 2010: 2125-2132.Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.