Spectral imaging toolbox: segmentation, hyperstack reconstruction, and batch processing of spectral images for the determination of cell and model membrane lipid order
© The Author(s). 2017
Received: 26 November 2016
Accepted: 26 April 2017
Published: 12 May 2017
Spectral imaging with polarity-sensitive fluorescent probes enables the quantification of cell and model membrane physical properties, including local hydration, fluidity, and lateral lipid packing, usually characterized by the generalized polarization (GP) parameter. With the development of commercial microscopes equipped with spectral detectors, spectral imaging has become a convenient and powerful technique for measuring GP and other membrane properties. The existing tools for spectral image processing, however, are insufficient for processing the large data sets afforded by this technological advancement, and are unsuitable for processing images acquired with rapidly internalized fluorescent probes.
Here we present a MATLAB spectral imaging toolbox with the aim of overcoming these limitations. In addition to common operations, such as the calculation of distributions of GP values, generation of pseudo-colored GP maps, and spectral analysis, a key highlight of this tool is reliable membrane segmentation for probes that are rapidly internalized. Furthermore, handling for hyperstacks, 3D reconstruction and batch processing facilitates analysis of data sets generated by time series, z-stack, and area scan microscope operations. Finally, the object size distribution is determined, which can provide insight into the mechanisms underlying changes in membrane properties and is desirable for e.g. studies involving model membranes and surfactant coated particles. Analysis is demonstrated for cell membranes, cell-derived vesicles, model membranes, and microbubbles with environmentally-sensitive probes Laurdan, carboxyl-modified Laurdan (C-Laurdan), Di-4-ANEPPDHQ, and Di-4-AN(F)EPPTEA (FE), for quantification of the local lateral density of lipids or lipid packing.
The Spectral Imaging Toolbox is a powerful tool for the segmentation and processing of large spectral imaging datasets with a reliable method for membrane segmentation and no ability in programming required. The Spectral Imaging Toolbox can be downloaded from https://uk.mathworks.com/matlabcentral/fileexchange/62617-spectral-imaging-toolbox.
An increasing body of evidence suggests that the dynamic reorganization of lipids in cellular membranes can compartmentalize membrane proteins, influencing a cell’s response to extracellular stimuli and its membrane permeability [1, 2]. It follows that drug-carrying agents, such as liposomes or gas microbubbles, with optimized lipid compositions can exploit these processes for enhanced drug-delivery via membrane fusion or membrane permeabilization [3–5]. To facilitate the characterization of such drug-delivery devices and to deepen our understanding of the fundamental biology of the cell membrane, a non-destructive method for evaluating intrinsic membrane physicochemical properties is required. As an example, packing or molecular order of membrane lipids can be sensed by fluorescent polarity-sensitive probes such as Laurdan or Di-4-ANEPPDHQ, whose emission spectrum shifts in response to changes in the molecular order of the membrane environment, usually quantified by a parameter denoted Generalized Polarization (GP) [6–11]. With the advent of commercial microscopes equipped with spectral detectors, shifts in the fluorescence emission spectra, and thus the GP parameter, can now be determined with much higher spatial accuracy using spectral imaging . Owing to the internalization of many polarity-sensitive fluorescent probes in living cells, however, membrane segmentation must be performed to accurately measure membrane lipid packing and to remove cytosolic contributions [7, 12]. Membrane segmentation is often performed using a secondary fluorophore which increases experimental cost and complexity.
To this end, we have developed the Spectral Imaging Toolbox, a toolbox for spectral analysis with reliable membrane segmentation without the need for a secondary imaging probe. In the Spectral Imaging Toolbox, we have included batch and hyperstack processing as well as 3D reconstruction of confocal z-stacks to facilitate processing of large datasets and experiments with multiple exposures. We demonstrate the utility of this tool with images of giant plasma membrane vesicles (GPMVs, cell-derived vesicles) labelled with either polarity-sensitive Laurdan or Di-4-ANEPPDHQ, images of live cancer cells and microbubbles labelled with carboxyl-modified Laurdan (C-Laurdan), and giant unilamellar vesicles (GUVs) labelled with Di-4-AN(F)EPPTEA (FE). In addition to the more commonly employed Laurdan and Di-4-ANEPPDHQ dyes, we chose FE and C-Laurdan for their superior photostability and emission spectrum range [8, 12].
The Spectral Imaging Toolbox was designed for spectral analysis of high magnification images of single or sub-confluent cells, vesicles and microbubbles in MATLAB .
Inputs and outputs
In spectral imaging, a stack of images of a sample region is recorded with each image in the stack monitoring a different wavelength range, such that the information from the whole stack discloses the spectrum of emitted fluorescence for each image pixel . The Spectral Imaging Toolbox is designed for batch processing and 3-4D stacks. Using the Spectral Imaging Toolbox, we were able to process and analyze a dataset containing over 1500 cells in a few hours . To our knowledge, this is the largest study using the GP parameter of cell membranes as a metric for membrane lipid order, highlighting the utility of our toolbox. For an input directory of spectral image stacks, the Spectral Imaging Toolbox outputs pseudo-colored GP maps, fitted GP histograms, and plotted spectra at the whole image, whole object, and segmented membrane levels for each image in the folder, as well as a spreadsheet summarizing the results. Input images and metadata are automatically converted to the OME-TIFF data standard using the Bio-Formats Library (144 image formats currently supported) . Options for automatic 3D reconstruction of confocal spectral z-stacks  and plotted size distributions of spherical vesicles are also available.
Graphical user interface (GUI)
A graphical user interface (GUI) guides the user through the analysis such that no programming skills are required. The GUI has a three panel design whereby the left panel displays instructions and menu items, the center panel allows for navigation through the images and user interaction (i.e., cropping and region of interest selection), and the right panel displays a gallery of images providing an overview of the results. The processing allows for user interaction at three steps. First, the user selects settings for which to run the Spectral Imaging Toolbox, such as whether to include membrane segmentation or a GP correction factor. Then following automatic object detection, the user has the option to segment each detected object further using one or more of several segmentation routines. Finally, the user can review the results and remove unwanted objects from the analysis as necessary.
Spectral image stacks are thresholded using an intensity threshold determined automatically by Otsu’s method . Objects of interest are then segmented and cropped using connected-component labelling of the binary thresholding mask . The resultant cropped images are displayed for the user to discard off-target cropped images as necessary.
Since the cropped images contain only a single object, the membrane segmentation is simple and reliable. The objects in the binarized cropped images are filled and the membranes detected using Sobel edge detection [19–21]. The membranes are then segmented using the edge-detected pixels following dilation with a horizontal line element . The Spectral Imaging Toolbox also has a spherical object mode designed for microbubbles and spherical vesicles, where objects are segmented by finding circles using the circular Hough transform [23, 24].
Generalized polarization (GP)
To clarify, only the intensities of the images at λB and λR are required for GP calculation, even with spectral image stacks consisting of images collected at many wavelengths (e.g. Fig. 1a). Thus, the spectral image stack is reduced to two images at λB and λR, and these two images are reduced to the single-valued GP parameter at each pixel (Fig. 1b).
The calculated GP values are then visualized using a pseudo-colored map with a look-up table scaled from -1 to 1 . Finally, the distribution of GP values is fitted to either a one or two-peak Gaussian chosen by the lower root-mean squared error. The resultant GP histogram can be used to calculate changes in mean lipid order or, for a well-defined two-peak Gaussian, to indicate the presence of two phases . To facilitate additional spectral analysis, spectra are generated from the mean intensities of images at each wavelength of the stack.
Generalized polarization (GP) correction factor
In the Spectral Imaging Toolbox, GPref and a reference image can be specified in order to determine G for subsequent GP calculations.
Here we present several examples of spectral imaging data processed with the Spectral Imaging Toolbox.
Spectral imaging by confocal microscopy
Spectral imaging was performed on a Zeiss LSM 780 confocal microscope equipped with a 32-channel gallium arsenide phosphide (GaAsP) detector array, as reported previously . Laurdan, C-Laurdan, FE, and Di-4-ANEPPDHQ were excited at 405, 405, 488 and 488 nm respectively and the lambda detection ranges set between 410 nm and 695 nm, 415 nm and 691 nm, 500 nm and 650 nm, and 490 nm and 695 nm respectively. The resulting spectral image stacks were processed and analyzed using the Spectral Imaging Toolbox.
A-549 cells, immortalized human alveolar adenocarcinomic epithelial cells, were grown in standard culture conditions with Dulbecco’s modified eagle medium (DMEM) containing 10% fetal bovine serum (FBS) and 1% penicillin/streptomycin. Giant unilamellar vesicles (GUVs) made of dioleoyl phosphatidylcholine (DOPC), brain sphingomyelin (brain SM), and cholesterol from Avanti Polar Lipids were produced in a 2:2:1 molar ratio by electroformation by a modification of the protocol proposed by Angelova et al. [10, 26]. Phospholipid shelled microbubbles with a 9:1 molar ratio of 1,2-Distearoyl-sn-glycero-3-phosphocholine (DSPC, Avanti Polar Lipids, USA) and polyoxyethylene (40) stearate (PEG40S, Sigma Aldrich, UK) were produced using a batch sonication protocol previously reported . Samples were labelled with either C-Laurdan (400 nM for A-549 cells and 100 nM for GUVs and microbubbles) or Di-4-AN(F)EPPTEA (FE) (100 nM for GUVs) in phosphate-buffered saline (PBS). Giant plasma membrane vesicles (GPMVs) were isolated from rat basophilic leukemia cells labelled with 100 nM Laurdan or 100 nM Di-4-ANEPPDHQ as described by Sezgin et al. . Briefly, cells were exposed for 1 h at 37 °C to GPMV buffer (10 mM HEPES, 150 mM NaCl, 2 mM CaCl2, pH 7.4) containing 25 mM paraformaldehyde and 2 mM dithiothreitol for inducing vesiculation. After vesiculation, the GPMV-rich supernatant was collected by pipetting and resuspended in GPMV buffer for imaging. For all samples, spectral imaging was performed with samples on 170 μm thick glass coverslips.
Segmentation of cells, GUVs, and microbubbles
3D reconstruction of pseudo-colored GP maps
Microbubble size distribution
The Spectral Imaging Toolbox is the first free and open-source software to accurately measure cell membrane lipid packing without cytosolic contributions using a single dye. Furthermore, by implementing batch and hyperstack processing as well as 3D reconstruction of confocal z-stacks, it addresses a growing need to process large spectral imaging datasets and data from experiments with multiple exposures. It is also the only spectral imaging software to our knowledge to leverage different processing routines for vesicles, for adherent cells, and for regions of interest (i.e., sub-cellular) respectively. Finally, while the algorithms used are not individually novel, their implementation for spectral imaging is not available elsewhere to our knowledge.
Comparison with existing software
Without using membrane segmentation, it is common to decompose the GP histogram into two Gaussian components whereby the lower GP component corresponds primarily to the intracellular regions and the higher GP component to the cell membrane . While this technique is valuable for localizing high and low lipid order regions, it is not appropriate for determining plasma membrane lipid order. Low lipid order domains in the membrane and high lipid order vesicles inside the cell, for instance, could not be attributed to their respective sub-cellular components without some form of segmentation. Thus, more advanced software is required for accurately determining membrane lipid order.
Existing tools of note for processing spectral imaging data with the GP parameter include the ImageJ plugins of Sezgin et al. and Owen et al., and SimFCS developed by Professor Enrico Gratton [10, 30, 31]. These tools all provide adequate means of calculating GP, generating GP visualizations, and histograms for a single spectral image.
The plugin of Owen et al. provides batch processing and enables membrane segmentation with the requirement of a secondary image acquisition and fluorescent membrane label. The Spectral Imaging Toolbox does not require an additional membrane label or image acquisition step to achieve membrane segmentation.
Sezgin et al. allow for fitting the spectra of each pixel with either a Gaussian or gamma-variate function to interpolate the intensities, IB and IR, for reducing noise in the GP calculation. We found that the gamma-variate fit is most appropriate for spectral imaging data but was too computationally expensive for batch and hyperstack processing. The Spectral Imaging Toolbox instead allows for optionally smoothing the intensity images using a median filter prior to GP calculation, much like SimFCS.
The power of SimFCS is its ability to process many types of advanced imaging data with one software suite. SimFCS does not, however, support batch processing, ROI segmentation, membrane segmentation, or z-stack GP analysis and visualization - core features of the Spectral Imaging Toolbox.
Regarding availability, ImageJ is free , as is SimFCS 2 from Globals Software (although the laboratory license for the updated version, SimFCS 4, is $2000). Most research institutions have MATLAB licenses and without a site license, students can purchase MATLAB with the necessary add-ons for only $60.
Another benefit of our software is the ease of customization. SimFCS is not designed for user modification of the source code, and ImageJ provides only a limited macro language and plugin facility. Conversely, the Spectral Imaging Toolbox can be readily extended using MATLAB vector operations well-suited to rapid and complex image processing and analysis. The open-source code will be maintained on the MATLAB Central File Exchange at the URL provided where updates and feature requests can be publicly discussed.
The Spectral Imaging Toolbox provides an easy-to-use means of analyzing large spectral imaging datasets. It requires no programming experience, outputs publication-quality figures, enables reliable membrane segmentation without the requirement of a counter stain, and incorporates batch and hyperstack processing. It is our intention to continue to develop this free and open-source toolbox with input from the community to further facilitate ambitious research with spectral imaging.
Availability and requirements
Project name: Spectral Imaging Toolbox
Project web page: https://ora.ox.ac.uk/objects/uuid:4375842f-3598-418d-8aa3-9b31f5023401
Operating system: Tested on Windows 7
Programming language: MATLAB 2015+
Other requirements: Image Processing Toolbox https://uk.mathworks.com/matlabcentral/fileexchange/62617-spectral-imaging-toolbox
Any restrictions on use by non-academics: none
We would like to extend our gratitude to Dr. Shamit Shrivastava and Valerio Pereno for helpful discussions, James Fisk and David Salisbury for device fabrication, and Falk Schneider for assistance with GUV preparation.
This work has been supported by the Engineering and Physical Sciences Research Council (EPSRC, grant number EP/I021795/1) who have provided funding for the research materials and overall project of which this work is a part. Miles Aron gratefully acknowledges the support of the Institute of Engineering and Technology for funding contributions towards his PhD studentship. JBdlS acknowledges support from a Marie Curie Career Integration Grant. CE, JBdlS and ES acknowledge microscope support by the Wolfson imaging Centre and financial support by the Wolfson Foundation, the Medical Research Council (MRC, grant number MC_UU_12010/unit pro-grammes G0902418 and MC_UU_12025), MRC/BBSRC/EPSRC (grant number MR/K01577X/1), and Wellcome Trust (grant ref 104924/14/Z/14). None of the funding bodies have played any part in the design of the study, in the collection, analysis, and interpretation of the data, or in the writing the manuscript.
Availability of data and materials
The datasets processed in this study are bundled with the software with instructions for demonstration purposes.
MA and RB wrote and implemented the software. MA drafted the manuscript. MA and DC performed the measurements with cells. DC, ES, and JBdlS performed the measurements with GUVs. RB performed the experiments with microbubbles. CE and ES supervised and participated in the design of the project. All authors participated in revising the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Lingwood D, Simons K. Lipid rafts as a membrane-organizing principle. Science. 2010;327:46–50.View ArticlePubMedGoogle Scholar
- Simons K, Gerl MJ. Revitalizing membrane rafts: new tools and insights. Nat Rev Mol Cell Biol. 2010;11:688–99.View ArticlePubMedGoogle Scholar
- Carugo D, et al. Modulation of the molecular arrangement in artificial and biological membranes by phospholipid-shelled microbubbles. Biomaterials. 2016;113:105.Google Scholar
- Hosny NA, et al. Mapping microbubble viscosity using fluorescence lifetime imaging of molecular rotors. Proc Natl Acad Sci U S A. 2013;110:9225–30.View ArticlePubMedPubMed CentralGoogle Scholar
- Lentacker I, et al. Understanding ultrasound induced sonoporation: Definitions and underlying mechanisms. Adv Drug Deliv Rev. 2014;72:49–64.View ArticlePubMedGoogle Scholar
- De La Serna Bernardino J, et al. Compositional and structural characterization of monolayers and bilayers composed of native pulmonary surfactant from wild type mice. Biochim Biophys Acta. 2013;1828:2450–9.View ArticleGoogle Scholar
- Dodes Traian MM, et al. Imaging lipid lateral organization in membranes with C-laurdan in a confocal microscope. J Lipid Res. 2012;53:609–16.View ArticlePubMedPubMed CentralGoogle Scholar
- Kwiatek JM, et al. Characterization of a new series of fluorescent probes for imaging membrane order. PLoS One. 2013;8:1–7.View ArticleGoogle Scholar
- Parasassi T, et al. Two-photon fluorescence microscopy of laurdan generalized polarization domains in model and natural membranes. Biophys J. 1997;72:2413–29.View ArticlePubMedPubMed CentralGoogle Scholar
- Sezgin E, et al. Spectral imaging to measure heterogeneity in membrane lipid packing. ChemPhysChem. 2015;16:1387–94.View ArticlePubMedPubMed CentralGoogle Scholar
- Yu W, et al. Fluorescence generalized polarization of cell membranes: a two-photon scanning microscopy approach. Biophys J. 1996;70:626–36.View ArticlePubMedPubMed CentralGoogle Scholar
- Sezgin E, et al. Measuring lipid packing of model and cellular membranes with environment sensitive probes. Langmuir. 2014;30:8160–6.View ArticlePubMedGoogle Scholar
- MATLAB. version 8.5.0 (R2015a) The Mathworks Inc., Natick, Massachusettes. 2015.Google Scholar
- Linkert M, et al. Metadata matters: access to image data in the real world. J Cell Biol. 2010;189:777–82.View ArticlePubMedPubMed CentralGoogle Scholar
- Aitkenhead A. Plot a 3D array using patch. MATLAB Central File Exchange. 2010. https://www.mathworks.com/matlabcentral/fileexchange/28497-plot-a-3d-array-using-patch. Retrieved March 25, 2016.
- Otsu N. A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern. 1979;9:62–6.View ArticleGoogle Scholar
- Haralock RM, Shapiro LG. Computer and robot vision Addison-Wesley Longman Publishing Co., Inc. 1991.Google Scholar
- Meyer F. Topographic distance and watershed lines. Signal Process. 1994;38:113–25.View ArticleGoogle Scholar
- Lim JS. Two-dimensional signal and image processing, vol. 710. Englewood Cliffs: Prentice Hall; 1990. p. 1.Google Scholar
- Parker JR. Algorithms for image processing and computer vision John Wiley & Sons. 2010.Google Scholar
- Soille P. Morphological image analysis: principles and applications Springer Science & Business Media. 2013.Google Scholar
- van den Boomgaard R, van Balen R. Methods for fast morphological image transforms using bitmapped binary images. CVGIP Graph Model Image Process. 1992;54:252–8.View ArticleGoogle Scholar
- Atherton TJ, Kerbyson DJ. Size invariant circle detection. Image Vis Comput. 1999;17:795–803.View ArticleGoogle Scholar
- Yuen H, et al. Comparative study of Hough Transform methods for circle finding. Image Vis Comput. 1990;8:71–7.View ArticleGoogle Scholar
- Brewer J, et al. Multiphoton excitation fluorescence microscopy in planar membrane systems. Biochim Biophys Acta. 2010;1798:1301–8.View ArticlePubMedGoogle Scholar
- Angelova MI, Dimitrov DS. Liposome electro formation. Faraday Discuss Chem Soc. 1986;81:303–11.View ArticleGoogle Scholar
- Carugo D, et al. Biologically and acoustically compatible chamber for studying ultrasound-mediated delivery of therapeutic compounds. Ultrasound Med Biol. 2015;41:1927–37.View ArticlePubMedGoogle Scholar
- Sezgin E, et al. Elucidating membrane structure and protein behavior using giant plasma membrane vesicles. Nat Protoc. 2012;7:1042.View ArticlePubMedGoogle Scholar
- Golfetto O, et al. Laurdan fluorescence lifetime discriminates cholesterol content from changes in fluidity in living cell membranes. Biophys J. 2013;104:1238–47.View ArticlePubMedPubMed CentralGoogle Scholar
- Owen DM, et al. Quantitative imaging of membrane lipid order in cells and organisms. Nat Protoc. 2012;7:24–35.View ArticleGoogle Scholar
- Sanchez S a, et al. Laurdan generalized polarization fluctuations measures membrane packing micro-heterogeneity in vivo. Proc Natl Acad Sci. 2012;109:7314–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Schindelin J, et al. The ImageJ ecosystem: an open platform for biomedical image analysis. Mol Reprod Dev. 2014;82:518–29.View ArticleGoogle Scholar