- Open Access
Quality control, analysis and secure sharing of Luminex® immunoassay data using the open source LabKey Server platform
BMC Bioinformatics volume 14, Article number: 145 (2013)
Immunoassays that employ multiplexed bead arrays produce high information content per sample. Such assays are now frequently used to evaluate humoral responses in clinical trials. Integrated software is needed for the analysis, quality control, and secure sharing of the high volume of data produced by such multiplexed assays. Software that facilitates data exchange and provides flexibility to perform customized analyses (including multiple curve fits and visualizations of assay performance over time) could increase scientists’ capacity to use these immunoassays to evaluate human clinical trials.
The HIV Vaccine Trials Network and the Statistical Center for HIV/AIDS Research and Prevention collaborated with LabKey Software to enhance the open source LabKey Server platform to facilitate workflows for multiplexed bead assays. This system now supports the management, analysis, quality control, and secure sharing of data from multiplexed immunoassays that leverage Luminex xMAP® technology. These assays may be custom or kit-based. Newly added features enable labs to: (i) import run data from spreadsheets output by Bio-Plex Manager™ software; (ii) customize data processing, curve fits, and algorithms through scripts written in common languages, such as R; (iii) select script-defined calculation options through a graphical user interface; (iv) collect custom metadata for each titration, analyte, run and batch of runs; (v) calculate dose-response curves for titrations; (vi) interpolate unknown concentrations from curves for titrated standards; (vii) flag run data for exclusion from analysis; (viii) track quality control metrics across runs using Levey-Jennings plots; and (ix) automatically flag outliers based on expected values. Existing system features allow researchers to analyze, integrate, visualize, export and securely share their data, as well as to construct custom user interfaces and workflows.
Unlike other tools tailored for Luminex immunoassays, LabKey Server allows labs to customize their Luminex analyses using scripting while still presenting users with a single, graphical interface for processing and analyzing data. The LabKey Server system also stands out among Luminex tools for enabling smooth, secure transfer of data, quality control information, and analyses between collaborators. LabKey Server and its Luminex features are freely available as open source software at http://www.labkey.com under the Apache 2.0 license.
Multiplexed bead arrays allow researchers to perform immunoassays that test tens or even hundreds of analytes against each sample in each plate well [1-18]. At present, many [19-23] (but not all [24, 25]) of these arrays leverage Luminex® xMAP® technology, so we refer to them here as “Luminex” assays. These include both commercially available assay kits and custom assays, such as the binding antibody multiplex assay (BAMA) for human immunodeficiency virus 1 (HIV-1) developed by the Tomaras Laboratory at Duke University . Such multiplexed assays can speed experimental efforts, increase lab efficiency and consume smaller amounts of sample material than ordinary enzyme-linked immunosorbent assays (ELISAs) [7, 10, 11, 15, 26]. In an ELISA, each analyte must be tested with a separate aliquot of sample in a separate well. Although Luminex assays can offer experimental advantages, they can also pose challenges in analysis  and quality control [15-17, 28-30], particularly given the greater complexity and dimensionality of such assays than ordinary ELISAs. The continued evolution of analysis and quality control techniques, the limits of current tools and the increasingly important role these assays play in certain fields of biomedical research all make enhanced software tools desirable for management and analysis of Luminex immunoassay data.
The field of vaccine immunology provides an example of the growing importance of Luminex assays and the need for better software support. In this field, samples from vaccine trial participants can be too scarce to assay against large numbers of analytes using ordinary ELISA techniques [10, 11]. To maximize the insights gained from vaccine trials, researchers have started to rely on multiplexed Luminex methods [1-3, 9-14]. Recent follow-up studies for the ALVAC-AIDSVAX trial, the first vaccine trial ever to demonstrate some degree of vaccine efficacy against HIV-1 [1, 31], heavily used Luminex assays. Several of these studies used Luminex assays to examine the binding of plasma immunoglobulins to panels of HIV-1 envelope proteins to determine immune correlates of vaccine efficacy [1, 5].
While completing ALVAC-AIDSVAX follow-up studies, several collaborating teams found that the existing software for analysis and quality control of research Luminex immunoassays did not meet their needs in two areas. First, labs found it necessary to move data between multiple software tools to fully process all experimental data, employ advanced analytical techniques, and perform quality control across runs and reagent/bead lots. This was labor-intensive, introduced additional opportunities for error, and multiplied versions of data and analyses. Second, existing Luminex tools did not enable smooth handoff of quality-controlled data from labs to central network statisticians and principal investigators, nor provide transparency into data excluded from analysis by the labs as part of quality control.
The inherent complexity of multiplexed immunoassays makes robust, transparent quality control techniques particularly vital to achieving reproducibility, reliability and comparability of such assays [8, 15-18, 32-35]. Custom immunoassays that use Luminex technology, such as BAMA, can be highly reproducible; for example, BAMA has been validated for use in analyzing HIV-1 specific antibody responses in clinical trials [4, 36], data in preparation for publication by Georgia Tomaras]. Nevertheless, variability in assay execution, analysis, and results is currently considered a key inhibitor of the reliable use of commercially available multiplexed assays in clinical applications, such as diagnostic biomarkers or surrogate endpoints for clinical trials [15, 17, 18, 35, 37-39]. One recent study of variability in multiplexed cytokine assay results showed significant variation across every participating lab and/or material lot for every reagent kit and multiplex platform employed (including several Luminex systems) . Large-scale efforts to develop assay “harmonization” guidelines [37-42] emphasize the importance of facilitating and sharing quality techniques that can be used to overcome intra- and inter-assay variability and stabilize assay performance across labs. Growing efforts to develop reporting standards for immunoassay protocols and results [42-46] further emphasize the importance of clearly tracking and reporting variables (particularly quality control procedures) that affect assay consistency.
In response to the limitations of existing software tools, the HIV Vaccine Trials Network (HVTN) and the Statistical Center for HIV/AIDS Research & Prevention (SCHARP) at the Fred Hutchinson Cancer Research Center collaborated with LabKey Software to enhance the freely available, open source LabKey Server system [47, 48] to support management, analysis and quality control of Luminex immunoassay data. Data may be produced by either customized or commercially available (kit-based) assays. The software may be particularly helpful to research organizations who seek greater control over analysis and quality control techniques; to consolidate, simplify and standardize calculation and monitoring procedures; and (as shown in Figure 1) to facilitate secure collaboration.
Steps for a Luminex immunoassay
To provide context and terminology for software discussions, we briefly sketch an abbreviated set of experimental, analysis and quality control steps that might be used as part of an immunoassay based on Luminex xMAP technology. Note that experimental steps, materials and terminology vary with the type of immunoassay; similarly, analysis and quality control techniques continue to be active areas of research [15, 16, 27-30, 32, 34].
Figure 2 shows how you might evaluate the binding of plasma antibodies from study participants (e.g., immunoglobulin A (IgA) antibodies) to a panel of analytes (e.g., virus envelope (ENV) proteins (antigens)). Experimental steps:
Conjugate each analyte with a different type of bead. Each bead type contains a mixture of red and infrared dyes whose ratio can produce a spectral signature that uniquely identifies the bead type (and thus the analyte).
Mix bead/analyte complexes with a sample in each plate well. Sufficient numbers of each type of bead must be deposited in each well to satisfy thresholds for statistically significant results. Optionally, unbound (“blank”) beads may be included in the bead mixture to allow subtraction of fluorescence from non-specific binding to beads. The type of sample deposited in each well varies depending on the purpose of the well: (i) A titrated standard, whose concentration is known and used to calculate a reference curve (ii) A titrated quality control, whose concentration is known and used to calculate a reference curve (iii) An unknown, such as serum from a study participant (iv) A positive or negative control (v) A background well, which contains only buffer and is used for subtracting that results from non-specific binding of the detector. Samples are usually replicated in several wells.
Incubate, then rinse. This removes excess sample.
Add detector conjugated to R-phycoerythrin. The detector and its attached fluorochrome later serve as reporter for the binding of sample material to the bead/analyte complex. The detector is sometimes called the conjugate for the experiment.
Incubate, then rinse. This removes excess detector.
Use two lasers to measure bead number and sample binding. Typically, flow cytometry and two lasers are used to make single-bead measurements. For each bead, one laser excites the bead’s dye, allowing identification of the bead type (and thus the analyte) from the red/infrared ratio of light, as well as detection of beads of incorrect size (such as doublets or fractured beads). A second laser excites the detector-bound fluorochrome, allowing measurement of sample binding. For each type of analyte in each well, the instrument reports the median fluorescence intensity (FI) for the bound detector for all beads coupled with that analyte.
On a per-run basis, analysis and quality control of results may include: normalization to account for background fluorescence, exclusion of suspect data, calculation of dose-response curves for titrated standards, the use of these curves to interpolate estimated concentrations of unknowns, and other steps. Performing quality control across many assay runs may involve: calculating representative metrics for each standard curve for each run, plotting these metrics and expected ranges on Levey-Jennings  charts to determine outliers, excluding data from analysis based on quality metrics, and identifying trends that require further investigation.
LabKey Server is a web application implemented in Java. It runs on the Apache Tomcat web server and stores its data in a relational database, either PostgreSQL or Microsoft SQL Server. LabKey Server has been tested on computers running Microsoft Windows and most Unix variants, including Linux, Macintosh OSX and Solaris.
LabKey Server’s tool for Luminex is packaged in a Java-based module that encapsulates user interface elements and calculation logic for designing, processing and displaying structured assays of various kinds. The tool can leverage a customizable transform script that performs Luminex-specific analysis calculations during import of assay data. If included, this script is also re-run automatically when data from a titration are excluded from analysis because the exclusion affects the analysis results. The default Luminex transform script is written in R, but many other programming languages could be used (e.g., Perl, Python, or Java).
Details of LabKey Server’s architecture and assay module are covered elsewhere . LabKey Server v12.3, available in December 2012, is the 25th official, public release of the platform since 2005.
Configuration of scripting
To access all features of the LabKey Server tool for Luminex, the R scripting environment must be installed and configured on the server. To leverage the default Luminex transform script (labkey_luminex_transform_script.R), one must also install the script, its utility script (youtil.R), the Ruminex R package , and required R packages (Rlabkey, xtable, drc and Cairo). See Additional file 1 to obtain the first three; the other R packages are available from the Comprehensive R Archive Network (CRAN) .
Overview of the Lumimex tool
When a researcher imports Luminex run data into a LabKey Server, the researcher is prompted to enter relevant metadata about the batch of runs, the run itself, included analytes and relevant titrations. Metadata include information required for calculations (e.g., normalization options, and desired standard for each analyte) and experimental characteristics that can be used for tracking purposes (e.g., experiment performer and reagent lot number). The system can be configured to use an R script to automatically analyze raw data and metadata to determine dose-response curves for titrations, estimate concentrations using these curves, identify outliers, determine quality control metrics for curves and plot curves. Unreliable experimental data can be flagged for exclusion from analyses. When a transform script is configured, the system automatically provides Levey-Jennings quality-control charts and allows users to define expected ranges using baseline sets of runs. Assay results can be integrated with other data types, such as specimen information and clinical data for study participants. The Luminex tool displays all source data, quality control exclusions, calculated values and curves in a secure, interactive, web-based interface.
Options for leveraging the tool
LabKey Server’s tool for Luminex can be accessed in two ways:
By installing and configuring a LabKey Server instance. This option allows you to administer and customize a private LabKey Server for your lab or organization. The “Availability and Requirements” section of this paper explains how to obtain installers and/or source code.
By logging into to the Atlas Science Portal . This option is available to qualified researchers at many of the consortia participating in the Global HIV Enterprise [47, 52, 53]. To inquire about access, contact email@example.com.
Documentation, tutorials, live demo, and context-sensitive help
Full documentation and tutorials for setting up, configuring and using LabKey Server and its Luminex assay tool are available at http://www.labkey.org. This documentation is updated regularly to match the currently released version of LabKey Server. The basic and advanced Luminex tutorials [54, 55] provide detailed walk-throughs of Luminex setup and scenarios. They also include a troubleshooting guide  that helps users interpret and fix error messages from Luminex transform scripts, plus address problems with script-calculated values, such as curve fits. The tutorials are accompanied by live demos  that allow visitors to interact with Luminex features that do not require editor-level permissions. For each page in the Luminex workflow, the software provides a context-sensitive Help link in the upper right corner that leads to a relevant tutorial or documentation page.
Assay file formats
LabKey Server understands Microsoft Excel® files output by Bio-Plex Manager™  for each Luminex assay plate run. Bio-Plex Manager is software that runs several types of Luminex devices. The LabKey Server tool for Luminex has been tested with the results of 96-well plate assays. It is expected to be compatible with newer, larger plates, such as those with 384 wells.
Each run file includes a separate worksheet for each type of bead (and thus each analyte). Each sheet displays a header with run metadata, one or two data tables, and a footer with calculated parameters and flags. Data tables report results provided by the instrument, either on a per-well basis (raw data) or on a per-sample basis (summary data). If summary data are reported, each row supplies an average for all sample replicates. Some files contain both raw and summary data tables.
Each row in a data table reports the sample type (background, standard, control or unknown), sample identifier, well location (for summary data, multiple are shown), sample description (often an identifier that can map the sample to its source specimen and study participant), FI (fluorescence intensity averaged across replicates for summary data), FI minus mean background well FI, coefficient of variance, expected concentration (for titrations only), dilution, bead count (for raw data only), and other columns.
Usage scenario for the tool
To analyze and perform quality control on Luminex data, a lab might follow these steps:
Set up an assay project. After setting up a LabKey Server, an administrator creates an assay-type project on the server with appropriate permissions for user access. It provides a central location for managing descriptions of Luminex assays and associated run data.
Create an assay design. An assay design  both describes the content expected for a particular type of assay run file and provides a framework for importing many runs and their associated metadata in a standardized manner. An administrator can either select the default Luminex assay design, or import a Luminex assay design archive that is tailored to support the default transform script. Both designs can be further customized, as shown in Figure 3. When usage of a transform script is desired, the path to this script is entered in the assay design.
Import data and enter metadata. After an administrator has created an assay design in the assay project, users can import run data to the server. As part of this process, the assay design guides the collection of appropriate metadata for the assay run, as shown in Figure 4. Certain metadata are used to control Luminex-specific data processing. For example, information collected may determine processing steps for inputs to calculations (such as normalizations for background fluorescence), identify the standard(s) used for calculating interpolated concentrations, or associate analytes with metadata (such as bead lots). Other metadata are used to annotate the run, run analytes, and/or batch of runs. During import, the transform script automatically performs calculations on the data and the system flags certain data for quality control (as discussed below in the “Calculations” section). Several files may be imported together as part of one run, allowing standards in one file to be associated with results in another.
Explore results. Curve fits and related results are calculated automatically by the transform script for each run during the import process. Results include curve fit parameters, estimated concentrations interpolated from calculated curve fits for standard titrations, and metrics calculated from curve fits, including EC50 (effective concentration at 50% of the difference between the asymptotes of a dose-response curve), AUC (trapezoidal area under the curve) and HighMFI (highest mean FI). Calculated results and data from run files are displayed together in grid views. The system provides curve visualizations based on both 4- and 5-parameter logistic regressions (4pl and 5pl), as shown in Figure 5. Users can explore their data through sorting, filtering and customizing grid views; using built-in visualization and analysis tools; or building custom SQL queries or visualizations . For example, LabKey Server’s built-in R scripting environment allows statisticians to define R scripts that produce visualizations and associate them with certain kinds of results.
Perform within-run quality control. Questionable results can be excluded from analysis on a per-analyte or per-replicate-group basis. If a replicate group of wells for a titration is excluded, the transform script is re-run to recalculate curves and associated results. Figure 6 shows how the system applies red highlighting to all excluded data.
Perform cross-run quality control. The system automatically plots Levey-Jennings charts for four metrics of performance (4pl EC50, 5pl EC50, AUC and HighMFI) for both standards and quality controls chosen for each analyte. Users can select a suite of baseline runs (a “guide set”) to establish expected ranges for analyte-specific standard metrics for all runs associated with the same lot of experimental materials, as shown in Figure 7. These ranges (+/− one, two and three standard deviations) are displayed on the Levey-Jennings plot for each metric for the analyte standard, as shown in Figure 8. For each run associated with the same lot of materials, quality control metrics that fall outside of expected ranges are flagged for review, as shown in Figure 9. Standard curves for selected runs can be displayed together to help identify inconsistencies in curves across runs, as shown in Figure 10.
Share quality-controlled data with collaborators. After a lab has completed quality control for a set of runs, a lab data manager copies finalized data into a shared, study-type project. A study-type project serves as an integration and analysis hub for many types of related data for a study (e.g., specimen information, study participant demographics and results from other assays) [47, 59]. Collaborators with appropriate permissions can use the server’s web portal to view and analyze this data. Administrators can set up custom views or SQL queries that allow different parties (such as lab technicians, statisticians and project managers) to see the data in their own preferred formats. Role-based, inheritable and customizable permission settings  support controlled, secure sharing within a lab, between labs, between organizations, and/or with the general public. Collaborating scientists can use the shared data portal to bring different perspectives to results, explore alternative analysis approaches, and collaborate efficiently on publication.
Publicly share data and analyses as part of a publication. Upon publication of results in a scientific journal, specified subsets of anonymized, releasable data can be publicly shared on a LabKey Server web portal alongside contextual information and tools, including quality control information and analytical scripts. Providing public, interactive access to publication-related data allows a wider pool of scientists to explore the results and investigate alternative analytical approaches. Interactive release of data, quality control information, and analytical tools also supports study reproducibility .
Calculations performed on Luminex data fall into three categories: automatic calculations performed by the server, automatic calculations performed by the transform script, and optional calculations performed by the script. Calculations by the script only occur if the script is associated with the assay design. Calculations by the system and the script are performed during data import. Additionally, if data for a replicate group of wells in a titration are excluded, the transform script and its calculations are re-run.
Automatic calculations and flagging performed by the server. LabKey Server provides automatic calculation of coefficients of variation (CVs) and provides flagging for outliers of various kinds to facilitate human review.
For quality control of multiplexed immunoassays, researchers typically pre-select acceptable thresholds of variation across replicates and use these thresholds to flag, review, and exclude dubious data in a standardized fashion. CVs are used to measure variability for different kinds of replicates (samples, assay runs, material lots, analysis labs, etc.) and identify questionable outliers or patterns that may be artifacts of experimental conditions [15, 17, 33, 34, 60]. Outliers can bias top asymptotes, bottom asymptotes, and slope parameters [60, 61]. CVs for both intra- and inter-assay measures may also be monitored over time to identify changes in experimental conditions that may affect the accuracy and comparability of results .
When the imported run file does not include summary data, LabKey Server calculates the CV of the FIs of each replicate group (sample/dilution/antigen combination). CVs are stored with each well-level row and measure variability across replicates. They are displayed as percents (%CVs).
LabKey Server adds a quality control flag to each data row whose reported FI is greater than 100 and whose %CV is greater than 15 (for unknowns) or 20 (for standards and quality controls). FI > 100 is used as a threshold to save review time; for our collaborators, only samples that are potentially “positive” (significantly changed with respect to a baseline) warrant further investigation. Columns flagged through this process are highlighted in red.
LabKey Server can automatically provide additional flagging and reporting of outliers. Assay design fields can be configured with arbitrary conditional formatting settings that automatically color code values when viewed in the user interface or in Excel file exports. A user can set up saved, custom views that automatically filter results to show only data rows that exceed user-set thresholds for user-selected measurements. Furthermore, as mentioned above, the system’s analyte- and replicate-specific exclusion options can be used to systematically add custom flags and exclusions, which the server displays in summary reports.
Automatic calculations performed by the default transform script. The script automatically applies a conversion function to normalized FIs to account for negative values potentially introduced by the removal of blank bead and/or background fluorescence. Currently, the script calculates: converted FI = max(FI, 0) + 1.
When calculating 5pl curve fits, the default transform script uses the Ruminex R package , which in turn uses the drc R package . When calculating 4pl curve fits, the script uses the drc R package directly. Users can edit the transform script to use alternative strategies for performing 5pl and 4pl curve fits [27, 63, 64], including using custom seed and optimization functions. Users can also add new calculations to the transform script.
Optional calculations performed by the default transform script. The default transform script enables users to opt to:
Normalize FI by subtracting blank bead and/or background well FI before calculating curves or interpolating unknowns. This subtracts fluorescence signal that is due to non-specific binding to the beads.
Log transform normalized FIs before calculation of curve fits, which can help stabilize variance extremes .
Apply weights to the squared errors used in goodness of fit optimization calculations. Weighting can help account for lower variance at lower FI (heteroscedasticity). This improves curve fits, particularly at the low range, thus expanding the useful range of data. Using the transform script, these weights can be arbitrary (e.g., weight = 1/FI1.8)
Calculate "positivity" by determining whether the value for each analyte has increased relative to a baseline value and also exceeds an analyte-specific threshold. This is helpful, for example, when you wish to determine whether measurements for an individual in a trial have increased relative to baseline, pre-trial values. Both the baseline and threshold for each analyte are entered during run import.
Additional system features and supported technologies
LabKey Server also allows researchers to integrate assay results (such as Luminex results) with related study data [47, 59]. Specimen identifiers in run data files can be mapped automatically to study-specific specimen identifiers (or participant/visit identifiers). This allows linkage and integration of specimen, experimental and clinical data.
The system also supports assays and techniques commonly used by immunologists, including ELISAs, neutralizing antibody assays , flow cytometry [65, 66], proteomics [48, 67], and next-generation sequencing [68, 69]. Furthermore, LabKey Server also supports the description, management and analysis of novel assay types .
The full set of features described here only became available in April 2012 with the release of LabKey Server 12.1, so adoption of the improved Luminex assay tool has been promising. As of January 2013, the Atlas Science Portal maintained by SCHARP, HVTN and their collaborators contained a total of 1,081 Luminex runs contributed by at least three separate labs.
Among software for Luminex analysis and quality control, LabKey Server stands out most distinctively in its support for customization, traceable quality control, and secure data sharing. These capabilities can help labs develop and adopt the new methods; simplify and standardize workflows; and securely, smoothly share information with collaborators. LabKey Server is also notably unique among Luminex-specific tools for being both open source and freely available (Apache 2.0 license ). Current, notable limitations include a lack of support for running Luminex instruments and a requirement that input run files conform to the Excel file format output by Bio-Plex instrument software.
Beyond LabKey Server, only a few software tools provide Luminex-specific support, and all of those tools provide only limited customizability. A much wider range of software tools provide significant customizability alongside general-purpose statistical features, but those tools do not inherently support Luminex-specific workflows. Table 1 compares the capabilities of LabKey Server with six representative tools: three systems tailored for Luminex (Luminex xPonent™ , Bio-Plex Manager , and MiraiBio MasterPlex QT™ ) and three general-purpose statistical tools (GraphPad/Prism® , Microsoft Excel , and R ). To highlight tradeoffs, features are roughly ordered from greatest Luminex specificity to greatest scope for customization.
This table does not aim to address tools for scientific data sharing . Furthermore, the table only includes Luminex-specific software designed for research assays, not software designed to support standardized diagnostic tests. Research assays typically require greater scope for cutting-edge analysis than manufacturer-defined diagnostic tests.
LabKey Server’s tool for management and analysis of Luminex immunoassay results can help labs and research organizations to:
Efficiently perform complex analyses of high-content data. The nature of multiplexed immunoassays results in a significant amount of information per experimental run. The tool can help teams efficiently manage and quickly analyze the complex, multidimensional data produced by such assays.
Facilitate networked research through smooth, secure sharing of Luminex results. A central, shared data portal/repository can prove particularly useful to research networks and consortia who employ central data management and statistics groups to execute study-wide and/or cross-study analyses based on data pooled from collaborating labs [47, 51, 76]. As shown in Figure 1, labs can use such a portal to supply statisticians with data and quality control information in a secure fashion. Central data managers can use the system’s reporting tools to efficiently monitor and troubleshoot study progress. Principal investigators (and others with appropriate permissions) can gain transparency into study progress, analyses and data, as well as explore alternative analysis approaches and collaborate on publications. Using a central repository can also help prevent loss of valuable data from individual computers. After study publication, a subset of releasable, anonymized study results can be made publicly available on the organization’s data portal by changing permission settings.
Retain raw Luminex data, quality controlled data, and analyses to make them available for later re-analysis. LabKey Server stores raw run data from the instrument, quality control information, calculated values, final datasets, visualizations, and the original run data files. Data records that have been flagged for quality control can be excluded from analysis without deletion. When data is stored in a shared repository, statisticians, labs and principal investigators can examine or export copies of the data as it looked at different stages of processing (e.g., with and without quality control exclusions).
Consolidate, simplify and standardize lab workflows by using one primary software tool for Luminex analyses. Eliminating the labor-intensive steps necessary to move data between tools for different calculations can increase efficiency, foster standardization and reduce opportunities for error. If the software is deployed on a shared portal, users have access to the same version of the tool and the same analysis algorithms without the need to install updates on a multiplicity of machines .
Customize calculations and visualizations. Labs can adopt new analysis and quality control techniques without adopting additional software tools or complicating workflows. They can use scripting and custom assay designs to incorporate the latest algorithms (e.g., new techniques for curve fitting), visualizations (e.g., custom R plots) and processing steps (e.g., subtraction of blank bead fluorescence) while still providing users with a friendly, graphical user interface. Labs can test out new analytical techniques and transform scripts without disrupting mainline workflows by establishing separate assay designs for exploratory analytics.
Track quality control across runs and reagent/bead lots using Levey-Jennings plots and outlier flagging. Both LabKey Server and existing Luminex-specific software packages enable both automatic and manual identification of outliers within runs. However, only LabKey Server provides extensive support for quality control tracking across runs and material lots using Levey-Jennings plots.
Gain flexibility in plate layouts and titration analyses. LabKey Server allows a user to associate multiple standards with each analyte, automatically perform curve fitting for all titrations (including quality controls and unknowns, not just standards), and select a standard on a different plate for use in interpolation of concentrations of unknowns. Bio-Plex Manager does not currently allow any of these options without rerunning analyses. Other software supports only some of these options.
Leverage LabKey Server platform features. The base system provides extensive support for data analysis, integration, visualization, reporting and workflow interface development. It also supports other assays and techniques commonly used by immunologists.
Use open-source, freely available tools. At present, LabKey Server is the only open source tool with a graphical user interface that provides substantial support for Luminex-specific scenarios. The R scripting environment is also open source, as are a wide variety of R statistical analysis packages. Using open source tools can provide advantages in transparency, cost and extensibility.
Facilitate assay harmonization across organizations. Overcoming variability and reproducibility issues for commercially available, multiplexed immunoassays for cytokine measurement is considered key to broadening the viable applications of such assays [37, 38]. To harmonize assay results, researchers identify experimental and analytical variables that strongly influence assay performance and use them to develop quality control guidelines that improve assay reproducibility across labs, material lots, organizations, etc. Identification of such performance variables requires sharing not just final results, but also protocol records, quality control information, data processing methodologies, and (possibly) analytical tools across collaborating organizations. To our knowledge, LabKey Server has not yet been employed for assay harmonization at a scale worthy of note; nevertheless, the system seems particularly well-suited given its support for sharing just this kind of information and tools. An installation of LabKey Server (the Atlas Science Portal ) has already been used for wide-scale proficiency testing (comparison of the performance of a standardized protocol across many labs) of a neutralizing antibody assay .
Current limitations on the use of LabKey Server for analysis of Luminex experiments include:
No support for running a Luminex instrument or designing Luminex plate layouts. Software such as Luminex xPonent, Bio-Plex Manager or MILLIPLEX Analyst™  is currently required for running instruments that leverage Luminex xMAP technology.
Limited Luminex data file format compatibility. Currently, the LabKey Server tool for Luminex only understands data files in the Excel format output by the Bio-Plex Manager software. However, the system can still infer the structure (column names and data types) of other tables of data, which allows users to quickly import other kinds of tabular data files, such as metadata files. Custom SQL queries can join imported tables of metadata to other kinds of Luminex data for display as custom data grids .
Familiarity with R recommended for extensive customization of analyses. Customization of certain aspects of data processing and analysis (e.g., selection of background FI subtraction settings) can be made through the user interface. However, making extensive changes to the default transform script (e.g., substituting a new curve fit algorithm) requires some knowledge of the R programming language. At the same time, transform scripts can be written in most programming languages (e.g., Perl, Python and Java), not just R.
Certain interfaces reflect terminology specific to certain kinds of immunoassays. The Levey-Jennings charting interface uses terminology consistent with the kind of immunoassays shown in Figure 2. For such experiments, analytes are antigens and the antibodies being measured are immunoglobulin isotypes. The interface can still be useful for other types of experiments as long as this terminology is understood.
LabKey Server undergoes ongoing development, culminating in 3-4 releases per year, so features and user interface refinements are regularly added to the platform. Features that may interest Luminex users have already been added during the period this paper has been under review. These improvements are available in LabKey Server v12.3 (released December 2012) and include: multi-curve titration plots for overlaying and comparing results from several runs (shown in Figure 10), the ability to run arbitrary numbers of transform scripts sequentially during data import, enhanced heuristics for identifying filter options for columns in data grids, and tools for anonymizing data for public release. One ongoing focus of development is support for ancillary studies , particularly “freezer studies” that leverage valuable, stored specimens to gain novel insights through new experiments, such as Luminex immunoassays.
LabKey Server’s support for Luminex data analysis and quality control allows labs to consolidate, customize and standardize data analysis workflows, which can eliminate labor-intensive and error-prone steps. Using LabKey Server as a data repository and portal can enable teams to securely share data, analyses, quality control information, and related documents. These capabilities can be particularly helpful to research organizations whose success depends on smooth collaboration between labs, central data managers, statistical teams and principal investigators. The open source license  for LabKey Server and its Luminex tool allow other researchers to freely leverage, customize and improve this software.
Availability and requirements
LabKey Server source code and compiled binaries
The LabKey Server open source software is freely available for download at http://www.labkey.org under the terms of the Apache License 2.0 . This site also provides documentation, tutorials and demos for users and developers, along with instructions for developers who wish to contribute code to the project through the LabKey Server Subversion repository.
Compiled binaries for Windows, Unix, Linux or Macintosh installation are available for free through LabKey Software at http://www.labkey.com. A graphical installer is available for computers running Windows XP or later. It includes the LabKey Server web application; the Apache Tomcat web server, v6.0.35; the Sun Java Runtime Environment, v1.7.0-29; the PostgreSQL database server, v9.2.1; and additional third-party components. Note that the installer does not include R. To access all features of the LabKey Server tool for Luminex, the R scripting environment must be installed and configured on the server.
Project name: LabKey Server
Project home page:http://www.labkey.org
Operating system(s): Platform independent
Other requirements, as of LabKey Server v12.3: Apache Tomcat 6.x; Sun Java Runtime Environment 6 or 7; and either PostgreSQL (8.3, 8.4, 9.0, 9.1, or 9.2) or Microsoft SQL Server (2008 R2 or 2012 with Service Pack 1). Check the project site for latest requirements of the most recent release.
License: Apache License 2.0 .
Access to the Atlas Science Portal
4 parameter logistic regression
5 parameter logistic regression
Coefficient of variation expressed as a percent
Acquired immune deficiency syndrome
Area under the curve
Binding antibody multiplex assay
Effective concentration at 50% of the difference between the asymptotes of a dose-response curve
Enzyme-linked immunosorbent assay
Highest mean fluorescence intensity
Human immunodeficiency virus type 1
The HIV Vaccine Trials Network
Median fluorescence intensity
the Statistical Center for HIV/AIDS Research & Prevention at the Fred Hutchinson Cancer Research Center
Haynes BF, Gilbert PB, McElrath MJ, Zolla-Pazner S, Tomaras GD, Alam SM, Evans DT, Montefiori DC, Karnasuta C, Sutthent R, Liao H-X, DeVico AL, Lewis GK, Williams C, Pinter A, Fong Y, Janes H, DeCamp A, Huang Y, Rao M, Billings E, Karasavvas N, Robb ML, Ngauy V, De Souza MS, Paris R, Ferrari G, Bailer RT, Soderberg KA, Andrews C, Berman PW, Frahm N, De Rosa SC, Alpert MD, Yates NL, Shen X, Koup RA, Pitisuttithum P, Kaewkungwal J, Nitayaphan S, Rerks-Ngarm S, Michael NL, Kim JH: Immune-Correlates Analysis of an HIV-1 Vaccine Efficacy Trial. N Engl J Med. 2012, 366: 1275-1286. 10.1056/NEJMoa1113425.
Moody MA, Yates NL, Amos JD, Drinker MS, Eudailey JA, Gurley TC, Marshall DJ, Whitesides JF, Chen X, Foulger A, Yu J-S, Zhang R, Meyerhoff RR, Parks R, Scull JC, Wang L, Vandergrift NA, Pickeral J, Pollara J, Kelsoe G, Alam SM, Ferrari G, Montefiori DC, Voss G, Liao H-X, Tomaras GD, Haynes BF: HIV-1 Gp120 Vaccine Induces Affinity Maturation in Both New and Persistent Antibody Clonal Lineages. J Virol. 2012, 86 (14): 7496-7507. 10.1128/JVI.00426-12.
Churchyard GJ, Morgan C, Adams E, Hural J, Graham BS, Moodie Z, Grove D, Gray G, Bekker L-G, McElrath MJ, Tomaras GD, Goepfert P, Kalams S, Baden LR, Lally M, Dolin R, Blattner W, Kalichman A, Figueroa JP, Pape J, Schechter M, Defawe O, De Rosa SC, Montefiori DC, Nabel GJ, Corey L, Keefer MC: A Phase IIA Randomized Clinical Trial of a Multiclade HIV-1 DNA Prime Followed by a Multiclade rAd5 HIV-1 Vaccine Boost in Healthy Adults (HVTN204). PLoS One. 2011, 6 (8): e21225-10.1371/journal.pone.0021225.
Yates NL, Lucas JT, Nolen TL, Vandergrift NA, Soderberg KA, Seaton KE, Denny TN, Haynes BF, Cohen MS, Tomaras GD: Multiple HIV-1-specific IgG3 responses decline during acute HIV-1. AIDS. 2011, 25: 2089-2097. 10.1097/QAD.0b013e32834b348e.
Tomaras GD, Yates NL, Liu P, Qin L, Fouda GG, Chavez LL, Decamp AC, Parks RJ, Ashley VC, Lucas JT, Cohen M, Eron J, Hicks CB, Liao H-X, Self SG, Landucci G, Forthal DN, Weinhold KJ, Keele BF, Hahn BH, Greenberg ML, Morris L, Karim SSA, Blattner WA, Montefiori DC, Shaw GM, Perelson AS, Haynes BF: Initial B-Cell Responses to Transmitted Human Immunodeficiency Virus Type 1: Virion-Binding Immunoglobulin M (IgM) and IgG Antibodies Followed by Plasma Anti-gp41 Antibodies with Ineffective Control of Initial Viremia. J Virol. 2008, 82: 12449-12463. 10.1128/JVI.01708-08.
Curtis KA, Kennedy MS, Charurat M, Nasidi A, Delaney K, Spira TJ, Owen SM: Development and Characterization of a Bead-Based, Multiplex Assay for Estimation of Recent HIV Type 1 Infection. AIDS Res Hum Retroviruses. 2012, 28: 188-197. 10.1089/aid.2011.0037.
Chowdhury F, Williams A, Johnson P: Validation and comparison of two multiplex technologies, Luminex® and Mesoscale Discovery, for human cytokine profiling. J Immunol Meth. 2009, 340: 55-64. 10.1016/j.jim.2008.10.002.
Elshal MF, McCoy JP: Multiplex bead array assays: Performance evaluation and comparison of sensitivity to ELISA. Methods. 2006, 38: 317-323. 10.1016/j.ymeth.2005.11.010.
Pine SO, Kublin JG, Hammer SM, Borgerding J, Huang Y, Casimiro DR, McElrath MJ: Pre-Existing Adenovirus Immunity Modifies a Complex Mixed Th1 and Th2 Cytokine Response to an Ad5/HIV-1 Vaccine Candidate in Humans. PLoS One. 2011, 6: e18526-10.1371/journal.pone.0018526.
Opalka D, Lachman CE, MacMullen SA, Jansen KU, Smith JF, Chirmule N, Esser MT: Simultaneous Quantitation of Antibodies to Neutralizing Epitopes on Virus-Like Particles for Human Papillomavirus Types 6, 11, 16, and 18 by a Multiplexed Luminex Assay. Clin Diagn Lab Immunol. 2003, 10: 108-115.
Pickering JW, Martins TB, Greer RW, Schroder MC, Astill ME, Litwin CM, Hildreth SW, Hill HR: A Multiplexed Fluorescent Microsphere Immunoassay for Antibodies to Pneumococcal Capsular Polysaccharides. AJCP. 2002, 117: 589-596.
De Rosa CS, Thomas EP, Bui J, Huang Y, deCamp A, Morgan C, Kalams SA, Tomaras GD, Akondy R, Ahmed R, Lau C-Y, Graham BS, Nabel GJ, McElrath MJ: HIV-DNA Priming Alters T Cell Responses to HIV-Adenovirus Vaccine Even When Responses to DNA Are Undetectable. J Immunol. 2011, 187: 3391-3401. 10.4049/jimmunol.1101421.
Peiperl L, Morgan C, Moodie Z, Li H, Russell N, Graham BS, Tomaras GD, De Rosa SC, McElrath MJ: The NIAID HIV Vaccine Trials Network: Safety and Immunogenicity of a Replication-Defective Adenovirus Type 5 HIV Vaccine in Ad5-Seronegative Persons: A Randomized Clinical Trial (HVTN 054). PLoS One. 2010, 5: e13579-10.1371/journal.pone.0013579.
De Jager W, Bourcier K, Rijkers GT, Prakken BJ, Seyfert-Margolis V: Prerequisites for cytokine measurements in clinical trials with multiplex immunoassays. BMC Immunol. 2009, 10: 52-10.1186/1471-2172-10-52.
Leng SX, McElhaney JE, Walston JD: Xie D, Fedarko NS, Kuchel GA: ELISA and multiplex technologies for cytokine measurement in inflammation and aging research. J Gerontol A Biol Sci Med Sci. 2008, 63: 879-884. 10.1093/gerona/63.8.879.
Ellington AA, Kullo IJ, Bailey KR, Klee GG: Antibody-Based Protein Multiplex Platforms: Technical and Operational Challenges. Clin Chem. 2010, 56: 186-193. 10.1373/clinchem.2009.127514.
Breen EC, Reynolds SM, Cox C, Jacobson LP, Magpantay L, Mulder CB, Dibben O, Margolick JB, Bream JH, Sambrano E, Martínez-Maza O, Sinclair E, Borrow P, Landay AL, Rinaldo CR, Norris PJ: Multisite Comparison of High-Sensitivity Multiplex Cytokine Assays. Clin Vaccine Immunol. 2011, 18: 1229-1242. 10.1128/CVI.05032-11.
Kang J-H, Vanderstichele H, Trojanowski JQ, Shaw LM: Simultaneous analysis of cerebrospinal fluid biomarkers using microsphere-based xMAP multiplex technology for early detection of Alzheimer’s disease. Methods. 2012, 56: 484-493. 10.1016/j.ymeth.2012.03.023.
xMAP Technology Multiplexing for Bioassays - Luminex Corporation: xMAP Technology Multiplexing for Bioassays - Luminex Corporation, [http://www.luminexcorp.com/TechnologiesScience/xMAPTechnology/]
Bio-Plex 200 Systems (Bio-Rad): [http://www.bio-rad.com/prd/en/US/LSR/PDP/715b85f1-6a4e-41b3-b5d9-80202d779e13/Bio-Plex_200_Systems]
Bio-Plex 3D Suspension Array System (Bio-Rad): [http://www.bio-rad.com/prd/en/US/LSR/PDP/L1AW4B15/Bio-Plex_3D_Suspension_Array_System]
Millipore -Luminex xMAP Technology, Instrumentation, Software & Templates: [http://www.millipore.com/drugdiscovery/dd3/ist]
Multiplex Instruments - Luminex Corporation: [http://www.luminexcorp.com/Products/Instruments/]
Meso Scale Discovery (MSD): [http://www.meso-scale.com/catalogsystemweb/webroot/index.aspx]
BD Biosciences- Bead-Based Immunoassays: [http://www.bdbiosciences.com/reagents/cytometricbeadarray/formats/index.jsp]
De Jager W, Rijkers GT: Solid-phase and bead-based cytokine immunoassay: A comparison. Methods. 2006, 38: 294-303. 10.1016/j.ymeth.2005.11.008.
Fong Y, Wakefield J, De Rosa S, Frahm N: A Robust Bayesian Random Effects Model for Nonlinear Calibration Problems. Biometrics. 2012, 2012: 2012-no
Kricka LJ, Master SR: Validation and Quality Control of Protein Microarray-based Analytical Methods. Mol Biotechnol. 2007, 38: 19-31.
Master SR, Bierl C, Kricka LJ: Diagnostic challenges for multiplexed protein microarrays. Drug Discov Today. 2006, 11: 1007-1011. 10.1016/j.drudis.2006.09.010.
Martins TB: Development of Internal Controls for the Luminex Instrument as Part of a Multiplex Seven-Analyte Viral Respiratory Antibody Profile. Clin Diagn Lab Immunol. 2002, 9: 41-45.
Rerks-Ngarm S, Pitisuttithum P, Nitayaphan S, Kaewkungwal J, Chiu J, Paris R, Premsri N, Namwat C, De Souza M, Adams E, Benenson M, Gurunathan S, Tartaglia J, McNeil JG, Francis DP, Stablein D, Birx DL, Chunsuttiwat S, Khamboonruang C, Thongcharoen P, Robb ML, Michael NL, Kunasol P, Kim JH: Vaccination with ALVAC and AIDSVAX to Prevent HIV-1 Infection in Thailand. N Engl J Med. 2009, 361: 2209-2220. 10.1056/NEJMoa0908492.
Kalos M: An integrative paradigm to impart quality to correlative science. J Transl Med. 2010, 8: 26-10.1186/1479-5876-8-26.
Bastarache JA, Koyama T, Wickersham NE, Mitchell DB, Mernaugh RL, Ware LB: Accuracy and reproducibility of a multiplex immunoassay platform: A validation study. J Immunol Meth. 2011, 367: 33-39. 10.1016/j.jim.2011.01.005.
Ellington AA, Kullo IJ, Bailey KR, Klee GG: Measurement and Quality Control Issues in Multiplex Protein Assays: A Case Study. Clin Chem. 2009, 55: 1092-1099. 10.1373/clinchem.2008.120717.
Huang Y, Gottardo R: Brief Bioinform. Comparability and reproducibility of biomedical data. 2012,
Sarzotti-Kelsoe M, Cox J, Cleland N, Denny T, Hural J, Needham L, Ozaki D, Rodriguez-Chavez IR, Stevens G, Stiles T, Tarragona-Fiol T, Simkins A: Evaluation and Recommendations on Good Clinical Laboratory Practice Guidelines for Phase I-III Clinical Trials. PLoS Med. 2009, 6: e1000067-10.1371/journal.pmed.1000067.
Britten CM, Janetzki S, Burg SH, Gouttefangeas C, Hoos A: Toward the harmonization of immune monitoring in clinical trials: Quo vadis? Cancer Immunology. Immunotherapy. 2007, 57: 285-288.
Burg SH Van D, Kalos M, Gouttefangeas C, Janetzki S, Ottensmeier C, Welters MJP, Romero P, Britten CM, Hoos A: Harmonization of Immune Biomarker Assays for Clinical Studies. Sci Transl Med. 2011, 3: 108ps44-108ps44. 10.1126/scitranslmed.3002785.
Hoos A, Eggermont AMM, Janetzki S, Hodi FS, Ibrahim R, Anderson A, Humphrey R, Blumenstein B, Old L, Wolchok J: Improved Endpoints for Cancer Immunotherapy Trials. J Natl Canc Inst. 2010, 102: 1388-1397. 10.1093/jnci/djq310.
Rao P, Zhang Z, Gebel H, Bray RA, Guleria I, Mohanakumar T, Nickerson P, Tambur A, Zeevi A, Heeger P, Gjertson D, Reed E: 29-OR: Validation of the Luminex platform to detect and quantify HLA antibodies: Effect of standardizing operation procedures on test variability by CTOT core laboratories. Hum Immunol. 2012, 73 (25): 1-174.
Galon J, Franck P, Marincola FM, Angell HK, Thurin M, Lugli A, Zlobec I, Berger A, Bifulco C, Botti G, Tatangelo F, Britten CM, Kreiter S, Chouchane L, Delrio P, Hartmann A, Asslaber M, Maio M, Masucci GV, Mihm M, Vidal-Vanaclocha F, Allison JP, Gnjatic S, Hakansson L, Huber C, Singh-Jasuja H, Ottensmeier C, Zwierzina H, Laghi L, Grizzi F: Cancer classification using the Immunoscore: a worldwide task force. J Transl Med. 2012, 10: 205-10.1186/1479-5876-10-205.
Hoos A, Britten CM, Huber C, O’Donnell-Tormey J: A methodological framework to enhance the clinical success of cancer immunotherapy. Nat Biotechnol. 2011, 29: 867-870. 10.1038/nbt.2000.
Taylor CF, Field D, Sansone S-A, Aerts J, Apweiler R, Ashburner M, Ball CA, Binz P-A, Bogue M, Booth T, Brazma A, Brinkman RR, Clark AM, Deutsch EW, Fiehn O, Fostel J, Ghazal P, Gibson F, Gray T, Grimes G, Hancock JM, Hardy NW, Hermjakob H, Julian RK, Kane M, Kettner C, Kinsinger C, Kolker E, Kuiper M, Novère NL, Leebens-Mack J, Lewis SE, Lord P, Mallon A-M, Marthandan N, Masuya H, McNally R, Mehrle A, Morrison N, Orchard S, Quackenbush J, Reecy JM, Robertson DG, Rocca-Serra P, Rodriguez H, Rosenfelder H, Santoyo-Lopez J, Scheuermann RH, Schober D, Smith B, Snape J, Stoeckert CJ, Tipton K, Sterk P, Untergasser A, Vandesompele J, Wiemann S: Promoting coherent minimum reporting guidelines for biological and biomedical investigations: the MIBBI project. Nat Biotechnol. 2008, 26: 889-896. 10.1038/nbt.1411.
Britten CM, Janetzki S, Burg SH, Huber C, Kalos M, Levitsky HI, Maecker HT, Melief CJM, O’Donnell-Tormey J, Odunsi K, Old LJ, Pawelec G, Roep BO, Romero P, Hoos A, Davis MM: Minimal information about T cell assays: the process of reaching the community of T cell immunologists in cancer and beyond. Canc Immunol Immunother. 2010, 60: 15-22.
Britten CM, Janetzki S, Butterfield LH, Ferrari G, Gouttefangeas C, Huber C, Kalos M, Levitsky HI, Maecker HT, Melief CJM, O’Donnell-Tormey J, Odunsi K, Old LJ, Ottenhoff THM, Ottensmeier C, Pawelec G, Roederer M, Roep BO, Romero P, Van der Burg SH, Walter S, Hoos A, Davis MM: T Cell Assays and MIATA: The Essential Minimum for Maximum Impact. Immunity. 2012, 37: 1-2. 10.1016/j.immuni.2012.07.010.
Janetzki S, Britten CM, Kalos M, Levitsky HI, Maecker HT, Melief CJM, Old LJ, Romero P, Hoos A, Davis MM: “MIATA”—Minimal Information about T Cell Assays. Immunity. 2009, 31: 527-528. 10.1016/j.immuni.2009.09.007.
Nelson EK, Piehler B, Eckels J, Rauch A, Bellew M, Hussey P, Ramsay S, Nathe C, Lum K, Krouse K, Stearns D, Connolly B, Skillman T, Igra M: LabKey Server: An open source platform for scientific data integration, analysis and collaboration. BMC Bioinformatics. 2011, 12: 71-10.1186/1471-2105-12-71.
Rauch A, Bellew M, Eng J, Fitzgibbon M, Holzman T, Hussey P, Igra M, Maclean B, Lin CW, Detter A, Fang R, Faca V, Gafken P, Zhang H, Whiteaker J, Whitaker J, States D, Hanash S, Paulovich A, McIntosh MW: Computational Proteomics Analysis System (CPAS): an extensible, open-source analytic system for evaluating and publishing proteomic data and high throughput biological experiments. J Proteome Res. 2006, 5: 112-121. 10.1021/pr0503533.
Levey S, Jennings ER: The use of control charts in the clinical laboratory. Am J Clin Pathol. 1950, 20: 1059-1066.
The Comprehensive R Archive Network: [http://cran.r-project.org/]
Atlas Science Portal: [https://atlas.scharp.org/cpas/project/home/begin.view]
Global HIV Vaccine Enterprise: [http://www.hivvaccineenterprise.org/]
Coordinating Committee of the Global HIV/AIDS Vaccine Enterprise: The Global HIV/AIDS Vaccine Enterprise: Scientific Strategic Plan. PLoS Med. 2005, 2: 25-
LabKey Server Tool for Luminex® Assays - Tutorial Level I: [https://www.labkey.org/wiki/home/Documentation/page.view?name=luminexAssayTutorial]
LabKey Server Tool for Luminex® Assays - Tutorial Level II: [https://www.labkey.org/wiki/home/Documentation/page.view?name=advancedLuminexTutorial]
Troubleshooting guide for Luminex transform scripts and curve fits: [https://www.labkey.org/wiki/home/Documentation/page.view?name=troubleshootLuminexTransformScripts]
LabKey Server Tool for Luminex® Assays - Tutorial Live Demo: [https://www.labkey.org/project/home/Study/Luminex/begin.view?]
Bio-Plex® Assay Data Analysis: Applications & Technologies (Bio-Rad): [http://www.bio-rad.com/evportal/en/US/LSR/Solutions/LUSM33IVK/Bio-Plex%C2%AE_Assay_Data_Analysis]
Piehler B, Nelson EK, Eckels J, Ramsay S, Lum K, Wood B, Greene KM, Gao H, Seaman MS, Montefiori DC, Igra M: LabKey Server NAb: A tool for analyzing, visualizing and sharing results from neutralizing antibody assays. BMC Immunol. 2011, 12: 33-10.1186/1471-2172-12-33.
Iversen PW, Beck B, Chen Y-F, Dere W, Devanarayan V, Eastwood BJ, Farmen MW, Iturria SJ, Montrose C, Moore RA, Weidner JR, Sittampalam GS: HTS Assay Validation. In Assay Guidance Manual. 2012, Eli Lilly & Company and the National Center for Advancing Translational Sciences: Bethesda (MD)
Beck B, Chen Y-F, Dere W, Devanarayan V, Eastwood BJ, Farmen MW, Iturria SJ, Iversen PW, Kahl SD, Moore RA, Sawyer BD, Weidner J: Assay Operations for SAR Support. In Assay Guidance Manual. 2012, Eli Lilly & Company and the National Center for Advancing Translational Sciences: Bethesda (MD)
Ritz C, Streibig JC: Bioassay Analysis using R. J Stat Software. 2005, 12: 1-22.
Gottschalk PG, Dunn JR: The five-parameter logistic: a characterization and comparison with the four-parameter logistic. Anal Biochem. 2005, 343: 54-65. 10.1016/j.ab.2005.04.035.
Motulsky H, Christopoulos A: Fitting Models to. 2004, Biological Data Using Linear and Nonlinear Regression: A Practical Guide to Curve Fitting. Oxford University Press
Shulman N, Bellew M, Snelling G, Carter D, Huang Y, Li H, Self SG, McElrath MJ, De Rosa SC: Development of an automated analysis system for data from flow cytometric intracellular cytokine staining assays from clinical vaccine trials. Cytometry. 2008, 73A: 847-856. 10.1002/cyto.a.20600.
Bellew M, Krouse K, Snelling G, Treister A, Self SG, McElrath MJ, De Rosa SC: Repository for data and analyses from multiparameter flow cytometric assays. J Med Primatol. 2009, 38: 67-93.
Eckels J, Hussey P, Nelson EK, Myers T, Rauch A, Bellew M, Connolly B, Law W, Eng JK, Katz J, McIntosh M, Mallick P, Igra M: Installation and Use of LabKey Server for Proteomics. 2002, John Wiley & Sons, Inc: In Current Protocols in Bioinformatics
Burwitz BJ, Sacha JB, Reed JS, Newman LP, Norante FA, Bimber BN, Wilson NA, Watkins DI, O’Connor DH: Pyrosequencing reveals restricted patterns of CD8+ T cell escape-associated compensatory mutations in simian immunodeficiency virus. J Virol. 2011, 85: 13088-13096. 10.1128/JVI.05650-11.
Moreland AJ, Guethlein LA, Reeves RK, Broman KW, Johnson RP, Parham P, O’Connor DH, Bimber BN: Characterization of killer immunoglobulin-like receptor genetics and comprehensive genotyping by pyrosequencing in rhesus macaques. BMC Genom. 2011, 12: 295-10.1186/1471-2164-12-295.
Apache License, Version 2.0: [http://www.apache.org/licenses/LICENSE-2.0.html]
Luminex Corporation: [http://www.luminexcorp.com/]
MiraiBio - MasterPlex QT for Multiplex Quantitative Analysis Curve-Fitting for Luminex 100/Luminex 200/MAGPIX/Bio-Plex/MSD Platforms: [http://www.miraibio.com/masterplex-qt/qt-luminex-quantitative-data-analysis-software.html]
GraphPad Prism: Scientific graphing, curve fitting and statistics: [http://www.graphpad.com/prism/prism.htm]
Microsoft Excel: [http://office.microsoft.com/en-us/excel/]
The R Project for Statistical Computing: [http://www.r-project.org/]
TrialShare Portal - Immune Tolerance Network: [https://itntrialshare.org/]
Nelson EK, Piehler B, Rauch A, Ramsay S, Holman D, Asare S, Asare A, Igra M: Ancillary study management systems: a review of needs. BMC Med Inform Decis Mak. 2013, 13: 5-10.1186/1472-6947-13-5.
We are indebted to Thomas Donn of SCHARP for his assistance in testing, Daryl Morris of SCHARP for help with Ruminex curve fits, and Kim Carson of BrighteyeWeb for improving Figures 1 and 2. We thank Dr. Marcella Sarzotti-Kelsoe of Duke University for quality assurance oversight and collaboration on validating the binding antibody multiplex assays (BAMA). We also thank Matthew Bellew, Adam Rauch, Mark Igra, Peter Hussey, Ren Lis, Karl Lum, Brian Connolly, Kevin Krouse, Trey Chadick, Steve Hanson, Nick Arnold, Kim Carson, Kristin Fitzsimmons, Alan Vezina, Ben Bimber, Dave Bradlee, Dax Hawkins, Rylan Bauermeister, Ben Hackett, and Avital Sadot for their ongoing work on the LabKey Server platform.
This work was supported by grants from the Bill and Melinda Gates Foundation to the Collaboration for AIDS Vaccine Discovery (OPP1032317 and 3830913), grants from the National Institute of Health (NIH/NIAID/DAIDS) to the HIV Vaccine Trials Network (HVTN) (5U01 AI46725-05, UM1-AI-068618 and U01-AI-068635), and the Duke University Center for AIDS Research (CFAR) Grant (P30 AI 64518).
JE, CN, EKN, EVN, and BP are employees of LabKey Software, a software consulting company that provides development, customization, and support for LabKey Server. LabKey Server is open source and freely available, so these authors do not have a direct financial interest in the software itself.
All authors reviewed and approved this manuscript. JE and CN designed and implemented the Luminex assay tool. JE also provided project management. EKN conceptualized, researched and wrote the paper. EKN also contributed tutorials, demos, documentation, and testing. SGS gathered requirements and provided project management and feature design. EVN contributed automated and manual testing. NLY and VCA provided usage scenarios, workflow expertise, and assistance in prioritizing laboratory requirements. LJH contributed expertise on analysis and data quality, as well as testing. MB provided data coordination and information on workflows. YF wrote the Ruminex R package. GDT saw the need for the tool and directed the lab work. BP contributed project management. JE, CN, EKN, SGS, NLY, LJH, GDT and BP contributed paper edits.
Electronic supplementary material
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Eckels, J., Nathe, C., Nelson, E.K. et al. Quality control, analysis and secure sharing of Luminex® immunoassay data using the open source LabKey Server platform. BMC Bioinformatics 14, 145 (2013). https://doi.org/10.1186/1471-2105-14-145
- Assay Design
- Multiplex Immunoassay
- Luminex Assay
- Perform Quality Control
- Quality Control Technique