Skip to main content
  • Research article
  • Open access
  • Published:

Transferring functional annotations of membrane transporters on the basis of sequence similarity and sequence motifs

Abstract

Background

Membrane transporters catalyze the transport of small solute molecules across biological barriers such as lipid bilayer membranes. Experimental identification of the transported substrates is very tedious. Once a particular transport mechanism has been identified in one organism, it is thus highly desirable to transfer this information to related transporter sequences in different organisms based on bioinformatics evidence.

Results

We present a thorough benchmark at which level of sequence identity membrane transporters from Escherichia coli, Saccharomyces cerevisiae, and Arabidopsis thaliana belong to the same families of the Transporter Classification (TC) system, and at what level these membrane transporters mediate the transport of the same substrate. We found that two membrane transporter sequences from different organisms that are aligned with normalized BLAST expectation value better than E-value 1e-8 are highly likely to belong to the same TC family (F-measure around 90%). Enriched sequence motifs identified by MEME at thresholds below 1e-12 support accurate classification into TC families for about two thirds of the sequences (F-measure 80% and higher). For the comparison of transported substrates, we focused on the four largest substrate classes of amino acids, sugars, metal ions, and phosphate. At similar identity thresholds, the nature of the transported substrates was more divergent (F-measure 40 - 75% at the same thresholds) than the TC family membership.

Conclusions

We suggest an acceptable threshold of 1e-8 for BLAST and HMMER where at least three quarters of the sequences are classified according to the TC system with a reasonably high accuracy. Researchers who wish to apply these thresholds in their studies should multiply these thresholds by the size of the database they search against. Our findings should be useful to those who wish to transfer transporter functional annotations across species.

Background

Prokaryotic and eukaryotic genomes each encode for hundreds of membrane transporter proteins that play essential roles for the cellular import and export of ions and small molecules. Furthermore, transporters mediate signal transduction processes catalyzing the export and uptake of signaling molecules. Therefore, the functional classification of membrane transporters is an important task. The available experimental knowledge about transporter function has been compiled in databases such as TCDB [1], TransportDB [2], SGD [3], and Aramemnon [4]. In these databases, the functional classification is normally done according to the hierarchical transporter classification (TC) system [5] adopted by the International Union of Biochemistry and Molecular Biology (IUBMB).

The TC system categorizes transporter sequences according to their class, subclass, (super) family, and subfamily on the basis of functional or phylogenetic information that is based on sequence similarity. An example for this classification would be the PTS Glucose-Glucoside (Glc) super family 4.A.1 that belongs to class ‘4’ group translocators and subclass ‘A’ phosphate transfer-driven group translocators. Subfamilies might correspond to transported substrates. A particular transporter sequence in such a family is identified by an extra digit to the right as e.g. 4.A.1.1.1.

A very important detail about each membrane transporter is of course the nature of its transported substrate molecule(s). As an alternative to the TC system, one may also classify transporters into different sets according to their substrates. It is presently unclear how such a substrate-based classification compares with the TC classification system. For example, the Aramemnon database lists members of five different TC families as phosphate transporters in Arabidopsis thaliana. In fact, many databases ignore the fourth digit (subfamily) of the TC system that normally refers to the main substrate. Schaadt and Helms have recently reported that membrane transporters from Arabidopsis thaliana that either transport amino acids, oligopeptides, phosphate, or sugar molecules can be distinguished from each other based on their amino acid composition [6, 7].

An important research question for membrane biology is whether two membrane transporters in organisms X and Y that show a certain sequence similarity will have the same function or not. Previous computational work in this area classified transporters using sequence homology and motif searches [8, 9], amino acid composition [10], and substrate specificity [6]. Interestingly, no study has so far critically analyzed the reliability margins of the individual features. In the general context of protein function, the Pfam repository of protein families has become a quasi-standard. Pfam employs so-called gathering thresholds that are manually curated, family-specific, bit score thresholds that are chosen by Pfam curators at the time a family is built. The threshold used recently corresponds roughly to ‘safe’ E-value thresholds of ~10-2[11]. In the TC system, the standard used for establishing homology between two proteins is 9 standard deviations (SDs). This corresponds to a probability of 10-19 that the degree of similarity observed arose by chance [12]. Chen and colleagues have recently assessed the performance of different orthology detection strategies for eukaryotic genomes [13].

Here, we have selected the three important model systems Escherichia coli (in the following abbreviated as Ec), Saccharomyces cerevisiae (Sc), and Arabidopsis thaliana (At) that belong arguably to the best characterized species in terms of transport processes. Analyzing homolog databases we found that Sc and At have more homologs compared to pairs (Sc, Ec) and (Ec, At) what reflects the smaller phylogenetic distance between Sc and At. According to the InParanoid database [14], 7173 out of the 26207 At genes (27.4%) have homologs in Sc and 2921 out of the 5884 Sc genes (49.6%) have homologs in At. For comparison, 933 Sc genes (15.8%) have homologs in Ec and 822 out of 4149 Ec genes (19.8%) have homologs in Sc. Finally, only 2778 At genes (10.6%) have homologs in Ec and 1168 Ec genes (28.1%) have homologs in At. Along the same lines, the Arabidopsis sequencing project revealed that a much higher percentage of the proteins in the 12 major functional subsets of the At genome had a BLASTP match with E < 10-30 to a protein from Sc (17-50)% than to a protein from Ec (5-32)% [15].

We used three different approaches to transfer transporter functional annotation between the three organisms by relating the level of sequence identity to the functional similarity between the three studied organisms. In this study, we will term this comparison “functional classification”. For this, we used the approaches BLAST that generates alignments that optimize a measure of local similarity [16], HMMER that searches for sequence homologs and performs protein sequence alignment using probabilistic methods [17], and MEME that performs motif discovery in protein sequences on the basis of expectation maximization [18]. So far there seem to be no accepted fixed thresholds for the prediction scores of the three tools. Therefore, different studies tend to use their own suitable set of thresholds [11-13, 19-21]. Our study establishes a set of thresholds under which the transporter function can safely be transferred between the three model organisms.

Results and discussion

In this work, we perform functional classification of transporter TC families and of transported substrate molecule using datasets from three model organisms. Our aim is to provide a simple guideline to biologists who wish to get a quick information whether available functional information about a transporter in species X may be transferred to another transporter sequence identified e.g. by BLAST search in species Y. Table 1 provides an overview over the main data sets used in this work. Figure 1 lists common TC families between the three organisms and the distribution of transporters among them. Additional file 1: Tables S1-S3 list all used transporters in this study, their TC families, substrates, and their Pfam description.

Table 1 Datasets
Figure 1
figure 1

Distribution of transporters among the TC families. Common Ec, At, and Sc TC families with member counts. Most families belong to the Electrochemical Potential Driven Transporters (class 2) and the Primary Active Transporters TC classes (class 3). Shared TC families in the searched organism with more than 2 members were used for MEME motif analysis.

Beside the TC analysis, we also created substrate families of transporters that are annotated to transport the same substrate. For each organism, we collected four large groups of transporters that have been experimentally shown to catalyze the transport of either metal ions, phosphates, sugars, or amino acids. Metal ion transporters account for about 25% of the complete substrate dataset in each organism. Sc contains twice as many metal ion transporters as Ec and At[22]. This can possibly be related with the existence of metallothionein proteins in yeast that function as a metal storage [23]. At contains three times as many phosphate transporters as Ec and four times as many as in Sc. This is probably due to the essential role of phosphate regulating the At root system [24-26]. Sugar transporters in At even account for 50% of the complete substrate dataset which is twice as many as in Ec and Sc. One possible explanation for this is that plants need sugar to complete photosynthesis [27]. Ec and Sc contain twice as many amino acid transporters as At. Figure 2 provides an overview to which TC families the members of the created substrate families belong. We noticed that the transporters for these four substrates are spread over many different TC families.

Figure 2
figure 2

Distribution of transporters from the four selected substrate families among the different TC families. Distribution of metal, phosphate, sugar, and amino acid transporters among the different TC families in the three organisms; Ec (squares), At (triangles) and Sc (ovals). The size of the symbols indicates the number of members of this class. See Additional file 1: Tables S1-S3 for more details.

Matching TC families

In this work, we used BLAST for aligning all transporter sequences of one organism against their TC analogues in the two other organisms. Then, we calculated the accuracy measures precision, recall, and F-measure (eq. 1-3) for various E-value thresholds. BLAST multiplies the significance of a hit by the total number of residues in the database. Thus, to make the obtained results independent from the size of the searched database we divided the E-values by the size of the DB that we were BLASTing against. In this way E-values from searches against different TC sets or substrates sets are comparable to each other. In the following, we will term the normalized BLAST results "normalized E-values". As an example, we BLASTed Sc transporter YDR342C either against the At dataset (23,567 residues) or against the non-redundant (nr) database of 2011 with 3,877,139,759 residues. Among the matching sequences, we identified the Arabidopsis transporter At3g19940 in both BLAST runs with an E-value of 1e-58 when searching against the At dataset and 1e-53 when matching against nr. This difference of reported E-values matches the ratio of the database sizes.

On the other hand, when computing the accuracy measures, we multiplied the results by the member count of each family and then averaged over all TC families considered in order to account for the different member count of each family, see Table 2. The last row shows the percentage of transporters that remained unclassified at the given threshold. These are transporters from one organism belonging to the shared TC families that do not share sequence identity better than the given E-value to any transporter in the shared TC family from the other organism.

Table 2 BLAST sequence homology search results within TC families in the three organisms

At the strictest threshold of 1e-20, the assignment of TC family has very high confidence but more than 80% of the sequences cannot be assigned for the Ec-At comparison and about half in the Ec-Sc and Sc-At comparisons. When the threshold is made more permissive, the number of correct predictions increased with few false predictions. We found that the precision and recall increased until 1e-8 but at threshold 1e-4 the number of false predictions increased. As expected, the unclassified percentage decreased as the thresholds were made more permissive. Based on this comparison, a rather permissive normalized BLAST threshold of 1e-8 is very acceptable but 1e-4 can still be considered with caution. When using the absolute identity scores of the alignment instead of the extracted E-values, the results were untrustworthy. The TC family prediction of Ec transporters based on Sc transporters annotated more sequences than the prediction based on At transporters at the strictest thresholds. Additionally, the Sc-At analysis resulted in a higher accuracy compared to the Ec-At analysis.

We then applied HMMER to the same datasets as for BLAST and calculated the accuracy measures and the unclassified percentage in the same way. Table 3 shows the results obtained with HMMER. For the purpose of normalization, the results were divided by the number of found hits in the database that was searched against. Overall, the results are similar to those obtained with BLAST. However, HMMER results are slightly more accurate at loose thresholds and cover a wider annotation fraction at the strictest thresholds with few more false positives. The number of correctly predicted TC family members at the medium-strong thresholds of 1e-16 and 1e-8 is always equal or higher than with BLAST. HMMER also missed fewer points (false negatives) compared to BLAST. This is clearly reflected by the higher recall value calculated most of the times. It should be re-emphasized that the E-values are computed by the three programs used here in different ways and are, thus, not directly comparable. Also, we have applied different normalization procedures - as suggested by the developers - to normalize the results to per-residue or per-sequence levels.

Table 3 HMMER results for homology between TC families from the three organisms

The decisions by HMMER appear similar to BLAST between the three organisms. Apparently, HMMER attained slightly higher precision for almost all thresholds compared to BLAST especially at loose thresholds. Additionally, in the Ec-Sc and the Sc-At analysis, HMMER made predictions for a larger fraction of the test set with a noticeably higher recall for thresholds till 1e-8 compared to BLAST. For threshold 1e-4, HMMER predicted a slightly smaller fraction of the test set compared to BLAST but HMMER reported much higher prediction accuracy. Hence, we suggest an acceptable HMMER threshold of 1e-4.

The enriched sequence motifs identified by MEME in sequences from one organism were subsequently searched in test sets of sequences from the other two organisms using the MAST program [28] from the MEME suite. Table 4 illustrates the results based on using motif searches for family classification of transporters. As can be expected, motif based searches performed better in families with many members such as 2.A.1. For loose thresholds, motif based classification showed lower precision compared to HMMER and BLAST but a comparable precision at the strictest thresholds of 1e-20 and 1e-16 as in Ec-Sc and Sc-At analysis. We suggest that motif based methods may be used beneficially in combination with other methods to support transporter classification. At looser thresholds than 1e-8, motif-based searches seem to lead to unreliable results and should be used with high caution.

Table 4 MAST results for the existence of predicted MEME motifs in TC families

Matching substrates families

In a second step, we used the same three methods to test whether annotations about the transported substrate can be transferred from one organism to the other. For this, we created four subsets of metal ions transporters, phosphate transporters, sugar transporters, and amino acid transporters. These are the four largest known substrate families and comprised 72 Ec transporters, 95 At transporters, and 79 Sc transporters, see Table 1.

As shown in Table 5, the results were markedly different from the TC family results. Despite the fact that BLAST reported acceptable prediction precision in the Ec-At and the Sc-At analysis, the program missed classification of many transporters. We noticed that sequences tend to match sequences from their TC families in other substrate families, rather than their analogues in the same substrate family. Thus, the precision for substrate classification is generally lower than for the TC classification, in particular for the Ec-Sc comparison. For instance, the metal transporter (YMR301C) from Sc was falsely matched to about one third of all Ec transporters in the four substrate families irrespective of their substrates since they belong to the same TC family (3.A.1).

Table 5 Homology search results within the four substrate families based on BLAST

Table 6 presents the HMMER prediction results for substrate families from the three organisms. Compared to BLAST, HMMER reported higher prediction accuracy in the Ec-Sc analysis but slightly lower prediction accuracy in Ec-At analysis at the strict thresholds such as in the TC comparisons. In fact, BLAST classified a slightly larger fraction of the test sets than HMMER in almost all runs. HMMER was also affected by transporters tending to match their TC family members in other substrate families rather than their homologues in the same substrate families.

Table 6 HMMER search results within the four chosen substrate families

Table 7 shows MAST search results for MEME motifs from different substrate families. MEME gave weak predictions in all runs but in the Sc-At analysis. However, recall in the medium strict thresholds 1e-16 and 1e-8 in the Ec-Sc analysis is generally acceptable but accompanied with many misclassifications. In the Ec-At analysis the prediction accuracy was generally low. Here, even the strict threshold of 1e-20 is unreliable because it gave wrong assignments of substrates in two out of three analyses.

Table 7 MAST results for the existence of predicted MEME motifs in substrate families

Surprisingly, 22 Sc sugar transporters were correctly classified from 3 motifs predicted by MEME in the At sugar substrate family. To the best of our knowledge, none of the three motifs have been annotated so far in databases such as [29]. Table 8 lists the regular expressions of these three motifs. The motifs were found around positions 420, 150, and 300 of the protein sequences, respectively.

Table 8 Enriched sequence motifs in At sugar transporters

Application of established thresholds to human datasets

Next, we tested these thresholds on four Hs datasets. In comparison to the three model organisms, these datasets are likely much less complete. We used the three tools to align the Hs transporters using a set of transporters from At and Sc and to align Ec transporters using Hs transporters. The results are in line with the comparisons of the three model organisms. When using BLAST and HMMER, only a small fraction was annotated at strict thresholds but more were classified at more permissive thresholds. Using HMMER, about 50% of the transporters remain not annotated even at the loosest threshold of 1e-4 whereas using BLAST many more were annotated but with a very low prediction accuracy. The reason is that the Hs phosphate and metal transporters were not annotated using the At and Sc sets and even did not help in annotating the Ec transporters. However, sugar and amino acid transporters were mostly correctly annotated. Most annotations of Hs transporters were based on matching (Hs, Sc) pairs. In motif searches, two thirds of the Hs transporters were annotated at the threshold of 1e-16 but none were annotated at the strictest threshold of 1e-20, see Table 9. The complete results of matching (Hs, At) and (Ec, Hs) are listed in Additional file 2: Table S4.

Table 9 Results of the three tools matching Hs and Sc sequences

Additionally, we studied the pairwise global similarity of all organism pairs using the program ggsearch from the FASTA program suite. The results were generally similar to BLAST and HMMER results with a slightly lower accuracy at the loose thresholds and even lower accuracy at the stricter thresholds. Results are listed in Additional file 3: Tables S5-S6.

Prediction of TC families in substrate families

Comparison of the two preceding sections shows that substrate families have less sequence similarity on average compared to TC families. Now, we tested the combination of both properties, see Figure 3. We performed this comparison in a systematic way. For this, we named the extracted families in the form “substrate family_TC family”. The four substrate families (amino acids, sugars, phosphates, metals) belong to 19 TC families in Ec, 13 in At and 14 in Sc. 7 families substrate-TC are shared between Ec and At, 7 also are shared between Ec and Sc and 11 are shared between Sc and At. Some TC families belong to many different substrate families like the family 3.A.1 that contains members of 4 Ec substrate families. We used BLAST to analyze the affiliation of test sequences toward their TC or substrate families. Here, only the best match of each substrate_TC family is considered. The heatmap in Figure 3 shows the tendency of Sc sequences to match their analogues from At TC or substrate families. Some Sc transporters matched strongly (black rectangles) their actual substrate_TC families from At like sugar_2.A.1, phosphate_2.A.1 and metal_2.A.55. However, most sequences from shared TC families had weaker matches to their TC families rather than their substrate families. Similar results were obtained in the Ec-At and Ec-Sc comparison, see Additional files 4: Figure S4 and Additional file 5: Figure S5. Thus, we suggest that it is beneficial to apply substrate information as a pre-filter for transporter TC family classification. On the other hand, transporters that transport the same substrate but belong to different TC families generally do not share noticeable sequence similarity. TC information can be the stand alone feature used to classify transporters but a little tuning by substrate information elevates the prediction accuracy. Misclassification will occur in the small substrate_TC families not in the big TC families.

Figure 3
figure 3

Heatmap of BLASTing Sc substrate_TC families against At families. BLAST homology search of 69 Sc transporters against 84 At transporters from 4 substrate families (amino acids, sugars, phosphates, metals) and 13 TC families (Sc) and 12 TC families (At). The grey scale follows a logarithmic scheme where white means no match better than normalized E < e-04 and black means the best matches better than E < e-20. Families generally match their substrate_TC families. However, they may also match TC families from different substrate_TC families.

Limitations and implications

In some way, our analysis presented here is a bit “circular” since we employ tools to identify sequence pairs belonging to the same TC categories while the TC classification itself was established in part based on phylogenetic analysis that is again based on sequence similarity. However, in a practical use case it is far simpler to run a BLAST or FASTA analysis than to establish a complicated phylogeny. Hence, our results reflect to what extent simple sequence similarity captures the structure of the more elaborate TC classification.

When comparing the results of the four methods (BLAST, FASTA, HMMER3, MEME), the reader should not forget that different strategies are employed by each of the methods to derive E-values for the reported results. Hence, the results of different methods are not directly comparable.

Note that datasets to be used for motif discovery are typically cleaned up for sequence redundancy e.g. using BLASTCLUST with a 25% sequence identity threshold [30]. Here, we did not do this because this would significantly decrease the number of families in the TC dataset that can be used for analysis. Hence, the MEME analysis partially rediscovered sequence similarities.

This work suggests that the current TC system adopted by IUBMB is a more robust classification feature compared to substrate classification. It is quite likely that phylogenetic inference is a more sensitive indicator of homology than simple sequence similarity or identity. Thus, it appears worthwhile to test the performance of phylogeny-based methods to relate the substrate specificities of membrane transporters.

When trying to completely block the transport of a certain substrate across a particular membrane of an organism it is hard to rely only on the TC information because one substrate can be transported by several transporters from different TC families. One possible explanation in fact is that transporters assigned to different sequence families might actually share a similar 3D structure and the structural similarity might provide an indication about the evolution of the transporter function. Such studies require more sensitive search methods like AlignMe [31].

Conclusions

We observed that classifying membrane transporters according to TC families gives more accurate results than classifying them according to substrate families. At the strictest threshold of 1e-20 for normalized E-values, predictions based on BLAST and HMMER result generally in high precision, but a huge fraction of the data remains unclassified. We suggest an acceptable threshold of 1e-8 for both programs where at least three quarters of the sequences are classified with a reasonably high accuracy. Researchers who wish to apply these thresholds in their studies should multiply these thresholds by the size of the database they search against. On the other hand, MEME showed unsatisfactory behavior for thresholds below 1e-8. Prediction of TC families split from substrate families showed satisfactory results implying that the application of substrate information as a pre-filter would improve the prediction results. The analysis and suggested thresholds in this study should be useful to those who wish to transfer transporter functional annotations across species without having to build a new phylogeny such as for the TC system. With respect to substrate annotation, the findings of this work may be combined with those of Schaadt et al. [6] who established amino acid composition for substrate annotation of transporters, and with the work of Saier MH Jr. [32].

Methods

Overview of the data

In the training part of this work, we used three sets of membrane transporter sequences from Ec (155), Sc (177), and At (158). In each case, we require that the transporter has been classified in the TC system and that TC/substrate annotations are based on experimental evidence. The sequences and annotations were retrieved from the databases TransportDB [2], SGD [3] and Aramemnon [4], respectively. From TransportDB we downloaded 354 sequences of Ec transporters. Among them, 157 have experimentally confirmed annotations about substrate and transporter class. Sc transporters were extracted from a list of 6752 ORFs downloaded from SGD. 900 transporters existed in verified ORFs among which 788 had a non-hypothetical function. Only 178 transporters had a clear TC family membership which was obtained by BLASTing SGD extracted transporters against the Sc TransportDB by requiring an E-value of 0.0 and a sequence identity of 100%. In Aramemnon, we used the keywords ‘transport’ and ‘carrier’ to download 616 transporter sequences from which 159 non-putatives with clear TC classification were extracted. Thereafter, we constructed subsets according to the TC system and according to substrates for later analysis. Obviously, matching a sequence correctly to a particular TC subfamily based on sequence similarity is only possible if this TC subfamily originally contains at least two members (if we take one out for testing, there is at least still one left). Thus, we considered only TC classes with more than one member. Additionally, we also downloaded functional descriptions from the Pfam database [33] for the transporters in the three organisms to assist the substrate information extracted from the individual databases. If substrate information from Pfam conflicted with the original substrate information, the Pfam information was discarded.

The transporters of the three organisms are annotated to 53 (Ec), 29 (At), and 34 (Sc) different TC families. Subclass 2.A (including uniporters, symporters, andantiporters) and subclass 3.A (P-P-bond-hydrolysis-driven transporters) were the most common TC subclasses. In Sc and At, the Major Facilitator Superfamily 2.A.1 accounts for nearly 40% of all transporters while in Ec it is the second largest family after the ATP-binding Cassette (ABC) Superfamily 3.A.1. Shared TC families belong mostly to TC classes Electrochemical Potential Driven Transporters (class 2) and the Primary Active Transporters (class 3).

For the testing part, we created four datasets of experimentally annotated human transporters (Hs). Sugar, amino acid, and metal transporter sets were extracted from the ChEMBL database [34]. Experimentally validated phosphate transporters were obtained from Uniprot [35]. We note that the set of metal transporters contains several proteins that transport several extra substrates besides the metal ion as well.

Prediction tools

The statistical significance of the sequence similarity between an input sequence and sequences in the input set was determined using the well-known tools BLAST [16] and HMMER [17]. The MEME program suite [18] version 4.6.0 was used to identify enriched sequence motifs in sets of transporter sequences from one organism belonging to the same TC family or that transport the same substrate. Later, the MAST program from the MEME suite provided a score when statistically significant motifs were identified in the sequences from the other organisms. Additionally, we used the tool ggsearch36 from the FASTA suite [36] to test whether sequences transporting the same substrate express not only local but also global sequence similarity.

First, we used NCBI BLAST version 2.2.23 and HMMER version 3.0 for pairwise comparisons of all 90 Ec transporters against the 84 At transporters that belong to 14 shared TC families. In the MEME analysis, we used only common At and Ec TC families with two or more members i.e. 71 Ec transporters and 77 At transporters belonging to 7 TC families. Next, we aligned the 98 Ec transporters belonging to 18 TC families against 131 Sc transporters. Ec and Sc shared 14 TC families that could be searched by MEME involving 87 transporters from Ec and 127 from Sc. Finally, we used BLAST and HMMER to compare 157 Sc transporters from 23 TC families against 141 At transporters. At and Sc shared 12 TC families involving 130 transporters from At and 120 from Sc. Repeatedly, we used sequences from different organisms but belonging to the same TC families as inputs and test sets for the classifiers to test the quality of the prediction. For identifying enriched sequence motifs with MEME, the sequences must be grouped into families that are likely to share motifs. Here, we used MEME to determine up to 3 motifs in each shared TC family between each pair of organisms; 7 such TC families for (At- Ec), 14 for (Sc- Ec), and 12 for (At- Sc). BLAST E-values were normalized by the number of residues in the searched database (see Results section). HMMER E-values were normalized by the number of hits.

In order to identify reliability thresholds at which functional information can be safely transferred between organisms, we tested thresholds (1e-20, 1e-16, 1e-12, 1e-8 and 1e-4) for the E-values and evaluated prediction accordingly. We calculated the accuracy measures precision (positive predictive value), recall (sensitivity) and F-measure (equations 1, 2, 3) at each threshold to evaluate the prediction performance (Tables 2, 3, 4, 5, 6 and 7). Precision emphasizes the role of unexpected results whereas recall emphasizes the role of missing classification points. F-measure is a suitable accuracy measure considering precision and recall as we want precision and recall to be evenly weighted. High precision points at a strong prediction boundary while members of other classes rarely match the current class. High recall points at strong similarity within the class members as they rarely match members of other classes. For an actual TC or substrate class, a false negative is a membrane transporter from the class that is predicted to belong to another class, while a false positive is membrane transporter from another class that is predicted to belong to the current class. An example confusion matrix is illustrated in Table 10.

Table 10 An example confusion matrix predicting TC class 3.A.1 members
Precision = tp tp + fp
(1)
Re call = tp tp + fn
(2)
F - measure = 2 × precision × recall precision + recall
(3)

Abbreviations

Ec:

Escherichia coli

Sc:

Saccharomyces cerevisiae

At:

Arabidopsis thaliana.

References

  1. Saier MH, Yen MR, Noto K, Tamang DG, Elkan C: The Transporter Classification Database: recent advances. Nucleic Acids Res. 2009, 37: D274-D278. 10.1093/nar/gkn862.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  2. Ren Q, Chen K, Paulsen IT: TransportDB: a comprehensive database resource for cytoplasmic membrane transport systems and outer membrane channels. Nucleic Acids Res. 2007, 35: D274-D279. 10.1093/nar/gkl925.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  3. Cherry JM, Hong EL, Amundsen C, Balakrishnan R, Binkley G, Chan ET, Christie KR, Costanzo MC, Dwight SS, Engel SR, Fisk DG, Hirschman JE, Hitz BC, Karra K, Krieger CJ, Miyasato SR, Nash RS, Park J, Skrzypek MS, Simison M, Weng S, Wong ED: Saccharomyces Genome Database: the genomics resource of budding yeast. Nucleic Acids Res. 2012, 40: D700-D705. 10.1093/nar/gkr1029.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  4. Schwacke R, Schneider A, Van Der Graaff E, Fischer K, Catoni E, Desimone M, Frommer WB, Flugge UI, Kunze R: ARAMEMNON, a Novel Database for Arabidopsis Integral Membrane Proteins. Plant Physiol. 2003, 131: 16-26. 10.1104/pp.011577.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  5. Busch W, Saier MH: The Transporter Classification (TC) System. Crit Rev Biochem Mol Biol. 2002, 37: 287-337. 10.1080/10409230290771528.

    Article  CAS  PubMed  Google Scholar 

  6. Schaadt NS, Christoph J, Helms V: Classifying Substrate Specificities of Membrane Transporters from Arabidopsis thaliana. J Chem Inf Model. 2010, 50: 1899-1905. 10.1021/ci100243m.

    Article  CAS  PubMed  Google Scholar 

  7. Schaadt NS, Helms V: Functional classification of membrane transporters and channels based on filtered TM/non-TM amino acid composition. Biopolymers. 2012, 97: 558-567. 10.1002/bip.22043.

    Article  CAS  PubMed  Google Scholar 

  8. Li H, Dai X, Zhao X: A nearest neighbor approach for automated transporter prediction and categorization from protein sequences. Bioinformatics. 2008, 24: 1129-1136. 10.1093/bioinformatics/btn099.

    Article  CAS  PubMed  Google Scholar 

  9. Haiquan L, Benedito VA, Udvardi MK, Zhao PX: TransportTP: A two-phase classification approach for membrane transporter prediction and characterization. BMC Bioinformatics. 2009, 10: 418-10.1186/1471-2105-10-418.

    Article  Google Scholar 

  10. Yabuki Y, Gromiha MM: Functional discrimination of membrane proteins using machine learning techniques. BMC Bioinformatics. 2008, 9: 135-10.1186/1471-2105-9-135.

    Article  PubMed Central  PubMed  Google Scholar 

  11. Punta M, Coggill PC, Eberhardt RY, Mistry J, Tate J, Boursnell C, Pang N, Forslund K, Ceric G, Clements J, Heger A, Holm L, Sonnhammer EL, Eddy SR, Bateman A, Finn RD: The Pfam protein families database. Nucleic Acids Res. 2012, 40: D290-D301. 10.1093/nar/gkr1065.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  12. Chang AB, Lin R, Keith Studley W, Tran CV, Saier MH: Phylogeny as a guide to structure and function of membrane transport proteins. Mol Membr Biol. 2004, 21: 171-181. 10.1080/09687680410001720830.

    Article  CAS  PubMed  Google Scholar 

  13. Chen F, Mackey AJ, Vermunt JK, Roos DS: Assessing Performance of Orthology Detection Strategies Applied to Eukaryotic Genomes. PLoS ONE. 2007, 2: e383-10.1371/journal.pone.0000383.

    Article  PubMed Central  PubMed  Google Scholar 

  14. Remm M, Storm CEV, Sonnhammer EL: Automatic Clustering of Orthologs and In-paralogs from Pairwise Species Comparisons. J Mol Biol. 2001, 314: 1041-1052. 10.1006/jmbi.2000.5197.

    Article  CAS  PubMed  Google Scholar 

  15. The Arabidopsis Genome Initiative: Analysis of the genome sequence of the fowering plant Arabidopsis thaliana. Nature. 2000, 408: 796-815. 10.1038/35048692.

    Article  Google Scholar 

  16. Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic local alignment search tool. J Mol Biol. 1990, 215: 403-410.

    Article  CAS  PubMed  Google Scholar 

  17. Sean RE: A new generation of homology search tools based on probabilistic inference. Genome Inform. 2009, 23: 205-211.

    Google Scholar 

  18. Elkan C, Bailey TL: Fitting a mixture model by expectation maximization to discover motifs in biopolymers. Proc Int Conf Intell Syst Mol Bio. 1994, 2: 28-36.

    Google Scholar 

  19. Frith MC, Hamada M, Horton P: Parameters for accurate genome alignment. BMC Bioinformatics. 2010, 11: 80-10.1186/1471-2105-11-80.

    Article  PubMed Central  PubMed  Google Scholar 

  20. Ashkenazi S, Snir R, Ofran Y: Assessing the Relationship between Conservation of Function and Conservation of Sequence Using Photosynthetic Proteins. Bioinformatics. 2012, 28: 3203-3210. 10.1093/bioinformatics/bts608.

    Article  CAS  PubMed  Google Scholar 

  21. Tian W, Skolnick J: How well is enzyme function conserved as a function of pairwise sequence identity?. J Mol Biol. 2003, 333: 863-882. 10.1016/j.jmb.2003.08.057.

    Article  CAS  PubMed  Google Scholar 

  22. Eide DJ: The molecular biology of metal ion transport in Saccharomyces Cerevisiae. Annu Rev Nutr. 1998, 18: 441-469. 10.1146/annurev.nutr.18.1.441.

    Article  CAS  PubMed  Google Scholar 

  23. Peterson CW, Narula SS, Armitage IM: 3D solution structure of copper and silver-substituted yeast metallothioneins. FEBS Lett. 1996, 379: 85-93. 10.1016/0014-5793(95)01492-6.

    Article  CAS  PubMed  Google Scholar 

  24. Williamson LC, Ribrioux SPCP, Fitter AH, Leyser HMO: Phosphate availability regulates root system architecture in Arabidopsis. Plant Physiol. 2001, 26: 875-882.

    Article  Google Scholar 

  25. Schachtman DP, Reid RJ, Ayling SM: Phosphorus Uptake by Plants: From Soil to Cell. Plant Physiol. 1998, 116: 447-453. 10.1104/pp.116.2.447.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  26. Shin H, Shin H-S, Dewbre GR, Harrison MJ: Phosphate transport in Arabidopsis: Pht1;1 and Pht1;4 play a major role in phosphate acquisition from both low- and high-phosphate environments. Plant Journal. 2004, 39: 629-642. 10.1111/j.1365-313X.2004.02161.x.

    Article  CAS  PubMed  Google Scholar 

  27. Williams LE, Lemoine R, Sauer N: Sugar transporters in higher plants-a diversity of roles and complex regulation. Trends Plant Sci. 2000, 5: 283-290. 10.1016/S1360-1385(00)01681-2.

    Article  CAS  PubMed  Google Scholar 

  28. Gribskov M, Bailey TL: Combining evidence using p-values: application to sequence homology searches. Bioinformatics. 1998, 14: 48-54. 10.1093/bioinformatics/14.1.48.

    Article  PubMed  Google Scholar 

  29. Marsico A, Scheubert K, Tuukkanen A, Henschel A, Winter C, Winnenburg R, Schroeder M: MeMotif: a database of linear motifs in α-helical transmembrane proteins. Nucleic Acids Res. 2009, 38: D181-D189.

    Article  PubMed Central  PubMed  Google Scholar 

  30. Frith MC, Saunders NFW, Kobe B, Bailey TL: Discovering Sequence Motifs with Arbitrary Insertions and Deletions. PLoS Comput Biol. 2008, 4: e1000071-10.1371/journal.pcbi.1000071.

    Article  PubMed Central  PubMed  Google Scholar 

  31. Khafizov K, Staritzbichler R, Mar S, Forrest LR: A Study of the Evolution of Inverted-Topology Repeats from LeuT-Fold Transporters Using AlignMe. Biochemistry. 2010, 49: 10702-10713. 10.1021/bi101256x.

    Article  CAS  PubMed  Google Scholar 

  32. Paulsen IT, Sliwinski MK, Saier MH: Microbial genome analyses: global comparisons of transport capabilities based on phylogenies, bioenergetics and substrate specificities. J Mol Biol. 1998, 277: 573-592. 10.1006/jmbi.1998.1609.

    Article  CAS  PubMed  Google Scholar 

  33. Finn RD, Mistry J, Tate J, Coggill P, Heger A, Pollington JE, Gavin OL, Gunesekaran P, Ceric G, Forslund K, Holm L, Sonnhammer EL, Eddy SR, Bateman A: The Pfam protein families database. Nucleic Acids Res. 2010, 36: D281-D288.

    Article  Google Scholar 

  34. Gaulton A, Bellis LJ, Bento AP, Chambers J, Davies M, Hersey A, Light Y, McGlinchey S, Michalovich D, Al-Lazikani B, Overington JP: ChEMBL: a large-scale bioactivity database for drug discovery. Nucleic Acids Res. 2011, 40: D1100-D1107.

    Article  PubMed Central  PubMed  Google Scholar 

  35. Consortium: The UniProt. Update on activities at the Universal Protein Resource (UniProt) in 2013. Nucleic Acids Res. 2013, 41: D43-D47.

    Article  Google Scholar 

  36. Pearson WR, Lipma DJ: Improved tools for biological sequence comparison. Proc Natl Acad Sci. 1988, 85: 2444-2448. 10.1073/pnas.85.8.2444.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We thank Nadine Schaadt and Ruzianisra Mohamed for their helpful comments and careful reading of our manuscript. AB was supported by a predoctoral scholarship from the German-Jordanian University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Volkhard Helms.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AB and VH conceived this study. AB wrote scripts, compiled data-sets, and performed the data analysis. AB and VH analyzed the data and jointly wrote the manuscript. Both authors read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Barghash, A., Helms, V. Transferring functional annotations of membrane transporters on the basis of sequence similarity and sequence motifs. BMC Bioinformatics 14, 343 (2013). https://doi.org/10.1186/1471-2105-14-343

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2105-14-343

Keywords