- Open Access
A machine learning model for classifying G-protein-coupled receptors as agonists or antagonists
BMC Bioinformatics volume 23, Article number: 346 (2022)
G-protein coupled receptors (GPCRs) sense and transmit extracellular signals into the intracellular machinery by regulating G proteins. GPCR malfunctions are associated with a variety of signaling-related diseases, including cancer and diabetes; at least a third of the marketed drugs target GPCRs. Thus, characterization of their signaling and regulatory mechanisms is crucial for the development of effective drugs.
In this study, we developed a machine learning model to identify GPCR agonists and antagonists. We designed two-step prediction models: the first model identified the ligands binding to GPCRs and the second model classified the ligands as agonists or antagonists. Using 990 selected subset features from 5270 molecular descriptors calculated from 4590 ligands deposited in two drug databases, our model classified non-ligands, agonists, and antagonists of GPCRs, and achieved an area under the ROC curve (AUC) of 0.795, sensitivity of 0.716, specificity of 0.744, and accuracy of 0.733. In addition, we verified that 70% (44 out of 63) of FDA-approved GPCR-targeting drugs were correctly classified into their respective groups.
Studies of ligand–GPCR interaction recognition are important for the characterization of drug action mechanisms. Our GPCR–ligand interaction prediction model can be employed in the pharmaceutical sciences for the efficient virtual screening of putative GPCR-binding agonists and antagonists.
G-protein coupled receptors (GPCRs) belong to membrane protein families that sense and transmit extracellular signals to the intracellular region by regulating G proteins. GPCRs are involved in diverse signaling pathways triggered by hormones and neurotransmitters, and participate in cell growth, differentiation, vision, olfaction, and gustatory system . When a ligand binds to a GPCR, the receptor undergoes a conformational change that can either activate (called an agonist) or inhibit (called an antagonist) signal transduction pathways . Approximately one-third of the drugs on the market target GPCRs [2, 3] and are used to treat various human diseases including cardiac malfunction, asthma, and migraines . In 2017, Hauser et al. reported that approximately 34% (475 drugs) of all US FDA (Food and Drug Administration)-approved drugs act on GPCR targets, and that most agents in clinical trials target novel GPCRs .
Owing to recent technological advances in receptor pharmacology, new avenues for GPCR drug discovery have emerged that diverge from the traditional view of signal transduction as a linear chain of events involving the heterotrimeric G proteins. However, GPCR drug discovery has long been focused on the identification of new compounds targeting GPCRs and their ligand binding sites. The classification of the agonist and antagonist properties of existing and newly discovered ligands is needed to optimize drug efficacy and develop appropriate therapeutic strategies that selectively activate or block relevant pathways.
Using a support vector machine (SVM) learning algorithm with 4884 chemical descriptors as input, Bushdid et al.  virtually screened 258 chemical compounds and determined agonists for the human G-protein-coupled odorant receptor (OR) 51E1 as well as human receptors OR1A1 and OR2W1, and mouse receptor MOR256-3. The predicted novel agonists were identified with a hit rate of 39–50%. Two newly identified agonists for OR51E1 were functionally validated through in vitro assays. In addition, to predict ligands and their roles in the human olfactory receptor OR1G1, Jabeen and Ranganathan  built classification models (SVM, random forest, naïve bayes, and neural networks) based on 13 relevant features for a dataset of 74 agonists and 74 antagonists. The area under the ROC curve (AUC) was 0.652–0.827. Using over 200,000 compounds, the best performing classifier, naïve bayes model, predicted 37 compounds as agonists for OR1G1 with > 80% probability score.
In this study, we developed a ligand-based machine learning model to identify novel human GPCR agonists and antagonists, irrespective of GPCR types. Using the existing knowledge-base to predict ligand activity according to similarities/dissimilarities of known active ligands, we designed two-step machine learning models that first identify the ligands binding to GPCRs and then classify the ligands as agonists or antagonists. GPCR ligand information from the International Union of Basic and Clinical Pharmacology (IUPHAR)/British Pharmacological Society (BPS) Guide to PHARMACOLOGY database (GtoPdb)  and Context-Oriented Directed Associations (CODA)  database were used to train two random forest (RF) models that will act independently but successively to classify query components into non-ligands, agonists, and antagonists of GPCRs. The optimal performance parameters for the integrated two-step models were AUC = 0.795, accuracy = 0.733, sensitivity = 0.716, and specificity = 0.744. Hence, our model allowed us to understand the molecular mechanisms of GPCR–ligand interactions. This model can be employed in the pharmaceutical sciences to screen novel drugs and therapeutic agents.
Results and discussion
Data collection and preprocessing
Out of 14,659 initially available human ligand-target interactions, 4590 ligand-target pairs were analyzed. We obtained 1058 and 1150 ligands that act as agonists (hereafter called GPCR-agonist) and antagonists (hereafter called GPCR-antagonist), respectively; the remaining 2382 ligands were classified as non-ligands of GPCRs (hereafter called GPCR-nontarget).
To eliminate potentially redundant ligands, ligands were clustered with their ECFP4 (extended connectivity fingerprints of bond diameter 4) fingerprints encoding the ligand’s structural characteristics as a vector  using an agglomerative hierarchical clustering method. This algorithm iteratively merges subclusters based on their similarity (above 0.8 in this study ) considering interconnectivity and closeness of the clusters . Only representative ligands in each cluster were used for training and test dataset. Consequently, 758 GPCR-agonists, 950 GPCR-antagonists, and 2206 GPCR-nontargets were selected for further analysis.
Molecular descriptor calculation and feature selection
We calculated 5270 molecular descriptors using Dragon software, and they were used for feature selection. Using Boruta algorithm that performs the comparison of the real predictor features with those of random (so-called shadow) variables, 990 selected predictor features (Additional file 1) with significantly larger importance values were taken as inputs for machine learning classifiers (Fig. 1A).
Machine learning model construction and evaluation
We designed two-step binary-class classifiers, given their superior accuracy estimates compared to multi-class classifiers . The first model (T-model) predicted GPCR-target or GPCR-nontarget; the second model (A-model) predicted GPCR-agonist or GPCR-antagonist (Fig. 1B). Specifically, when a query molecule is input, the T-model predicts whether or not the molecule is a GPCR ligand. If not, it is classified as a GPCR-nontarget molecule. If classified as a GPCR-target, the A-model predicts whether it acts as a GPCR agonist or antagonist.
For the T-model, 1708 GPCR-target (from 758 GPCR-agonists and 950 GPCR-antagonists) and 2206 GPCR-nontarget were used in the training dataset. Because no statistical model functions at 100% accuracy, some of the GPCR-nontarget classified molecules could potentially interact with GPCRs; thus, we used all of the available data to minimize the data imbalance [14, 15]. For the A-model, we used 758 GPCR-agonists and 950 GPCR-antagonists in the training data set.
The T-model and A-model were built separately using the RF classifier and were evaluated using the leave-one-out cross-validation (LOO-CV) method. The T-model and A-model achieved an AUC of 0.787 and 0.823, respectively. The final integrated two-step model produced an AUC of 0.795 (accuracy = 0.733, sensitivity = 0.716, and specificity = 0.744) (Table 1).
Model validation with FDA-approved GPCR drugs
To validate our model under different experimental conditions, we used FDA-approved GPCR-targeting drugs. Data for 134 drugs were collected, of which data for 63 drugs with ligand-binding types and SMILES (simplified molecular input line entry system) descriptors were used for the model validation procedures.
Our T-model predicted that 52 of 63 (82.5%) drugs could interact with GPCRs. According to the A-model, 44 of the 52 GPCR-target drugs (84.6%) were correctly categorized as agonists or antagonists. Consequently, 44 out of 63 (69.8%) FDA-approved GPCR-targeting drugs were correctly classified into their respective groups (GPCR-agonist, GPCR-antagonist, GPCR-nontarget) (Table 2). In addition to the positive data, our T-model was also tested on negative dataset. To this end, we collected 1278 GPCR-nontarget drugs (out of 14,594 drugs) from DrugBank database. After excluding ligands for which descriptors were not calculated by Dragon software, we retained 982 drugs as GPCR-nontarget drugs. 808 of 982 GPCR-nontarget drugs (82.3%) were correctly predicted by our T-model (Additional file 2). Though our study considered a relatively small sample size, our results clearly showed that the integrated two-step RF models had a high and balanced prediction accuracy. Future studies should consider the practical compatibility of virtual screening with larger sample size datasets and more complex models associated with signaling pathways.
Because the GPCRs are involved in diverse cellular signaling transductions and therefore play essential and important roles in pharmaceutical research, they have long been considered as prime targets for drug discovery. However, unlike other cellular proteins, experimental screening of GPCR structure–function and ligand-identification is expensive and time-consuming. Machine learning-based approaches have recently gained popularity in GPCR-based virtual drug discovery. In this study, we developed in-silico models to predict GPCR-agonists and GPCR-antagonists with reasonably high accuracy. The key contribution of this work is two folds: first one is presenting a GPCR-type independent classification model that could classify both GPCR agonists and antagonists together, regardless of the GPCR types, and second is using over 14,000 of publicly available ligand-target interaction data that could make the model more accurate and could be used in future similar studies. Although our prediction models require further testing, they could be applied in drug discovery technologies to predict putative GPCR-binding ligands from millions of unlabeled chemical compounds.
We acquired pharmacological datasets relating to ligand-activity-target relationships from the GtoPdb (https://www.guidetopharmacology.org) , including data for over 1700 drug targets with over 9000 related ligands, and the CODA network database , including drug–drug target associations with related molecular, phenomic, and anatomical variables. Out of 14,659 human ligand-target interactions, 4590 ligand-target pairs were analyzed in this study and included both a ligand-binding type (e.g., agonist and antagonist) and a SMILES descriptor.
Dragon software (version 7.0.10)  was used to calculate the chemical and physical properties (molecular descriptors) of chemicals from their SMILES as an input. These chemoinformatic properties include 1D descriptors, such as the number of atom types and structural fragments of the molecule, and 2D descriptors, such as structural features, logP, and connectivity indices [18, 20].
We applied the Boruta packages (version 7.0.0)  with default parameters to obtain the best subset of descriptors. To screen the key features in each class, the FSelector package  in R software was used.
Machine learning model and performance evaluation
We applied a RF machine learning model, using the randomForest function in the R randomForest package . For the main two parameters, the number of random explanatory variables for splitting each tree node, mtry, and the number of trees, ntree, were set at number of features and 100, respectively.
To validate the constructed RF model, we used the LOO-CV for method selection . To obtain the performance measurement values (true positive, TP; true negative, TN; false positive, FP; false negative, FN) of the integrated two-step models, a micro-average calculation  was used.
Area under the ROC curve
British pharmacological society
Context-oriented directed associations
Extended connectivity fingerprints of bond diameter 4
Food and drug administration
G-protein coupled receptors
Guide to PHARMACOLOGY database
The International Union of basic and clinical pharmacology
Simplified molecular input line entry system
Rosenbaum DM, Rasmussen SG, Kobilka BK. The structure and function of G-protein-coupled receptors. Nature. 2009;459(7245):356–63.
Wang D. The essential role of G protein-coupled receptor (GPCR) signaling in regulating T cell immunity. Immunopharmacol Immunotoxicol. 2018;40(3):187–92.
Stevens RC, Cherezov V, Katritch V, Abagyan R, Kuhn P, Rosen H, Wuthrich K. The GPCR network: a large-scale collaboration to determine human GPCR structure and function. Nat Rev Drug Discov. 2013;12(1):25–34.
Venkatakrishnan AJ, Deupi X, Lebon G, Tate CG, Schertler GF, Babu MM. Molecular signatures of G-protein-coupled receptors. Nature. 2013;494(7436):185–94.
Hauser AS, Attwood MM, Rask-Andersen M, Schiöth HB, Gloriam DE. Trends in GPCR drug discovery: new agents, targets and indications. Nat Rev Drug Discov. 2017;16(12):829–42.
Bushdid C, de March CA, Fiorucci S, Matsunami H, Golebiowski J. Agonists of G-protein-coupled odorant receptors are predicted from chemical features. J Phys Chem Lett. 2018;9(9):2235–40.
Jabeen A, Ranganathan S. Applications of machine learning in GPCR bioactive ligand discovery. Curr Opin Struct Biol. 2019;55:66–76.
Harding SD, Sharman JL, Faccenda E, Southan C, Pawson AJ, Ireland S, Gray AJG, Bruce L, Alexander SPH, Anderton S, et al. The IUPHAR/BPS guide to PHARMACOLOGY in 2018: updates and expansion to encompass the new guide to IMMUNOPHARMACOLOGY. Nucleic Acids Res. 2018;46(D1):D1091–106.
Yu H, Jung J, Yoon S, Kwon M, Bae S, Yim S, Lee J, Kim S, Kang Y, Lee D. CODA: Integrating multi-level context-oriented directed associations for analysis of drug effects. Sci Rep. 2017;7(1):7519.
Bajusz D, Rácz A, Héberger K. 3.14 - chemical data formats, fingerprints, and other molecular descriptions for database analysis and searching. In: Chackalamannil S, Rotella D, Ward SE, editors. Comprehensive medicinal chemistry III. Oxford: Elsevier; 2017. p. 329–78.
Kogej T, Blomberg N, Greasley PJ, Mundt S, Vainio MJ, Schamberger J, Schmidt G, Hüser J. Big pharma screening collections: more of the same or unique libraries? the AstraZeneca–bayer pharma AG case. Drug Discov Today. 2013;18(19):1014–24.
Han J, Kamber M, Pei J. 10 - cluster analysis: basic concepts and methods. In: Han J, Kamber M, Pei J, editors. Data mining (Third Edition). Boston: Morgan Kaufmann; 2012. p. 443–95.
Piir G, Sild S, Maran U. Binary and multi-class classification for androgen receptor agonists, antagonists and binders. Chemosphere. 2021;262: 128313.
Li L, Koh CC, Reker D, Brown JB, Wang H, Lee NK, Liow H-H, Dai H, Fan H-M, Chen L, et al. Predicting protein-ligand interactions based on bow-pharmacological space and Bayesian additive regression trees. Sci Rep. 2019. https://doi.org/10.1038/s41598-019-43125-6.
Lin W-J, Chen JJ. Class-imbalanced classifiers for high-dimensional data. Brief Bioinform. 2013;14(1):13–26.
Sriram K, Insel PA. G protein-coupled receptors as targets for approved drugs: how many targets and how many drugs? Mol Pharmacol. 2018;93(4):251.
Wishart DS, Feunang YD, Guo AC, Lo EJ, Marcu A, Grant JR, Sajed T, Johnson D, Li C, Sayeeda Z, et al. DrugBank 5.0: a major update to the DrugBank database for 2018. Nucleic Acids Res. 2018;46(D1):D1074–82.
Mauri A, Consonni V, Pavan M, Todeschini R. DRAGON software: an easy approach to molecular descriptor calculations. MATCH Commun Math Comput Chem. 2006;56:237–48.
Bajusz D, Rácz A, Héberger K. Why is Tanimoto index an appropriate choice for fingerprint-based similarity calculations? J Cheminf. 2015;7(1):20.
Hong H, Xie Q, Ge W, Qian F, Fang H, Shi L, Su Z, Perkins R, Tong W. Mold2, molecular descriptors from 2D structures for chemoinformatics and toxicoinformatics. J Chem Inf Model. 2008;48(7):1337–44.
Kursa M, Rudnicki W. Feature selection with boruta package. J Stat Softw. 2010;36:1–13.
Piotr Romanski LK, Patrick Schratz. FSelector: selecting attributes. R package version 033 2021:https://CRAN.R-project.org/package=FSelector.
Liaw A, Wiener M. Classification and regression by randomForest. R News. 2002;2(3):18–22.
Fushiki T. Estimation of prediction error by using K-fold cross-validation. Stat Comput. 2011;21(2):137–46.
Tsoumakas G, Katakis I, Vlahavas I. Mining multi-label data. In: Maimon O, Rokach L, editors. Data mining and knowledge discovery handbook. Boston: Springer; 2010. p. 667–85.
The authors are grateful for the constructive comments and suggestions made by the reviewers.
About this supplement
This article has been published as part of BMC Bioinformatics Volume 23 Supplement 9, 2022: Proceedings of the 15th International Conference on Data and Text Mining in Biomedical Informatics (DTMBIO 2021). The full contents of the supplement are available online at https://bmcbioinformatics.biomedcentral.com/articles/supplements/volume23-supplement-9.
This work was supported by research grants from the Bio-Synergy Research Project (NRF-2015M3A9C4075820 to C.P.) of the Ministry of Science, ICT and Future Planning through the National Research Foundation; Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2022R1A2C1010731 to C.P. and NRF-2021R1A6A3A13046324 to J.O.); and “Research center for fishery resource management based on the information and communication technology” (2021, grant number 20180384), funded by the Ministry of Oceans and Fisheries, Korea. The funding sources had no role in the study design; collection, analysis, or interpretation of the data; or in the writing of the manuscript. Publication costs were funded by the “Research center for fishery resource management based on the information and communication technology” (2021, grant number 20180384) of the Ministry of Oceans and Fisheries.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Oh, J., Ceong, Ht., Na, D. et al. A machine learning model for classifying G-protein-coupled receptors as agonists or antagonists. BMC Bioinformatics 23 (Suppl 9), 346 (2022). https://doi.org/10.1186/s12859-022-04877-7
- G-protein-coupled receptors
- GPCR–ligand interactions
- GPCR agonists and antagonists
- Machine learning
- Two-step random forest classification