Scoring functions and enrichment: a case study on Hsp90
BMC Bioinformatics volume 8, Article number: 27 (2007)
The need for fast and accurate scoring functions has been driven by the increased use of in silico virtual screening twinned with high-throughput screening as a method to rapidly identify potential candidates in the early stages of drug development. We examine the ability of some the most common scoring functions (GOLD, ChemScore, DOCK, PMF, BLEEP and Consensus) to discriminate correctly and efficiently between active and non-active compounds among a library of ~3,600 diverse decoy compounds in a virtual screening experiment against heat shock protein 90 (Hsp90).
Firstly, we investigated two ranking methodologies, GOLDrank and BestScorerank. GOLD rank is based on ranks generated using GOLD. The various scoring functions, GOLD, ChemScore, DOCK, PMF, BLEEP and Consensus, are applied to the pose ranked number one by GOLD for that ligand. BestScore rank uses multiple poses for each ligand and independently chooses the best ranked pose of the ligand according to each different scoring function. Secondly, we considered the effect of introducing the Thr184 hydrogen bond tether to guide the docking process towards a particular solution, and its effect on enrichment. Thirdly, we considered normalisation to account for the known bias of scoring functions to select larger molecules. All the scoring functions gave fairly similar enrichments, with the exception of PMF which was consistently the poorest performer. In most cases, GOLD was marginally the best performing individual function; the Consensus score usually performed similarly to the best single scoring function. Our best results were obtained using the Thr184 tether in combination with the BestScorerank protocol and normalisation for molecular weight. For that particular combination, DOCK was the best individual function; DOCK recovered 90% of the actives in the top 10% of the ranked list; Consensus similarly recovered 89% of the actives in its top 10%.
Overall, we demonstrate the validity of virtual screening as a method for identifying new leads from a pool of ligands with similar physicochemical properties and we believe that the outcome of this study provides useful insight into the setting up of a suitable docking and scoring protocol, resulting in enrichment of 'target active' compounds.
Recent years have seen the development of in silico 'virtual screening' of very large libraries of molecules as an integral part of the drug development process. An initial library might contain millions of compounds that are potentially available, either in-house or from vendors' catalogues. Virtual screening has the twin goals of finding molecules with both favourable ADMET properties and suitable bioactivity. The first goal involves searching for molecules with favourable values of relevant properties such as solubility, polarity, logP, possible toxicity, absorption and likely routes of metabolic breakdown, hence guiding the medicinal chemist towards molecules of good bioavailability and low toxicity. While this is a very important aspect of virtual screening, hereafter we shall concentrate on the second goal of finding molecules with suitable bioactivity.
In the favourable case where the three dimensional structure of the target, usually a protein, is known, it is possible to computationally dock thousands of molecules into the active site, looking for those that will have suitable spatial and chemical complementarity and hence bind strongly . The simplest case is rigid body docking, where we take given fixed conformations of the protein and ligand and find where in the protein the ligand will bind, and how it will be oriented, in order to obtain the (spatially and chemically) best fit. Even with the assumption of rigid bodies, the search space is six dimensional.
However, in reality the problem is harder than this. Both protein and ligand are liable to undergo conformational change upon docking. This means that the method must allow conformational variation, ideally in both molecules. The search space acquires a high dimensionality and the flexible docking problem is difficult. In the present work, we carry out semi-flexible docking.
One of the most successful strategies for docking is to use a genetic algorithm, as in the program GOLD . Such an algorithm mirrors Darwinian evolution, representing the solution as a 'chromosome'. Genetic algorithms allow a population of solutions to exist, and in each 'generation' these can evolve by processes such 'breeding' and 'mutation'. Poor solutions are killed off, while good ones leave their offspring in future generations. Such algorithms may typically reach an excellent solution in a few tens of generations.
Scoring functions, either identical to or different from those utilised as measures of fitness within docking programs, are used to assign predicted binding affinities and rank ligands relative to one another, with a view to selecting and testing experimentally a small subset for biological activity. The development of suitable scoring functions for ranking the solutions produced by docking methods, and especially for accurate prediction of protein-ligand binding affinities, remains a considerable challenge. The scoring function must accurately measure both intramolecular conformational strain energy and intermolecular interaction energy. Several contrasting kinds of scoring function have had some success, including some based on molecular mechanics force fields (Coulomb + van der Waals + hydrogen bonding + bond stretching & bending + torsions)  and others centred on modelling each of the relevant terms of a 'Master Equation' describing the free energy of interaction. An alternative is provided by knowledge-based scoring functions, such as BLEEP  and PMF , where the objective is to use the co-ordinates of hundreds of three dimensional protein-ligand complex structures as a knowledge base. Using this knowledge, a putative protein-ligand interaction geometry can be assessed on the basis of how similar its features are to those of the ensemble of known structures. The features used are the distributions of atom-atom distances between protein and ligand in the complex. Commonly observed features, such as donor/acceptor type nitrogen/oxygen distances at typical hydrogen bonding distances around 3Å, score favourably. Less frequently observed interactions, such as close polar/non-polar contacts, score unfavourably. When the contributions are summed over all pairs of atoms in the complex, the resulting score indicates how much the putative structure 'looks like' a real protein-ligand complex.
When the binding affinity of a series of homologous inhibitors into a particular site is known, it is possible to generate 'customised' scoring functions to fit the data . Ideally, the combination of the search algorithm and the scoring function should result in a single solution close to the experimental ligand position . General-purpose scoring functions, in contrast, are designed to be applicable to a wide variety of protein-ligand complexes, and are therefore parameterised using a diverse set of protein ligand complexes. This work concentrates on five general-purpose scoring functions.
The application of virtual screening techniques in parallel with High-Throughput Screening (HTS) technology, coupled with structural biology , can extend the scope of screening to external databases. This allows more diverse chemical entities to be identified as hits, and as a consequence can help to reduce the assay-to-lead attrition rate observed from HTS .
There are many questions, however, associated with the tools employed for docking-based virtual screening. A number of approximations are often employed for the docking/scoring searches (e.g., neglect of protein flexibility in rigid docking, lack of a rigorous treatment of solvation, and the choice of one particular protonation state) in order for the virtual screen to be completed within an acceptable time limit, as well as other unavoidable approximations such as the limitations of X-ray crystal structures. Despite the above, virtual screening can be improved by taking into consideration additional information about the receptor of interest and using this information advantageously in docking/scoring applications [10–13]. Recent advances in virtual screening include various physics-based methods [14–16] and consensus scoring [17, 18].
In our study, we concentrate on heat shock protein 90 (Hsp90), which is a chaperone and a target for anti-cancer therapeutics . Prior to screening, the binding site was prepared by using the SYBYL® 7.0 software of Tripos . The docking program GOLD 2.2  was used to perform docking with and without the presence of a tether. The ligands docked were taken from 'active' and 'inactive' datasets ; we also used a set of 'decoys' retrieved from the CIPSLINE cancer database . Post-dock scoring was calculated using multiple scoring functions: GOLD , ChemScore , DOCK , PMF , BLEEP [4, 25–28], and a Consensus generated from the preceding five. We used two ranking methodologies: best GOLD rank and BestScore rank (see Methods).
Results and discussion
We analysed crystal structures (PDB Codes: 1YC1/1YC3/1YC4, 1BYQ) containing the ligands 4BC (Figure 1), 43P (Figure 1), and ADP (Figure 2) bound to the N-terminal ATP binding domain of human Hsp90α, as described in detail in the Methods section.
We considered the conformation of the ADP bound Hsp90 (PDB Code: 1BYQ), representing a ligand bound structure, as a suitable starting point for virtual screening. Thr184 was used as a tether, since it generated a low RMSD (root mean square deviation) from its corresponding crystallographic conformations (< 1Å, Table 1) and, in preliminary work, strongly outperformed the alternative Asp93 tether. Each library compound was docked to the binding site (PDB Code: 1BYQ), firstly with no tether and secondly with the tether Thr184. We separately used the GOLD and ChemScore functions for on-dock scoring. The RMSD values between the docked ligands and their crystallographic conformations (1YC1/1YC3/1YC4) are given in Table 1.
A larger set of 'active' (261) and 'inactive' (54) compounds similar to 4BC and 43P and a 'decoy' (~3600) set of known drugs, with similarly druglike physicochemical properties (molecular weight, logP, numbers of hydrogen bond donors, hydrogen bond acceptors and rotatable bonds, see Methods), but assumed inactive against this target, were docked to the binding site, with and without the Thr184 hydrogen bond tether, using GOLD 2.2 and the GOLD scoring function. Post-dock scoring used the SYBYL®-CScore™ module, BLEEP as stand alone software, and Consensus (see Methods).
By ranking all ligands via their score values, the enrichments were calculated for each scoring function to establish how many decoys had to be picked in order to find all the original actives, based on poses chosen with either the GOLD rank or BestScore rank methodologies. GOLD rank is based on ranks generated using GOLD. Each scoring function is applied to the pose ranked number one by GOLD for that ligand. BestScore rank chooses, in each case, the best pose as ranked by the particular scoring function in question, rather than always using the pose ranked first by GOLD. The virtual screening was carried out both with and without the tether.
Scores normalised for molecular weight  were obtained by dividing the raw score by the number of heavy atoms to the power of 1/3. This is designed to reduce the inherent bias towards larger molecules that arises from the additive nature of scoring functions. Normalisation also reduces the prevalence of high molecular weight molecules amongst the hits, which is likely to be beneficial from a lead optimisation perspective.
We give the results in Table 2 (no tether) and Table 3 (Thr184 tether). Some of the same data are shown as Receiver Operating Characteristic (ROC) curves in Figure 3. The ROC curves are presented as plots of the proportion of all actives recovered versus the proportion of all inactives recovered as one proceeds from the top to the bottom of the ranked list. The areas under these ROC curves are a convenient measure of performance, and are included in Tables 2 and 3. An ideal case would recover all actives before recovering any inactives and hence have an area of unity. The apparent contradiction between the retrievals of actives for GOLD between Tables 2, 3 (e.g., 28% of actives for GOLD rank and 25% of actives for BestScore rank in the top 10% in Table 2) is due to the different implementations of the GOLD algorithm in GOLD 2.2 and in the SYBYL® -CScore™ module.
The relative performance of the scoring functions is typically given by
GOLD ≈ Consensus > DOCK ≈ ChemScore > BLEEP >> PMF.
The Consensus score used in this work is a simple sum of the Z-scaled scores from five scoring functions. As such, it is less sophisticated than other consensus strategies considered elsewhere [17, 27]. Nonetheless, it is generally a robust method, comparable in performance to the best individual scoring function. The good performance of the Consensus scoring method result is to some extent in agreement with recent virtual screening studies where Consensus scoring improves the enrichment of true hits [32–34] in various systems. However, the improvement given by using the Consensus method is small, and on occasions Consensus fails to outperform the best individual function.
The performance of PMF here is usually worse than random and PMF is consistently the poorest performer in all applied protocols. We used the implementation of PMF in SYBYL® 7.0; our previous use of the SYBYL implementation of PMF also gave disappointing results , though the present ones are certainly poorer. PMF gave much better results in its authors' own in-house implementation [5, 35].
The tethered results are in all cases better than the corresponding untethered ones. This effect is particularly strong when the BestScore rank protocol is used.
The utilisation of tethering during docking requires prior knowledge of ligand-protein X-ray structures, which is not always available. Inspection of the structures shows that in general the tether is satisfied as expected in the better scoring structures and structures unable to satisfy the tether appear further down the ranked list.
When the tether is used, the BestScore rank protocol always gives better results than a corresponding calculation using the GOLD rank protocol. For untethered docking, there is little difference in the performance of the two protocols.
The GOLD rank protocol tends to be biased towards to the GOLD function in relation to the other scoring functions; BestScore rank proved to be an unbiased method selecting the best score for each scoring function independently.
In most cases, normalisation has little effect on performance, and any such effect is often deleterious. However, for the particular combination of tethered docking and the BestScore rank protocol, normalisation gives a significant improvement (though not for ChemScore).
This combination of tethered docking, the BestScore rank protocol and normalisation by dividing the raw score by the number of heavy atoms to the power of 1/3 gives the best results found in this study; this is true for every scoring function except ChemScore.
We consider that this optimal combination gives a good virtual screening performance (other than with PMF), with the percentages of actives found in the first 10% of the ranked library being 90%, 79%, 69% and 52% for the four best individual scoring functions and 89% for Consensus. The ROC curves for this combination are shown in Figure 3.
The performance ranking of the scoring functions for this optimal combination of tether, BestScore rank and normalisation is somewhat atypical of those found in our other calculations and is given by
DOCK ≈ Consensus > GOLD > BLEEP > ChemScore >> PMF.
This work has demonstrated the successful development of a virtual screening methodology, as has been achieved by other groups for different therapeutically relevant targets [36, 37]. A library of ~3600 compounds was docked semi-flexibly into the active site of Hsp90. Five scoring functions, including BLEEP, were used to discriminate active from inactive compounds. The present work offers alternative protocols for virtual screening of chemical libraries with an emphasis on the effect of using multiple ligand poses for scoring with some of the most common scoring functions and also tethered and un-tethered docking.
For tethered docking, we find that consideration of multiple poses for each ligand in our BestScore rank protocol is superior to relying on the best scoring pose generated by a single scoring function. The different scoring functions are thus judged on the basis of their own top-scoring poses, which may be different from one another.
Though normalisation has little effect on enrichment elsewhere in this work, in the case where the Thr184 tether is combined with the BestScorerank protocol, normalisation generates a significant improvement in enrichment. This combination of tethered docking, the BestScore rank protocol and normalisation gives the best results found in this work. Normalisation also reduces the prevalence of high molecular weight molecules amongst the hits, which is likely to be beneficial from a lead optimisation perspective.
Although we use only a very simple implementation of Consensus scoring, we find it to be a generally robust methodology. It performs similarly to the best individual scoring function in each virtual screening run.
Overall, we demonstrate the validity of virtual screening as a method for identifying new leads from a pool of ligands with similar physicochemical properties and we believe that the outcome of this study provides useful insight into the setting up of a suitable docking/scoring protocol, resulting in enrichment of 'target active' compounds.
Prior to docking-based virtual screening, the binding site was prepared using SYBYL® 7.0. Protonation states as at pH7, atom- and bond-types, hydrogen addition, and consideration of active site waters for inclusion/exclusion were implemented using SYBYL® 7.0 for the crystal structures (PDB Codes: 1YC1/1YC3/1YC4 , 1BYQ) containing the ligands 4BC (Figure 1), 43P (Figure 1), and ADP bound to the N-terminal ATP binding domain of human Hsp90α. A diagram featuring the key protein-ligand interactions for the ligand ADP was generated using LIGPLOT  (Figure 2).
For the purpose of this study, we considered the conformation of the ADP bound Hsp90 (PDB Code: 1BYQ), representing a ligand bound structure and a more suitable starting point for virtual screening. The bound inhibitor was not included in the docking run. The 3D coordinates of the ligands were generated from 2D structures using CORINA . For tether selection, we considered Thr184 [29, 40] Asp93  and Gly97, which all form distinct hydrogen bonds with bound ligands. Gly97 was not included in the final calculations as it did not form any interaction with ATP and showed poor results in initial validation studies. Default tether weights were used. Both Thr184 and Asp93 initially seemed to be appropriate tethers, since they generated the lowest RMSD from their corresponding crystallographic conformation (< 1Å) for this system (see Table 1). However, our early results showed that the Asp93 tether did not produce a significant enrichment of actives and hence it was not considered further.
Docking and scoring protocol
Each compound in the library was docked to the binding site (PDB Code: 1BYQ), with no tether and with the Thr184 tether. In each case, we separately used both the GOLD and ChemScore functions for on-dock scoring. The RMSD was calculated between each docked ligand and its later published crystallographic conformation (PDB Codes: 1YC1/1YC3/1YC4) (Table 1 and Figures 3, 4). GOLD rank is based on ranks generated using GOLD. The various scoring functions, GOLD, ChemScore, DOCK, PMF, BLEEP and Consensus, are applied to the pose ranked number one by GOLD for that ligand. BestScore rank uses multiple poses for each ligand, and independently chooses the best ranked pose of the ligand according to each individual scoring function.
A larger set of 'active' (261) and 'inactive' (54) compounds similar to 4BC (4-benzo[1, 3]dioxol-5-yl-5-(5-ethyl-2,4-dihydroxy-phenyl)-2H-pyrazole-3-carboxylic acid) and 43P (4-ethyl-6-[4-(1H-imidazol-4-yl)-1H-pyrazol-3yl]-benzene-1,3-diol) and a 'decoy' (~3600) set of known drugs (with similar physicochemical properties but assumed inactive against this target) were docked to the binding site, with and without the Thr184 hydrogen bond tether, using GOLD 2.2 and the GOLD scoring function, determined to give the best results in previous test runs. Post-dock scoring using a set of different scoring functions was applied using the SYBYL®-CScore™ module, and BLEEP as stand alone software. The Consensus was defined as follows: the mean of each scoring function was subtracted from the score of each compound and divided by its standard deviation; the sum of these scaled values of the five scoring functions generated the consensus. This sum over Z-scaled scoring function values was implemented using perl scripts.
Using the activity data reported in a set of recent patents , we defined compounds as 'active' if IC50 < 10 μM and as 'inactive' if IC50 > 50 μM. The 'decoy' set was selected from the CIPSLINE cancer database using the dbtranslate and dbslnfilter tools in SYBYL® 7.0, so as to maintain the same physicochemical properties as the active/inactive set: MWt 150–750, logP 1–6, rotatable bonds 0–14 and hydrogen bond donors/acceptors 0–8/0–12. In each case, up to 10 poses were saved for each docked compound. Two separate results files were written containing all poses for all ligands, and containing only the top GOLD rank pose for each ligand.
Koh JT: Making virtual screening a reality. Proc Natl Acad Sci USA 2003, 100: 6902–6903. 10.1073/pnas.1332743100
Jones G, Willett P, Glen RC, Leach AR, Taylor R: Development and validation of a genetic algorithm for flexible docking. J Mol Biol 1997, 267: 727–748. 10.1006/jmbi.1996.0897
Huang N, Kalyanaraman C, Bernacki K, Jacobson MP: Molecular mechanics methods for predicting protein-ligand binding. Phys Chem Chem Phys 2006, 8: 5166–5177. 10.1039/b608269f
Mitchell JBO, Laskowski RA, Alex A, Thornton JM: BLEEP – Potential of mean force describing protein-ligand interactions: I. Generating potential. J Comput Chem 1999, 20: 1165–1176. Publisher Full Text 10.1002/(SICI)1096-987X(199908)20:11<1165::AID-JCC7>3.0.CO;2-A
Muegge I, Martin YC: general and fast scoring for protein-ligand interactions: A simplified potential approach. J Med Chem 1999, 42: 791–804. 10.1021/jm980536j
Walters WP, Stahl MT, Murcko MA: Virtual screening – An overview. Drug Discov Today 1998, 3: 160–178. 10.1016/S1359-6446(97)01163-X
McConkey BJ, Sobolev V, Edelman M: The performance of current methods in ligand-protein docking. Curr Sci 2002, 83: 845–856.
Lyne PD, Kenny PW, Cosgrove DA, Deng C, Zabludoff S, Wendoloski JJ, Ashwell S: Identification of compounds with nanomolar binding affinity for checkpoint kinase-1 using knowledge-based virtual screening. J Med Chem 2004, 47: 1962–1968. 10.1021/jm030504i
Mestres J: Virtual screening: a real screening complement to high-throughput screening. Biochem Soc Trans 2002, 30: 797–799. 10.1042/BST0300797
Baxter CA, Murray CW, Waszkowycz B, Li J, Sykes RA, Bone RGA, Perkins TDJ, Wylie W: approach to molecular docking and its application to virtual screening of chemical databases. J Chem Inf Comput Sci 2000, 40: 254–262. 10.1021/ci990440d
Perola E, Xu K, Kollmeyer TM, Kaufmann SH, Prendergast FG, Pang Y-P: Successful virtual screening of a chemical database for farnesyltransferase inhibitor leads. J Med Chem 2000, 43: 401–408. 10.1021/jm990408a
Doman TN, McGovern SL, Witherbee BJ, Kasten TP, Kurumbail R, Stallings WC, Connolly DT, Shoichet BK: Molecular docking and high throughput screening for novel inhibitors of protein tyrosine phosphatase-lB. J Med Chem 2002, 45: 2213–2221. 10.1021/jm010548w
Grüneberg S, Stubbs MT, Klebe G: Successful virtual screening for novel inhibitors of human carbonic anhydrase: Strategy and experimental confirmation. J Med Chem 2002, 45: 3588–3602. 10.1021/jm011112j
Kalyanaraman C, Bernacki K, Jacobson MP: Virtual screening against highly charged active sites: Identifying substrates of alpha-beta barrel enzymes. Biochemistry 2005, 44: 2059–2071. 10.1021/bi0481186
Raha K, Merz KM Jr>: Large-scale validation of a quantum mechanics based scoring function: Predicting the binding affinity and the binding mode of a diverse set of protein-ligand complexes. J Med Chem 2005, 48: 4558–4575. 10.1021/jm048973n
Jacobsson M, Karlén A: Ligand bias of scoring functions in structure-based virtual screening. J Chem Inf Model 2006, 46: 1334–1343.
Oda A, Tsuchida K, Takakura T, Yamaotsu N, Hirono S: Comparison of consensus scoring strategies for evaluating computational models of protein-ligand complexes. J Chem Inf Model 2006, 46: 380–391. 10.1021/ci050283k
Baber JC, Shirley WA, Gao Y, Feher M: The use of consensus scoring in ligand-based virtual screening. J Chem Inf Model 2006, 46: 277–288. 10.1021/ci050296y
Isaacs JS, Xu W, Neckers L: Heat shock protein 90 as a molecular target for cancer therapeutics. Cancer Cell 2003, 3: 213–217. 10.1016/S1535-6108(03)00029-1
SYBYL®7.0 Tripos Inc., 1699 South Hanley Road, St Louis, Missouri, 63144 USA [http://www.tripos.com/]
Mitchell Group Datasets, Konstantinou Kirtay et al . Datasets Page[http://www-mitchell.ch.cam.ac.uk/sdf_SMILES/data.html]
Prous Science CIPSLINE Cancer Database. We accessed this in January 2005; CIPSLINE was discontinued in 2006[http://www.prous.com]
Eldridge MD, Murray CW, Auton TR, Paolini GV, Mee RP: Empirical scoring functions: I. The development of a fast empirical scoring function to estimate the binding affinity of ligands in receptor complexes. J Comp -Aided Molec Des 1997, 11: 425–445. 10.1023/A:1007996124545
Kuntz ID, Blaney JM, Oatley SJ, Langridge R, Ferrin TE: A geometric approach to macromolecule-ligand interactions. J Mol Biol 1982, 161: 269–288. 10.1016/0022-2836(82)90153-X
Mitchell JBO, Laskowski RA, Alex A, Forster MJ, Thornton JM: BLEEP – Potential of mean force describing protein-ligand interactions: II. Calculation of binding energies and comparison with experimental data. J Comput Chem 1999, 20: 1177–1185. Publisher Full Text 10.1002/(SICI)1096-987X(199908)20:11<1177::AID-JCC8>3.0.CO;2-0
Nobeli I, Mitchell JBO, Alex A, Thornton JM: Evaluation of a knowledge-based potential of mean force for scoring docked protein-ligand complexes. J Comput Chem 2001, 22: 673–688. 10.1002/jcc.1036
Marsden PM, Puvanendrampillai D, Mitchell JBO, Glen RC: Predicting protein-ligand binding affinities: A low scoring game? Org Biomol Chem 2004, 2: 3267–3273. 10.1039/b409570g
Konstantinou-Kirtay C, Mitchell JBO, Lumley JA: Knowledge based potentials: The reverse Boltzmann methodology, virtual screening and molecular weight dependence. QSAR & Comb Sci 2005, 24: 527–536. 10.1002/qsar.200430926
Kreusch A, Han S, Brinker A, Zhou V, Choi H-S, He Y, Lesley SA, Caldwell J, Gu X-J: Crystal structures of human HSP90α-complexed with dihydroxyphenylpyrazoles. Bioorg Med Chem Lett 2005, 15: 1475–1478. 10.1016/j.bmcl.2004.12.087
Obermann WM, Sondermann H, Russo AA, Pavletich NP, Hartl FU: In vivo function of Hsp90 is dependent on ATP binding and ATP hydrolysis. J Cell Biol 1998, 143: 901–910. 10.1083/jcb.143.4.901
Pan Y, Huang N, Cho S, MacKerell AD Jr>: Consideration of molecular weight during compound selection in virtual target-based database screening. J Chem Inf Comput Sci 2003, 43: 267–272. 10.1021/ci020055f
Bissantz C, Folkers G, Rognan D: Protein-based virtual screening of chemical databases. 1. Evaluation of different docking/scoring combinations. J Med Chem 2000, 43: 4759–4767. 10.1021/jm001044l
Stahl M, Rarey M: Detailed analysis of scoring functions for virtual screening. J Med Chem 2001, 44: 1035–1042. 10.1021/jm0003992
Charifson PS, Corkery JJ, Murcko MA, Walters WP: Consensus scoring: A method for obtaining improved hit rates from docking databases of three-dimensional structures into proteins. J Med Chem 1999, 42: 5100–5109. 10.1021/jm990352k
Muegge I, Martin YC, Hajduk PJ, Fesik SW: Evaluation of PMF scoring in docking weak ligands to the FK506 binding protein. J Med Chem 1999, 42: 2498–2503. 10.1021/jm990073x
Krovat EM, Langer T: Impact of scoring functions on enrichment in docking-based virtual screening: An application study on renin inhibitors. J Chem Inf Comput Sci 2004, 44: 1123–1129. 10.1021/ci0342728
Smith R, Hubbard RE, Gschwend DA, Leach AR, Good AC: Analysis and optimization of structure-based virtual screening protocols (3). New methods and old problems in scoring function design. J Mol Graph Model 2003, 22: 41–53. 10.1016/S1093-3263(03)00125-6
Wallace AC, Laskowski RA, Thornton JM: LIGPLOT: A program to generate schematic diagrams of protein-ligand interactions. Prot Eng 1995, 8: 127–134. 10.1093/protein/8.2.127
CORINA, Molecular Networks GmbH[http://www.molecular-networks.com/online_demos/corina_demo.html]
Dymock B, Barril X, Beswick M, Collier A, Davies N, Drysdale M, Fink A, Fromont C, Hubbard RE, Massey A, Surgenor A, Wright L: Adenine derived inhibitors of the molecular chaperone HSP90-SAR explained through multiple X-ray structures. Bioorg Med Chem Lett 2004, 14: 325–328. 10.1016/j.bmcl.2003.11.011
Barril X, Morley SD: Unveiling the full potential of flexible receptor docking using multiple crystallographic structures. J Med Chem 2005, 48: 4432–4443. 10.1021/jm048972v
Patents & number of compounds we defined as active or inactive: WO3055860 Actives: 36, Inactives: 21; WO4050087 Actives: 19, Inactives: 13; WO4056782 Actives: 59, Inactives: 17; WO4072051 Actives: 129, Inactives: 0; WO4096212 Actives: 13, Inactives: 0; WO5000300 Actives: 5, Inactives: 3
This work was funded by the EPSRC, InsightFaraday (now part of the Chemistry Innovation Knowledge Transfer Network), Arrow Therapeutics Ltd and Unilever plc.
CKK carried out the work under the supervision of JAL (industrial supervisor) and JBOM (academic supervisor). All authors cooperated in the analysis of the results and the writing of the manuscript.
About this article
Cite this article
Konstantinou-Kirtay, C., Mitchell, J.B. & Lumley, J.A. Scoring functions and enrichment: a case study on Hsp90. BMC Bioinformatics 8, 27 (2007). https://doi.org/10.1186/1471-2105-8-27
- Receiver Operating Characteristic Curve
- Virtual Screening
- Similar Physicochemical Property
- High Molecular Weight Molecule
- Virtual Screening Performance