A comparative study of S/MAR prediction tools
© Evans et al; licensee BioMed Central Ltd. 2007
Received: 27 July 2006
Accepted: 02 March 2007
Published: 02 March 2007
S/MARs are regions of the DNA that are attached to the nuclear matrix. These regions are known to affect substantially the expression of genes. The computer prediction of S/MARs is a highly significant task which could contribute to our understanding of chromatin organisation in eukaryotic cells, the number and distribution of boundary elements, and the understanding of gene regulation in eukaryotic cells. However, while a number of S/MAR predictors have been proposed, their accuracy has so far not come under scrutiny.
We have selected S/MARs with sufficient experimental evidence and used these to evaluate existing methods of S/MAR prediction. Our main results are: 1.) all existing methods have little predictive power, 2.) a simple rule based on AT-percentage is generally competitive with other methods, 3.) in practice, the different methods will usually identify different sub-sequences as S/MARs, 4.) more research on the H-Rule would be valuable.
A new insight is needed to design a method which will predict S/MARs well. Our data, including the control data, has been deposited as additional material and this may help later researchers test new predictors.
In the nucleus of eukaryotic cells specific regions of the DNA are attached to the nuclear matrix. These regions are called matrix attachment regions (or scaffold attachment regions, abbreviated as S/MARs). It is thought that there are tens of thousands of S/MARs in the genome of higher eukaryotes , which assigns a major role in the organisation of the chromatin within the nucleus to the S/MARs. There is a category of S/MARs that function as boundary elements when they separate a gene from other genes' regulatory modules [2–5]. S/MARs can activate enhancer regions , and determine which one of a class of genes to transcribe . They also have a strong effect on the level of expression of transgenes [8, 9]. Therefore, S/MARs are of intrinsic interest for the understanding of gene regulation in eukaryotic cells.
Reliable predictions of S/MARs by computer would be very valuable, as they would facilitate the design of experiments and improve our understanding of regulatory mechanisms. In genome-wide applications, such methods could allow insights into the number of S/MARs , their distribution in the genome, their position relative to genes, and the functional classifications of S/MARs. However, while a number of methods have been proposed, their predictive power has so far not been put under detailed scrutiny and is therefore uncertain. There has also been very little analysis of the respective strengths and weaknesses of the proposed methods which could facilitate the design of better methods.
A considerable amount of research has been focused on computational predictions of the position of S/MARs and several methods of S/MAR prediction have been proposed. The MAR-Finder method scores sub-sequences of DNA by the abundance of DNA-motifs thought to be correlated with S/MARs . Particular motifs have been suggested by experimental groups: the recognition signature (MRS) consisting of two consensus sequences  and a "consensus" sequence by Wang et al. . It has also been found that a long run of bases that do not contain a G binds to the matrix  and this is the basis of the H-Rule . Two methods which have attempted to learn motifs from a training set are SMARTest  and ChrClass , the latter also attempting to classify S/MARs.
It has been recognised that S/MARs are often AT-rich and this has lead to the idea that strand separation (or at least the potential for strand separation) is important for S/MAR binding. The program Thermodyn  makes a simple calculation of the free energy of strand separation and this program has received a fleeting mention in the S/MAR literature  where its results correlated with the S/MARs observed in that experiment.
SIDD (stress-induced duplex destabilisation) is a more complicated calculation of the potential of DNA strands to separate in a given region . This calculation takes into account the torsional stress on the DNA and uses a thermodynamic model of energy states. A long series of papers [2, 19–21] has drawn attention to correlations between S/MARs and SIDD results in particular situations and experiments. Other authors such as Krawetz et al.  have included SIDD in their list of possible tools for finding S/MARs. However, the latest thinking of the SIDD team  is that SIDD calculations do not [yet] form the basis of an S/MAR predictor for wild type S/MARs in genomic DNA. In view of the obvious interest in this approach, the following analyses include our own interpretation of the method which we call "duplex destabilisation".
It is not surprising that the original authors make encouraging statements about their own methods but a number of authors have praised competitor methods, for example:- The authors of SMARTest say MAR-Finder gives 80% precision and 32% sensitivity . Rogozin et al.  say that both MAR-Finder and ChrClass (their own method) can be recommended for analysing eukaryotic genomes even if caution must be exercised. A paper from the SIDD team  compared MAR-Finder, SMARTest and SIDD on one sequence and said "we have applied all three algorithms in parallel and found a reassuring amount of coincidence for a thoroughly studied example." The experimental paper by Purbowasito et al.  complimented the good performance of ChrClass with 85% sensitivity and 50% precision. Another experimental paper  found the MRS signature to be a good indicator.
There have however been a handful of negative results in the literature. The experimental paper by Ostermeier et al.  failed to find any correlation with predictive methods. Liebich et al.  suggested that many motifs associated with S/MARs were merely a consequence of the fact that many S/MARs were AT-rich. Although Purbowasito et al.  complimented the performance of ChrClass, other methods were not found to be so successful. Krawetz et al.  give a small tutorial example on the use of computer methods where it is notable that the methods give different results and the advice is "to compare the results obtained from several different algorithms".
On balance the tone of the literature is very positive, even if this does not reflect the views of many workers in the field, especially for the prediction of AT-poor S/MARs. The situation calls for a comprehensive statistical evaluation especially since these methods are used by biologists to plan their experiments. Our analysis uses relatively large datasets and in particular measures performance against negative control sets.
We have put together a positive test set of experimentally verified S/MARs of known position within the mouse or human genome as well as negative test sets and applied all the methods mentioned above to this data. Our evaluation reveals that these methods have little predictive power. Moreover, we show that a simple rule based on AT-percentage generally achieves the same level of accuracy as the other methods. It is well known that many S/MARs are AT-rich but it is still a surprise that such a simple method compares well with the current state of the art.
A point of practical importance to the user is that the methods will largely predict different sub-sequences. This result might be exploited to design a stronger method for S/MAR prediction, but we believe further insights based on the biological mechanisms involved will be needed.
Although none of the methods analysed could serve as a practical prediction tool, our analyses suggest several reasons for thinking further research on the H-Rule would be valuable.
Extensive additional material has been deposited [see Additional file 1].
Percentage of S/MARs and pseudo-S/MARs predicted by each method by type of sequence
MAR-Finder (rules 1–6)
MAR-Finder (rules 1–5)
Percentage of S/MARs and pseudo-S/MARs predicted by each method by type of sequence
Results have also been obtained for a number of different combinations of the data (including the parts of the positive dataset obtained from the SMARt DB and Purbowasito sources separately)–but no method can be said to be good in any of the conditions tested.
Summary of the MAR-Finder Rules
Purpose of Rule
Origin of replication
Topoisomerase II cleavage sites
We have evaluated the predictive power of the available methods for S/MAR prediction on positive and background test sets using straightforward analytical techniques. The results lead us to four main conclusions: the methods analysed have little predictive power; a simple rule based on AT-percentage does just as well especially at low false discovery rates; in practice, the different methods will identify different sub-sequences; several aspects of the H-Rule have been observed which deserve further investigation.
These results are different from those claimed by the original authors and this needs some explanation. We think that the main reason for these conclusions is that much previous analysis did not include a comparison against negative/background test sets and in particular a control based on the length of the putative S/MAR. Several of the original studies are based on only a handful of positive test sequences. Their results cannot be generalised to these larger human/mouse test sets. We also question if some of the analyses in the literature have not been biased by a concentration on one or two of the best cases effectively using very stringent thresholds. As an aid for future work we have included the 10 kb sequences for both the positive and control sequences in the additional material [see Additional files 5, 6, 7, 8, 9].
We have explored changes in the details of the analyses. For example we tried doubling/halving the window sizes. For MAR-Finder we have tried other combinations of rules, alternatives in defining the base probabilities and how the signals for the two strands are combined. The thrust of our conclusions is unchanged. We are therefore confident that our conclusions are robust against technical changes and definitions. The Purbowasito data  formed about a third of our dataset. In case this affected the results, we repeated our analyses without this data and our conclusions are unaffected.
While all methods have little predictive power, some comments on individual methods can be made. In general MAR-Finder performs better when rules 1–6 are used than when only rules 1–5 are used. This is true for regions which are AT-rich as well as those that are AT-poor. Exploratory analyses suggest that MAR-Finder might perform better when the base frequencies are defined from a very long sequence which contain the candidate S/MAR(s), but this alternative does not turn the method into a strong predictor. The ChrClass method does not come with strong claims from its authors but Purbowasito et al.  found good performance for S/MARs in one megabase of DNA sequence. For the same data we find that it detects a high proportion of true S/MARs but also has a high false positive rate: for the other S/MARs in our dataset it does not perform well (details not shown). We find the MRS signature to have very moderate predictive power–less than expected . The SMARTest method tends to find a smaller proportion of real (and pseudo) S/MARs than either the MRS or ChrClass methods. We also find its performance comparable to MAR-Finder at comparable levels of sensitivity. Thermodyn turns out to be as good as some of the more established methods.
The H-Rule may not be of practical use but it is the best predictor of those examined. Figures 14 and 15 show aspects of this idea which might be exploited to improve the measure. Figure 15 and the fact that the S/MAR average remains below the background average for tens of kilobases from the S/MAR centre invites interpretation. A typical S/MAR may be in a large distinctive region which presumably contains more than one S/MAR. Regions between the S/MARs (or S/MAR-clusters) may be under selective pressure not to bind to the matrix to allow for proper looping of DNA. Therefore, one way to improve S/MAR prediction may be to incorporate features of the neighbouring, non-binding regions into the model.
In framing the duplex destabilisation method, we have followed the ideas and calculational technique of the SIDD calculations . We have tried variations in the method, e.g. of window sizes and the use of the p-graph instead of the G-graph and have found that they all lead to the same conclusions. We have also experimented with alternatives such as area measures (the area of graph under a given threshold) and length measures (the number of bases for which a graph falls below the threshold). For some area measures there was a small improvement in predictive power but nothing to alter the main conclusions. We did not try the complexities of the method described in general terms in  but we see no reason to dispute their conclusion that a SIDD predictor of wild type S/MARs in genomic DNA has not yet been developed.
It is of course possible that these principles might be used successfully but we foresee difficulties and do not share the hopes expressed in . The purpose of SIDD calculations is to calculate where torsional stress causes DNA to separate. It is still not obvious that either torsional stress or strand separation is relevant to S/MAR binding. In vivo the salt concentration is comparatively high and DNA would relieve torsional stress by twisting about itself rather than melting . The presence of nucleosomes also relieves torsional stress. Several S/MAR proteins bind to double stranded DNA and SATB1 in particular does not bind to single stranded DNA . The main problem that we have found is that for any sequence the duplex destabilisation method searches for the weakest point. There is therefore a tendency for the duplex destabilisation method to predict exactly one S/MAR in any sequence of any length. To some extent this is avoided by the use of the G-graph rather than the probability p-graph–but it remains a difficulty of the method. This explains its poor performance on the coding, negative and E. coli test sets. It also explains the purpose behind the procedure described in  of obtaining a standardised measure for a sub-sequence by splicing it into a standard plasmid.
Our use of AT-percentage as a prediction rule is not intended to suggest that AT-richness of (many) S/MARs is a new result. On the contrary, most authors who write on the subject explain that many S/MARs are known to have a high correlation with AT-rich regions or have runs of As, but the situation is more complicated. The current methods of S/MAR prediction have a correlation with AT-richness built in: MAR-Finder has several rules correlated with AT-content and the duplex destabilisation calculations are heavily influenced by AT-content. Indeed as noted below when rule 6, "AT-richness", is included in MAR-Finder it dominates the other rules. However, we do find it striking that our simple AT-percentage-rule is competitive with published methods.
One notorious problem for research in this area is the choice of a control set. There are a number of features of the genome which have been annotated–for example transcription start sites–but it does not follow that these regions are free of S/MARs. On the contrary these may be regions where S/MARs are to be found. The approach that we prefer is to use real DNA sequences chosen randomly from the mouse genome. The disadvantage is that the real proportion of S/MARs within this test set is unknown. However, if a predictor cannot make a clear distinction between the real S/MARs and the background set it must mean that either the predictor is very poor or that the definition of an S/MAR is nearly meaningless–a random piece of DNA is just as good. We have constructed three other control datasets: the coding, the negative and the E. coli dataset. The advantage of these three sets is that it is almost certain that there are no S/MARs in these datasets: both the function and sequence of coding sequences make them unlikely to contain S/MARs; the negative dataset consists of an entirely artificial sequence; and E. coli has no nucleus which implies that no specialised S/MARs can have evolved. The disadvantage of these datasets is that they can easily be distinguished by statistical methods from mouse/human sequences and if the evaluation is set up in this form it is not clear whether a successful measure is doing anything more than distinguishing the type of sequence rather than finding S/MARs. Our reading of Figures 3, 4, 5 is that this is all these measures are doing. However, if these control sets are regarded as giving a proper evaluation then the H-Rule and the AT-method are superior to the other methods. It is also true that if one used a threshold which found only a fifth of real S/MARs then most of the methods would find a negligible number of S/MARs in these three control sets. However, on the same basis, the same threshold would identify at least a tenth of random sequences of mouse DNA as containing an S/MAR.
Users will also need to bear in mind that different methods will predict different sub-sequences as S/MARs. At one level this is obvious in that the default parameters of the different methods operate at regions along the ROC curve. It is also a corollary of the with-LIS/non-LIS results (Figures 16 and 17). Other evidence that the methods will in practice identify different sequences was given in Figures 6 and 7.
A number of roles for S/MARs have been proposed in the literature , and this suggests it might be possible to predict the function or type of an S/MAR as well as its presence. However, there is not yet sufficient data for such an analysis. The ChrClass method  is an attempt at this, but the authors themselves stress the difficulties of their analysis. We examined the notes in SMARt DB and it is possible that the different methods are in fact predicting S/MARs with different features, e.g. duplex destabilisation for S/MARs with bent DNA and MAR-Finder with clusters of motifs, but with the current limited data we can only leave this as a question for further work. The analysis splitting the data by LIS and non-LIS S/MARs fell short of giving statistical significance, but it would be interesting to see if a larger dataset could settle the question of whether some methods were better at finding LIS confirmed S/MARs.
Using background sequences allows one to see how many hits a method will generate on average in a length of sequence. Unfortunately the poor predictive power of the methods means that we cannot go on to estimate the number of S/MARs in the genome, and we have therefore not reported these results.
However, two points may be made. Firstly, as could be deduced from the Results section, there are many hits in the background sequences. Secondly, sequences containing a known S/MAR contain more hits than background sequences do–suggesting that S/MARs come in clusters. This possibility is not unexpected given the work of [7, 24] and .
We have been invited to comment on where progress might be made in this field. We do not share the view that S/MARs are no more than an experimental artefact but we do suspect that the term is too broad and useful categories need to be identified either by function or more probably by the protein (or protein family) that binds to the S/MAR. We also expect that experiments of wild type S/MARs will be more useful than in vitro ones. A corrollary of S/MARs coming in clusters is that a biologically relevant feature might be a long region (say 100 kb) that contains a cluster of S/MARs. Support for this idea comes from the behaviour of the H-Rule measure which takes several 10 kb to return to the background level. If the biology is to be explained in terms of strand separation then the in vivo mechanisms need to be better understood. On present evidence it looks more likely that the H-Rule is closer to the biological mechanisms and that progress may be made by a better mathematical formulation of the H-rule.
It appears that existing methods can pick out a few extreme candidates for S/MARs and that these can be expected to be true positives. However, a method which identifies S/MARs with good precision is still needed. It is clear that a new insight is needed: perhaps then we will be able to identify some sequences as forming–for example–insulators between genes and others as framing regulatory cassettes.
The MAR-Finder method  uses a set of DNA-sequence motifs known to be abundant in S/MARs in order to predict S/MARs. In the MAR-Finder calculations these motifs are grouped into "rules" according to the reason the motif was included: see Table 3. As noted below, the authors are not entirely prescriptive as to which of these rules are to be used.
In a window of fixed length the number of occurrences of each motif is determined and compared to the expected number of occurrences in a random DNA sequence of the same length as the window. Using a Poisson distribution these values are turned into a score for that window. The average of the score for the positive strand and the negative strand is then computed and called the MAR-potential. This step is repeated for each window along the sequence under consideration and those windows that have a MAR-potential above a given threshold are predicted to contain an S/MAR. In the original method the MAR-potential is scaled so that the maximum value for the sequence under consideration is 1.0. We give results by Frisch et al.  for the power of this method in the subsection describing SMARTest.
Both the original MAR-Finder method  and its present incarnation on the MAR-Wiz website  leave it open to the user to specify several steps in the analysis–in particular, which motifs to include and how the final scaling is done. An example of this ambiguity is that rule 6–the "AT-richness rule"–is used in some applications for the detection of AT-rich S/MARs, but not for the detection of AT-poor S/MARs [10, 11, 16]. We have evaluated the contribution of this motif to the MAR-potential and found that it dominates the other motifs, if included. The MAR-Wiz website allows two rules to be used which were not discussed in their original paper–a "consensus sequence" and the H-rule. We discuss these separately below. The default method of normalising by the maximum potential in the sequence, as described above, is statistically unstable, and the authors suggest that the user clips the highest peaks in the MAR-potential if this should seem appropriate. There is also the ambiguity of how to define the frequencies of the bases: the default is to use the frequencies in the sequence being analysed–however long that might be.
We have coded the method as described in . We have deduced that the published specification is incomplete but on making the appropriate changes we get very close agreement with the graphs in the original paper and from the website. The changes refer to the motifs listed in Figure 1 of . Motif 7 should read A4n7A3n7A4 and motif 8 similarly. Although not stated, it also appears that motifs 16 and 17 should be allowed to match with one and two mismatches respectively, and the probability of the motifs occurring should be adjusted accordingly.
We have used the default window of 1000 bases and tried both alternatives of including and excluding the "AT-richness rule". These are referred to as "MAR-Finder (rules 1–6)" and "MAR-Finder (rules 1–5)". Base frequencies have been calculated from the 10 kb sequence containing the S/MAR. Instead of the arbitrary scaling method we have left the MAR-potential in absolute units and tried various thresholds.
The "consensus sequence" is "TCTTTAATTTCTAATATATTTAGAA" and is a SATB1 recognition sequence derived from the S/MAR downstream of the mouse immunoglobulin heavy chain enhancer . Any twenty-five base pair sequence is very rare and this one does not occur exactly in our positive test set. If two mismatches are allowed then it appears twice–not surprisingly in/near the two S/MARs that gave rise to the sequence. The use of this sequence therefore depends entirely on how many mismatches are allowed, and since this sequence is nearly all A/T this method becomes simply a measure of AT-richness over two dozen bases and we have not pursued this particular approach further.
It has been found that a long run of bases that do not contain a G binds to the matrix . MAR-Wiz  allows users to use this rule where it is translated into their formalism as a motif of 20 consecutive Hs (i.e. each of the 20 bases is an A, T or C) and allowing no mismatches. We call this MAR-Wiz implementation the H'-Rule. We have also implemented a version, which we call the H-Rule, which is a simple count of the number of occurrences (possibly overlapping) of a motif of 20 consecutive Hs on either strand in a moving window of 1000 bases, allowing two mismatches. We have quoted most of our results for this latter measure as it usually performs better, but as we discuss there are some interesting features of the H'-Rule.
The two part motif AATAAYAA and AWWRTAANNWWGNNNC has been suggested by van Drunen et al.  to be an indicator of an S/MAR, where Y = C or T, W = A or T, R = A or G, and N = A or C or G or T.
These motifs should appear within about 200 bp of each other and can be on either strand, in either order and may even be overlapping. The 8 base part should match exactly and the 16 base part is allowed one base mismatch. The authors found that this signature identified 80% of S/MARs in their test set.
Frisch et al.  explain in general terms that SMARTest is based on 97 weight matrices, describing motifs of length 10 to 21 bases, which are AT-rich. These motifs were obtained by automatic searching in 34 known animal and plant S/MARs. Their testing on an independent test set gave comparatively good results finding 14 out of 37 known S/MARs and 19 out of 28 predictions to be correct–that is a sensitivity of 38% and precision of 68%, where sensitivity = , and precision (sometimes called specificity) = , where TP = number of true positives, FP = number of false positives, FN = number of false negatives. Note that it was possible for more than one "prediction" to predict the same S/MAR. The same authors compared MAR-Finder on the same data and in their hands it found 12 out of 37 known S/MARs and 20 out of 25 predictions to be correct–that is a sensitivity of 32% and a precision of 80%. We used the SMARTest program as supplied on the public website.
We have used the package as supplied from the public website  and we have used the results for "predicted S/MARs" ignoring any output for the MRS and using the column "score" as a variable threshold in the ROC analyses. In the figures giving ROC curves, "C" marks the point where all the predictions of ChrClass for "predicted S/MARs" are included.
SIDD calculations predict where the DNA strands can easily separate: it has been suggested that this is an indication of the presence of an S/MAR . This is plausible both because DNA melting tends to occur in regions high in AT and there is some association of S/MARs with origins of replication [31, 32].
These calculations assume that DNA is under torsional stress and it will relieve this stress by melting. Energy is needed to separate the strands but the energy needed to twist a pair of separated strands is less than the energy to twist the equivalent length of double stranded DNA. These facts form the basis of a thermodynamic model [19, 33, 34] which calculates the energies and probabilities of different states with different positions of base separation. One output is the p-graph which gives the probability that a given base pair is separated–typically this graph shows a peak in a small region and is close to zero elsewhere. The G-graph gives the average energy which has to be put into the system for a given base pair to separate and is normally a more sensitive measure: following the advice in the references this is the quantity we have used for the duplex destabilisation method. We were able to get results corresponding to the public website up to an (inconsequential) off-set of about 1.5 to 2.0 kcal between the website results and our calculations for a given sequence.
Details of the method are in the above references. In short, the calculations are extremely time consuming, and we have limited the analysis to thermodynamic states of one or two open windows, on the grounds that this gives a good approximation to the result given with more open windows. Otherwise we used the default parameters of the public website. The reported results are based on calculations on a sequence length of 10 kb: exploratory analyses with longer and shorter sequences give similar results (not shown).
As noted in the introduction, the authors of [2, 19, 21] present a number of ideas and results but do not claim to give a prediction algorithm. This implementation takes the obvious step of testing whether the G-graph crosses below a given threshold.
Thermodyn is a calculation of the free energy of strand separation derived from summing the contributions of each doublet in a window to the thermodynamic quantities ΔH and ΔS . Its use in the context of finding S/MARs comes from Kieffer et al.  where it was used to check for the plausibility of the S/MARs found in that experiment. The formulae are straightforward to program and we have tried Thermodyn as a predictor in our analyses. After some experimenting, we used a window size of 1000 bases.
A simple measure of AT-percentage was also tried as a control: this was calculated as the proportion of bases that are A or T in a sliding window of 300 bases. This proportion was associated with the central base of the window.
The additional files contain our C++ code for calculating several of these measures [see Additional file 10].
Test Sets and Analytical Procedure
Positive Test Set
To evaluate the S/MAR predictors we constructed a test set of known S/MARs. S/MARs are defined according to one of several experimental protocols. There is some controversy in the field as to the validity of the protocols  and the underlying biology is still being clarified : we therefore give a short explanation of the operational definitions.
In most in vitro selection protocols, the nuclei are isolated from cells, and the nuclear scaffolds are fractionated from these nuclei with either LIS-containing buffer–that is a low salt extraction buffer containing lithium diiodosalicylate–or a high-salt buffer. The nuclear scaffolds are digested with restriction enzymes, incubated with labelled DNA fragments in the presence of some competitor DNA and centrifugated. The DNA is purified and analysed on agarose gel and via autoradiography . The first steps in the usual in vivo selection protocols are the same, but after restriction digest, the nuclear scaffolds are directly centrifugated. The DNA is purified from both supernatant (non-S/MAR) and pellet (S/MAR) fraction and analysed on agarose gel and southern hybridisation [4, 37], or directly cloned and sequenced . For UV-crosslinking the cells are UV-radiated, and the nuclear lamina is purified. The DNA fragments covalently linked to the lamina proteins in vivo are cloned and sequenced . In the topoisomerase II cleavage assay, an incubation with topoisomerase II is followed by Proteinase K digest, phenol-extraction and DNA purification. The analysis of the DNA fragments is done by gel electrophoresis, restriction digests, Southern transfer, hybridisation, and PCR amplification .
It can be seen that there are a number of ways in which subtypes of S/MARs might be defined according to the experimental definition. One division of the protocols is into in vivo protocols which find S/MARs as they occur in cells and in vitro protocols which test if known sequences of DNA can act as S/MARs. Another interesting division is between those protocols which use LIS and those that do not–the former is thought to be a more disruptive technique and hence finds fewer S/MARs.
We obtained our positive sequences from two sources, about two thirds from the S/MARt DB, which is built up from a literature search , and one third from the S/MARs found in the experiment of Purbowasito et al.  for one sequence of one megabase. In both cases, the defined mouse and human sequences were blasted against the mouse genome (asssembly build NCBIM33) or human genome (assembly build NCBI35) to find the surrounding chromosomal sequence. In essence the reported analyses refer to the S/MAR sequences themselves, but there are several reasons why the analyses need the surrounding sequence–for example many of the methods use moving windows of length 1 kb. As noted below we also credit the methods with near misses. To make sure these minor needs have been met, the analyses have used a sequence of 10 kb with the S/MAR in the middle. Knowing the surrounding sequence has also allowed a number of exploratory analyses of the 100 kb region. The additional material contains various tables giving the DNA sequence, reference identifier and further information about the data we used [see Additional files 11, 12, 13].
The Purbowasito experiment  was based on an in vitro binding assay using high salt and this provided a further 52 S/MARs to make a total of 165 S/MARs. We also checked that no S/MAR was included twice in the dataset.
Control Test Sets
We evaluated the performance of the S/MAR predictors on the positive test set by comparing the performance against a control test set. We have four control datasets, which we call "background", "coding", "negative" and "E. coli". We regard the background test set as the most useful for this purpose: the choice of control dataset is discussed in the Discussion section.
Each control set consists of 330 sequences and was used in the same way. A sub-sequence in the middle of each sequence was imagined to be an S/MAR and part of the analysis was to see if the imaginary S/MAR was (wrongly) identified by the prediction methods. We call the imaginary S/MAR a pseudo S/MAR. The chance of finding the pseudo S/MAR increases with its length and to control for this we matched two sequences in the background set to one sequence in the positive test set and assumed that each of the pseudo S/MARs had the same length as the matched real S/MAR.
The background test set was assembled by selecting sequences at random from the mouse genome. If a sequence contained an undefined base, an N, then that sequence was discarded and another one chosen. The coding test set was prepared by concatenating coding sequences and then dividing the concatenation into long sections. The coding sequences were taken to be the exons of coding proteins, excluding the first and last exon, from ENSEMBL mouse assembly 33. The negative test set consists of artificial sequences derived from a 3rd order Markov model: that is each sequence was built by adding a base chosen at random based on the conditional probabilities of the three preceding bases. These probabilities were derived by sampling sequences from the whole of the mouse genome. The E. coli test set is a selection of non-overlapping sequences from the E. coli K12 substrain MG1655 taken from GenBank sequence reference U00096.
The profile of each of the measures was calculated for each sequence in the test sets and an S/MAR is predicted where the measure shows a peak. However, the precise algorithm will contain parameters for the necessary height and width of the peak. The height or threshold can be varied to alter the balance between the proportion of S/MARs found and the false positive rate.
We also included two parameters to allow predictions to be successful for near misses. These parameters were set in the light of the following information. It is known that functional S/MARs can be very short and one set of experiments found there is no need to make S/MARs longer than 300 bases . We gave statistics above on the length of S/MARs in the dataset. The authors of MAR-Finder advise that in their method there should be a significant value, for a sliding window of 1000 bases, at three consecutive positions 100 bases apart on the assumption that S/MARs are about 600 bases long.
The following procedure has been adopted. The measure had to exceed the threshold for at least a given number of bases, x. For MAR-Finder and the MAR-Finder version of the H-Rule x was taken to be 201 bases (for the reason explained above) and for all other methods x was taken to be 1. These islands were then extended on each side by y bases, y being chosen to make up the run to 600 bases, i.e. y was 200 for MAR-Finder and 300 for the other methods, y was put equal to 0 for Thermodyn and the H-Rule as this worked well for these methods. Given the lack of ambiguity for the ChrClass and SMARTest methods, we used the predictions as they stood–i.e. x is irrelevant, and y was taken as 10 as a protection against any difficulties in finding the S/MAR in the genome assembly.
Islands which were less than z bases apart were then merged: i.e. the region between the islands regarded as part of the larger S/MAR. z was taken as 100 bases. Any method of analysis will have implicit values for x, y and z. However, our exploratory analyses show that our conclusions are robust over a wide range of these parameters.
Finally the method is taken to have predicted a particular S/MAR or pseudo S/MAR if any one of its bases has been identified as part of an S/MAR by this procedure.
AH was supported by a HFSPO LT fellowship. AH and SO were supported by Wellcome Trust Functional Genomics Grants on Stem Cells and on Developmental Neuroscience awarded to GK (066790/E/02/Z). KE did much of this work while supported under the Wellcome Trust Functional Genomics programme grant awarded to LW and GK. We thank the referees for their helpful comments.
- Boulikas T: Chromatin domains and prediction of MAR sequences. Int Rev Cytol 1995, 162A: 279–388.PubMedGoogle Scholar
- Goetze S, Baer A, Winkelmann S, Nehlsen K, Seibler J, Maass K, Bode J: Performance of genomic bordering elements at predefined genomic loci. Mol Cell Biol 2005, 25: 2260–2272. 10.1128/MCB.25.6.2260-2272.2005PubMed CentralView ArticlePubMedGoogle Scholar
- Heng HHQ, Goetze S, Ye CJ, Liu G, Stevens JB, Bremer SW, Wykes SM, Bode J, Krawetz SA: Chromatin loops are selectively anchored using scaffold/matrix-attachment regions. J Cell Sci 2004, 117: 999–1008. 10.1242/jcs.00976View ArticlePubMedGoogle Scholar
- Levy-Wilson B, Fortier C: The limits of the DNase I-sensitive domain of the human apolipoprotein B gene coincide with the locations of chromosomal anchorage loops and define the 5' and 3' boundaries of the gene. J Biol Chem 1989, 264: 21196–21204.PubMedGoogle Scholar
- Widak W, Widlak P: MAR/SAR elements flank the rat HST70 gene transcription unit. Cell Mol Biol Lett 2004, 9: 123–133.Google Scholar
- Cockerill PN, Yuen MH, Garrard WT: The Enhancer of the immunoglobulin heavy chain locus is flanked by presumptive chromosomal loop anchorage elements. J Biol Chem 1987, 262: 5394–5397.PubMedGoogle Scholar
- Walter WR, Singh GB, Krawetz SA: MARs mission update. Biochem Biophys Res Commun 1998, 242: 419–422. 10.1006/bbrc.1997.7939View ArticlePubMedGoogle Scholar
- Allen GC, Spiker S, Thompson WF: Use of matrix attachment regions (MARs) to minimize transgene silencing. Plant Molecular Biology 2000, 43: 361–376. 10.1023/A:1006424621037View ArticlePubMedGoogle Scholar
- Girod PA, Zahn-Zabal M, Mermod N: Use of the chicken lysozyme 5' matrix attachment region to generate high producer CHO cell lines. Biotechnol Bioeng 2005, 91: 1–11. 10.1002/bit.20563View ArticlePubMedGoogle Scholar
- Frisch M, Freeh K, Klingenhoff A, Cartharius K, Liebich I, Werner T: In silico prediction of scaffold/matrix attachment regions in large genomic sequences. Genome Res 2002, 12: 349–354. 10.1101/gr.206602. Article published online before print in January 2002PubMed CentralView ArticlePubMedGoogle Scholar
- Singh GB, Kramer JA, Krawetz SA: Mathematical model to predict regions of chromatin attachment to the nuclear matrix. Nucleic Acids Res 1997, 25: 1419–1425. 10.1093/nar/25.7.1419PubMed CentralView ArticlePubMedGoogle Scholar
- van Drunen CM, Sewalt RGAB, Oosterling RW, Weisbeek PJ, Smeekens SCM, van Driel R: A bipartite sequence element associated with matrix/scaffold attachment regions. Nucleic Acids Res 1999, 27: 2924–2930. 10.1093/nar/27.14.2924PubMed CentralView ArticlePubMedGoogle Scholar
- Wang B, Dickinson LA, Koivunen E, Ruoslahti E, Kohwi-Shigematsu T: A novel matrix attachment region DNA binding motif identified using a random phage peptide library. J Biol Chem 1995, 270: 23239–23242. 10.1074/jbc.270.40.23239View ArticlePubMedGoogle Scholar
- Dickinson LA, Joh T, Kohwi Y, Kohwi-Shigematsu T: A tissue-specific MAR/SAR DNA-binding protein with unusual binding site recognition. Cell 1992, 70: 631–645. 10.1016/0092-8674(92)90432-CView ArticlePubMedGoogle Scholar
- On the MAR-wiz website, the H-Rule is credited to unreferenced work on rice by Alexander Tikhonov of Purdue University
- Glazko GV, Rogozin IB, Glazkov MV: Comparative study and prediction of DNA fragments associated with various elements of the nuclear matrix. Biochim Biophys Acta 2001, 1517: 351–364.View ArticlePubMedGoogle Scholar
- Huang Y, Kowalski D: WEB-THERMODYN: sequence analysis software for profiling DNA helical stability. Nucleic Acids Res 2003, 31: 3819–3821. 10.1093/nar/gkg562PubMed CentralView ArticlePubMedGoogle Scholar
- Kieffer LJ, Greally JM, Landres I, Nag S, Nakajima Y, Kohwi-Shigematsu T, Kavathas PB: Identification of a candidate regulatory region in the human CD8 gene complex by colocalization of DNase I hypersensitive sites and matrix attachment regions which bind SATB1 and GATA-3. J Immunol 2002, 168: 3915–3922.View ArticlePubMedGoogle Scholar
- Benham C, Kohwi-Shigematsu T, Bode J: Stress-induced duplex DNA destabilization in scaffold/matrix attachment regions. J Mol Biol 1997, 274: 181–196. 10.1006/jmbi.1997.1385View ArticlePubMedGoogle Scholar
- Goetze S, Gluch A, Benham C, Bode J: Computational and in-vitro analysis of destabilized DNA regions in the interferon gene cluster: potential of predicting function gene domains. Biochemistry 2003, 42: 154–166. 10.1021/bi026496+View ArticlePubMedGoogle Scholar
- Bode J, Winkelmann S, Götze S, Spiker S, Tsutsui K, Bi C, Prashanth AK, Benham C: Correlations between scaffold/matrix attachment region (S/MAR) binding activity and DNA duplex destabilization energy. J Mol Biol 2006, 358: 597–613. 10.1016/j.jmb.2005.11.073View ArticlePubMedGoogle Scholar
- Krawetz SA, Draghici S, Goodrich R, Liu Z, Ostermeier GC: In silico and wet-bench identification of nuclear attachment regions. Methods Mol Med 2005, 108: 439–458.PubMedGoogle Scholar
- Rogozin IB, Glazko GV, Glazkov MV: Computer prediction of sites associated with various elements of the nuclear matrix. Brief Bioinform 2000, 1: 33–44. 10.1093/bib/1.1.33View ArticlePubMedGoogle Scholar
- Purbowasito W, Suda C, Yokomine T, Zubair M, Sado T, Tsutsui K, Sasaki H: Large-scale identification and mapping of nuclear matrix-attachment regions in the distal imprinted domain of mouse chromosome 7. DNA Res 2004, 11: 391–407. 10.1093/dnares/11.6.391View ArticlePubMedGoogle Scholar
- Donev R, Horton R, Beck S, Doneva T, Vatcheva R, Bowen RW, Sheer D: Recruitment of heterogeneous nuclear ribonucleoprotein A1 in vivo to the LMP/TAP region of the major histocompatibility complex. J Biol Chem 2003, 278: 5214–5226. 10.1074/jbc.M206621200View ArticlePubMedGoogle Scholar
- Ostermeier GC, Liu Z, Martins RP, Bharadwaj RR, Ellis J, Draghici S, Krawetz SA: Nuclear matrix association of the human β -globin locus utilizing a novel approach to quantitative real-time PCR. Nucleic Acids Res 2003, 31: 3257–3266. 10.1093/nar/gkg424PubMed CentralView ArticlePubMedGoogle Scholar
- Liebich I, Bode J, Reuter I, Wingender E: Evaluation of sequence motifs found in scaffold/matrix-attached regions (S/MARs). Nucleic Acids Res 2002, 30: 3433–3442. 10.1093/nar/gkf446PubMed CentralView ArticlePubMedGoogle Scholar
- Adrian M, ten Heggeler-Bordier B, Wahli W, Stasiak AZ, Stasiak A, Dubochet J: Direct visualization of supercoiled DNA molecules in solution. EMBO J 1990, 9: 4551–4554.PubMed CentralPubMedGoogle Scholar
- Kramer JA, Krawetz SA: Nuclear matrix interactions within the sperm genome. J Biol Chem 1996, 271: 11619–11622. 10.1074/jbc.271.37.22915View ArticlePubMedGoogle Scholar
- Girard-Reydet C, Gregoire D, Vassetzky Y, Mechali M: DNA replication initiates at domains overlapping with nuclear matrix attachment regions in the xenopus and mouse c-myc promoter. Gene 2004, 332: 129–138. 10.1016/j.gene.2004.02.031View ArticlePubMedGoogle Scholar
- Koina E, Piper A: An inactive X specific replication origin associated with a matrix attachment region in the human X linked HPRT gene. J Cell Biochem 2005, 95: 391–402. 10.1002/jcb.20425View ArticlePubMedGoogle Scholar
- Benham CJ, Bi C: The analysis of stress-induced duplex destabilization in long genomic DNA sequences. J Comput Biol 2004, 11: 519–543. 10.1089/cmb.2004.11.519View ArticlePubMedGoogle Scholar
- Bi C, Benham CJ: The approximate algorithm for analysis of the strand separation transition in superhelical DNA using nearest neighbor energetics. Proc IEEE Comp Soc Bioinformatics 2003, 460–461. [http://bipad.cmh.edu/SIDD_Stanford2003.pdf]Google Scholar
- Perderson T: Half a century of the "Nuclear Matrix". Mol Biol Cell 2000, 11: 799–805.View ArticleGoogle Scholar
- Branco MR, Pombo A: Intermingling of chromosome territories in interphase suggests role in translocations and transcription-dependent associations. PLoS Biology 2006., 4: [DOI:10.1371/journal.pbio.0040138] [DOI:10.1371/journal.pbio.0040138]Google Scholar
- Rollini P, Namciu SJ, Marsden MD, Fournier RE: Identification and characterization of nuclear matrix-attachment regions in the human serpin gene cluster at 14q32.1. Nucleic Acids Res 1999, 27: 3779–3791. 10.1093/nar/27.19.3779PubMed CentralView ArticlePubMedGoogle Scholar
- Will K, Warnecke G, Albrechtsen N, Boulikas T, Deppert W: High affinity MAR-DNA binding is a common property of murine and human mutant p53. J Cell Biochem 1998, 69: 260–270. Publisher Full Text 10.1002/(SICI)1097-4644(19980601)69:3%3C260::AID-JCB4%3E3.0.CO;2-PView ArticlePubMedGoogle Scholar
- Christova R, Bach I, Galcheva-Gargova Z: Sequences of DNA fragments contacting the nuclear lamina in vivo. DNA Cell Biol 1992, 11: 627–636.View ArticlePubMedGoogle Scholar
- Lagarkova MA, Svetlova E, Giacca M, Falaschi A, Razin SV: DNA loop anchorage region colocalizes with the replication origin located downstream to the human gene encoding lamin B2. J Cell Biochem 1998, 69: 13–18. Publisher Full Text 10.1002/(SICI)1097-4644(19980401)69:1%3C13::AID-JCB2%3E3.0.CO;2-YView ArticlePubMedGoogle Scholar
- Liebich I, Bode J, Frisch M, Wingender E: S/MARt DB: a database on scaffold/matrix attached regions. Nucleic Acids Res 2002, 30(1):372–374. 10.1093/nar/30.1.372PubMed CentralView ArticlePubMedGoogle Scholar
- Boulikas T, Kong CF: Multitude of inverted repeats characterizes a class of anchorage site of chromatin loops to the nuclear matrix. J Cell Biochem 1993, 53: 1–12. 10.1002/jcb.240530102View ArticlePubMedGoogle Scholar
- Goldberg GI, Collier I, Cassel A: Specific DNA sequences associated with the nuclear matrix in synchronized mouse 3T3 cells. Proc Natl Acad Sci USA 1983, 80: 6887–6891. 10.1073/pnas.80.22.6887PubMed CentralView ArticlePubMedGoogle Scholar
- Jackson DA, Bartlett J, Cook PR: Sequences attaching loops of nuclear and mitochondrial DNA to underlying structures in human cells: the role of transcription units. Nucleic Acids Res 1996, 24: 1212–1219. 10.1093/nar/24.7.1212PubMed CentralView ArticlePubMedGoogle Scholar
- Jarman AP, Higgs DR: Nuclear scaffold attachment sites in the human globin gene complexes. EMBO J 1988, 7: 3337–3344.PubMed CentralPubMedGoogle Scholar
- Kramer JA, Adams MA, Singh GB, Dogget NA, Krawetz SA: Extended analysis of the region encompassing the PRM1 → PRM2 → TNP2 domain: genomic organization, evolution and gene identification. J Exp Zool 1998, 282: 245–243. Publisher Full Text 10.1002/(SICI)1097-010X(199809/10)282:1/2%3C245::AID-JEZ26%3E3.0.CO;2-RView ArticlePubMedGoogle Scholar
- Bode J, Maass K: Chromatin domain surrounding the human interferon-beta gene as defined by scaffold attachment regions. Biochemistry 1988, 27: 4706–4711. 10.1021/bi00413a019View ArticlePubMedGoogle Scholar
- Chou RH, Churchill JR, Flubacher MM, Mapstone DE, Jones J: Identification of a nuclear matrix-associated region of the c-myc protooncogene and its recognition by a nuclear protein in the human leukemia HL-60 cell line. Cancer Res 1990, 50: 3199–3206.PubMedGoogle Scholar
- Fischer DP, van Drunen CM, Winkler GS, van de Putte P, Backendorf C: Involvement of a nuclear matrix association region in the regulation of the SPRR2A keratinocyte terminal differentiation marker. Nucleic Acids Res 1998, 26: 5288–5294. 10.1093/nar/26.23.5288PubMed CentralView ArticlePubMedGoogle Scholar
- Hanson RD, Ley TJ: A-T-rich scaffold attachment regions flank the hematopoietic serine protease genes clustered on chromosome 14q11.2. Blood 1992, 79: 610–618.PubMedGoogle Scholar
- Romig H, Ruff J, Fackelmayer FO, Patil MS, Richter A: Characterization of two intronic nuclear-matrix-attachment regions in the human topoisomerase I gene. Eur J Biochem 1994, 221: 411–419. 10.1111/j.1432-1033.1994.tb18753.xView ArticlePubMedGoogle Scholar
- Zhong XP, Carabana J, Krangel MS: Flanking nuclear matrix attachment regions synergize with the T cell receptor delta enhancer to promote V(D)J recombination. PNAS USA 1999, 96: 11970–11975. 10.1073/pnas.96.21.11970PubMed CentralView ArticlePubMedGoogle Scholar
- Kramer JA, Krawetz SA: PCR-based assay to determine nuclear matrix association. BioTechniques 1997, 22: 826–828.PubMedGoogle Scholar
- Avramova Z, Paneva E: Matrix attachment sites in the murine alpha-globin gene. Biochem Biophys Res Commun 1992, 182: 78–85. 10.1016/S0006-291X(05)80114-7View ArticlePubMedGoogle Scholar
- Banan M, Rojas IC, Lee WH, King HL, Harriss JV, Kobayashi R, Web CF, Gottlieb PD: Interaction of the nuclear matrix-associated region (MAR)-binding proteins, SATB1 and CDP/Cux, with a MAR element (L2a) in an upstream regulatory region of the mouse CD8a gene. J Biol Chem 1997, 272: 18440–18452. 10.1074/jbc.272.29.18440View ArticlePubMedGoogle Scholar
- Chattopadhyay S, Whitehurst CE, Chen J: A nuclear matrix attachment region upstream of the T cell receptor beta gene enhancer binds Cux/CDP and SATB1 and modulates enhancer-dependent reporter gene expression but not endogenous gene expression. J Biol Chem 1998, 273: 29838–29846. 10.1074/jbc.273.45.29838View ArticlePubMedGoogle Scholar
- Chernov IP, Akopov SB, Nikolaev LG, Sverdlov ED: Identification and mapping of nuclear matrix-attachment regions in a one megabase locus of human chromosome 19q13.12: long-range correlation of S/MARs and gene positions. J Cell Biochem 2002, 84: 590–600. 10.1002/jcb.10043View ArticlePubMedGoogle Scholar
- Chong S, Taylor KA, Piper AA: Intragenic matrix attachment and DNA-protein interactions in the human X-linked Hprt gene. Biochim Biophys Acta 1995, 1264: 103–114.View ArticlePubMedGoogle Scholar
- Cunningham JM, Purucker ME, Jane SM, Safer B, Vanin EF, Ney PA, Lowrey CH, Nienhuis AW: The regulatory element 3' to the gammaA-globin gene binds to the nuclear matrix and interacts with special A-T-rich binding protein (SATB1), an SAR/MAR-associating region DNA binding protein. Blood 1994, 84: 1298–1308.PubMedGoogle Scholar
- deBelle I, Cai S, Kohwi-Shigematsu T: The genomic sequences bound to special AT-rich sequence-binding protein 1 (SATB1) in vivo in Jurkat T cells are tightly associated with the nuclear matrix at the bases of the chromatin loops. J Cell Biol 1998, 141: 335–348. 10.1083/jcb.141.2.335View ArticleGoogle Scholar
- Engel H, Ruehl H, Benham CJ, Bode J, Weiss S: Germ-line transcripts of the immunoglobulin lambda J-C clusters in the mouse: characterization of the initiation sites and regulatory elements. Mol Immunol 2001, 38: 289–302. 10.1016/S0161-5890(01)00056-6View ArticlePubMedGoogle Scholar
- Mielke C, Maass K, Tuemmler M, Bode J: Anatomy of highly expressing chromosomal sites targeted by retroviral vectors. Biochemistry 1996, 35: 2239–2252. 10.1021/bi952393yView ArticlePubMedGoogle Scholar
- Nikolaev LG, Tsevegiyn T, Akopov SB, Ashworth LK, Sverdlov ED: Construction of a chromosome specific library of human MARs and mapping of matrix attachment regions on human chromosome 19. Nucleic Acids Res 1996, 24: 1330–1336. 10.1093/nar/24.7.1330PubMed CentralView ArticlePubMedGoogle Scholar
- Porter S, Larue L, Mintz B: Mosaicism of tyrosinase-locus transcription and chromatin structure in dark vs. light melanocyte clones of homozygous chinchilla-mottled mice. Dev Genet 1991, 12: 393–402. 10.1002/dvg.1020120604View ArticlePubMedGoogle Scholar
- Singh L, Panicker SG, Nagaraj R, Majumdra KC: Banded krait minor-satellite (Bkm)-associated Y chromosome-specific repetitive DNA in mouse. Nucleic Acids Res 1994, 22: 2289–2295. 10.1093/nar/22.12.2289PubMed CentralView ArticlePubMedGoogle Scholar
- Sperry AO, Blasquez VC, Garrard WT: Dysfunction of chromosomal loop attachment sites: illegitimate recombination linked to matrix association regions and topoisomerase II. Proc Natl Acad Sci USA 1989, 86: 5497–5501. 10.1073/pnas.86.14.5497PubMed CentralView ArticlePubMedGoogle Scholar
- Strissel PL, Dann HA, Pomykala HM, Diaz MO, Rowley JD, Olopade OI: Scaffold-associated regions in the human type I interferon gene cluster on the short arm of chromosome 9. Genomics 1998, 47: 217–229. 10.1006/geno.1997.5103View ArticlePubMedGoogle Scholar
- Sykes RC, Lin D, Hwang SJ, Framson PE, Chinault AC: Yeast ARS function and nuclear matrix association coincide in a short sequence from the human HPRT locus. Mol Gen Genet 1988, 212: 301–309. 10.1007/BF00334700View ArticlePubMedGoogle Scholar
- Webb CF, Das C, Eneff KL, Tucker PW: Identification of a matrix-associated region 5' of an immunoglobulin heavy chain variable region gene. Mol Cell Biol 1991, 11: 5206–5211.PubMed CentralView ArticlePubMedGoogle Scholar
- Lenartowski R, Goc A: Tissue-specific association of the human tyrosine hydroxylase gene with the nuclear matrix. Neurosci Lett 2002, 330: 151–154. 10.1016/S0304-3940(02)00746-2View ArticlePubMedGoogle Scholar
- Kipp M, Göhring F, Ostendorp T, van Drunen CM, van Driel R, Przybylski M, Fackelmayer FO: SAF-Box, a conserved protein domain that specifically recognizes scaffold attachment region DNA. Mol Cell Biol 2000, 20: 7480–7489. 10.1128/MCB.20.20.7480-7489.2000PubMed CentralView ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.