# Two molecular measures of relatedness based on haplotype sharing

- David Edwards
^{1}Email author

**Received: **26 July 2015

**Accepted: **29 October 2015

**Published: **11 November 2015

## Abstract

### Background

Measuring the extent of shared ancestry between individuals or organisms is important in many fields, including forensic science, conservation genetics and animal breeding. The traditional approach is to calculate the expected degree of relatedness between individuals in a pedigree. This assumes that the founders of the pedigree are non-inbred and unrelated to each other, which is rarely the case. In contrast, molecular data allow measurement of actual relatedness without knowledge of a pedigree. Methods to do this have been proposed, but generally do not take the lengths of the genomic regions shared between individuals into account.

### Results

Two measures based on the extent of haplotype sharing between genomes are proposed. The intercept measure *B* estimates the fraction of shared genome between individuals, and the product measure *C* is closely related to the numerator relationship matrix *A*. Both are based on a model for the joint distribution of markers at the haplotype level. The two measures are compared to the pedigree-based measure *A* and to vanRaden’s *G*, a frequently used molecular measure, using a set of data comprising 5037 dairy cattle. The comparison criteria include the ability to capture genealogical relatedness and the prediction accuracy obtained when used in genomic prediction. Both *B* and *C* explain around 95 *%* of the variation in *A*, whereas *G* explains around 6 *%*. *G* captures genealogical relatedness poorly, particularly for distantly related individuals (second cousins or farther). Both *B* and *C* tend to be larger than *A* but this can be ascribed to the assumption of non-inbred unrelated founders. Using *C* in linear mixed models results in slightly higher prediction accuracy than *G*, and using *B* results in slightly lower prediction accuracy.

### Conclusions

The two proposed measures of relatedness capture genealogical relatedness well, outperforming vanRaden’s *G* in this respect. When used in genomic prediction models, the product measure leads to slightly improved prediction accuracy.

### Keywords

Genomic relationship matrix Multiset Acyclic probabilistic finite automata Haplotype sharing## Background

Estimating the extent of shared ancestry between individuals or organisms is central to many fields. Examples range from forensic science [1], studies of population structure [2, 3], and conservation genetics [4], to the mixed linear models used in genomic prediction and genome-wide association studies [5, 6].

Following Malêcot [7], measures of relatedness between two individuals are generally formulated in terms of the coefficient of coancestry, which is the probability that for a randomly selected gene, two alleles, one taken at random from each individual, descend from a single ancestral gene — that is, the probability that the alleles are identical-by-descent (IBD). Similarly, a measure of inbreeding for an individual is defined as the probability that the two alleles of a randomly selected gene are IBD [7]. When a pedigree is available, probabilities that two alleles are IBD from common ancestors within the pedigree can be calculated, and from these the classical measures of relatedness and inbreeding can be derived. The calculations typically assume that the founders are unrelated and not inbred, which is rarely the case. The measures depend on the choice of pedigree, and represent expected rather than realized relatedness and inbreeding, since they cannot incorporate the randomness inherent in meiosis.

With the advent of high-scale genotyping technologies such as single nucleotide polymorphism (SNP) arrays, it is possible to estimate realized relatedness directly from molecular data without knowledge of genealogy, and a variety of ways to do this are available [8, 9]. These generally take the form of genome-wise averages of single-SNP statistics, which have the disadvantage of not taking the lengths of genomic regions shared between two individuals into account [8]. In Section “Methods,” two novel measures based on the extent of haplotype sharing are described, and their properties studied. In Section “Results” the methods are applied to a set of data from dairy cattle, and compared to the classical pedigree-based measure and a measure due to vanRaden [10] that is widely used in animal breeding. Section “Software” describes the software used and Section “Discussion” gives a brief discussion.

## Methods

The methods developed in this paper are based on the following conceptual framework. The genome is divided into a series of physical intervals, and the variant DNA strings that may occur in the intervals are denoted *segments*. To each interval corresponds a set of segments that may occur in the interval, and these sets do not overlap: a segment that may occur in one interval may not occur in another. With some abuse of terminology one may identify the intervals with genes, and the possible segments with alleles. A specific genome is regarded as a collection of segments, and measures of relatedness between genomes are constructed in terms of similarity between such collections. For this the concept of a multiset is needed.

### Multisets

A multiset [11] is a generalization of the concept of a set that, unlike a set, allows multiple instances of its elements. The multiplicity of an element is the number of instances of the element in the multiset. For example, [2 figs, 5 pears, 3 plums ] is a multiset in which the element fig has multiplicity two. Note the use of square brackets [] to distinguish multisets from ordinary sets using curly brackets {}. A multiset corresponds to an ordinary set if the multiplicity of every element is one or zero.

Multiset intersection is a generalization of set intersection. The intersection of two multisets is formed by taking the minima of the multiplicities of the corresponding elements in the two multisets. For example:

[2 figs, 5 pears, 3 plums] ∩ [1 fig, 10 pears, 0 plums] = [1 fig, 5 pears, 0 plums].

The sum and product multiset operators, represented by + and × respectively, use the straightforward element-wise operations, for example:

[2 figs, 5 pears, 3 plums] + [1 fig, 10 pears, 0 plums] = [3 figs, 15 pears, 3 plums], and

[2 figs, 5 pears, 3 plums] × [1 fig, 10 pears, 0 plums] = [2 figs, 50 pears, 0 plums].

*A*is written |

*A*|. Some useful properties of the operators include the equations

that hold for any multisets *A*, *B* and *C* [11].

### Two measures of genomic relatedness

As described above a genome is taken to be composed of a collection of segments, taken from a larger pool of segments \({\mathcal {S}}\). Let *G*
_{
i
} represent the genome of individual *i*, regarded as a collection of segments *s* in \({\mathcal {S}}\). Since there may be duplicates, *G*
_{
i
} is a multiset. Let *x*
_{
is
} represent the multiplicity of segment *s* in *G*
_{
i
}.

Let there be *p* intervals (loci). For \(s \in {\mathcal {S}}\), let *l*(*s*)∈{1,…,*p*} indicate the interval associated with segment *s*. At each interval, an individual genome has two segments, corresponding to its two haplotypes. Thus each genome has in all 2*p* segments.

*i*and

*j*the intersect measure of their similarity is defined as the cardinality of the intersection of the two genomes, divided by the total number of segments:

where *x*∧*y* is the minimum of *x* and *y*. Since |*G*
_{
i
}|=2*p*, we have *b*
_{
ii
}=1 for all *i*. For all *i* and *j*, 0≤*b*
_{
ij
}≤1. Also *b*
_{
ij
}=0 iff *G*
_{
i
} and *G*
_{
j
} have no common segments, and *b*
_{
ij
}=1 iff *G*
_{
i
} and *G*
_{
j
} are identical.

We have 0≤*c*
_{
ij
}≤2 for all *i* and *j*, with *c*
_{
ij
}=0 iff *G*
_{
i
} and *G*
_{
j
} have no common segments. In matrix terms *C*=(*c*
_{
ij
}) can be written as *C*=*X*
*X*
^{
T
}/2*p* where *X*=(*x*
_{
is
}) is the \(N \times |{\mathcal {S}}|\) matrix of multiplicities.

*x*and

*y*take values in {0,1,2},

*xy*is given by , and

*x*∧

*y*by , so

*x*

*y*=2(

*x*∧

*y*)−

*I*(

*x*=

*y*=1), where

*I*is the indicator function. It follows that

*κ*

_{ ij }, a measure of shared heterozygosity, is defined as

*x*∈{0,1,2},

*x*

^{2}=

*x*+2

*I*(

*x*=2), so

*f*

_{ i }, a measure of homozygosity of individual

*i*, is

*C*to the numerator relationship matrix [12], let

*θ*

_{ ij }be the coefficient of coancestry between individuals

*i*and

*j*, that is, the probability that for a randomly selected gene, two alleles, one taken at random from each individual, are IBD [7]. Define

*𝜗*

_{ ij }similarly as the probability that for a randomly selected gene, two alleles, one taken at random from each individual, are identical, that is, identical-by-state (IBS). For

*k*=1,…,

*p*, write the two segments of individual

*i*at interval

*k*as \((s_{i1}^{k}, s_{i2}^{k})\), and similarly \((s_{j1}^{k}, s_{j2}^{k})\) for individual

*j*. Then for

*i*≠

*j*,

Note that *𝜗*
_{
ij
} is the probability of an event randomly chosen from the 4*p* identities on the right-hand side of Eq. (4). Hence *𝜗*
_{
ij
}=2*p*
*c*
_{
ij
}/4*p*, and so *c*
_{
ij
}=2*𝜗*
_{
ij
}. Thus *c*
_{
ij
} is twice the IBS-sense coefficient of coancestry *𝜗*
_{
ij
}.

*θ*

_{ i }be the coefficient of inbreeding for individual

*i*, that is, the probability that for a randomly selected gene, the two alleles are IBD [7], and let

*𝜗*

_{ i }be the corresponding IBS-sense quantity. When

*i*=

*j*, we obtain

so *c*
_{
ii
}=1+*𝜗*
_{
i
}, and *f*
_{
i
} is the IBS-sense coefficient of inbreeding *𝜗*
_{
i
}.

*A*=(

*a*

_{ ij }) where

*C*and

*A*are conceptually closely related. An assumption behind this assertion is discussed in Section “Discussion”.

### Defining the segmentation

To define the segmentation a statistical model in the form of an acyclic probabilistic finite automaton (APFA) [13] is used. Such models allow the extent of haplotype sharing within and between genomes to be quantified, and underlie the Beagle program [14, 15] that is widely used for processing high-dimensional SNP data. Phase estimation, imputation and model selection are performed simultaneously, using the algorithm described in [15]. Beagle is highly efficient, taking only a few minutes to process each chromosome for the data described in Section “Data and computations”, and performs well: for example, imputation accuracy rates generally exceed 97 *%* in cattle data [16].

*V*is a vertex set and

*E*an edge set: a small example is shown in Fig. 1. This is a model for the joint distribution of

*p*=20 markers at the haplotype level. To each edge in

*E*is attached a probability, such that the sum of probabilities of the outgoing edges from each vertex in

*V*is one. Each haplotype corresponds to a path through the graph from the root (the leftmost vertex) to the sink (the rightmost vertex). The probability of a haplotype is the product of the probabilities of the edges in its root-to-sink path. See further [17, 18].

In [14, 15] the haplotypes that traverse a given edge are known as a haplotype cluster. Here a different perspective is adopted. The edges of the APFA are taken to represent chromosomal segments, that is, we set \({\mathcal {S}} = E\). So if two haplotypes traverse the same edge in an interval they are taken to share the same DNA in that interval, and if they traverse different edges, they are taken not to share DNA in that interval. The data may be represented as an *N*×|*E*| matrix *X* taking values in {0,1,2}, whose (*i,j*)th element specifies the multiplicity of segment *j* in individual *i*. The variables corresponding to the columns of *X* are called haplomarkers, and *X* is called the haplomarker design matrix.

*B*and

*C*to be \( B = \left (\begin {array}{ccc} 1.000 & 0.750 & 0.650 \\ 0.750 & 1.000 & 0.675 \\ 0.650 & 0.675 & 1.000 \\ \end {array} \right) \) and \( C = \left (\begin {array}{ccc} 1.000 & 0.750 & 0.875 \\ 0.750 & 1.000 & 0.900 \\ 0.875 & 0.900 & 1.450 \\ \end {array} \right) \). There are, for example, nine edges shared between the two haplotypes (red dashed lines) in the offspring genome, so the homozygosity of this individual is 0.45.

### Expected relatedness

Consider first three individuals, *i*, *j*, and *k*, where *i* and *j* are the parents of *k*. We examine how the parent-offspring relatedness measures depend on the relatedness of the parents. Specifically, expressions for the expectations of the parent-offspring relatedness conditional on the parental relatedness will be derived.

*G*

_{ i }and

*G*

_{ j }are first partitioned into two gametes, say \(G_{i} = [{H_{i}^{1}} + {H_{i}^{2}}]\) and \(G_{j} = [{H_{j}^{1}} + {H_{j}^{2}}]\) such that \(|{H_{i}^{1}}|=|{H_{i}^{2}}|=|{H_{j}^{1}}|=|{H_{j}^{2}}|=p\). The partitioning process (segregation) is complex and stochastic, but only properties that are invariant to this are considered here. Then the genome \(G_{k}= [H_{i}^{*} + H_{j}^{*}]\) is formed where \(H_{i}^{*}\) is either \({H_{i}^{1}}\) or \({H_{i}^{2}}\), and \(H_{j}^{*}\) is either \({H_{j}^{1}}\) or \({H_{j}^{2}}\), and the four combinations are equiprobable. Thus

*h*,

*i*,

*j*and

*k*, where again

*i*and

*j*are the parents of

*k*, and where the relatedness between

*h*,

*i*and

*j*is known.

but I have not been able to derive an expression for *E*(*b*
_{
kh
}) corresponding to (12).

Expressions (8), (??) and (12) are identical to those used in the calculation of the numerator relationship matrix using the algorithm of [19]. When only a subset of individuals in a pedigree are genotyped, a hybrid expected/realized relationship matrix *R*=(*r*
_{
ij
}) exploiting both pedigree and genomic information can be obtained using the following simple modification to the algorithm.

*N*. Write the subset of genotyped individuals as

*S*, and for all

*i,j*∈

*S*, set

*r*

_{ ij }=

*c*

_{ ij }, the realized genomic relatedness described above. For

*k*=1,…

*N*, derive the relatedness between an individual

*k*and the preceding individuals as follows. When

*k*∉

*S*, set

*i*and

*j*are the parents of

*k*. If either or both

*i*and

*j*are unknown (i.e., not in the pedigree) assume they are unrelated, that is, use

*r*

_{ ij }=0 in this calculation. For each

*h*∈{1,…,

*k*−1}, if {

*h,k*}⫅̸

*S*, set

where again *i* and *j* are the parents of *k*. If *i* is unknown, use *r*
_{
ih
}=0, and if *j* is unknown, use *r*
_{
jh
}=0 in this calculation.

This algorithm adjusts the expected relationships downstream of *S* in the pedigree. An alternative method that adjusts all the relationships outside of *S* is sketched in the following subsection.

### Modifying *A*

*A*as a covariance matrix and wish to construct a new \(\tilde {A}\) for which the marginal covariance of group one is set to \(A_{11}^{*}\), and the conditional (co)variance of group two, given group one, is kept the same. That is to say, such that

*A*

^{12},

*A*

^{21}=(

*A*

^{12})

^{ T }and

*A*

^{22}are retained. So we require that where ∗ denotes unspecified and

*E*is an increment matrix to be found. Using standard results on inverses of partitioned matrices we obtain

is the required increment. Write the matrix obtained in this way \(\tilde {A} = A|A_{11}^{*}\). This technique is used when a subset of individuals in a pedigree are genotyped, to compute a hybrid expected/realized relationship matrix exploiting both pedigree and genomic information [20, 21].

## Results

In this section empirical comparisons are made between the proposed relationship matrices *B* and *C*, the numerator relationship matrix *A* derived from the pedigree, and the matrix *G* of vanRaden [10].

### Data and computations

The data used in this analysis are genotypes and complex traits for 5037 Nordic Holstein bulls. The 5037 bulls were genotyped using a 50K chip and then imputed with Impute2 [22] to 777K (HD), using a reference panel of 1197 HD genotyped bulls. Five traits are examined below: protein, fat, yield, body and mastitis. These are de-regressed proofs (DRP) derived from genetic evaluations in December 2013. A detailed description of their definitions and derivations is available from the Danish Agricultural Advisory Centre (https://www.landbrugsinfo.dk). The year of birth of the bulls ranged from 1974 to 2009. The 3914 bulls born until 2004 were taken to comprise the training set, and the remaining 1394 bulls born from 2005 to 2009 were taken to comprise the test set.

The pedigree-based relationship matrix (*A*) for the 5037 bulls was derived from the Nordic Holstein pedigree of year 2013 (which contains a total of 134832 animals) in the standard way.

*G*) following [10] was calculated from the marker data, using

where *M*=(*m*
_{
ik
}) is the *N*×*p* marker design matrix whose elements take values in {0,1,2}, and \(\bar {m}_{k}\) is the mean allele frequency of the relevant allele of the *k*th marker, that is, \(\bar {m}_{k}= \sum _{i=1 \dots N} m_{\textit {ik}}/N\). Thus the allele frequencies are set to those in the current sample.

Beagle version 3.3.2 was applied to the unphased marker data from the Holstein bulls, and the *B* and *C* matrices were derived from the Beagle output files. Beagle uses two tuning parameters, *m* and *b*. The larger the parameters, the simpler the selected APFA. The settings *m*=1 and *b*=0, suggested in [15, 18], were used below in the following sections, except Section “Prediction”: here the settings *m*=4 and *b*=0.2 suggested in [23] were used, since they result in slightly better prediction accuracy.

### Relatedness and pedigree distance

In Sections “Two measures of genomic relatedness” and “Expected relatedness” it was seen that there is a close conceptual relationship between *C* and the numerator relationship matrix *A*. This section examines empirically the extent to which the measures capture the genealogical relationships between individuals. This is done in several ways.

Summary statistics of relationship measures broken down by distance

A | B | C | G | |||||
---|---|---|---|---|---|---|---|---|

Distance | mean | sd | mean | sd | mean | sd | mean | sd |

1 | 0.562 | 0.026 | 0.510 | 0.037 | 0.579 | 0.048 | 0.504 | 0.035 |

2 | 0.328 | 0.035 | 0.332 | 0.040 | 0.377 | 0.049 | 0.252 | 0.052 |

3 | 0.195 | 0.042 | 0.223 | 0.042 | 0.253 | 0.050 | 0.104 | 0.054 |

4 | 0.122 | 0.037 | 0.163 | 0.037 | 0.186 | 0.044 | 0.025 | 0.046 |

5 | 0.094 | 0.027 | 0.140 | 0.030 | 0.160 | 0.036 | -0.002 | 0.033 |

6 | 0.082 | 0.024 | 0.130 | 0.029 | 0.148 | 0.034 | -0.010 | 0.027 |

7 | 0.068 | 0.025 | 0.117 | 0.031 | 0.132 | 0.037 | -0.012 | 0.024 |

8 | 0.046 | 0.023 | 0.092 | 0.034 | 0.103 | 0.039 | -0.011 | 0.021 |

9 | 0.023 | 0.016 | 0.061 | 0.026 | 0.067 | 0.029 | 0.000 | 0.024 |

The parent-offspring pairs are clearly identified by all four measures, but for the more distant pairs there appears to be least separation for the *G* measure. For the *A* measure, distances of four and above are less than 0.2, with a spike close to zero at distance 9, reflecting the assumption of unrelated founders. There are distinct peaks for most distances, indicating good separation between these. The *B* and *C* measures at distance four and above are larger, being less than 0.3, also with good separation. The *G* measures for distance five and above are centered around zero, so about half of the values are negative, and there is poor separation. This suggests that *G* performs relatively poorly for distantly related individuals, say second cousins or farther.

### Comparison with pedigree-based relationships

*A*matrix takes this into account and is the natural pedigree-based measure. The upper three subplots of Fig. 4 show smoothed scatterplots of

*A*versus

*G*,

*B*, and

*C*, for all distinct pairs of animals in the data. It is seen that the bulk of the points lie above the identity line in the

*A*versus

*G*plot, and under the line in the

*A*versus

*B*, and

*A*versus

*C*plots: that is,

*G*tends to underestimate

*A*whereas

*B*and

*C*tend to overestimate

*A*. See also Table 1. Adjusted

*R*

^{2}statistics based on simple linear regression models with no intercept, as shown in Fig. 4, indicate that

*G*only explains around 6

*%*of the variation of

*A*, whereas both

*B*and

*C*explain around 95

*%*.

### Comparison using consistency

The tendency for *B* and *C* to be larger than *A* could be due to the assumption of non-inbred, unrelated founders that underlies *A*: if this is false, deflated estimates of relatedness and inbreeding would result. To examine this possibility we use the technique described in Section “Modifying *A*
” to examine the consistency of *B*, *C* and *G* with *A*, in the following way. A random sample of 1000 animals from the genotyped Holstein bulls is taken, and called group one. The matrices *A*|*G*
_{11}, *A*|*B*
_{11} and *A*|*C*
_{11} are derived and compared with the realized relationships, that is, the off-diagonals of (*A*|*G*
_{11})_{22} are compared with those of *G*
_{22} and so forth. The process is repeated for 10 random samples of size 1000. The three lower subplots in Fig. 4 show the results. It is seen that *B* is highly consistent with *A*: the realized relatedness measures in *B*
_{22} are very close to the adjusted values (*A*|*B*
_{11})_{22}. The same is true of *C*. But *G* shows poor consistency with *A*: the realized relatedness measures in *G*
_{22} tend to exceed the adjusted values (*A*|*G*
_{11})_{22}.

### Comparison of inbreeding coefficients

*A*with those from

*G*and

*C*. It is seen that

*C*explains 89

*%*of the variation in

*A*whereas

*G*explains only 42

*%*. The inbreeding coefficients from

*A*are non-negative, but negative values occur in

*G*. The inbreeding coefficients from

*C*are consistently larger than those from

*A*, which may reflect assumptions of non-inbred unrelated founders underlying

*A*. To examine this, the consistency of the inbreeding coefficients from

*C*and

*G*are compared using the method just described: the results are shown in Fig. 5. The coefficients from

*C*

_{22}are slightly smaller than those from (

*A*|

*C*

_{11})

_{22}. Thus the difference may at least in part be due to assumptions of non-inbred unrelated founders. The consistency of the inbreeding coefficients from

*G*with those from

*A*is very poor. Estimates of inbreeding coefficients based on

*G*may be sensitive to choice of allele frequencies in the base population [10].

### Prediction

where *y* is the response vector, *μ* is the overall mean, **1** is a vector of 1’s, *g* is a vector of breeding values, and *e* is a vector of residuals. It is assumed that \(g \sim N(0, V {\sigma ^{2}_{g}})\) and independently \(e \sim N(0, D {\sigma ^{2}_{e}})\), where *V* is a relationship matrix (i.e. *A*, *B*, *C*, or *G*), and *D* is a diagonal matrix with elements \(d_{\textit {kk}}=(1 - {r_{k}^{2}})/{r_{k}^{2}}\) to account for heterogeneous residual variances due to varying reliability \({r_{k}^{2}}\) of the complex trait *y*.

*C*consistently has the highest prediction accuracy, though the improvement over

*G*is modest, of the order of 0.4

*%*when the full training set is used, and 0.6

*%*when closely related animals are excluded from the training set. In contrast,

*B*has slightly less prediction accuracy than

*C*for both the full and the reduced training set.

Prediction accuracy (correlation) for G-REML using the four relationship matrices

Full training set | Reduced training set | |||||||
---|---|---|---|---|---|---|---|---|

Trait | A | B | C | G | A | B | C | G |

protein | 0.498 | 0.661 | 0.670 | 0.667 | 0.219 | 0.556 | 0.562 | 0.559 |

fat | 0.474 | 0.625 | 0.651 | 0.643 | 0.220 | 0.526 | 0.556 | 0.549 |

body | 0.490 | 0.567 | 0.570 | 0.565 | 0.377 | 0.518 | 0.526 | 0.512 |

mast | 0.454 | 0.572 | 0.585 | 0.581 | 0.298 | 0.504 | 0.513 | 0.514 |

yield | 0.513 | 0.656 | 0.667 | 0.663 | 0.203 | 0.543 | 0.554 | 0.549 |

## Software

Beagle version 3.3.2 was used to select APFA on which the measures are based. A C++ program, available from the author, was written to construct the *B* and *C* relationship matrices from Beagle output files. DMU [24] was used to perform the REML analyses. The remaining computations were performed using R: in particular, the *A* matrix was computed using the pedigree package, and Figs. 1 and 2 were constructed using the gRapfa package [18].

## Discussion

Two novel measures of relatedness based on shared haplotypes were introduced in Section “Methods”. The intersect measure (*B*) is an estimate of the fraction of shared genome, and the product measure (*C*) is closely related to the numerator relationship matrix (*A*) [12].

The framework underlying the measures is that of a diploid genome divided into intervals and segments (or genes and alleles) in which it is assumed that segments are not shared between intervals, so that the multiplicity of each segment in a genome is in {0,1,2}. It would be interesting to examine whether the measures can be extended to polyploid genomes, and whether the assumption of no shared segments, which cannot accommodate phenomena such as gene duplication, can be relaxed.

The close conceptual relation between *C* and *A* rests implicitly on an assumption that whenever two haplotypes share the same segment (in the APFA context, traverse the same edge) their chromosomal segments are indeed identical (IBS). This is a strong assumption, and most likely only approximately true. Probably the reason that the proposed measures capture genealogical relatedness well here is that the APFA-based segmentation is in reasonable accordance with this assumption. If the sample size were small, a overly simple APFA would be selected, leading to over-estimation of haplotype sharing. Similarly, if segments were defined directly using the marker alleles (say, with two segments per interlocus interval corresponding to the alleles of a flanking marker), the assumption would be violated, and the resulting measures may be expected to capture relatedness poorly. If full-sequence data are available, it would in principle be possible to verify the assumption for the APFA-based segmentation, or perhaps to develop an improved segmentation method.

In Section “Results” it was shown that the tendency for *B* and *C* to be larger than *A* can be ascribed to the assumptions of non-inbred, unrelated founders that underlie *A*. An alternative explanation could be that the segmentation method chosen here tends to overestimate the extent of haplotype sharing. Further research into this would be useful.

A comparison of the prediction accuracy in a mixed linear model using the relationship matrices as covariances found that *C* performed consistently better than *G*, with an improvement of about 0.4 *%* when all available animals were used in the training set, increasing to 0.6 *%* when close relatives were excluded. There is intense interest in methods to improve prediction accuracy in genomic selection programmes [25], since small improvements may represent substantial economic gains for the breeding company, and the present methods may contribute to this goal.

Note that as described above *C* takes the form *X*
*X*
^{
T
}/2*p*, where *X* is the *N*×|*E*| haplomarker design matrix. Hence the use of *C* in (15) is equivalent to the model *y*=**1**
*μ*+*X*
*h*+*e* with random haplomarker effects \(h \sim N(0, I_{|E|} {\sigma _{g}^{2}})\) and independent error \(e \sim N\left (0, D {\sigma _{e}^{2}}\right)\). From Eq. (14), *G* takes the form (*M*−*δ*)(*M*−*δ*)^{
T
}/*η* where *M* is the *N*×*p* marker design matrix, and *δ* and *η* are shift and scale constants. Although different shift and scale transformations of the (haplo)marker variables would lead to different relationship matrices, they would not affect the predictive ability of the models [26]. So in this sense the comparison between *C* and *G* in the prediction context is between the predictive power of *X* and *M*, rather than between the relatedness measures *per se*.

It is straightforward to construct weighted versions of the measures. Let *w*
_{1},…,*w*
_{
p
} be a set of apriori given non-negative numbers such that \(\sum _{i=1 \dots p} w_{i}= 1\). These could for example be proportional to inter-marker distances, or to probabilities of the existence of a quantitative trait locus (QTL) in the respective interval in order to quantify trait-specific relatedness. Expressions (1) and (2) are replaced by \(\sum _{s \in {\mathcal {S}}} w_{l(s)} (x_{\textit {is}} \wedge x_{\textit {js}})\) and \(\sum _{s \in {\mathcal {S}}} w_{l(s)} x_{\textit {is}} x_{\textit {js}}\), respectively.

The present methods have a certain similarity of approach to that of the Chromopainter program [27]. This seeks to explore admixture in SNP data sampled from multiple populations. Given SNP data for a set of recipient chromosomes, and for a set of donor chromosomes, it forms each recipient chromosome as a mosaic of donor chromosomes, by applying the haplotype copying model [28] in a hidden Markov model framework. This has been used to explore human migratory history [29]. The present methods provide an alternative modelling approach in which it is not necessary to prescribe a donor/recipient ordering. A review of genomic similarity measures from the population structure perspective is given in [30].

A natural way to display patterns of relatedness is to apply principal coordinates analysis ([31], Chapter 14), using − log(*b*
_{
ij
}) as a distance measure between individuals *i* and *j*. Also the length of shared regions is informative: on average, the longer the shared regions, the more recent the ancestor(s). The location of the shared regions may sometimes also be of interest, for example, when there is knowledge of the location of genetic variants influencing a complex trait.

## Conclusions

Two novel molecular measures of relatedness based on haplotype sharing are described. The intersect measure estimates the fraction of shared genome between individuals, and the product measure has a close conceptual relationship with the coefficient of coancestry. Both capture genealogical relatedness well, outperforming vanRaden’s *G* in this respect. When used in genomic prediction models, the product measure leads to slightly improved prediction accuracy.

## Availability of data and materials

The cattle data are the property of the Danish Cattle Federation (Aarhus, Denmark), Faba Co-op (Helsinki, Finland), Seges (Aarhus, Denmark), Växa Sverige (Uppsala, Sweden), Swedish Dairy Association (Stockholm, Sweden), and Nordic Cattle Genetic Evaluation (Aarhus, Denmark), and are not publicly available.

## Declarations

### Acknowledgements

Helpful conversations with Rasmus Brøndum, Ole Christensen, Luc Janss, Bernt Guldbrandtsen and Just Jensen are gratefully acknowledged. I thank the Danish Cattle Federation (Aarhus, Denmark), Faba Co-op (Helsinki, Finland), Seges (Aarhus, Denmark), Växa Sverige (Uppsala, Sweden), Swedish Dairy Association (Stockholm, Sweden), and Nordic Cattle Genetic Evaluation (Aarhus, Denmark) for providing data. This research was supported by the Center for Genomic Selection in Animals and Plants (GenSAP) funded by The Danish Council for Strategic Research.

**Open Access** This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

## Authors’ Affiliations

## References

- Balding DJ, Nichols RA. Dna profile match probability calculation: how to allow for population stratification, relatedness, database selection and single bands. Forensic Sci Int. 1994; 64(2):125–40.View ArticlePubMedGoogle Scholar
- Norder H, Hammas B, Lee SD, Bile K, Couroucé A-M, Mushahwar IK, et al.Genetic relatedness of hepatitis b viral strains of diverse geographical origin and natural variations in the primary structure of the surface antigen. J Gen Virol. 1993; 74:1341–1341.View ArticlePubMedGoogle Scholar
- Lawson DJ, Hellenthal G, Myers S, Falush D. Inference of population structure using dense haplotype data. PLoS Genet. 2012; 8(1):1002453.View ArticleGoogle Scholar
- Oliehoek PA, Windig JJ, Van Arendonk JA, Bijma P. Estimating relatedness between individuals in general populations with a focus on their use in conservation programs. Genet. 2006; 173(1):483–96.View ArticleGoogle Scholar
- Kang HM, Sul JH, Service SK, Zaitlen NA, Kong S-y, Freimer NB, et al.Variance component model to account for sample structure in genome-wide association studies. Nat Genet. 2010; 42(4):348–54.View ArticlePubMedPubMed CentralGoogle Scholar
- Yang J, Zaitlen NA, Goddard ME, Visscher PM, Price AL. Advantages and pitfalls in the application of mixed-model association methods. Nat Genet. 2014; 46(2):100–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Malécot G. Mathématiques de l’Hérédité. Paris: Masson; 1948.Google Scholar
- Speed D, Balding DJ. Relatedness in the post-genomic era: is it still useful?Nat Rev Genet. 2015; 16(1):33–44.View ArticlePubMedGoogle Scholar
- Weir BS, Anderson AD, Hepler AB. Genetic relatedness analysis: modern data and new challenges. Nat Rev Genet. 2006; 7(10):771–80.View ArticlePubMedGoogle Scholar
- VanRaden P. Efficient methods to compute genomic predictions. J Dairy Sci. 2008; 91(11):4414–423.View ArticlePubMedGoogle Scholar
- Syropoulos A. Mathematics of multisets In: Calude C, editor. Multiset Processing: Mathematical, Computer Science, and Molecular Computing Points of View. New York: Springer: 2001. p. 347–58.Google Scholar
- Wright S. Coefficients of inbreeding and relationship. Am Nat. 1922::330–338.Google Scholar
- Ron D, Singer Y, Tishby N. On the learnability and usage of acyclic finite automata. J Comput Syst Sci. 1998; 56:133–52.View ArticleGoogle Scholar
- Browning BL, Browning SR. A unified approach to genotype imputation and haplotype-phase inference for large data sets of trios and unrelated individuals. Am J Hum Genet. 2009; 84(2):210–23.View ArticlePubMedPubMed CentralGoogle Scholar
- Browning BL, Browning SR. Efficient multilocus association testing for whole genome association studies using localized haplotype clustering. Genet Epidemiol. 2007; 31(5):365–75.View ArticlePubMedGoogle Scholar
- Brøndum RF, Ma P, Lund MS, Su G. Short communication: Genotype imputation within and across nordic cattle breeds. J Dairy Sci. 2012; 95(11):6795–800.View ArticlePubMedGoogle Scholar
- Edwards D, Ankinakatte S. Context-specific graphical models for discrete longitudinal data. Stat Model. 2014; 15(4):301–25.View ArticleGoogle Scholar
- Ankinakatte S, Edwards D. Modelling discrete longitudinal data using acyclic probabilistic finite automata. Comput Stat Data Anal. 2015; 88:40–52.View ArticleGoogle Scholar
- Emik LO, Terrill CE. Systematic procedures for calculating inbreeding coefficients. J Hered. 1949; 40(2):51–5.PubMedGoogle Scholar
- Legarra A, Aguilar I, Misztal I. A relationship matrix including full pedigree and genomic information. J Dairy Sci. 2009; 92(9):4656–663.View ArticlePubMedGoogle Scholar
- Christensen OF, Lund MS. Genomic prediction when some animals are not genotyped. Genet Sel Evol. 2010; 42(2):1–8.Google Scholar
- Marchini J, Howie B. Genotype imputation for genome-wide association studies. Nat Rev Genet. 2010; 11(7):499–511.View ArticlePubMedGoogle Scholar
- Browning SR, Browning BL. Rapid and accurate haplotype phasing and missing-data inference for whole-genome association studies by use of localized haplotype clustering. Am J Hum Genet. 2007; 81(5):1084–97.View ArticlePubMedPubMed CentralGoogle Scholar
- Madsen P, Sørensen P, Su G, Damgaard LH, Thomsen H, Labouriau R. DMU-a package for analyzing multivariate mixed models. In: 8th World Congress on Genetics Applied to Livestock Production: 2006:247.Google Scholar
- de los Campos G, Hickey JM, Pong-Wong R, Daetwyler HD, Calus MP. Whole-genome regression and prediction methods applied to plant and animal breeding. Gen. 2013; 193(2):327–45.Google Scholar
- Strandén I, Christensen OF. Allele coding in genomic evaluation. Genet Sel Evol. 2011; 43(25).Google Scholar
- Hellenthal G, Auton A, Falush D. Inferring human colonization history using a copying model. PLoS Genetics. 2008; 4(6). doi:10.1371/annotation/da6e20fe-f8eb-4e44-8669-6c20c7102b3d.
- Li N, Stephens M. Modeling linkage disequilibrium and identifying recombination hotspots using single-nucleotide polymorphism data. Genetics. 2003; 165(4):2213–233.PubMedPubMed CentralGoogle Scholar
- Hellenthal G, Busby GB, Band G, Wilson JF, Capelli C, Falush D, et al.A genetic atlas of human admixture history. Science. 2014; 343(6172):747–51.View ArticlePubMedPubMed CentralGoogle Scholar
- Lawson DJ, Falush D. Population identification using genetic data. Annu Rev Genomics Hum Genet. 2012; 13:337–61.View ArticlePubMedGoogle Scholar
- Mardia KV, Kent JT, Bibby JM. Multivariate Analysis. London: Academic press; 1979.Google Scholar