Skip to main content

Table 4 Comparison of M2 and our method M3 on the estimation of r2

From: Genotype determination for polymorphisms in linkage disequilibrium

 

r 2

0.802

0.500

0.304

high quality

M2

.798 (4e-5)

.497 (3e-5)

.302 (2e-5)

 

M3

.799 (3e-5)

.498 (2e-5)

.303 (1e-5)

low quality

M2

.757 (.002)

.469 (.001)

.283 (6e-4)

 

M3

.770 (.001)

.478 (6e-4)

.291 (3e-4)

mixed quality

M2

.775 (8e-4)

.482 (4e-4)

.293 (2e-4)

 

M3

.784 (4e-4)

.488 (2e-4)

.297 (1e-4)

  1. The first row shows true values of the square of Pearson's correlation. Numbers in parentheses are mean square errors.