Table 2 Root mean squared error in P for known Q and K= 2
From: A fast least-squares algorithm for population inference
RMSE (%) | N= 100 | N= 1000 | N= 10000 | ||||||
|---|---|---|---|---|---|---|---|---|---|
|  | α=0.1 | α=1.0 | α=2.0 | α=0.1 | α=1.0 | α=2.0 | α=0.1 | α=1.0 | α=2.0 |
SQP | 4.35 | 6.03 | 7.41 | 1.37 | 1.90 | 2.37 | 0.43 | 0.60 | 0.75 |
LS | 4.37 | 6.16 | 7.68 | 1.38 | 1.93 | 2.40 | 0.44 | 0.61 | 0.76 |