Skip to main content

Table 4 Median error rates in PhiX DNA data using shadow linear regression and smoothing spline approachesa

From: Empirical estimation of sequencing error rates using smoothing splines

Samples

Expected ER

SRER

SRER Bias

EER_CS

EER_CS Bias

EER_RS

EER_RS Bias

100217

0.0323

0.0250

0.0073

0.0315

0.0008

0.0315

0.0008

100514

0.0152

0.0143

0.0009

0.0152

0.0000

0.0152

0.0000

  1. aBased on 1000 replicates. The frequency-based simulation approach was applied. For each replicate, we considered the top 1000 reads with the highest frequencies as the error-free reads and generated 1000 pairs of error-free read counts and shadow counts
  2. Expected ER expected error rate in simulation studies
  3. SRER error rate estimated using shadow regression
  4. SRER Bias the absolute value of the difference between SRER and Expected ER
  5. EER_CS empirical error rate estimated using cubic smoothing spline
  6. EER_CS Bias the absolute value of the difference between EER_CS and Expected ER
  7. EER_RS empirical error rate estimated using robust smoothing spline
  8. EER_RS Bias the absolute value of the difference between EER_RS and Expected ER