Skip to main content

Table 9 Rate and MSE obtained by running SCALCE [35] and fastqz [34] on the H. sapiens dataset

From: QualComp: a new lossy compressor for quality scores based on rate distortion theory

Scalce fastqz
Error threshold R MSE Quantization R MSE
100 0.5339 3.69 70 0.02 1208.02
90 0.64 2.58 50 0.02 1208.02
80 0.64 2.58 40 0.02 1208.02
60 0.85 1.67 20 0.10 246.37
40 0.98 1.18 30 0.28 87.99
20 1.55 0.96 10 0.36 43.86
0 2.04 0 5 0.82 6.31
    1 2.04 0
  1. MSE obtained by SCALCE with different error thresholds and by fastqz with different quantization levels.