From: QualComp: a new lossy compressor for quality scores based on rate distortion theory
Scalce | fastqz | ||||
---|---|---|---|---|---|
Error threshold | R | MSE | Quantization | R | MSE |
90 | 0.80 | 7.47 | 70 | 0.05 | 596.15 |
80 | 0.80 | 7.47 | 50 | 0.05 | 596.15 |
100 | 0.93 | 6.62 | 40 | 0.05 | 596.15 |
60 | 0.96 | 5.36 | 30 | 0.67 | 234.36 |
40 | 1.29 | 3.31 | 20 | 0.46 | 76.19 |
20 | 1.94 | 1.18 | 10 | 1.04 | 17.83 |
0 | 2.65 | 0 | 5 | 1.33 | 3.53 |
 |  |  | 1 | 2.59 | 0 |