Skip to main content

Table 7 The cost of using spot instances for Case 2, where some spot instances get terminated

From: MC-GenomeKey: a multicloud system for the detection and annotation of genomic variants

  Bid = $0.2 (1 min) Bid = $0.3 (62 min) Bid = $0.35 (100 min) Bid = $0.4 (135 min) Bid = $0.5 (172 min) Bid = $0.6 (224 min) Bid = $1 (419 min) Average data transfer time (cost) Total time
Exome
 No Failure $1.734 $2.534 $2.934 $3.334 $4.134 $4.934 $8.134 0 1:51:33
 Failure Step 1 (Mapping) $8.78 $9.38 $9.51 $9.98 $10.58 $11.18 $13.58 7 min (0.6$) 02:08:23
 Failure Step 2 (Variant Calling) $9.13 $9.73 $9.91 $10.33 $10.93 $11.53 $13.93 6 min (0.47$) 02:06:10
 Failure Step 3 (Annotation) $4.06 $4.66 $4.81 $5.26 $5.86 $6.46 $8.86 2 s (0.05$) 01:55:48
Whole Genome (4 Nodes)
 No Failure $27.744 $40.544 $46.9 $53.344 $66.144 $78.944 $130.144 0 31:39:43
 Failure Step 1 (Mapping) $114.43 $121.63 $125.23 $128.83 $136.03 $143.23 $172.03 123 min (4.87$) 33:08:46
 Failure Step 2 (VC) $64.52 $74.92 $80.12 $85.32 $95.72 $106.12 $147.72 min (0.96$) 33:47:17
 Failure Step 3 (Annotation) $45.32 $56.92 $62.72 $68.52 $80.12 $91.72 $138.12 30 s (0.6) 32:14:01
Whole Genome (8 Nodes)
 No Failure $32.23 $47.70 $55.42 $63.16 $78.63 $94.10 $155.96 0 19:18:06
 Failure Step 1 (Mapping) $137.64 $146.04 $150.24 $154.44 $162.84 $171.24 $204.84 123 min (4.87$) 21:30:1
 Failure Step 2 (VC) $77.33 $90.13 $96.53 $102.93 $115.73 $128.53 $179.73 101 min (0.96$) 21:12:08
 Failure Step 3 (Annotation) $48.26 $62.66 $69.86 $77.06 $91.46 $105.86 $163.46 30 s (0.585$) 19:55:01
Whole Genome (32 nodes)
 No Failure $39.88 $59.61 $69.50 $79.35 $99.08 $118.81 $197.75 0 6:11:30
 Failure Step 1 (Mapping) $165.64 $176.84 $182.44 $188.04 $199.24 $210.44 $255.24 123 min (4.87$) 8:15:12
 Failure Step 2 (VC) $93.33 $109.33 $117.33 $125.33 $141.33 $157.33 $221.33 101 min (0.96$) 7:56:03
 Failure Step 3 (Annotation) $83.46 $101.06 $109.86 $118.66 $136.26 $153.86 $224.26 30 s (0.585$) 6:55:12
  1. The cost of using spot instances with different bid prices and failure time points given for Case 2, where some spot instances get terminated (we assume half of initial number) for Exome and Whole Genome datasets. GCE cluster setup time is nearly 7 min. For every bid we provided the average lifetime of cluster in brackets. Costs in bold are the most likely ones with the respective bid price and its most likely time of failure. The best expected costs for a given experiment are underlined. The best expected cost for exome is 3.334 using bid of 0.4 and for whole genomes is 106.12 with a bid of 0.6 finishing in 33 h. If one has to finish in less than 10 h, the best price is 125.33 with 32 nodes and bid price of $0.4