Fig. 5

IMOS architecture. A master node (rounded rectangle) with a number of slaves ones (rounded square). Spark Driver, HDFS NameNode, and the cluster manager are placed on the master node. Each slave node contains a HDFS DataNode, a Spark Executor, and an instance of IMOS worker. Spark executor communicates with DataNode and IMOS worker through storage disk and socket as the medium, respectively. Components of Spark, HDFS, and our design are distinguished using slate gray, blue, and green colors, respectively