Table 2 Hardware and software characteristics of the cluster nodes (testbed 2)

Hardware

CPU Model

2 × Intel Xeon Silver 4216 Cascade Lake-SP

CPU Speed/Turbo

2.1 GHz/3.2 GHz

#Cores per node

32

#Threads per node

64

Cache L1/L2/L3

32 KiB/1 MiB/22 MiB

Memory

256 GiB DDR4 2933 MHhz

Disks

1 × HDD 2 TiB SATA3 7.2K rpm

1 × SSD 240 GiB SATA3

Network

InfiniBand FDR

Software

OS Version

CentOS Linux release 7.9.2009

Kernel

5.4.233-1

Java

OpenJDK 1.8.0_372

Spark

Version

3.1.1

Executors per node

1

Executor heap size

225 GiB

Executor cores

32

Hadoop

Version

2.10.1

HDFS

Block size

128 MiB

Replication factor

3