Table 3 U12(126) uniform experiment layout
Number of experiences | Hyperparameter | |||||
|---|---|---|---|---|---|---|
X1 | X2 | X3 | X4 | X5 | X6 | |
1 | 8 | 5 | 8 | 20 | Tanh | Adam |
2 | 16 | 5 | 32 | 14 | Tanh | SGD |
3 | 8 | 5 | 4 | 14 | Tanh | Adam |
4 | 16 | 5 | 16 | 20 | SELU | SGD |
5 | 8 | 5 | 32 | 14 | SELU | SGD |
6 | 16 | 5 | 8 | 14 | SELU | Adam |
7 | 8 | 3 | 16 | 20 | Leaky ReLU | SGD |
8 | 16 | 3 | 4 | 20 | Leaky ReLU | Adam |
9 | 8 | 3 | 8 | 14 | Leaky ReLU | Adam |
10 | 16 | 3 | 32 | 20 | ReLU | SGD |
11 | 8 | 3 | 4 | 20 | ReLU | Adam |
12 | 16 | 3 | 16 | 14 | ReLU | SGD |