19  HPT PyTorch: Regression

In this tutorial, we will show how spotPython can be integrated into the PyTorch training workflow for regreession tasks.

This document refers to the following software versions:

pip list | grep  "spot[RiverPython]"
spotPython                        0.2.52
spotRiver                         0.0.94
Note: you may need to restart the kernel to use updated packages.

spotPython can be installed via pip. Alternatively, the source code can be downloaded from gitHub: https://github.com/sequential-parameter-optimization/spotPython.

!pip install spotPython
# import sys
# !{sys.executable} -m pip install --upgrade build
# !{sys.executable} -m pip install --upgrade --force-reinstall spotPython

19.1 Step 1: Setup

Before we consider the detailed experimental setup, we select the parameters that affect run time, initial design size and the device that is used.

Caution: Run time and initial design size should be increased for real experiments
  • MAX_TIME is set to one minute for demonstration purposes. For real experiments, this should be increased to at least 1 hour.
  • INIT_SIZE is set to 5 for demonstration purposes. For real experiments, this should be increased to at least 10.
Note: Device selection
  • The device can be selected by setting the variable DEVICE.
  • Since we are using a simple neural net, the setting "cpu" is preferred (on Mac).
  • If you have a GPU, you can use "cuda:0" instead.
  • If DEVICE is set to None, spotPython will automatically select the device.
    • This might result in "mps" on Macs, which is not the best choice for simple neural nets.
MAX_TIME = 1
INIT_SIZE = 5
DEVICE = "cpu" # "cuda:0"
from spotPython.utils.device import getDevice
DEVICE = getDevice(DEVICE)
print(DEVICE)
cpu
import os
import copy
import socket
from datetime import datetime
from dateutil.tz import tzlocal
start_time = datetime.now(tzlocal())
HOSTNAME = socket.gethostname().split(".")[0]
experiment_name = '24-torch' + "_" + HOSTNAME + "_" + str(MAX_TIME) + "min_" + str(INIT_SIZE) + "init_" + str(start_time).split(".", 1)[0].replace(' ', '_')
experiment_name = experiment_name.replace(':', '-')
print(experiment_name)
if not os.path.exists('./figures'):
    os.makedirs('./figures')
24-torch_maans03_1min_5init_2023-07-03_13-07-02

19.2 Step 2: Initialization of the fun_control Dictionary

Caution: Tensorboard does not work under Windows
  • Since tensorboard does not work under Windows, we recommend setting the parameter tensorboard_path to None if you are working under Windows.

spotPython uses a Python dictionary for storing the information required for the hyperparameter tuning process, which was described in Section 14.2.

from spotPython.utils.init import fun_control_init
fun_control = fun_control_init(task="regression",
 tensorboard_path="runs/24_spot_torch_regression",
 device=DEVICE)

19.3 Step 3: PyTorch Data Loading

# Create dataset
import pandas as pd
import numpy as np
from sklearn import datasets as sklearn_datasets
from sklearn.preprocessing import MinMaxScaler
from sklearn.model_selection import train_test_split
X, y = sklearn_datasets.make_regression(
    n_samples=1000, n_features=10, noise=1, random_state=123)
y = y.reshape(-1, 1)

# Normalize the data
X_scaler = MinMaxScaler()
X_scaled = X_scaler.fit_transform(X)
y_scaler = MinMaxScaler()
y_scaled = y_scaler.fit_transform(y)

# combine the features and target into a single dataframe named train_df
train_df = pd.DataFrame(np.hstack((X_scaled, y_scaled)))

target_column = "y"
n_samples = train_df.shape[0]
n_features = train_df.shape[1] - 1
train_df.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
X_train, X_test, y_train, y_test = train_test_split(train_df.drop(target_column,
    axis=1), 
    train_df[target_column],
    random_state=42,
    test_size=0.25)
trainset = pd.DataFrame(np.hstack((X_train, np.array(y_train).reshape(-1, 1))))
testset = pd.DataFrame(np.hstack((X_test, np.array(y_test).reshape(-1, 1))))
trainset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
testset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
print(train_df.shape)
print(trainset.shape)
print(testset.shape)
(1000, 11)
(750, 11)
(250, 11)
import torch
from spotPython.torch.dataframedataset import DataFrameDataset
dtype_x = torch.float32
dtype_y = torch.float32
train_df = DataFrameDataset(train_df, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
train = DataFrameDataset(trainset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
test = DataFrameDataset(testset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
n_samples = len(train)
  • Now we can test the data loading:
from spotPython.torch.traintest import create_train_val_data_loaders
trainloader, testloader = create_train_val_data_loaders(train, 2, True, 0)
for i, data in enumerate(trainloader, 0):
    inputs, labels = data
    print(inputs.shape)
    print(labels.shape)
    print(inputs)
    print(labels)
    break
torch.Size([2, 10])
torch.Size([2])
tensor([[0.3566, 0.2825, 0.4358, 0.5737, 0.3085, 0.4328, 0.4551, 0.5332, 0.3735,
         0.4098],
        [0.4123, 0.5197, 0.6590, 0.6292, 0.3662, 0.2946, 0.5570, 0.5681, 0.4320,
         0.6783]])
tensor([0.1767, 0.4051])
  • Since this works fine, we can add the data loading to the fun_control dictionary:
# add the dataset to the fun_control
fun_control.update({"data": train_df, # full dataset,
               "train": train,
               "test": test,
               "n_samples": n_samples,
               "target_column": target_column,})

19.4 Step 4: Specification of the Preprocessing Model

After the training and test data are specified and added to the fun_control dictionary, spotPython allows the specification of a data preprocessing pipeline, e.g., for the scaling of the data or for the one-hot encoding of categorical variables, see Section 14.4. This feature is not used here, so we do not change the default value (which is None).

19.5 Step 5: Select Model (algorithm) and core_model_hyper_dict

19.5.1 Implementing a Configurable Neural Network With spotPython

spotPython includes the Net_lin_reg class which is implemented in the file netregression.py.

This class inherits from the class Net_Core which is implemented in the file netcore.py, see Section 14.5.1.

from torch import nn
import spotPython.torch.netcore as netcore


class Net_lin_reg(netcore.Net_Core):
    def __init__(
        self, _L_in, _L_out, l1, dropout_prob, lr_mult,
        batch_size, epochs, k_folds, patience, optimizer,
        sgd_momentum
    ):
        super(Net_lin_reg, self).__init__(
            lr_mult=lr_mult,
            batch_size=batch_size,
            epochs=epochs,
            k_folds=k_folds,
            patience=patience,
            optimizer=optimizer,
            sgd_momentum=sgd_momentum,
        )
        l2 = max(l1 // 2, 4)
        self.fc1 = nn.Linear(_L_in, l1)
        self.fc2 = nn.Linear(l1, l2)
        self.fc3 = nn.Linear(l2, _L_out)
        self.relu = nn.ReLU()
        self.softmax = nn.Softmax(dim=1)
        self.dropout1 = nn.Dropout(p=dropout_prob)
        self.dropout2 = nn.Dropout(p=dropout_prob / 2)

    def forward(self, x):
        x = self.fc1(x)
        x = self.relu(x)
        x = self.dropout1(x)
        x = self.fc2(x)
        x = self.relu(x)
        x = self.dropout2(x)
        x = self.fc3(x)
        return x

19.5.1.1 The Net_Core class

Net_lin_reg inherits from the class Net_Core which is implemented in the file netcore.py. This class was described in Section 14.5.1.

from spotPython.torch.netregression import Net_lin_reg
from spotPython.data.torch_hyper_dict import TorchHyperDict
from spotPython.hyperparameters.values import add_core_model_to_fun_control
fun_control = add_core_model_to_fun_control(core_model=Net_lin_reg,
                              fun_control=fun_control,
                              hyper_dict=TorchHyperDict,
                              filename=None)

19.5.2 The Search Space

19.5.3 Configuring the Search Space With spotPython

19.5.3.1 The hyper_dict Hyperparameters for the Selected Algorithm

spotPython uses JSON files for the specification of the hyperparameters, which were described in Section 14.5.5.

The corresponding entries for the core_model class are shown below.

fun_control['core_model_hyper_dict']
{'_L_in': {'type': 'int',
  'default': 10,
  'transform': 'None',
  'lower': 10,
  'upper': 10},
 '_L_out': {'type': 'int',
  'default': 1,
  'transform': 'None',
  'lower': 1,
  'upper': 1},
 'l1': {'type': 'int',
  'default': 3,
  'transform': 'transform_power_2_int',
  'lower': 3,
  'upper': 8},
 'dropout_prob': {'type': 'float',
  'default': 0.01,
  'transform': 'None',
  'lower': 0.0,
  'upper': 0.9},
 'lr_mult': {'type': 'float',
  'default': 1.0,
  'transform': 'None',
  'lower': 0.1,
  'upper': 10.0},
 'batch_size': {'type': 'int',
  'default': 4,
  'transform': 'transform_power_2_int',
  'lower': 1,
  'upper': 4},
 'epochs': {'type': 'int',
  'default': 4,
  'transform': 'transform_power_2_int',
  'lower': 4,
  'upper': 9},
 'k_folds': {'type': 'int',
  'default': 1,
  'transform': 'None',
  'lower': 1,
  'upper': 1},
 'patience': {'type': 'int',
  'default': 2,
  'transform': 'transform_power_2_int',
  'lower': 1,
  'upper': 5},
 'optimizer': {'levels': ['Adadelta',
   'Adagrad',
   'Adam',
   'AdamW',
   'SparseAdam',
   'Adamax',
   'ASGD',
   'NAdam',
   'RAdam',
   'RMSprop',
   'Rprop',
   'SGD'],
  'type': 'factor',
  'default': 'SGD',
  'transform': 'None',
  'class_name': 'torch.optim',
  'core_model_parameter_type': 'str',
  'lower': 0,
  'upper': 12},
 'sgd_momentum': {'type': 'float',
  'default': 0.0,
  'transform': 'None',
  'lower': 0.0,
  'upper': 1.0}}

19.6 Step 6: Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

spotPython provides functions for modifying the hyperparameters, their bounds and factors as well as for activating and de-activating hyperparameters without re-compilation of the Python source code. These functions were described in Section 14.6.

19.6.1 Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

19.6.1.1 Modify Hyperparameters of Type numeric and integer (boolean)

from spotPython.hyperparameters.values import modify_hyper_parameter_bounds

fun_control = modify_hyper_parameter_bounds(fun_control, "epochs", bounds=[2, 16])
fun_control = modify_hyper_parameter_bounds(fun_control, "patience", bounds=[3, 7])

19.6.1.2 Modify Hyperparameter of Type factor

from spotPython.hyperparameters.values import modify_hyper_parameter_levels
fun_control = modify_hyper_parameter_levels(fun_control, "optimizer",
    ["Adadelta", "Adagrad", "Adam", "AdamW", "Adamax", "ASGD", "NAdam"])


fun_control.update({
               "_L_in": n_features,
               "_L_out": 1,})

19.6.2 Optimizers

Optimizers are described in Section 14.6.1.

19.7 Step 7: Selection of the Objective (Loss) Function

19.7.1 Evaluation

The evaluation procedure requires the specification of two elements:

  1. the way how the data is split into a train and a test set (see Section 14.7.1)
  2. the loss function (and a metric).

19.7.2 Loss Functions and Metrics

The key "loss_function" specifies the loss function which is used during the optimization, see Section 14.7.5.

We will use MSE loss for the regression task.

from torch.nn import MSELoss
loss_torch = MSELoss()
fun_control.update({"loss_function": loss_torch})

19.7.3 Metric

from torchmetrics import MeanAbsoluteError
metric_torch = MeanAbsoluteError().to(fun_control["device"])
fun_control.update({"metric_torch": metric_torch})

19.8 Step 8: Calling the SPOT Function

19.8.1 Preparing the SPOT Call

The following code passes the information about the parameter ranges and bounds to spot.

# extract the variable types, names, and bounds
from spotPython.hyperparameters.values import (get_bound_values,
    get_var_name,
    get_var_type,)
var_type = get_var_type(fun_control)
var_name = get_var_name(fun_control)
fun_control.update({"var_type": var_type,
                    "var_name": var_name})
lower = get_bound_values(fun_control, "lower")
upper = get_bound_values(fun_control, "upper")
from spotPython.utils.eda import gen_design_table
print(gen_design_table(fun_control))
| name         | type   | default   |   lower |   upper | transform             |
|--------------|--------|-----------|---------|---------|-----------------------|
| _L_in        | int    | 10        |    10   |    10   | None                  |
| _L_out       | int    | 1         |     1   |     1   | None                  |
| l1           | int    | 3         |     3   |     8   | transform_power_2_int |
| dropout_prob | float  | 0.01      |     0   |     0.9 | None                  |
| lr_mult      | float  | 1.0       |     0.1 |    10   | None                  |
| batch_size   | int    | 4         |     1   |     4   | transform_power_2_int |
| epochs       | int    | 4         |     2   |    16   | transform_power_2_int |
| k_folds      | int    | 1         |     1   |     1   | None                  |
| patience     | int    | 2         |     3   |     7   | transform_power_2_int |
| optimizer    | factor | SGD       |     0   |     6   | None                  |
| sgd_momentum | float  | 0.0       |     0   |     1   | None                  |

19.8.2 The Objective Function fun_torch

The objective function fun_torch is selected next. It implements an interface from PyTorch’s training, validation, and testing methods to spotPython.

from spotPython.fun.hypertorch import HyperTorch
fun = HyperTorch().fun_torch
from spotPython.hyperparameters.values import get_default_hyperparameters_as_array
hyper_dict=TorchHyperDict().load()
X_start = get_default_hyperparameters_as_array(fun_control, hyper_dict)

19.8.3 Starting the Hyperparameter Tuning

The spotPython hyperparameter tuning is started by calling the Spot function as described in Section 14.8.4.

from spotPython.spot import spot
from math import inf
spot_tuner = spot.Spot(fun=fun,
                   lower = lower,
                   upper = upper,
                   fun_evals = inf,
                   fun_repeats = 1,
                   max_time = MAX_TIME,
                   noise = False,
                   tolerance_x = np.sqrt(np.spacing(1)),
                   var_type = var_type,
                   var_name = var_name,
                   infill_criterion = "y",
                   n_points = 1,
                   seed=123,
                   log_level = 50,
                   show_models= False,
                   show_progress= True,
                   fun_control = fun_control,
                   design_control={"init_size": INIT_SIZE,
                                   "repeats": 1},
                   surrogate_control={"noise": True,
                                      "cod_type": "norm",
                                      "min_theta": -4,
                                      "max_theta": 3,
                                      "n_theta": len(var_name),
                                      "model_fun_evals": 10_000,
                                      "log_level": 50
                                      })
spot_tuner.run(X_start=X_start)

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.7103122166156, 'lr_mult': 3.62368745191023, 'batch_size': 8, 'epochs': 128, 'k_folds': 1, 'patience': 16, 'optimizer': 'Adam', 'sgd_momentum': 0.5446851204405787}
Epoch: 1 | 
MeanAbsoluteError: 0.1465502679347992 | Loss: 0.0343003983511344 | Epoch: 2 | MeanAbsoluteError: 0.1433185786008835 | Loss: 0.0325688291463609 | Epoch: 3 | 
MeanAbsoluteError: 0.1404336094856262 | Loss: 0.0299330577989550 | Epoch: 4 | MeanAbsoluteError: 0.1258818358182907 | Loss: 0.0255257219051648 | Epoch: 5 | 
MeanAbsoluteError: 0.1188727095723152 | Loss: 0.0235464455388290 | Epoch: 6 | MeanAbsoluteError: 0.1231291741132736 | Loss: 0.0247487991950230 | Epoch: 7 | 
MeanAbsoluteError: 0.1182753592729568 | Loss: 0.0222063015068048 | Epoch: 8 | MeanAbsoluteError: 0.1137692406773567 | Loss: 0.0213574432694402 | Epoch: 9 | 
MeanAbsoluteError: 0.1292541027069092 | Loss: 0.0255118774152116 | Epoch: 10 | MeanAbsoluteError: 0.1144954264163971 | Loss: 0.0200379248340859 | Epoch: 11 | 
MeanAbsoluteError: 0.1036395356059074 | Loss: 0.0182879555137142 | Epoch: 12 | MeanAbsoluteError: 0.1130254492163658 | Loss: 0.0209219976401839 | Epoch: 13 | 
MeanAbsoluteError: 0.1133170798420906 | Loss: 0.0217107345877019 | Epoch: 14 | MeanAbsoluteError: 0.1066759377717972 | Loss: 0.0187184988324972 | Epoch: 15 | 
MeanAbsoluteError: 0.1110114008188248 | Loss: 0.0201303499174843 | Epoch: 16 | MeanAbsoluteError: 0.1097626909613609 | Loss: 0.0190721750994654 | Epoch: 17 | 
MeanAbsoluteError: 0.1082964465022087 | Loss: 0.0198494462100299 | Epoch: 18 | MeanAbsoluteError: 0.1022551208734512 | Loss: 0.0169152787604712 | 
Epoch: 19 | MeanAbsoluteError: 0.1047790795564651 | Loss: 0.0172961684875190 | Epoch: 20 | MeanAbsoluteError: 0.1004447713494301 | Loss: 0.0171259393253805 | Epoch: 21 | 
MeanAbsoluteError: 0.0924532860517502 | Loss: 0.0140425119806375 | Epoch: 22 | 
MeanAbsoluteError: 0.1031959652900696 | Loss: 0.0186140003221992 | Epoch: 23 | MeanAbsoluteError: 0.0938113108277321 | Loss: 0.0150768763116120 | Epoch: 24 | 
MeanAbsoluteError: 0.0933983549475670 | Loss: 0.0144720881393081 | Epoch: 25 | 
MeanAbsoluteError: 0.0874785110354424 | Loss: 0.0137459026484162 | Epoch: 26 | MeanAbsoluteError: 0.0949684306979179 | Loss: 0.0159820871256096 | Epoch: 27 | MeanAbsoluteError: 0.0895402207970619 | Loss: 0.0133270176470672 | 
Epoch: 28 | 
MeanAbsoluteError: 0.0920959487557411 | Loss: 0.0142600782718019 | Epoch: 29 | MeanAbsoluteError: 0.0840932503342628 | Loss: 0.0116627598671537 | Epoch: 30 | MeanAbsoluteError: 0.0906529277563095 | Loss: 0.0137360144749676 | 
Epoch: 31 | MeanAbsoluteError: 0.0888112634420395 | Loss: 0.0130078479230992 | Epoch: 32 | 
MeanAbsoluteError: 0.0819668993353844 | Loss: 0.0119643201377537 | Epoch: 33 | MeanAbsoluteError: 0.0862467885017395 | Loss: 0.0129927315314202 | 
Epoch: 34 | MeanAbsoluteError: 0.0752064362168312 | Loss: 0.0100128317227293 | Epoch: 35 | MeanAbsoluteError: 0.0841168686747551 | Loss: 0.0125765538909227 | Epoch: 36 | 
MeanAbsoluteError: 0.0841892212629318 | Loss: 0.0122822045324076 | Epoch: 37 | 
MeanAbsoluteError: 0.0800836384296417 | Loss: 0.0118883071638840 | Epoch: 38 | MeanAbsoluteError: 0.0824426338076591 | Loss: 0.0121180862647873 | Epoch: 39 | MeanAbsoluteError: 0.0853315889835358 | Loss: 0.0125345584483033 | Epoch: 40 | 
MeanAbsoluteError: 0.0792756006121635 | Loss: 0.0111103206750398 | Epoch: 41 | 
MeanAbsoluteError: 0.0707920864224434 | Loss: 0.0094240001635626 | Epoch: 42 | MeanAbsoluteError: 0.0768285393714905 | Loss: 0.0106067246310168 | Epoch: 43 | MeanAbsoluteError: 0.0692230984568596 | Loss: 0.0081795909546169 | Epoch: 44 | 
MeanAbsoluteError: 0.0698742344975471 | Loss: 0.0089140196367608 | Epoch: 45 | 
MeanAbsoluteError: 0.0897505283355713 | Loss: 0.0127671012826460 | Epoch: 46 | MeanAbsoluteError: 0.0829731002449989 | Loss: 0.0120533580315839 | Epoch: 47 | MeanAbsoluteError: 0.0736887753009796 | Loss: 0.0098165841742517 | 
Epoch: 48 | MeanAbsoluteError: 0.0784743875265121 | Loss: 0.0095865090965833 | 
Epoch: 49 | MeanAbsoluteError: 0.0779817551374435 | Loss: 0.0114169973316357 | Epoch: 50 | 
MeanAbsoluteError: 0.0723554939031601 | Loss: 0.0093342512723451 | Epoch: 51 | 
MeanAbsoluteError: 0.0710147842764854 | Loss: 0.0090036800033168 | Epoch: 52 | MeanAbsoluteError: 0.0743891298770905 | Loss: 0.0111278193439112 | Epoch: 53 | MeanAbsoluteError: 0.0727041661739349 | Loss: 0.0103133383979041 | Epoch: 54 | 
MeanAbsoluteError: 0.0706437826156616 | Loss: 0.0097242977292473 | Epoch: 55 | 
MeanAbsoluteError: 0.0646881759166718 | Loss: 0.0088876342327383 | Epoch: 56 | MeanAbsoluteError: 0.0829079076647758 | Loss: 0.0128933832625319 | Epoch: 57 | MeanAbsoluteError: 0.0675030723214149 | Loss: 0.0083705220359231 | 
Epoch: 58 | MeanAbsoluteError: 0.0767833068966866 | Loss: 0.0099373241353437 | 
Epoch: 59 | MeanAbsoluteError: 0.0714833438396454 | Loss: 0.0100503236432192 | Early stopping at epoch 58
Returned to Spot: Validation loss: 0.010050323643219216

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.19981931523998656, 'lr_mult': 7.004318498645526, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07401195908206384}
Epoch: 1 | MeanAbsoluteError: 0.2298645228147507 | Loss: 0.0723050262190794 | Epoch: 2 | 
MeanAbsoluteError: 0.1311577558517456 | Loss: 0.0276005463184495 | Epoch: 3 | MeanAbsoluteError: 0.1222146376967430 | Loss: 0.0238469290105920 | Epoch: 4 | 
MeanAbsoluteError: 0.1406924873590469 | Loss: 0.0298010570634353 | Epoch: 5 | MeanAbsoluteError: 0.1447687745094299 | Loss: 0.0306070074439049 | Epoch: 6 | MeanAbsoluteError: 0.1171868517994881 | Loss: 0.0211990836419557 | Epoch: 7 | MeanAbsoluteError: 0.1036706194281578 | Loss: 0.0170289297637187 | Epoch: 8 | MeanAbsoluteError: 0.1349335461854935 | Loss: 0.0267111237503980 | 
Epoch: 9 | MeanAbsoluteError: 0.0933966487646103 | Loss: 0.0132947640101376 | Epoch: 10 | 
MeanAbsoluteError: 0.1245425045490265 | Loss: 0.0230791570226613 | Epoch: 11 | MeanAbsoluteError: 0.0915151908993721 | Loss: 0.0135606373905351 | Epoch: 12 | MeanAbsoluteError: 0.1636169105768204 | Loss: 0.0340025353392488 | Epoch: 13 | MeanAbsoluteError: 0.0957288071513176 | Loss: 0.0143535225407073 | Epoch: 14 | MeanAbsoluteError: 0.1493275016546249 | Loss: 0.0307427759429342 | 
Epoch: 15 | MeanAbsoluteError: 0.1574276685714722 | Loss: 0.0327281426442297 | Epoch: 16 | MeanAbsoluteError: 0.0799869596958160 | Loss: 0.0095492583748541 | Epoch: 17 | 
MeanAbsoluteError: 0.0761413052678108 | Loss: 0.0090572702649393 | Epoch: 18 | MeanAbsoluteError: 0.1375507563352585 | Loss: 0.0265040458425095 | Epoch: 19 | MeanAbsoluteError: 0.1663704961538315 | Loss: 0.0342947627956930 | Epoch: 20 | MeanAbsoluteError: 0.0865119770169258 | Loss: 0.0105804685307176 | Epoch: 21 | 
MeanAbsoluteError: 0.0645374730229378 | Loss: 0.0066027457482721 | Epoch: 22 | MeanAbsoluteError: 0.0716007500886917 | Loss: 0.0083035270830518 | Epoch: 23 | MeanAbsoluteError: 0.0532590672373772 | Loss: 0.0049695630533327 | Epoch: 24 | 
MeanAbsoluteError: 0.0775581076741219 | Loss: 0.0082704918704143 | Epoch: 25 | MeanAbsoluteError: 0.0954759418964386 | Loss: 0.0141071457611887 | Epoch: 26 | MeanAbsoluteError: 0.0511733144521713 | Loss: 0.0045458936181508 | Epoch: 27 | MeanAbsoluteError: 0.0539892278611660 | Loss: 0.0053302555614592 | Epoch: 28 | 
MeanAbsoluteError: 0.0490333661437035 | Loss: 0.0041849723048998 | Epoch: 29 | MeanAbsoluteError: 0.1263512074947357 | Loss: 0.0196785601836286 | Epoch: 30 | MeanAbsoluteError: 0.1145513504743576 | Loss: 0.0166868288560133 | Epoch: 31 | 
MeanAbsoluteError: 0.0717080235481262 | Loss: 0.0082769460706530 | Epoch: 32 | MeanAbsoluteError: 0.0793527066707611 | Loss: 0.0103870619235462 | Epoch: 33 | MeanAbsoluteError: 0.0636511668562889 | Loss: 0.0060786533071414 | Epoch: 34 | MeanAbsoluteError: 0.0551659502089024 | Loss: 0.0057379902818387 | Epoch: 35 | 
MeanAbsoluteError: 0.0763480439782143 | Loss: 0.0092521949524158 | Epoch: 36 | MeanAbsoluteError: 0.0559752397239208 | Loss: 0.0056035308118321 | Epoch: 37 | MeanAbsoluteError: 0.0908609852194786 | Loss: 0.0110796308880182 | Epoch: 38 | 
MeanAbsoluteError: 0.0624473690986633 | Loss: 0.0056381771267441 | Epoch: 39 | MeanAbsoluteError: 0.0537531673908234 | Loss: 0.0047649907891786 | Epoch: 40 | MeanAbsoluteError: 0.0589927732944489 | Loss: 0.0058194381478978 | Epoch: 41 | MeanAbsoluteError: 0.0445129461586475 | Loss: 0.0032646789730183 | Epoch: 42 | 
MeanAbsoluteError: 0.0535773038864136 | Loss: 0.0046113730334726 | Epoch: 43 | MeanAbsoluteError: 0.0585017465054989 | Loss: 0.0065994161230169 | Epoch: 44 | MeanAbsoluteError: 0.1343590170145035 | Loss: 0.0217486551325572 | Epoch: 45 | 
MeanAbsoluteError: 0.0881341919302940 | Loss: 0.0101912020656623 | Epoch: 46 | MeanAbsoluteError: 0.0506394654512405 | Loss: 0.0040953639392300 | Epoch: 47 | MeanAbsoluteError: 0.0433488637208939 | Loss: 0.0031640424246066 | Epoch: 48 | MeanAbsoluteError: 0.0720015540719032 | Loss: 0.0075748084407104 | 
Epoch: 49 | MeanAbsoluteError: 0.0413276106119156 | Loss: 0.0031068314442803 | Epoch: 50 | MeanAbsoluteError: 0.0785648524761200 | Loss: 0.0080422553184785 | Epoch: 51 | MeanAbsoluteError: 0.0684561282396317 | Loss: 0.0077080047983480 | Epoch: 52 | 
MeanAbsoluteError: 0.0443604439496994 | Loss: 0.0030910904445734 | Epoch: 53 | MeanAbsoluteError: 0.0574641153216362 | Loss: 0.0045455167756269 | Epoch: 54 | MeanAbsoluteError: 0.0848084315657616 | Loss: 0.0096277989888270 | Epoch: 55 | 
MeanAbsoluteError: 0.0866882652044296 | Loss: 0.0095783900959711 | Epoch: 56 | MeanAbsoluteError: 0.0801673755049706 | Loss: 0.0086018133810476 | Epoch: 57 | MeanAbsoluteError: 0.0415003709495068 | Loss: 0.0029076966457069 | Epoch: 58 | MeanAbsoluteError: 0.0437917225062847 | Loss: 0.0038134715103201 | Epoch: 59 | 
MeanAbsoluteError: 0.0766886174678802 | Loss: 0.0097043512045945 | Epoch: 60 | MeanAbsoluteError: 0.0417851246893406 | Loss: 0.0030413038207610 | Epoch: 61 | MeanAbsoluteError: 0.0751864090561867 | Loss: 0.0072491896142693 | 
Epoch: 62 | MeanAbsoluteError: 0.0851616486907005 | Loss: 0.0100979880723906 | Epoch: 63 | MeanAbsoluteError: 0.0689888969063759 | Loss: 0.0078919382618838 | Epoch: 64 | MeanAbsoluteError: 0.0381616614758968 | Loss: 0.0027377061472323 | Epoch: 65 | MeanAbsoluteError: 0.0942744985222816 | Loss: 0.0108227148946179 | Epoch: 66 | 
MeanAbsoluteError: 0.0565058588981628 | Loss: 0.0048832347077367 | Epoch: 67 | MeanAbsoluteError: 0.0653484761714935 | Loss: 0.0059973378175575 | Epoch: 68 | 
MeanAbsoluteError: 0.0433216914534569 | Loss: 0.0037468733743912 | Epoch: 69 | MeanAbsoluteError: 0.0819345414638519 | Loss: 0.0093703104036027 | Epoch: 70 | MeanAbsoluteError: 0.0438974499702454 | Loss: 0.0034950638655573 | Epoch: 71 | MeanAbsoluteError: 0.0938752368092537 | Loss: 0.0110000211402382 | Epoch: 72 | MeanAbsoluteError: 0.0833513885736465 | Loss: 0.0088046958522969 | Epoch: 73 | 
MeanAbsoluteError: 0.0758317783474922 | Loss: 0.0091762362832302 | Epoch: 74 | MeanAbsoluteError: 0.0623837485909462 | Loss: 0.0060014659171238 | Epoch: 75 | 
MeanAbsoluteError: 0.0429614149034023 | Loss: 0.0029395381417616 | Epoch: 76 | MeanAbsoluteError: 0.0693752616643906 | Loss: 0.0077041397361379 | Epoch: 77 | MeanAbsoluteError: 0.0344431884586811 | Loss: 0.0022107944793166 | Epoch: 78 | MeanAbsoluteError: 0.0788850039243698 | Loss: 0.0104683409199903 | Epoch: 79 | MeanAbsoluteError: 0.0481766313314438 | Loss: 0.0036854942353736 | Epoch: 80 | 
MeanAbsoluteError: 0.0325442999601364 | Loss: 0.0020409580932832 | Epoch: 81 | MeanAbsoluteError: 0.0447830818593502 | Loss: 0.0032139029476399 | Epoch: 82 | 
MeanAbsoluteError: 0.0595495998859406 | Loss: 0.0062200540162035 | Epoch: 83 | MeanAbsoluteError: 0.0506231524050236 | Loss: 0.0046691363738654 | Epoch: 84 | MeanAbsoluteError: 0.0438967347145081 | Loss: 0.0027406412777246 | Epoch: 85 | MeanAbsoluteError: 0.0430453494191170 | Loss: 0.0032540942039831 | Epoch: 86 | MeanAbsoluteError: 0.0385330989956856 | Loss: 0.0028732616766846 | Epoch: 87 | 
MeanAbsoluteError: 0.0415843129158020 | Loss: 0.0029628015870817 | Epoch: 88 | MeanAbsoluteError: 0.0615296885371208 | Loss: 0.0067420810902197 | Epoch: 89 | 
MeanAbsoluteError: 0.0409345738589764 | Loss: 0.0030407296603938 | Epoch: 90 | MeanAbsoluteError: 0.0437403544783592 | Loss: 0.0034806847045394 | Epoch: 91 | MeanAbsoluteError: 0.0718301683664322 | Loss: 0.0083132274693957 | Epoch: 92 | MeanAbsoluteError: 0.0430223196744919 | Loss: 0.0028670883590454 | Epoch: 93 | MeanAbsoluteError: 0.0390532128512859 | Loss: 0.0029509935380989 | 
Epoch: 94 | MeanAbsoluteError: 0.0603561960160732 | Loss: 0.0057925927134133 | Epoch: 95 | MeanAbsoluteError: 0.0698826834559441 | Loss: 0.0068900385062749 | Epoch: 96 | 
MeanAbsoluteError: 0.1048073843121529 | Loss: 0.0131166071974133 | Epoch: 97 | MeanAbsoluteError: 0.0438184067606926 | Loss: 0.0037703027054177 | Epoch: 98 | MeanAbsoluteError: 0.0324225984513760 | Loss: 0.0021546576233385 | Epoch: 99 | MeanAbsoluteError: 0.0379888266324997 | Loss: 0.0027638493675592 | Epoch: 100 | 
MeanAbsoluteError: 0.0622935816645622 | Loss: 0.0052003516742077 | Epoch: 101 | MeanAbsoluteError: 0.0335472039878368 | Loss: 0.0027016623291849 | Epoch: 102 | MeanAbsoluteError: 0.0643774047493935 | Loss: 0.0066801846444019 | Epoch: 103 | 
MeanAbsoluteError: 0.0358759909868240 | Loss: 0.0025026529573982 | Epoch: 104 | MeanAbsoluteError: 0.0479043386876583 | Loss: 0.0031632323577804 | Epoch: 105 | MeanAbsoluteError: 0.0461565032601357 | Loss: 0.0036297049434660 | Epoch: 106 | 
MeanAbsoluteError: 0.0557995922863483 | Loss: 0.0040632623345836 | Epoch: 107 | MeanAbsoluteError: 0.0603315494954586 | Loss: 0.0056074119516109 | Epoch: 108 | MeanAbsoluteError: 0.0408070124685764 | Loss: 0.0029361801846933 | Epoch: 109 | MeanAbsoluteError: 0.0372107438743114 | Loss: 0.0022350637959071 | Epoch: 110 | 
MeanAbsoluteError: 0.0597605779767036 | Loss: 0.0055995307201029 | Epoch: 111 | MeanAbsoluteError: 0.0372264198958874 | Loss: 0.0024809391102999 | Epoch: 112 | MeanAbsoluteError: 0.0302692726254463 | Loss: 0.0020200722486295 | Epoch: 113 | 
MeanAbsoluteError: 0.0556732565164566 | Loss: 0.0044167078970196 | Epoch: 114 | MeanAbsoluteError: 0.0319532789289951 | Loss: 0.0020377111520104 | Epoch: 115 | MeanAbsoluteError: 0.0315410792827606 | Loss: 0.0020351166420273 | Epoch: 116 | MeanAbsoluteError: 0.0289837904274464 | Loss: 0.0017579200074052 | 
Epoch: 117 | MeanAbsoluteError: 0.0457379482686520 | Loss: 0.0030549824678976 | Epoch: 118 | MeanAbsoluteError: 0.0479692481458187 | Loss: 0.0035312132248165 | Epoch: 119 | MeanAbsoluteError: 0.0726120769977570 | Loss: 0.0088981146630096 | Epoch: 120 | 
MeanAbsoluteError: 0.0352841094136238 | Loss: 0.0021452760280992 | Epoch: 121 | MeanAbsoluteError: 0.0844720602035522 | Loss: 0.0092097637243569 | Epoch: 122 | MeanAbsoluteError: 0.0354913063347340 | Loss: 0.0021139433129544 | Epoch: 123 | 
MeanAbsoluteError: 0.0820707380771637 | Loss: 0.0088259873323535 | Epoch: 124 | MeanAbsoluteError: 0.0723874494433403 | Loss: 0.0084685692318568 | Epoch: 125 | MeanAbsoluteError: 0.0435980558395386 | Loss: 0.0027748649131115 | Epoch: 126 | MeanAbsoluteError: 0.0299818012863398 | Loss: 0.0018187495573473 | Epoch: 127 | 
MeanAbsoluteError: 0.0337663255631924 | Loss: 0.0024028556317238 | Epoch: 128 | MeanAbsoluteError: 0.0620326288044453 | Loss: 0.0059802178170924 | Epoch: 129 | MeanAbsoluteError: 0.0765396505594254 | Loss: 0.0102964709512889 | Epoch: 130 | 
MeanAbsoluteError: 0.0462801568210125 | Loss: 0.0033860426077521 | Epoch: 131 | MeanAbsoluteError: 0.0664553046226501 | Loss: 0.0052954085955494 | Epoch: 132 | MeanAbsoluteError: 0.0607513189315796 | Loss: 0.0059288451693168 | Epoch: 133 | MeanAbsoluteError: 0.0566596537828445 | Loss: 0.0041695506262936 | Epoch: 134 | 
MeanAbsoluteError: 0.0738382712006569 | Loss: 0.0068019349618178 | Epoch: 135 | MeanAbsoluteError: 0.0451808162033558 | Loss: 0.0032654718471397 | Epoch: 136 | MeanAbsoluteError: 0.0627372190356255 | Loss: 0.0058779554613131 | Epoch: 137 | 
MeanAbsoluteError: 0.0437181219458580 | Loss: 0.0029652392197596 | Epoch: 138 | MeanAbsoluteError: 0.0580667257308960 | Loss: 0.0058665504850643 | Epoch: 139 | MeanAbsoluteError: 0.0392470806837082 | Loss: 0.0024223542269809 | Epoch: 140 | MeanAbsoluteError: 0.0693906098604202 | Loss: 0.0063008509919439 | Epoch: 141 | 
MeanAbsoluteError: 0.0473736338317394 | Loss: 0.0043357821536790 | Epoch: 142 | MeanAbsoluteError: 0.0538762100040913 | Loss: 0.0046466826093628 | Epoch: 143 | MeanAbsoluteError: 0.0292934514582157 | Loss: 0.0015782496852090 | Epoch: 144 | 
MeanAbsoluteError: 0.0544405877590179 | Loss: 0.0050655248158268 | Epoch: 145 | MeanAbsoluteError: 0.0407013744115829 | Loss: 0.0028923121832409 | Epoch: 146 | MeanAbsoluteError: 0.0275894012302160 | Loss: 0.0014298474278276 | Epoch: 147 | MeanAbsoluteError: 0.0556350946426392 | Loss: 0.0045638380841793 | Epoch: 148 | 
MeanAbsoluteError: 0.0449847579002380 | Loss: 0.0032801519356374 | Epoch: 149 | MeanAbsoluteError: 0.0566510334610939 | Loss: 0.0055462677693485 | Epoch: 150 | MeanAbsoluteError: 0.0416226498782635 | Loss: 0.0027181418232718 | 
Epoch: 151 | MeanAbsoluteError: 0.0474987365305424 | Loss: 0.0038212974813130 | Epoch: 152 | MeanAbsoluteError: 0.0548770762979984 | Loss: 0.0048469587743871 | Epoch: 153 | MeanAbsoluteError: 0.0422151461243629 | Loss: 0.0031461943504646 | Epoch: 154 | MeanAbsoluteError: 0.0726694539189339 | Loss: 0.0088899297345626 | Epoch: 155 | 
MeanAbsoluteError: 0.0610570348799229 | Loss: 0.0050748230546321 | Epoch: 156 | MeanAbsoluteError: 0.0385513938963413 | Loss: 0.0026788482944922 | Epoch: 157 | 
MeanAbsoluteError: 0.0530892871320248 | Loss: 0.0049227942516537 | Epoch: 158 | MeanAbsoluteError: 0.0310471914708614 | Loss: 0.0017961909179576 | Epoch: 159 | MeanAbsoluteError: 0.0362704619765282 | Loss: 0.0021518998117627 | Epoch: 160 | MeanAbsoluteError: 0.0621766522526741 | Loss: 0.0055169100922189 | Epoch: 161 | MeanAbsoluteError: 0.0603983737528324 | Loss: 0.0064058644501002 | Epoch: 162 | 
MeanAbsoluteError: 0.0713345557451248 | Loss: 0.0070993927258410 | Epoch: 163 | 
MeanAbsoluteError: 0.0521365962922573 | Loss: 0.0039538823827905 | Epoch: 164 | MeanAbsoluteError: 0.0392248518764973 | Loss: 0.0029431987235225 | Epoch: 165 | MeanAbsoluteError: 0.0363257303833961 | Loss: 0.0024879901657665 | Epoch: 166 | MeanAbsoluteError: 0.0896980091929436 | Loss: 0.0127976233580787 | Epoch: 167 | MeanAbsoluteError: 0.0479886382818222 | Loss: 0.0031969212240687 | Epoch: 168 | 
MeanAbsoluteError: 0.0312237106263638 | Loss: 0.0018164984005699 | Epoch: 169 | 
MeanAbsoluteError: 0.0420375838875771 | Loss: 0.0025478645632240 | Epoch: 170 | MeanAbsoluteError: 0.0311065893620253 | Loss: 0.0019898864220044 | Epoch: 171 | MeanAbsoluteError: 0.0465169586241245 | Loss: 0.0035185340522347 | Epoch: 172 | MeanAbsoluteError: 0.0409976653754711 | Loss: 0.0026161860074162 | Epoch: 173 | MeanAbsoluteError: 0.0353823266923428 | Loss: 0.0022442561059602 | Epoch: 174 | MeanAbsoluteError: 0.1094226688146591 | Loss: 0.0159117877483368 | Epoch: 175 | 
MeanAbsoluteError: 0.0506212487816811 | Loss: 0.0036283952404598 | Epoch: 176 | 
MeanAbsoluteError: 0.0396159291267395 | Loss: 0.0026525409745150 | Epoch: 177 | MeanAbsoluteError: 0.0348135903477669 | Loss: 0.0026475669246314 | Epoch: 178 | MeanAbsoluteError: 0.0306412409991026 | Loss: 0.0016865455361671 | Early stopping at epoch 177
Returned to Spot: Validation loss: 0.0016865455361671354

config: {'_L_in': 10, '_L_out': 1, 'l1': 128, 'dropout_prob': 0.8582565260508446, 'lr_mult': 0.4977322453322358, 'batch_size': 2, 'epochs': 32768, 'k_folds': 1, 'patience': 128, 'optimizer': 'ASGD', 'sgd_momentum': 0.6834550718769361}
Epoch: 1 | 
MeanAbsoluteError: 0.2102675139904022 | Loss: 0.0700052329490427 | Epoch: 2 | 
MeanAbsoluteError: 0.1902111917734146 | Loss: 0.0578029420127859 | Epoch: 3 | 
MeanAbsoluteError: 0.1704472601413727 | Loss: 0.0455920836143196 | Epoch: 4 | 
MeanAbsoluteError: 0.1693751066923141 | Loss: 0.0453828522380597 | Epoch: 5 | 
MeanAbsoluteError: 0.1519162058830261 | Loss: 0.0370325942806570 | Epoch: 6 | 
MeanAbsoluteError: 0.1647857576608658 | Loss: 0.0413459200109355 | Epoch: 7 | 
MeanAbsoluteError: 0.1444289833307266 | Loss: 0.0329250520459997 | Epoch: 8 | 
MeanAbsoluteError: 0.1495256125926971 | Loss: 0.0346060129922019 | Epoch: 9 | 
MeanAbsoluteError: 0.1445829421281815 | Loss: 0.0327894075153745 | Epoch: 10 | 
MeanAbsoluteError: 0.1404394507408142 | Loss: 0.0309249591022247 | Epoch: 11 | 
MeanAbsoluteError: 0.1367861032485962 | Loss: 0.0301508035687342 | Epoch: 12 | 
MeanAbsoluteError: 0.1403637528419495 | Loss: 0.0298146008420736 | Epoch: 13 | 
MeanAbsoluteError: 0.1421889811754227 | Loss: 0.0309560968841348 | Epoch: 14 | 
MeanAbsoluteError: 0.1355681270360947 | Loss: 0.0287911524920492 | Epoch: 15 | 
MeanAbsoluteError: 0.1322758793830872 | Loss: 0.0269071043825049 | Epoch: 16 | 
MeanAbsoluteError: 0.1372147947549820 | Loss: 0.0299760351347504 | Epoch: 17 | 
MeanAbsoluteError: 0.1334013938903809 | Loss: 0.0284501889260719 | Epoch: 18 | 
MeanAbsoluteError: 0.1335695087909698 | Loss: 0.0275006578292232 | Epoch: 19 | 
MeanAbsoluteError: 0.1363352984189987 | Loss: 0.0290654015521189 | Epoch: 20 | 
MeanAbsoluteError: 0.1326225101947784 | Loss: 0.0275961426610108 | Epoch: 21 | 
MeanAbsoluteError: 0.1369360089302063 | Loss: 0.0287218223907015 | Epoch: 22 | 
MeanAbsoluteError: 0.1323734968900681 | Loss: 0.0278122280626364 | Epoch: 23 | 
MeanAbsoluteError: 0.1373230367898941 | Loss: 0.0291733847224774 | Epoch: 24 | 
MeanAbsoluteError: 0.1348941922187805 | Loss: 0.0287413676993068 | Epoch: 25 | 
MeanAbsoluteError: 0.1398703008890152 | Loss: 0.0300548223855731 | Epoch: 26 | 
MeanAbsoluteError: 0.1359839737415314 | Loss: 0.0278233862900136 | Epoch: 27 | 
MeanAbsoluteError: 0.1371723413467407 | Loss: 0.0295950265634262 | Epoch: 28 | 
MeanAbsoluteError: 0.1320696026086807 | Loss: 0.0275795390935915 | Epoch: 29 | 
MeanAbsoluteError: 0.1351308971643448 | Loss: 0.0282096868621496 | Epoch: 30 | 
MeanAbsoluteError: 0.1336297243833542 | Loss: 0.0284704427943022 | Epoch: 31 | 
MeanAbsoluteError: 0.1294516921043396 | Loss: 0.0259481846124011 | Epoch: 32 | 
MeanAbsoluteError: 0.1316147893667221 | Loss: 0.0278283554319448 | Epoch: 33 | 
MeanAbsoluteError: 0.1346359699964523 | Loss: 0.0281896035256796 | Epoch: 34 | 
MeanAbsoluteError: 0.1319144815206528 | Loss: 0.0273319061663157 | Epoch: 35 | 
MeanAbsoluteError: 0.1326851397752762 | Loss: 0.0276891666042502 | Epoch: 36 | 
MeanAbsoluteError: 0.1345913410186768 | Loss: 0.0280713521813353 | Epoch: 37 | 
MeanAbsoluteError: 0.1326993554830551 | Loss: 0.0272130460611243 | Epoch: 38 | 
MeanAbsoluteError: 0.1354285031557083 | Loss: 0.0286762683039221 | Epoch: 39 | 
MeanAbsoluteError: 0.1343396306037903 | Loss: 0.0292079061026501 | Epoch: 40 | 
MeanAbsoluteError: 0.1323216855525970 | Loss: 0.0271999799676511 | Epoch: 41 | 
MeanAbsoluteError: 0.1359363347291946 | Loss: 0.0287333529506577 | Epoch: 42 | 
MeanAbsoluteError: 0.1383922100067139 | Loss: 0.0297411425444686 | Epoch: 43 | 
MeanAbsoluteError: 0.1332575231790543 | Loss: 0.0271407835496939 | Epoch: 44 | 
MeanAbsoluteError: 0.1348319053649902 | Loss: 0.0285623567773534 | Epoch: 45 | 
MeanAbsoluteError: 0.1325636655092239 | Loss: 0.0269271087023662 | Epoch: 46 | 
MeanAbsoluteError: 0.1323404908180237 | Loss: 0.0273918965288127 | Epoch: 47 | 
MeanAbsoluteError: 0.1314835548400879 | Loss: 0.0275082659434217 | Epoch: 48 | 
MeanAbsoluteError: 0.1325118839740753 | Loss: 0.0277585854500649 | Epoch: 49 | 
MeanAbsoluteError: 0.1351818889379501 | Loss: 0.0288086264085723 | Epoch: 50 | 
MeanAbsoluteError: 0.1328666657209396 | Loss: 0.0270632607707133 | Epoch: 51 | 
MeanAbsoluteError: 0.1315873265266418 | Loss: 0.0271051560469399 | Epoch: 52 | 
MeanAbsoluteError: 0.1309643387794495 | Loss: 0.0270515738606142 | Epoch: 53 | 
MeanAbsoluteError: 0.1308590173721313 | Loss: 0.0267266542107488 | Epoch: 54 | 
MeanAbsoluteError: 0.1291332244873047 | Loss: 0.0262955247475960 | Epoch: 55 | 
MeanAbsoluteError: 0.1332070380449295 | Loss: 0.0278715249624414 | Epoch: 56 | 
MeanAbsoluteError: 0.1315446794033051 | Loss: 0.0265039573529793 | Epoch: 57 | 
MeanAbsoluteError: 0.1346282660961151 | Loss: 0.0280348556671136 | Epoch: 58 | 
MeanAbsoluteError: 0.1319085508584976 | Loss: 0.0279327961548794 | Epoch: 59 | 
MeanAbsoluteError: 0.1346115320920944 | Loss: 0.0284140881807131 | Epoch: 60 | 
MeanAbsoluteError: 0.1329792886972427 | Loss: 0.0274519832962081 | Epoch: 61 | 
MeanAbsoluteError: 0.1313138455152512 | Loss: 0.0273683139205483 | Epoch: 62 | 
MeanAbsoluteError: 0.1324835121631622 | Loss: 0.0272303155153349 | Epoch: 63 | 
MeanAbsoluteError: 0.1308646500110626 | Loss: 0.0263581244484521 | Epoch: 64 | 
MeanAbsoluteError: 0.1340015381574631 | Loss: 0.0274037616678591 | Epoch: 65 | 
MeanAbsoluteError: 0.1322430223226547 | Loss: 0.0272585186181823 | Epoch: 66 | 
MeanAbsoluteError: 0.1358350366353989 | Loss: 0.0285829973557459 | Epoch: 67 | 
MeanAbsoluteError: 0.1313312202692032 | Loss: 0.0262801016263256 | Epoch: 68 | 
MeanAbsoluteError: 0.1326214373111725 | Loss: 0.0282333546235653 | Epoch: 69 | 
MeanAbsoluteError: 0.1294749230146408 | Loss: 0.0274280032874473 | Epoch: 70 | 
MeanAbsoluteError: 0.1334284991025925 | Loss: 0.0276461564169343 | Epoch: 71 | 
MeanAbsoluteError: 0.1350211650133133 | Loss: 0.0280860106343607 | Epoch: 72 | 
MeanAbsoluteError: 0.1288627386093140 | Loss: 0.0262988397310073 | Epoch: 73 | 
MeanAbsoluteError: 0.1258650571107864 | Loss: 0.0257986366617843 | Epoch: 74 | 
MeanAbsoluteError: 0.1320160180330276 | Loss: 0.0284305243047735 | Epoch: 75 | 
MeanAbsoluteError: 0.1315242499113083 | Loss: 0.0267569974019716 | Epoch: 76 | 
MeanAbsoluteError: 0.1270900815725327 | Loss: 0.0251626516123846 | Epoch: 77 | 
MeanAbsoluteError: 0.1290774196386337 | Loss: 0.0262120977829909 | Epoch: 78 | 
MeanAbsoluteError: 0.1323226839303970 | Loss: 0.0267147681474065 | Epoch: 79 | 
MeanAbsoluteError: 0.1293153911828995 | Loss: 0.0263596312516165 | Epoch: 80 | 
MeanAbsoluteError: 0.1291421055793762 | Loss: 0.0266981449957530 | Epoch: 81 | 
MeanAbsoluteError: 0.1317014396190643 | Loss: 0.0267117979713172 | Epoch: 82 | 
MeanAbsoluteError: 0.1329379826784134 | Loss: 0.0267283582722303 | Epoch: 83 | 
MeanAbsoluteError: 0.1293889582157135 | Loss: 0.0268393121918659 | Epoch: 84 | 
MeanAbsoluteError: 0.1289502680301666 | Loss: 0.0265247344132513 | Epoch: 85 | 
MeanAbsoluteError: 0.1309358477592468 | Loss: 0.0267960062957718 | Epoch: 86 | 
MeanAbsoluteError: 0.1339800208806992 | Loss: 0.0291091277476638 | Epoch: 87 | 
MeanAbsoluteError: 0.1306488364934921 | Loss: 0.0276701888881507 | Epoch: 88 | 
MeanAbsoluteError: 0.1269007325172424 | Loss: 0.0251975345493580 | Epoch: 89 | 
MeanAbsoluteError: 0.1317367702722549 | Loss: 0.0266242250544140 | Epoch: 90 | 
MeanAbsoluteError: 0.1306271106004715 | Loss: 0.0258505436492851 | Epoch: 91 | 
MeanAbsoluteError: 0.1257923096418381 | Loss: 0.0254803450923525 | Epoch: 92 | 
MeanAbsoluteError: 0.1319987326860428 | Loss: 0.0263663655910447 | Epoch: 93 | 
MeanAbsoluteError: 0.1297155171632767 | Loss: 0.0262844181972711 | Epoch: 94 | 
MeanAbsoluteError: 0.1282313317060471 | Loss: 0.0258336456426575 | Epoch: 95 | 
MeanAbsoluteError: 0.1305791288614273 | Loss: 0.0259409813903039 | Epoch: 96 | 
MeanAbsoluteError: 0.1299192458391190 | Loss: 0.0267952538813309 | Epoch: 97 | 
MeanAbsoluteError: 0.1337317526340485 | Loss: 0.0285358113419109 | Epoch: 98 | 
MeanAbsoluteError: 0.1359720528125763 | Loss: 0.0284682803261482 | Epoch: 99 | 
MeanAbsoluteError: 0.1368359178304672 | Loss: 0.0274737656553043 | Epoch: 100 | 
MeanAbsoluteError: 0.1246303915977478 | Loss: 0.0250178357934177 | Epoch: 101 | 
MeanAbsoluteError: 0.1314410716295242 | Loss: 0.0273502034942309 | Epoch: 102 | 
MeanAbsoluteError: 0.1310835480690002 | Loss: 0.0265947020305612 | Epoch: 103 | 
MeanAbsoluteError: 0.1256079375743866 | Loss: 0.0248133385669886 | Epoch: 104 | 
MeanAbsoluteError: 0.1273702085018158 | Loss: 0.0258738804601793 | Epoch: 105 | 
MeanAbsoluteError: 0.1329370141029358 | Loss: 0.0266674335473605 | Epoch: 106 | 
MeanAbsoluteError: 0.1300746947526932 | Loss: 0.0260796583358509 | Epoch: 107 | 
MeanAbsoluteError: 0.1262635737657547 | Loss: 0.0252232829822848 | Epoch: 108 | 
MeanAbsoluteError: 0.1316016614437103 | Loss: 0.0267054219685391 | Epoch: 109 | 
MeanAbsoluteError: 0.1257272958755493 | Loss: 0.0246715343375884 | Epoch: 110 | 
MeanAbsoluteError: 0.1216469556093216 | Loss: 0.0241570896546909 | Epoch: 111 | 
MeanAbsoluteError: 0.1300028711557388 | Loss: 0.0257637493615039 | Epoch: 112 | 
MeanAbsoluteError: 0.1254722923040390 | Loss: 0.0244095791159392 | Epoch: 113 | 
MeanAbsoluteError: 0.1247556433081627 | Loss: 0.0243579811501938 | Epoch: 114 | 
MeanAbsoluteError: 0.1298024356365204 | Loss: 0.0257387680254760 | Epoch: 115 | 
MeanAbsoluteError: 0.1292264163494110 | Loss: 0.0258599332454226 | Epoch: 116 | 
MeanAbsoluteError: 0.1263683587312698 | Loss: 0.0237060754367849 | Epoch: 117 | 
MeanAbsoluteError: 0.1295398175716400 | Loss: 0.0254856416733674 | Epoch: 118 | 
MeanAbsoluteError: 0.1306554675102234 | Loss: 0.0269362826354336 | Epoch: 119 | 
MeanAbsoluteError: 0.1246975362300873 | Loss: 0.0245332025622095 | Epoch: 120 | 
MeanAbsoluteError: 0.1276959031820297 | Loss: 0.0257547269590092 | Epoch: 121 | 
MeanAbsoluteError: 0.1313905268907547 | Loss: 0.0263389125947530 | Epoch: 122 | 
MeanAbsoluteError: 0.1308957487344742 | Loss: 0.0259577891469235 | Epoch: 123 | 
MeanAbsoluteError: 0.1270331889390945 | Loss: 0.0255616329296026 | Epoch: 124 | 
MeanAbsoluteError: 0.1258517652750015 | Loss: 0.0248064573726151 | Epoch: 125 | 
MeanAbsoluteError: 0.1281343549489975 | Loss: 0.0259041373229653 | Epoch: 126 | 
MeanAbsoluteError: 0.1216480880975723 | Loss: 0.0236343797259906 | Epoch: 127 | 
MeanAbsoluteError: 0.1280666887760162 | Loss: 0.0255383877176791 | Epoch: 128 | 
MeanAbsoluteError: 0.1275421082973480 | Loss: 0.0249033994598237 | Epoch: 129 | 
MeanAbsoluteError: 0.1286983937025070 | Loss: 0.0250221212751543 | Epoch: 130 | 
MeanAbsoluteError: 0.1285388320684433 | Loss: 0.0263967684063634 | Epoch: 131 | 
MeanAbsoluteError: 0.1292266100645065 | Loss: 0.0251264087326369 | Epoch: 132 | 
MeanAbsoluteError: 0.1295073479413986 | Loss: 0.0253726596887767 | Epoch: 133 | 
MeanAbsoluteError: 0.1279838830232620 | Loss: 0.0255606904519664 | Epoch: 134 | 
MeanAbsoluteError: 0.1300766915082932 | Loss: 0.0256406949323718 | Epoch: 135 | 
MeanAbsoluteError: 0.1244168356060982 | Loss: 0.0241338649195192 | Epoch: 136 | 
MeanAbsoluteError: 0.1242953985929489 | Loss: 0.0250053166821211 | Epoch: 137 | 
MeanAbsoluteError: 0.1281491816043854 | Loss: 0.0251866012951359 | Epoch: 138 | 
MeanAbsoluteError: 0.1280431002378464 | Loss: 0.0251377001110920 | Epoch: 139 | 
MeanAbsoluteError: 0.1248274371027946 | Loss: 0.0241240021228441 | Epoch: 140 | 
MeanAbsoluteError: 0.1227015554904938 | Loss: 0.0245439655071459 | Epoch: 141 | 
MeanAbsoluteError: 0.1298843622207642 | Loss: 0.0255411586355573 | Epoch: 142 | 
MeanAbsoluteError: 0.1220896765589714 | Loss: 0.0243916879071427 | Epoch: 143 | 
MeanAbsoluteError: 0.1272732764482498 | Loss: 0.0256080518243834 | Epoch: 144 | 
MeanAbsoluteError: 0.1272633075714111 | Loss: 0.0250219793947933 | Epoch: 145 | 
MeanAbsoluteError: 0.1243763342499733 | Loss: 0.0249034954612337 | Epoch: 146 | 
MeanAbsoluteError: 0.1276964098215103 | Loss: 0.0247417030789044 | Epoch: 147 | 
MeanAbsoluteError: 0.1216303780674934 | Loss: 0.0235365609275565 | Epoch: 148 | 
MeanAbsoluteError: 0.1283976584672928 | Loss: 0.0257982634430906 | Epoch: 149 | 
MeanAbsoluteError: 0.1304911673069000 | Loss: 0.0254237747793862 | Epoch: 150 | 
MeanAbsoluteError: 0.1330068707466125 | Loss: 0.0264143744669855 | Epoch: 151 | 
MeanAbsoluteError: 0.1230328232049942 | Loss: 0.0236413720425238 | Epoch: 152 | 
MeanAbsoluteError: 0.1269550323486328 | Loss: 0.0255889309786047 | Epoch: 153 | 
MeanAbsoluteError: 0.1303141266107559 | Loss: 0.0259740762907313 | Epoch: 154 | 
MeanAbsoluteError: 0.1235509589314461 | Loss: 0.0238506868071515 | Epoch: 155 | 
MeanAbsoluteError: 0.1253559440374374 | Loss: 0.0245093535417497 | Epoch: 156 | 
MeanAbsoluteError: 0.1231924667954445 | Loss: 0.0247702913483954 | Epoch: 157 | 
MeanAbsoluteError: 0.1295823603868484 | Loss: 0.0262727898198258 | Epoch: 158 | 
MeanAbsoluteError: 0.1278733760118484 | Loss: 0.0251748437492643 | Epoch: 159 | 
MeanAbsoluteError: 0.1199144199490547 | Loss: 0.0227695104174200 | Epoch: 160 | 
MeanAbsoluteError: 0.1252374053001404 | Loss: 0.0247888246475486 | Epoch: 161 | 
MeanAbsoluteError: 0.1227606311440468 | Loss: 0.0233336357145163 | Epoch: 162 | 
MeanAbsoluteError: 0.1273369789123535 | Loss: 0.0257185621307387 | Epoch: 163 | 
MeanAbsoluteError: 0.1237519830465317 | Loss: 0.0232765136946303 | Epoch: 164 | 
MeanAbsoluteError: 0.1229064166545868 | Loss: 0.0237345356884180 | Epoch: 165 | 
MeanAbsoluteError: 0.1262762397527695 | Loss: 0.0253981210764808 | Epoch: 166 | 
MeanAbsoluteError: 0.1281509995460510 | Loss: 0.0249654590317126 | Epoch: 167 | 
MeanAbsoluteError: 0.1239137649536133 | Loss: 0.0242376528247648 | Epoch: 168 | 
MeanAbsoluteError: 0.1230630204081535 | Loss: 0.0239877468943208 | Epoch: 169 | 
MeanAbsoluteError: 0.1247112378478050 | Loss: 0.0256065924063053 | Epoch: 170 | 
MeanAbsoluteError: 0.1229579001665115 | Loss: 0.0249163790212090 | Epoch: 171 | 
MeanAbsoluteError: 0.1241895556449890 | Loss: 0.0244219807383827 | Epoch: 172 | 
MeanAbsoluteError: 0.1243385672569275 | Loss: 0.0241788867663126 | Epoch: 173 | 
MeanAbsoluteError: 0.1253541409969330 | Loss: 0.0248438792563805 | Epoch: 174 | 
MeanAbsoluteError: 0.1242505386471748 | Loss: 0.0252868995567527 | Epoch: 175 | 
MeanAbsoluteError: 0.1203417703509331 | Loss: 0.0230033636144314 | Epoch: 176 | 
MeanAbsoluteError: 0.1245066076517105 | Loss: 0.0246181107750939 | Epoch: 177 | 
MeanAbsoluteError: 0.1221471279859543 | Loss: 0.0239063262273946 | Epoch: 178 | 
MeanAbsoluteError: 0.1234842538833618 | Loss: 0.0242254837757597 | Epoch: 179 | 
MeanAbsoluteError: 0.1209900826215744 | Loss: 0.0230126463896401 | Epoch: 180 | 
MeanAbsoluteError: 0.1258654892444611 | Loss: 0.0244968820097468 | Epoch: 181 | 
MeanAbsoluteError: 0.1274453699588776 | Loss: 0.0249511652763855 | Epoch: 182 | 
MeanAbsoluteError: 0.1274299621582031 | Loss: 0.0260672907218880 | Epoch: 183 | 
MeanAbsoluteError: 0.1197483167052269 | Loss: 0.0229019757693944 | Epoch: 184 | 
MeanAbsoluteError: 0.1219831183552742 | Loss: 0.0234900968522804 | Epoch: 185 | 
MeanAbsoluteError: 0.1258478760719299 | Loss: 0.0243632268416695 | Epoch: 186 | 
MeanAbsoluteError: 0.1289843916893005 | Loss: 0.0255433419044130 | Epoch: 187 | 
MeanAbsoluteError: 0.1220621392130852 | Loss: 0.0223041181580144 | Epoch: 188 | 
MeanAbsoluteError: 0.1205440238118172 | Loss: 0.0223933748658601 | Epoch: 189 | 
MeanAbsoluteError: 0.1234936118125916 | Loss: 0.0244739943884391 | Epoch: 190 | 
MeanAbsoluteError: 0.1201927065849304 | Loss: 0.0223184843539881 | Epoch: 191 | 
MeanAbsoluteError: 0.1359861940145493 | Loss: 0.0281348931079265 | Epoch: 192 | 
MeanAbsoluteError: 0.1225375011563301 | Loss: 0.0235323135276364 | Epoch: 193 | 
MeanAbsoluteError: 0.1156979724764824 | Loss: 0.0221839884005021 | Epoch: 194 | 
MeanAbsoluteError: 0.1230374276638031 | Loss: 0.0237839971993041 | Epoch: 195 | 
MeanAbsoluteError: 0.1287959814071655 | Loss: 0.0258700679007840 | Epoch: 196 | 
MeanAbsoluteError: 0.1242656931281090 | Loss: 0.0250640546331609 | Epoch: 197 | 
MeanAbsoluteError: 0.1216176822781563 | Loss: 0.0225814329611603 | Epoch: 198 | 
MeanAbsoluteError: 0.1183160766959190 | Loss: 0.0216939987466321 | Epoch: 199 | 
MeanAbsoluteError: 0.1174577325582504 | Loss: 0.0220731549389408 | Epoch: 200 | 
MeanAbsoluteError: 0.1178647205233574 | Loss: 0.0218637973417450 | Epoch: 201 | 
MeanAbsoluteError: 0.1207670569419861 | Loss: 0.0224049093275971 | Epoch: 202 | 
MeanAbsoluteError: 0.1222442239522934 | Loss: 0.0233788612563512 | Epoch: 203 | 
MeanAbsoluteError: 0.1254101097583771 | Loss: 0.0239695930171486 | Epoch: 204 | 
MeanAbsoluteError: 0.1194647103548050 | Loss: 0.0233337992228917 | Epoch: 205 | 
MeanAbsoluteError: 0.1226928457617760 | Loss: 0.0235651551392705 | Epoch: 206 | 
MeanAbsoluteError: 0.1238314583897591 | Loss: 0.0238619637972442 | Epoch: 207 | 
MeanAbsoluteError: 0.1176069006323814 | Loss: 0.0221152269300849 | Epoch: 208 | 
MeanAbsoluteError: 0.1229983121156693 | Loss: 0.0231393391072440 | Epoch: 209 | 
MeanAbsoluteError: 0.1220446676015854 | Loss: 0.0229629165236474 | Epoch: 210 | 
MeanAbsoluteError: 0.1209176108241081 | Loss: 0.0227465720652253 | Epoch: 211 | 
MeanAbsoluteError: 0.1284721046686172 | Loss: 0.0245805704874995 | Epoch: 212 | 
MeanAbsoluteError: 0.1285114139318466 | Loss: 0.0248372880018239 | Epoch: 213 | 
MeanAbsoluteError: 0.1275059878826141 | Loss: 0.0256342718140998 | Epoch: 214 | 
MeanAbsoluteError: 0.1207654848694801 | Loss: 0.0236312665033135 | Epoch: 215 | 
MeanAbsoluteError: 0.1192171126604080 | Loss: 0.0224707571422914 | Epoch: 216 | 
MeanAbsoluteError: 0.1203290522098541 | Loss: 0.0227653912679186 | Epoch: 217 | 
MeanAbsoluteError: 0.1214761883020401 | Loss: 0.0227677798597142 | Epoch: 218 | 
MeanAbsoluteError: 0.1233539208769798 | Loss: 0.0233017162022952 | Epoch: 219 | 
MeanAbsoluteError: 0.1244300305843353 | Loss: 0.0239834562751154 | Epoch: 220 | 
MeanAbsoluteError: 0.1210247576236725 | Loss: 0.0232080408688247 | Epoch: 221 | 
MeanAbsoluteError: 0.1149001941084862 | Loss: 0.0209321498541491 | Epoch: 222 | 
MeanAbsoluteError: 0.1260302066802979 | Loss: 0.0250623940417184 | Epoch: 223 | 
MeanAbsoluteError: 0.1296425759792328 | Loss: 0.0265303449663528 | Epoch: 224 | 
MeanAbsoluteError: 0.1263261884450912 | Loss: 0.0234201644613252 | Epoch: 225 | 
MeanAbsoluteError: 0.1197481378912926 | Loss: 0.0226027781875261 | Epoch: 226 | 
MeanAbsoluteError: 0.1205332800745964 | Loss: 0.0218801511206160 | Epoch: 227 | 
MeanAbsoluteError: 0.1243117749691010 | Loss: 0.0235715339456995 | Epoch: 228 | 
MeanAbsoluteError: 0.1212009415030479 | Loss: 0.0236190035902352 | Epoch: 229 | 
MeanAbsoluteError: 0.1238471493124962 | Loss: 0.0242575536294316 | Epoch: 230 | 
MeanAbsoluteError: 0.1184770092368126 | Loss: 0.0239081451293896 | Epoch: 231 | 
MeanAbsoluteError: 0.1209292635321617 | Loss: 0.0224181624354484 | Epoch: 232 | 
MeanAbsoluteError: 0.1230580285191536 | Loss: 0.0245733254488247 | Epoch: 233 | 
MeanAbsoluteError: 0.1239335536956787 | Loss: 0.0228608987199307 | Epoch: 234 | 
MeanAbsoluteError: 0.1182504147291183 | Loss: 0.0217470101684254 | Epoch: 235 | 
MeanAbsoluteError: 0.1203619986772537 | Loss: 0.0224266062828125 | Epoch: 236 | 
MeanAbsoluteError: 0.1190977096557617 | Loss: 0.0228768746853651 | Epoch: 237 | 
MeanAbsoluteError: 0.1222894787788391 | Loss: 0.0225844189309282 | Epoch: 238 | 
MeanAbsoluteError: 0.1228785216808319 | Loss: 0.0245114814394522 | Epoch: 239 | 
MeanAbsoluteError: 0.1206199228763580 | Loss: 0.0224941258190665 | Epoch: 240 | 
MeanAbsoluteError: 0.1278737038373947 | Loss: 0.0247227553539172 | Epoch: 241 | 
MeanAbsoluteError: 0.1167895644903183 | Loss: 0.0211972226358436 | Epoch: 242 | 
MeanAbsoluteError: 0.1184048876166344 | Loss: 0.0216626869243555 | Epoch: 243 | 
MeanAbsoluteError: 0.1244337484240532 | Loss: 0.0245967773436132 | Epoch: 244 | 
MeanAbsoluteError: 0.1168437972664833 | Loss: 0.0211213659144899 | Epoch: 245 | 
MeanAbsoluteError: 0.1190522983670235 | Loss: 0.0220293253432828 | Epoch: 246 | 
MeanAbsoluteError: 0.1138084158301353 | Loss: 0.0211509681826283 | Epoch: 247 | 
MeanAbsoluteError: 0.1150573864579201 | Loss: 0.0218722552771214 | Epoch: 248 | 
MeanAbsoluteError: 0.1180302798748016 | Loss: 0.0220100900266940 | Epoch: 249 | 
MeanAbsoluteError: 0.1220537573099136 | Loss: 0.0230908026724258 | Epoch: 250 | 
MeanAbsoluteError: 0.1188417300581932 | Loss: 0.0225336065472220 | Epoch: 251 | 
MeanAbsoluteError: 0.1138249188661575 | Loss: 0.0200077641700530 | Epoch: 252 | 
MeanAbsoluteError: 0.1161041930317879 | Loss: 0.0206555419291059 | Epoch: 253 | 
MeanAbsoluteError: 0.1129278019070625 | Loss: 0.0196378064693029 | Epoch: 254 | 
MeanAbsoluteError: 0.1191969439387321 | Loss: 0.0217842380475486 | Epoch: 255 | 
MeanAbsoluteError: 0.1178955957293510 | Loss: 0.0217673723236658 | Epoch: 256 | 
MeanAbsoluteError: 0.1225695312023163 | Loss: 0.0235642511541179 | Epoch: 257 | 
MeanAbsoluteError: 0.1189354062080383 | Loss: 0.0221451033592651 | Epoch: 258 | 
MeanAbsoluteError: 0.1159379482269287 | Loss: 0.0209394718445643 | Epoch: 259 | 
MeanAbsoluteError: 0.1145046129822731 | Loss: 0.0207393894296062 | Epoch: 260 | 
MeanAbsoluteError: 0.1135144531726837 | Loss: 0.0209288315546170 | Epoch: 261 | 
MeanAbsoluteError: 0.1143190860748291 | Loss: 0.0212320348639635 | Epoch: 262 | 
MeanAbsoluteError: 0.1203311905264854 | Loss: 0.0223308805727963 | Epoch: 263 | 
MeanAbsoluteError: 0.1187510788440704 | Loss: 0.0223521757698230 | Epoch: 264 | 
MeanAbsoluteError: 0.1112951263785362 | Loss: 0.0194042576799984 | Epoch: 265 | 
MeanAbsoluteError: 0.1200256124138832 | Loss: 0.0220208585454384 | Epoch: 266 | 
MeanAbsoluteError: 0.1108825802803040 | Loss: 0.0195892313580650 | Epoch: 267 | 
MeanAbsoluteError: 0.1140665039420128 | Loss: 0.0212596434280082 | Epoch: 268 | 
MeanAbsoluteError: 0.1138576492667198 | Loss: 0.0208727094482553 | Epoch: 269 | 
MeanAbsoluteError: 0.1228623837232590 | Loss: 0.0229354494923246 | Epoch: 270 | 
MeanAbsoluteError: 0.1239947527647018 | Loss: 0.0235173111618496 | Epoch: 271 | 
MeanAbsoluteError: 0.1184322088956833 | Loss: 0.0215539103346722 | Epoch: 272 | 
MeanAbsoluteError: 0.1139651089906693 | Loss: 0.0196214106114424 | Epoch: 273 | 
MeanAbsoluteError: 0.1161968633532524 | Loss: 0.0205856080231024 | Epoch: 274 | 
MeanAbsoluteError: 0.1189232617616653 | Loss: 0.0228102921399598 | Epoch: 275 | 
MeanAbsoluteError: 0.1183187365531921 | Loss: 0.0211991970293457 | Epoch: 276 | 
MeanAbsoluteError: 0.1199806481599808 | Loss: 0.0214618806982374 | Epoch: 277 | 
MeanAbsoluteError: 0.1160579398274422 | Loss: 0.0213208495988996 | Epoch: 278 | 
MeanAbsoluteError: 0.1179701387882233 | Loss: 0.0215897889621556 | Epoch: 279 | 
MeanAbsoluteError: 0.1227130219340324 | Loss: 0.0238527893999011 | Epoch: 280 | 
MeanAbsoluteError: 0.1229173764586449 | Loss: 0.0231404031535688 | Epoch: 281 | 
MeanAbsoluteError: 0.1178055182099342 | Loss: 0.0214884666224680 | Epoch: 282 | 
MeanAbsoluteError: 0.1166307330131531 | Loss: 0.0213225198407114 | Epoch: 283 | 
MeanAbsoluteError: 0.1184815838932991 | Loss: 0.0224593540875135 | Epoch: 284 | 
MeanAbsoluteError: 0.1215936392545700 | Loss: 0.0226987398487593 | Epoch: 285 | 
MeanAbsoluteError: 0.1152554228901863 | Loss: 0.0212227753332506 | Epoch: 286 | 
MeanAbsoluteError: 0.1137505620718002 | Loss: 0.0205230907607135 | Epoch: 287 | 
MeanAbsoluteError: 0.1227038577198982 | Loss: 0.0233315011995728 | Epoch: 288 | 
MeanAbsoluteError: 0.1172978356480598 | Loss: 0.0216168211314653 | Epoch: 289 | 
MeanAbsoluteError: 0.1165268421173096 | Loss: 0.0219216217240319 | Epoch: 290 | 
MeanAbsoluteError: 0.1112872809171677 | Loss: 0.0201413721899735 | Epoch: 291 | 
MeanAbsoluteError: 0.1169391870498657 | Loss: 0.0211478150009740 | Epoch: 292 | 
MeanAbsoluteError: 0.1087261065840721 | Loss: 0.0187534253972990 | Epoch: 293 | 
MeanAbsoluteError: 0.1149894446134567 | Loss: 0.0205256762765930 | Epoch: 294 | 
MeanAbsoluteError: 0.1132562011480331 | Loss: 0.0200840635438605 | Epoch: 295 | 
MeanAbsoluteError: 0.1164590567350388 | Loss: 0.0211450988286621 | Epoch: 296 | 
MeanAbsoluteError: 0.1234339922666550 | Loss: 0.0227225621935456 | Epoch: 297 | 
MeanAbsoluteError: 0.1213747635483742 | Loss: 0.0218261067468363 | Epoch: 298 | 
MeanAbsoluteError: 0.1127093881368637 | Loss: 0.0206090404669521 | Epoch: 299 | 
MeanAbsoluteError: 0.1139312908053398 | Loss: 0.0207886384594409 | Epoch: 300 | 
MeanAbsoluteError: 0.1185982152819633 | Loss: 0.0210673390916781 | Epoch: 301 | 
MeanAbsoluteError: 0.1100021600723267 | Loss: 0.0195816084379718 | Epoch: 302 | 
MeanAbsoluteError: 0.1146771907806396 | Loss: 0.0209409156637654 | Epoch: 303 | 
MeanAbsoluteError: 0.1114989444613457 | Loss: 0.0204456535896558 | Epoch: 304 | 
MeanAbsoluteError: 0.1060042157769203 | Loss: 0.0182423085901731 | Epoch: 305 | 
MeanAbsoluteError: 0.1107240915298462 | Loss: 0.0195195720785220 | Epoch: 306 | 
MeanAbsoluteError: 0.1152724325656891 | Loss: 0.0207731267367975 | Epoch: 307 | 
MeanAbsoluteError: 0.1147233545780182 | Loss: 0.0200741056437255 | Epoch: 308 | 
MeanAbsoluteError: 0.1116947531700134 | Loss: 0.0197723196629280 | Epoch: 309 | 
MeanAbsoluteError: 0.1184227392077446 | Loss: 0.0224489457386274 | Epoch: 310 | 
MeanAbsoluteError: 0.1177092269062996 | Loss: 0.0216322571821608 | Epoch: 311 | 
MeanAbsoluteError: 0.1190647482872009 | Loss: 0.0211090057645924 | Epoch: 312 | 
MeanAbsoluteError: 0.1083347573876381 | Loss: 0.0184748093901483 | Epoch: 313 | 
MeanAbsoluteError: 0.1128053441643715 | Loss: 0.0201024182817491 | Epoch: 314 | 
MeanAbsoluteError: 0.1107850670814514 | Loss: 0.0195984465022048 | Epoch: 315 | 
MeanAbsoluteError: 0.1091450899839401 | Loss: 0.0194626172037533 | Epoch: 316 | 
MeanAbsoluteError: 0.1038403734564781 | Loss: 0.0178249661163697 | Epoch: 317 | 
MeanAbsoluteError: 0.1171389669179916 | Loss: 0.0213841378810654 | Epoch: 318 | 
MeanAbsoluteError: 0.1109480038285255 | Loss: 0.0190781150546779 | Epoch: 319 | 
MeanAbsoluteError: 0.1136367172002792 | Loss: 0.0201267168830236 | Epoch: 320 | 
MeanAbsoluteError: 0.1172280088067055 | Loss: 0.0222621215877977 | Epoch: 321 | 
MeanAbsoluteError: 0.1155606955289841 | Loss: 0.0203938189101367 | Epoch: 322 | 
MeanAbsoluteError: 0.1099353805184364 | Loss: 0.0197518191332347 | Epoch: 323 | 
MeanAbsoluteError: 0.1141984686255455 | Loss: 0.0202540502073528 | Epoch: 324 | 
MeanAbsoluteError: 0.1124569475650787 | Loss: 0.0196308325407639 | Epoch: 325 | 
MeanAbsoluteError: 0.1116140782833099 | Loss: 0.0194612937883358 | Epoch: 326 | 
MeanAbsoluteError: 0.1172863021492958 | Loss: 0.0207787396640651 | Epoch: 327 | 
MeanAbsoluteError: 0.1136894226074219 | Loss: 0.0197656322567491 | Epoch: 328 | 
MeanAbsoluteError: 0.1135412752628326 | Loss: 0.0206906095358621 | Epoch: 329 | 
MeanAbsoluteError: 0.1099154949188232 | Loss: 0.0195675870151839 | Epoch: 330 | 
MeanAbsoluteError: 0.1114951446652412 | Loss: 0.0194799950518548 | Epoch: 331 | 
MeanAbsoluteError: 0.1203667297959328 | Loss: 0.0221433327442113 | Epoch: 332 | 
MeanAbsoluteError: 0.1172201782464981 | Loss: 0.0214955961201728 | Epoch: 333 | 
MeanAbsoluteError: 0.1101076230406761 | Loss: 0.0190324027752195 | Epoch: 334 | 
MeanAbsoluteError: 0.1202044039964676 | Loss: 0.0217025208938867 | Epoch: 335 | 
MeanAbsoluteError: 0.1143727004528046 | Loss: 0.0203296812928844 | Epoch: 336 | 
MeanAbsoluteError: 0.1074640005826950 | Loss: 0.0183476901652345 | Epoch: 337 | 
MeanAbsoluteError: 0.1090474724769592 | Loss: 0.0196792662288256 | Epoch: 338 | 
MeanAbsoluteError: 0.1105525046586990 | Loss: 0.0194957763344185 | Epoch: 339 | 
MeanAbsoluteError: 0.1099732816219330 | Loss: 0.0199719384095321 | Epoch: 340 | 
MeanAbsoluteError: 0.1112416237592697 | Loss: 0.0185751687509279 | Epoch: 341 | 
MeanAbsoluteError: 0.1115840375423431 | Loss: 0.0185860737370482 | Epoch: 342 | 
MeanAbsoluteError: 0.1100447699427605 | Loss: 0.0185696589054229 | Epoch: 343 | 
MeanAbsoluteError: 0.1146142706274986 | Loss: 0.0205673177303591 | Epoch: 344 | 
MeanAbsoluteError: 0.1180334240198135 | Loss: 0.0215321239770856 | Epoch: 345 | 
MeanAbsoluteError: 0.1154225170612335 | Loss: 0.0203762664787549 | Epoch: 346 | 
MeanAbsoluteError: 0.1113865002989769 | Loss: 0.0198626081445642 | Epoch: 347 | 
MeanAbsoluteError: 0.1113539114594460 | Loss: 0.0185956120409537 | Epoch: 348 | 
MeanAbsoluteError: 0.1109112277626991 | Loss: 0.0204713044206437 | Epoch: 349 | 
MeanAbsoluteError: 0.1102373898029327 | Loss: 0.0183471426501637 | Epoch: 350 | 
MeanAbsoluteError: 0.1079941317439079 | Loss: 0.0178741592704925 | Epoch: 351 | 
MeanAbsoluteError: 0.1133004501461983 | Loss: 0.0195486071342990 | Epoch: 352 | 
MeanAbsoluteError: 0.1091309711337090 | Loss: 0.0192581023531966 | Epoch: 353 | 
MeanAbsoluteError: 0.1106746271252632 | Loss: 0.0197598629271670 | Epoch: 354 | 
MeanAbsoluteError: 0.1061421483755112 | Loss: 0.0183699913645008 | Epoch: 355 | 
MeanAbsoluteError: 0.1197916194796562 | Loss: 0.0237493675776447 | Epoch: 356 | 
MeanAbsoluteError: 0.1131652444601059 | Loss: 0.0199773004423817 | Epoch: 357 | 
MeanAbsoluteError: 0.1060523763298988 | Loss: 0.0176641216907107 | Epoch: 358 | 
MeanAbsoluteError: 0.1121506020426750 | Loss: 0.0201430348924381 | Epoch: 359 | 
MeanAbsoluteError: 0.1088513806462288 | Loss: 0.0181910248589944 | Epoch: 360 | 
MeanAbsoluteError: 0.1114470958709717 | Loss: 0.0202714130242627 | Epoch: 361 | 
MeanAbsoluteError: 0.1084359213709831 | Loss: 0.0181774812148069 | Epoch: 362 | 
MeanAbsoluteError: 0.1131586357951164 | Loss: 0.0202884888344367 | Epoch: 363 | 
MeanAbsoluteError: 0.1085071936249733 | Loss: 0.0186360509012593 | Epoch: 364 | 
MeanAbsoluteError: 0.1097636669874191 | Loss: 0.0193709138991350 | Epoch: 365 | 
MeanAbsoluteError: 0.1120966821908951 | Loss: 0.0196423731649217 | Epoch: 366 | 
MeanAbsoluteError: 0.1163576766848564 | Loss: 0.0211185560436570 | Epoch: 367 | 
MeanAbsoluteError: 0.1069724559783936 | Loss: 0.0182413802355101 | Epoch: 368 | 
MeanAbsoluteError: 0.1158574447035789 | Loss: 0.0215859119286082 | Epoch: 369 | 
MeanAbsoluteError: 0.1151331961154938 | Loss: 0.0217689722171053 | Epoch: 370 | 
MeanAbsoluteError: 0.1170153692364693 | Loss: 0.0213258852182965 | Epoch: 371 | 
MeanAbsoluteError: 0.1130115613341331 | Loss: 0.0207253134681378 | Epoch: 372 | 
MeanAbsoluteError: 0.1014262735843658 | Loss: 0.0172444242029451 | Epoch: 373 | 
MeanAbsoluteError: 0.1079891100525856 | Loss: 0.0187004893554240 | Epoch: 374 | 
MeanAbsoluteError: 0.1104081496596336 | Loss: 0.0190538861916866 | Epoch: 375 | 
MeanAbsoluteError: 0.1107673421502113 | Loss: 0.0193246308959594 | Epoch: 376 | 
MeanAbsoluteError: 0.1056442558765411 | Loss: 0.0185647574392654 | Epoch: 377 | 
MeanAbsoluteError: 0.1040799021720886 | Loss: 0.0178372529238307 | Epoch: 378 | 
MeanAbsoluteError: 0.1148910671472549 | Loss: 0.0208913113199136 | Epoch: 379 | 
MeanAbsoluteError: 0.1141818091273308 | Loss: 0.0201505185857726 | Epoch: 380 | 
MeanAbsoluteError: 0.1101194769144058 | Loss: 0.0184993584140223 | Epoch: 381 | 
MeanAbsoluteError: 0.1112821325659752 | Loss: 0.0191732752729877 | Epoch: 382 | 
MeanAbsoluteError: 0.1083045080304146 | Loss: 0.0184835520648024 | Epoch: 383 | 
MeanAbsoluteError: 0.1031277924776077 | Loss: 0.0176558217865992 | Epoch: 384 | 
MeanAbsoluteError: 0.1162542626261711 | Loss: 0.0206359932509561 | Epoch: 385 | 
MeanAbsoluteError: 0.1100053116679192 | Loss: 0.0186747396927482 | Epoch: 386 | 
MeanAbsoluteError: 0.1042319014668465 | Loss: 0.0172732980792838 | Epoch: 387 | 
MeanAbsoluteError: 0.1054554954171181 | Loss: 0.0179135237121469 | Epoch: 388 | 
MeanAbsoluteError: 0.1136918142437935 | Loss: 0.0205074256897691 | Epoch: 389 | 
MeanAbsoluteError: 0.1144536435604095 | Loss: 0.0207948570311419 | Epoch: 390 | 
MeanAbsoluteError: 0.1063778251409531 | Loss: 0.0184382278054788 | Epoch: 391 | 
MeanAbsoluteError: 0.1093017458915710 | Loss: 0.0189151251932102 | Epoch: 392 | 
MeanAbsoluteError: 0.1103127673268318 | Loss: 0.0189185671649708 | Epoch: 393 | 
MeanAbsoluteError: 0.1163487210869789 | Loss: 0.0204652114893058 | Epoch: 394 | 
MeanAbsoluteError: 0.1059659570455551 | Loss: 0.0175768491303218 | Epoch: 395 | 
MeanAbsoluteError: 0.1061762496829033 | Loss: 0.0181319024823764 | Epoch: 396 | 
MeanAbsoluteError: 0.1082430258393288 | Loss: 0.0174185658502392 | Epoch: 397 | 
MeanAbsoluteError: 0.1135094985365868 | Loss: 0.0197790348138369 | Epoch: 398 | 
MeanAbsoluteError: 0.1118199303746223 | Loss: 0.0194046005930674 | Epoch: 399 | 
MeanAbsoluteError: 0.1096143499016762 | Loss: 0.0186319853877406 | Epoch: 400 | 
MeanAbsoluteError: 0.1098315417766571 | Loss: 0.0194485069151627 | Epoch: 401 | 
MeanAbsoluteError: 0.1078771948814392 | Loss: 0.0183863855820285 | Epoch: 402 | 
MeanAbsoluteError: 0.0985797420144081 | Loss: 0.0162425671764019 | Epoch: 403 | 
MeanAbsoluteError: 0.1073623374104500 | Loss: 0.0179628877468834 | Epoch: 404 | 
MeanAbsoluteError: 0.1028630584478378 | Loss: 0.0178884074802530 | Epoch: 405 | 
MeanAbsoluteError: 0.1082184761762619 | Loss: 0.0183466988605990 | Epoch: 406 | 
MeanAbsoluteError: 0.1104218661785126 | Loss: 0.0186570576659869 | Epoch: 407 | 
MeanAbsoluteError: 0.1006022244691849 | Loss: 0.0165893402691775 | Epoch: 408 | 
MeanAbsoluteError: 0.1080789044499397 | Loss: 0.0184906883639148 | Epoch: 409 | 
MeanAbsoluteError: 0.1065803915262222 | Loss: 0.0179645125131841 | Epoch: 410 | 
MeanAbsoluteError: 0.1124235391616821 | Loss: 0.0203065908331579 | Epoch: 411 | 
MeanAbsoluteError: 0.1093000248074532 | Loss: 0.0191671217917368 | Epoch: 412 | 
MeanAbsoluteError: 0.0966078862547874 | Loss: 0.0152736370590342 | Epoch: 413 | 
MeanAbsoluteError: 0.1038100868463516 | Loss: 0.0168429692335970 | Epoch: 414 | 
MeanAbsoluteError: 0.1072236746549606 | Loss: 0.0186142792037572 | Epoch: 415 | 
MeanAbsoluteError: 0.1052646860480309 | Loss: 0.0174917519066366 | Epoch: 416 | 
MeanAbsoluteError: 0.1088057681918144 | Loss: 0.0178884330691653 | Epoch: 417 | 
MeanAbsoluteError: 0.1104790866374969 | Loss: 0.0196447814899147 | Epoch: 418 | 
MeanAbsoluteError: 0.1005770936608315 | Loss: 0.0154605810453844 | Epoch: 419 | 
MeanAbsoluteError: 0.1070555001497269 | Loss: 0.0177700087717191 | Epoch: 420 | 
MeanAbsoluteError: 0.1097387820482254 | Loss: 0.0189863474376034 | Epoch: 421 | 
MeanAbsoluteError: 0.1024144440889359 | Loss: 0.0170932739910495 | Epoch: 422 | 
MeanAbsoluteError: 0.1085557937622070 | Loss: 0.0188421526051631 | Epoch: 423 | 
MeanAbsoluteError: 0.1129229366779327 | Loss: 0.0197384734790921 | Epoch: 424 | 
MeanAbsoluteError: 0.1020447090268135 | Loss: 0.0154831843953192 | Epoch: 425 | 
MeanAbsoluteError: 0.0974431484937668 | Loss: 0.0144806950667165 | Epoch: 426 | 
MeanAbsoluteError: 0.1066611930727959 | Loss: 0.0182443831500132 | Epoch: 427 | 
MeanAbsoluteError: 0.1082078516483307 | Loss: 0.0186480926018339 | Epoch: 428 | 
MeanAbsoluteError: 0.1127255484461784 | Loss: 0.0199842765862316 | Epoch: 429 | 
MeanAbsoluteError: 0.1010202616453171 | Loss: 0.0157428803886554 | Epoch: 430 | 
MeanAbsoluteError: 0.1073424816131592 | Loss: 0.0184276818295863 | Epoch: 431 | 
MeanAbsoluteError: 0.1078823879361153 | Loss: 0.0189910158392740 | Epoch: 432 | 
MeanAbsoluteError: 0.1061350405216217 | Loss: 0.0182186201614483 | Epoch: 433 | 
MeanAbsoluteError: 0.1050368621945381 | Loss: 0.0174774029051089 | Epoch: 434 | 
MeanAbsoluteError: 0.1022097021341324 | Loss: 0.0176141184859898 | Epoch: 435 | 
MeanAbsoluteError: 0.1035732775926590 | Loss: 0.0170162531867815 | Epoch: 436 | 
MeanAbsoluteError: 0.1107955649495125 | Loss: 0.0189139174593341 | Epoch: 437 | 
MeanAbsoluteError: 0.1076001003384590 | Loss: 0.0181775151464778 | Epoch: 438 | 
MeanAbsoluteError: 0.1103157550096512 | Loss: 0.0180585617210212 | Epoch: 439 | 
MeanAbsoluteError: 0.0987242907285690 | Loss: 0.0166644142848478 | Epoch: 440 | 
MeanAbsoluteError: 0.1042128056287766 | Loss: 0.0178156605951032 | Epoch: 441 | 
MeanAbsoluteError: 0.1036315336823463 | Loss: 0.0166473287887250 | Epoch: 442 | 
MeanAbsoluteError: 0.1042812764644623 | Loss: 0.0168682512188874 | Epoch: 443 | 
MeanAbsoluteError: 0.1039046868681908 | Loss: 0.0169052274274388 | Epoch: 444 | 
MeanAbsoluteError: 0.1005613729357719 | Loss: 0.0171008928685236 | Epoch: 445 | 
MeanAbsoluteError: 0.1089297086000443 | Loss: 0.0185141705477387 | Epoch: 446 | 
MeanAbsoluteError: 0.1029682159423828 | Loss: 0.0170057015290270 | Epoch: 447 | 
MeanAbsoluteError: 0.1019812151789665 | Loss: 0.0172717804495763 | Epoch: 448 | 
MeanAbsoluteError: 0.1016053408384323 | Loss: 0.0168519639029788 | Epoch: 449 | 
MeanAbsoluteError: 0.1032952666282654 | Loss: 0.0174556447161497 | Epoch: 450 | 
MeanAbsoluteError: 0.1090637966990471 | Loss: 0.0194075546173553 | Epoch: 451 | 
MeanAbsoluteError: 0.0968510285019875 | Loss: 0.0153647898138782 | Epoch: 452 | 
MeanAbsoluteError: 0.1080319434404373 | Loss: 0.0181882659715605 | Epoch: 453 | 
MeanAbsoluteError: 0.1026531010866165 | Loss: 0.0165582563802794 | Epoch: 454 | 
MeanAbsoluteError: 0.1027656644582748 | Loss: 0.0169871264434187 | Epoch: 455 | 
MeanAbsoluteError: 0.1030584499239922 | Loss: 0.0182213424418417 | Epoch: 456 | 
MeanAbsoluteError: 0.1050972566008568 | Loss: 0.0176845944045878 | Epoch: 457 | 
MeanAbsoluteError: 0.1082886606454849 | Loss: 0.0188664381343794 | Epoch: 458 | 
MeanAbsoluteError: 0.1030610427260399 | Loss: 0.0168680448738936 | Epoch: 459 | 
MeanAbsoluteError: 0.1062390878796577 | Loss: 0.0176622357205391 | Epoch: 460 | 
MeanAbsoluteError: 0.1010513603687286 | Loss: 0.0160592330798924 | Epoch: 461 | 
MeanAbsoluteError: 0.1037242189049721 | Loss: 0.0175088923414781 | Epoch: 462 | 
MeanAbsoluteError: 0.0996847227215767 | Loss: 0.0162871328825895 | Epoch: 463 | 
MeanAbsoluteError: 0.1028450280427933 | Loss: 0.0175891913717351 | Epoch: 464 | 
MeanAbsoluteError: 0.1076999828219414 | Loss: 0.0182758360010727 | Epoch: 465 | 
MeanAbsoluteError: 0.0998352468013763 | Loss: 0.0156349182651805 | Epoch: 466 | 
MeanAbsoluteError: 0.0980077013373375 | Loss: 0.0154706906826686 | Epoch: 467 | 
MeanAbsoluteError: 0.0983856990933418 | Loss: 0.0155107726874606 | Epoch: 468 | 
MeanAbsoluteError: 0.1016805022954941 | Loss: 0.0177262570226837 | Epoch: 469 | 
MeanAbsoluteError: 0.1044908687472343 | Loss: 0.0180568924769129 | Epoch: 470 | 
MeanAbsoluteError: 0.1044169664382935 | Loss: 0.0180222642709001 | Epoch: 471 | 
MeanAbsoluteError: 0.0998695790767670 | Loss: 0.0173250358633716 | Epoch: 472 | 
MeanAbsoluteError: 0.1001142412424088 | Loss: 0.0167369568090847 | Epoch: 473 | 
MeanAbsoluteError: 0.1080079749226570 | Loss: 0.0179532358421905 | Epoch: 474 | 
MeanAbsoluteError: 0.1014707535505295 | Loss: 0.0168618322504835 | Epoch: 475 | 
MeanAbsoluteError: 0.1033758297562599 | Loss: 0.0171427309479138 | Epoch: 476 | 
MeanAbsoluteError: 0.1050861328840256 | Loss: 0.0179493298879243 | Epoch: 477 | 
MeanAbsoluteError: 0.0991537272930145 | Loss: 0.0155396374180176 | Epoch: 478 | 
MeanAbsoluteError: 0.0994060561060905 | Loss: 0.0162475738374633 | Epoch: 479 | 
MeanAbsoluteError: 0.1072624996304512 | Loss: 0.0181582321104967 | Epoch: 480 | 
MeanAbsoluteError: 0.1012874171137810 | Loss: 0.0174265437384990 | Epoch: 481 | 
MeanAbsoluteError: 0.1009065657854080 | Loss: 0.0159158798698869 | Epoch: 482 | 
MeanAbsoluteError: 0.1054950878024101 | Loss: 0.0181722106381009 | Epoch: 483 | 
MeanAbsoluteError: 0.0971867144107819 | Loss: 0.0156648227361438 | Epoch: 484 | 
MeanAbsoluteError: 0.1049359813332558 | Loss: 0.0172289869571978 | Epoch: 485 | 
MeanAbsoluteError: 0.1019908413290977 | Loss: 0.0170625475561246 | Epoch: 486 | 
MeanAbsoluteError: 0.1018972173333168 | Loss: 0.0163799107017257 | Epoch: 487 | 
MeanAbsoluteError: 0.0923860073089600 | Loss: 0.0140937910763508 | Epoch: 488 | 
MeanAbsoluteError: 0.0976248905062675 | Loss: 0.0155754736408320 | Epoch: 489 | 
MeanAbsoluteError: 0.1014536321163177 | Loss: 0.0166061183147516 | Epoch: 490 | 
MeanAbsoluteError: 0.1052436381578445 | Loss: 0.0184943631670224 | Epoch: 491 | 
MeanAbsoluteError: 0.0991752594709396 | Loss: 0.0156068176250362 | Epoch: 492 | 
MeanAbsoluteError: 0.0947347655892372 | Loss: 0.0148993021188411 | Epoch: 493 | 
MeanAbsoluteError: 0.1100518777966499 | Loss: 0.0191614920042533 | Epoch: 494 | 
MeanAbsoluteError: 0.1056070923805237 | Loss: 0.0173845929727152 | Epoch: 495 | 
MeanAbsoluteError: 0.1005499660968781 | Loss: 0.0164102801292514 | Epoch: 496 | 
MeanAbsoluteError: 0.1027273982763290 | Loss: 0.0165491457164292 | Epoch: 497 | 
MeanAbsoluteError: 0.0989020764827728 | Loss: 0.0170743581438031 | Epoch: 498 | 
MeanAbsoluteError: 0.1039193496108055 | Loss: 0.0183461209881110 | Epoch: 499 | 
MeanAbsoluteError: 0.1026449576020241 | Loss: 0.0168292134146517 | Epoch: 500 | 
MeanAbsoluteError: 0.0939760431647301 | Loss: 0.0147978980380382 | Epoch: 501 | 
MeanAbsoluteError: 0.1077166125178337 | Loss: 0.0183066413398774 | Epoch: 502 | 
MeanAbsoluteError: 0.0993370488286018 | Loss: 0.0163019097216844 | Epoch: 503 | 
MeanAbsoluteError: 0.0945171266794205 | Loss: 0.0153303724879515 | Epoch: 504 | 
MeanAbsoluteError: 0.1008688509464264 | Loss: 0.0167775752919260 | Epoch: 505 | 
MeanAbsoluteError: 0.1000161617994308 | Loss: 0.0160814810981780 | Epoch: 506 | 
MeanAbsoluteError: 0.0964475125074387 | Loss: 0.0152281972941516 | Epoch: 507 | 
MeanAbsoluteError: 0.0980840399861336 | Loss: 0.0151069655128716 | Epoch: 508 | 
MeanAbsoluteError: 0.1020107269287109 | Loss: 0.0166987450830250 | Epoch: 509 | 
MeanAbsoluteError: 0.1021979674696922 | Loss: 0.0167664950191465 | Epoch: 510 | 
MeanAbsoluteError: 0.0917973965406418 | Loss: 0.0138971836048950 | Epoch: 511 | 
MeanAbsoluteError: 0.0963429212570190 | Loss: 0.0152386311171881 | Epoch: 512 | 
MeanAbsoluteError: 0.1007172763347626 | Loss: 0.0163271431545976 | Epoch: 513 | 
MeanAbsoluteError: 0.0974454432725906 | Loss: 0.0150090079839962 | Epoch: 514 | 
MeanAbsoluteError: 0.0970909595489502 | Loss: 0.0152078219187570 | Epoch: 515 | 
MeanAbsoluteError: 0.1093857213854790 | Loss: 0.0189685863059033 | Epoch: 516 | 
MeanAbsoluteError: 0.1001348719000816 | Loss: 0.0159167319953364 | Epoch: 517 | 
MeanAbsoluteError: 0.1002429872751236 | Loss: 0.0173474698936722 | Epoch: 518 | 
MeanAbsoluteError: 0.0968904420733452 | Loss: 0.0147789504478290 | Epoch: 519 | 
MeanAbsoluteError: 0.1099022030830383 | Loss: 0.0189467534753688 | Epoch: 520 | 
MeanAbsoluteError: 0.0999557301402092 | Loss: 0.0163296968406727 | Epoch: 521 | 
MeanAbsoluteError: 0.0940432772040367 | Loss: 0.0150107734339629 | Epoch: 522 | 
MeanAbsoluteError: 0.1007972657680511 | Loss: 0.0165020587223019 | Epoch: 523 | 
MeanAbsoluteError: 0.1039046943187714 | Loss: 0.0179870286903558 | Epoch: 524 | 
MeanAbsoluteError: 0.1025696396827698 | Loss: 0.0168178719457258 | Epoch: 525 | 
MeanAbsoluteError: 0.0984179973602295 | Loss: 0.0154235302003993 | Epoch: 526 | 
MeanAbsoluteError: 0.0999756827950478 | Loss: 0.0161285601375372 | Epoch: 527 | 
MeanAbsoluteError: 0.1014905944466591 | Loss: 0.0169098500771361 | Epoch: 528 | 
MeanAbsoluteError: 0.0993648767471313 | Loss: 0.0157294345559058 | Epoch: 529 | 
MeanAbsoluteError: 0.0958481952548027 | Loss: 0.0151875809337071 | Epoch: 530 | 
MeanAbsoluteError: 0.0981381163001060 | Loss: 0.0157585828482053 | Epoch: 531 | 
MeanAbsoluteError: 0.0965672805905342 | Loss: 0.0149766461527421 | Epoch: 532 | 
MeanAbsoluteError: 0.0964750424027443 | Loss: 0.0154436523162440 | Epoch: 533 | 
MeanAbsoluteError: 0.0996313169598579 | Loss: 0.0153808052581735 | Epoch: 534 | 
MeanAbsoluteError: 0.1016926169395447 | Loss: 0.0164642078203421 | Epoch: 535 | 
MeanAbsoluteError: 0.0961120948195457 | Loss: 0.0155447739682859 | Epoch: 536 | 
MeanAbsoluteError: 0.1009661704301834 | Loss: 0.0154702615079016 | Epoch: 537 | 
MeanAbsoluteError: 0.0927701070904732 | Loss: 0.0139665581687101 | Epoch: 538 | 
MeanAbsoluteError: 0.0975929275155067 | Loss: 0.0158387144066364 | Epoch: 539 | 
MeanAbsoluteError: 0.1090823113918304 | Loss: 0.0187838930328508 | Epoch: 540 | 
MeanAbsoluteError: 0.0926862731575966 | Loss: 0.0139182428712957 | Epoch: 541 | 
MeanAbsoluteError: 0.0952141359448433 | Loss: 0.0151013247385466 | Epoch: 542 | 
MeanAbsoluteError: 0.1026523187756538 | Loss: 0.0169537403314704 | Epoch: 543 | 
MeanAbsoluteError: 0.0927795246243477 | Loss: 0.0137619458422220 | Epoch: 544 | 
MeanAbsoluteError: 0.1018760204315186 | Loss: 0.0173547741950218 | Epoch: 545 | 
MeanAbsoluteError: 0.0876221582293510 | Loss: 0.0129409775619085 | Epoch: 546 | 
MeanAbsoluteError: 0.0948479548096657 | Loss: 0.0155146177764254 | Epoch: 547 | 
MeanAbsoluteError: 0.0949814319610596 | Loss: 0.0144324240290734 | Epoch: 548 | 
MeanAbsoluteError: 0.1003346219658852 | Loss: 0.0164650584347934 | Epoch: 549 | 
MeanAbsoluteError: 0.0971016734838486 | Loss: 0.0160147672195308 | Epoch: 550 | 
MeanAbsoluteError: 0.0968489944934845 | Loss: 0.0155255982812378 | Epoch: 551 | 
MeanAbsoluteError: 0.0989157184958458 | Loss: 0.0159895595274672 | Epoch: 552 | 
MeanAbsoluteError: 0.0949094891548157 | Loss: 0.0159155225827756 | Epoch: 553 | 
MeanAbsoluteError: 0.0996364429593086 | Loss: 0.0171524579235605 | Epoch: 554 | 
MeanAbsoluteError: 0.0945355296134949 | Loss: 0.0136509586978354 | Epoch: 555 | 
MeanAbsoluteError: 0.0961039140820503 | Loss: 0.0149329183692074 | Epoch: 556 | 
MeanAbsoluteError: 0.0990012139081955 | Loss: 0.0165087454026313 | Epoch: 557 | 
MeanAbsoluteError: 0.0989302769303322 | Loss: 0.0161787420539379 | Epoch: 558 | 
MeanAbsoluteError: 0.0916829332709312 | Loss: 0.0142824590044135 | Epoch: 559 | 
MeanAbsoluteError: 0.0980954542756081 | Loss: 0.0163639789991430 | Epoch: 560 | 
MeanAbsoluteError: 0.0932519435882568 | Loss: 0.0141505422331587 | Epoch: 561 | 
MeanAbsoluteError: 0.0952534526586533 | Loss: 0.0145549110552626 | Epoch: 562 | 
MeanAbsoluteError: 0.0996774584054947 | Loss: 0.0156302000666619 | Epoch: 563 | 
MeanAbsoluteError: 0.0977452695369720 | Loss: 0.0161742547542478 | Epoch: 564 | 
MeanAbsoluteError: 0.0895439311861992 | Loss: 0.0132933590046984 | Epoch: 565 | 
MeanAbsoluteError: 0.0941376537084579 | Loss: 0.0146976954252265 | Epoch: 566 | 
MeanAbsoluteError: 0.1013995260000229 | Loss: 0.0165438991334910 | Epoch: 567 | 
MeanAbsoluteError: 0.1030474603176117 | Loss: 0.0171867421689209 | Epoch: 568 | 
MeanAbsoluteError: 0.0905660465359688 | Loss: 0.0138430645086676 | Epoch: 569 | 
MeanAbsoluteError: 0.0905057564377785 | Loss: 0.0134842142437022 | Epoch: 570 | 
MeanAbsoluteError: 0.0910122320055962 | Loss: 0.0136786883624639 | Epoch: 571 | 
MeanAbsoluteError: 0.0933640524744987 | Loss: 0.0150762352257637 | Epoch: 572 | 
MeanAbsoluteError: 0.0958045050501823 | Loss: 0.0152325371302868 | Epoch: 573 | 
MeanAbsoluteError: 0.0984153971076012 | Loss: 0.0157607538873466 | Epoch: 574 | 
MeanAbsoluteError: 0.0905474945902824 | Loss: 0.0135822923557619 | Epoch: 575 | 
MeanAbsoluteError: 0.0918791666626930 | Loss: 0.0142797212744154 | Epoch: 576 | 
MeanAbsoluteError: 0.0922047346830368 | Loss: 0.0138489314861363 | Epoch: 577 | 
MeanAbsoluteError: 0.0958790108561516 | Loss: 0.0150872529657014 | Epoch: 578 | 
MeanAbsoluteError: 0.0954126641154289 | Loss: 0.0150977555640566 | Epoch: 579 | 
MeanAbsoluteError: 0.1041245311498642 | Loss: 0.0187601747452572 | Epoch: 580 | 
MeanAbsoluteError: 0.0959928110241890 | Loss: 0.0142142682177170 | Epoch: 581 | 
MeanAbsoluteError: 0.0892215967178345 | Loss: 0.0133904045842549 | Epoch: 582 | 
MeanAbsoluteError: 0.0938471630215645 | Loss: 0.0136533047924361 | Epoch: 583 | 
MeanAbsoluteError: 0.0891572833061218 | Loss: 0.0131718141755361 | Epoch: 584 | 
MeanAbsoluteError: 0.0962666049599648 | Loss: 0.0152779891085083 | Epoch: 585 | 
MeanAbsoluteError: 0.0949072614312172 | Loss: 0.0148243514096733 | Epoch: 586 | 
MeanAbsoluteError: 0.0947503522038460 | Loss: 0.0140619072997166 | Epoch: 587 | 
MeanAbsoluteError: 0.0899440199136734 | Loss: 0.0123618191588563 | Epoch: 588 | 
MeanAbsoluteError: 0.0914239287376404 | Loss: 0.0136703018918100 | Epoch: 589 | 
MeanAbsoluteError: 0.0943471118807793 | Loss: 0.0145854217026014 | Epoch: 590 | 
MeanAbsoluteError: 0.0967638194561005 | Loss: 0.0153680206452069 | Epoch: 591 | 
MeanAbsoluteError: 0.0934237316250801 | Loss: 0.0138307518876779 | Epoch: 592 | 
MeanAbsoluteError: 0.0914214104413986 | Loss: 0.0138032288863421 | Epoch: 593 | 
MeanAbsoluteError: 0.0960265845060349 | Loss: 0.0160195194552701 | Epoch: 594 | 
MeanAbsoluteError: 0.0908762589097023 | Loss: 0.0144466645822104 | Epoch: 595 | 
MeanAbsoluteError: 0.0973815470933914 | Loss: 0.0152153484319084 | Epoch: 596 | 
MeanAbsoluteError: 0.0903173089027405 | Loss: 0.0136349404588206 | Epoch: 597 | 
MeanAbsoluteError: 0.0993798300623894 | Loss: 0.0164040038574725 | Epoch: 598 | 
MeanAbsoluteError: 0.0928648784756660 | Loss: 0.0148511308150773 | Epoch: 599 | 
MeanAbsoluteError: 0.0925984457135201 | Loss: 0.0144162231851078 | Epoch: 600 | 
MeanAbsoluteError: 0.0999183505773544 | Loss: 0.0163086755104208 | Epoch: 601 | 
MeanAbsoluteError: 0.0949678793549538 | Loss: 0.0147953141444790 | Epoch: 602 | 
MeanAbsoluteError: 0.0939765349030495 | Loss: 0.0151060917086215 | Epoch: 603 | 
MeanAbsoluteError: 0.0900883451104164 | Loss: 0.0144351810567120 | Epoch: 604 | 
MeanAbsoluteError: 0.0943650528788567 | Loss: 0.0142321199094780 | Epoch: 605 | 
MeanAbsoluteError: 0.0943175479769707 | Loss: 0.0144278338145705 | Epoch: 606 | 
MeanAbsoluteError: 0.0966250672936440 | Loss: 0.0148062422547567 | Epoch: 607 | 
MeanAbsoluteError: 0.0929063409566879 | Loss: 0.0143242070393414 | Epoch: 608 | 
MeanAbsoluteError: 0.0964447259902954 | Loss: 0.0165878285482177 | Epoch: 609 | 
MeanAbsoluteError: 0.0911976322531700 | Loss: 0.0141807622512958 | Epoch: 610 | 
MeanAbsoluteError: 0.0998397096991539 | Loss: 0.0168758690922550 | Epoch: 611 | 
MeanAbsoluteError: 0.0933445617556572 | Loss: 0.0141533588031598 | Epoch: 612 | 
MeanAbsoluteError: 0.1003218889236450 | Loss: 0.0170749911178215 | Epoch: 613 | 
MeanAbsoluteError: 0.0928163006901741 | Loss: 0.0134476699212852 | Epoch: 614 | 
MeanAbsoluteError: 0.0897209718823433 | Loss: 0.0137047016221428 | Epoch: 615 | 
MeanAbsoluteError: 0.0935354456305504 | Loss: 0.0142482936388357 | Epoch: 616 | 
MeanAbsoluteError: 0.0933858901262283 | Loss: 0.0135930238121493 | Epoch: 617 | 
MeanAbsoluteError: 0.0918898880481720 | Loss: 0.0136457925226114 | Epoch: 618 | 
MeanAbsoluteError: 0.0930190011858940 | Loss: 0.0148269979656592 | Epoch: 619 | 
MeanAbsoluteError: 0.0951678082346916 | Loss: 0.0146986238623746 | Epoch: 620 | 
MeanAbsoluteError: 0.0936522185802460 | Loss: 0.0144980985643148 | Epoch: 621 | 
MeanAbsoluteError: 0.0880865082144737 | Loss: 0.0127878839933631 | Epoch: 622 | 
MeanAbsoluteError: 0.0964249148964882 | Loss: 0.0150128442532878 | Epoch: 623 | 
MeanAbsoluteError: 0.0964215323328972 | Loss: 0.0150659070204711 | Epoch: 624 | 
MeanAbsoluteError: 0.0916870385408401 | Loss: 0.0139418501170682 | Epoch: 625 | 
MeanAbsoluteError: 0.0943727493286133 | Loss: 0.0147048733378930 | Epoch: 626 | 
MeanAbsoluteError: 0.0872936844825745 | Loss: 0.0126948013046422 | Epoch: 627 | 
MeanAbsoluteError: 0.0949321165680885 | Loss: 0.0146096022160176 | Epoch: 628 | 
MeanAbsoluteError: 0.0940456688404083 | Loss: 0.0145572021667613 | Epoch: 629 | 
MeanAbsoluteError: 0.0927180722355843 | Loss: 0.0145954246538652 | Epoch: 630 | 
MeanAbsoluteError: 0.0939121916890144 | Loss: 0.0143216857194542 | Epoch: 631 | 
MeanAbsoluteError: 0.0899544879794121 | Loss: 0.0141671223289207 | Epoch: 632 | 
MeanAbsoluteError: 0.0897123292088509 | Loss: 0.0139130756513138 | Epoch: 633 | 
MeanAbsoluteError: 0.0875496789813042 | Loss: 0.0122651119255412 | Epoch: 634 | 
MeanAbsoluteError: 0.0856055542826653 | Loss: 0.0122901948574387 | Epoch: 635 | 
MeanAbsoluteError: 0.0943021997809410 | Loss: 0.0145512787488406 | Epoch: 636 | 
MeanAbsoluteError: 0.0920844003558159 | Loss: 0.0140073012297459 | Epoch: 637 | 
MeanAbsoluteError: 0.0914235934615135 | Loss: 0.0142126699681588 | Epoch: 638 | 
MeanAbsoluteError: 0.0964135974645615 | Loss: 0.0152535194434070 | Epoch: 639 | 
MeanAbsoluteError: 0.0941481292247772 | Loss: 0.0140724621999349 | Epoch: 640 | 
MeanAbsoluteError: 0.0919471979141235 | Loss: 0.0136402633980227 | Epoch: 641 | 
MeanAbsoluteError: 0.0897419601678848 | Loss: 0.0128721297246860 | Epoch: 642 | 
MeanAbsoluteError: 0.0859987735748291 | Loss: 0.0123512204378979 | Epoch: 643 | 
MeanAbsoluteError: 0.0952442437410355 | Loss: 0.0146059012127807 | Epoch: 644 | 
MeanAbsoluteError: 0.0882844403386116 | Loss: 0.0131798083862911 | Epoch: 645 | 
MeanAbsoluteError: 0.0949488058686256 | Loss: 0.0153795219777385 | Epoch: 646 | 
MeanAbsoluteError: 0.0833041220903397 | Loss: 0.0123624810551822 | Epoch: 647 | 
MeanAbsoluteError: 0.0986357480287552 | Loss: 0.0167904764682316 | Epoch: 648 | 
MeanAbsoluteError: 0.0921415761113167 | Loss: 0.0136074942604137 | Epoch: 649 | 
MeanAbsoluteError: 0.0899546146392822 | Loss: 0.0134202059395951 | Epoch: 650 | 
MeanAbsoluteError: 0.0902867093682289 | Loss: 0.0139226380417191 | Epoch: 651 | 
MeanAbsoluteError: 0.0890051722526550 | Loss: 0.0136951213330576 | Epoch: 652 | 
MeanAbsoluteError: 0.0883634686470032 | Loss: 0.0135377957807699 | Epoch: 653 | 
MeanAbsoluteError: 0.0934864357113838 | Loss: 0.0142462751980929 | Epoch: 654 | 
MeanAbsoluteError: 0.0901531502604485 | Loss: 0.0131909499006845 | Epoch: 655 | 
MeanAbsoluteError: 0.0906517803668976 | Loss: 0.0135523621848309 | Epoch: 656 | 
MeanAbsoluteError: 0.0944647192955017 | Loss: 0.0147696035142872 | Epoch: 657 | 
MeanAbsoluteError: 0.0898716524243355 | Loss: 0.0134419995284892 | Epoch: 658 | 
MeanAbsoluteError: 0.0908722653985023 | Loss: 0.0141600228689398 | Epoch: 659 | 
MeanAbsoluteError: 0.0914921090006828 | Loss: 0.0136172812132524 | Epoch: 660 | 
MeanAbsoluteError: 0.0862129181623459 | Loss: 0.0125896860675615 | Epoch: 661 | 
MeanAbsoluteError: 0.0899091660976410 | Loss: 0.0128018571685789 | Epoch: 662 | 
MeanAbsoluteError: 0.0886658951640129 | Loss: 0.0123498835242981 | Epoch: 663 | 
MeanAbsoluteError: 0.0919820815324783 | Loss: 0.0136060434315247 | Epoch: 664 | 
MeanAbsoluteError: 0.0909993052482605 | Loss: 0.0136573489211150 | Epoch: 665 | 
MeanAbsoluteError: 0.0857016146183014 | Loss: 0.0125602142562275 | Epoch: 666 | 
MeanAbsoluteError: 0.0921309068799019 | Loss: 0.0153196479408251 | Epoch: 667 | 
MeanAbsoluteError: 0.0874250382184982 | Loss: 0.0122946061741095 | Epoch: 668 | 
MeanAbsoluteError: 0.0904047191143036 | Loss: 0.0137904984501559 | Epoch: 669 | 
MeanAbsoluteError: 0.0838717892765999 | Loss: 0.0120195161146694 | Epoch: 670 | 
MeanAbsoluteError: 0.0933444276452065 | Loss: 0.0142137601671902 | Epoch: 671 | 
MeanAbsoluteError: 0.0826912149786949 | Loss: 0.0116376230075548 | Epoch: 672 | 
MeanAbsoluteError: 0.0937707796692848 | Loss: 0.0143063872153895 | Epoch: 673 | 
MeanAbsoluteError: 0.0928021073341370 | Loss: 0.0143146147663356 | Epoch: 674 | 
MeanAbsoluteError: 0.0910034552216530 | Loss: 0.0140793540118223 | Epoch: 675 | 
MeanAbsoluteError: 0.0887886211276054 | Loss: 0.0126948969314374 | Epoch: 676 | 
MeanAbsoluteError: 0.0914553999900818 | Loss: 0.0144349705032497 | Epoch: 677 | 
MeanAbsoluteError: 0.0864346474409103 | Loss: 0.0122873366463561 | Epoch: 678 | 
MeanAbsoluteError: 0.0911565199494362 | Loss: 0.0155455442583479 | Epoch: 679 | 
MeanAbsoluteError: 0.0874512195587158 | Loss: 0.0124682045781325 | Epoch: 680 | 
MeanAbsoluteError: 0.0868952050805092 | Loss: 0.0122871886139304 | Epoch: 681 | 
MeanAbsoluteError: 0.0857532098889351 | Loss: 0.0122076764364950 | Epoch: 682 | 
MeanAbsoluteError: 0.0893708765506744 | Loss: 0.0130092634931498 | Epoch: 683 | 
MeanAbsoluteError: 0.0933153033256531 | Loss: 0.0140856258919424 | Epoch: 684 | 
MeanAbsoluteError: 0.0828882381320000 | Loss: 0.0114508920138144 | Epoch: 685 | 
MeanAbsoluteError: 0.0847683623433113 | Loss: 0.0119703660677624 | Epoch: 686 | 
MeanAbsoluteError: 0.0841552242636681 | Loss: 0.0119749532328084 | Epoch: 687 | 
MeanAbsoluteError: 0.0901032462716103 | Loss: 0.0135006122748988 | Epoch: 688 | 
MeanAbsoluteError: 0.0865492448210716 | Loss: 0.0127749186941522 | Epoch: 689 | 
MeanAbsoluteError: 0.0901451110839844 | Loss: 0.0138095143953251 | Epoch: 690 | 
MeanAbsoluteError: 0.0857677608728409 | Loss: 0.0126865721644572 | Epoch: 691 | 
MeanAbsoluteError: 0.0843984186649323 | Loss: 0.0115191478347697 | Epoch: 692 | 
MeanAbsoluteError: 0.0862066298723221 | Loss: 0.0126267376492130 | Epoch: 693 | 
MeanAbsoluteError: 0.0904658734798431 | Loss: 0.0141702425702715 | Epoch: 694 | 
MeanAbsoluteError: 0.0892438367009163 | Loss: 0.0129698373368592 | Epoch: 695 | 
MeanAbsoluteError: 0.0888628959655762 | Loss: 0.0137570939340609 | Epoch: 696 | 
MeanAbsoluteError: 0.0895384326577187 | Loss: 0.0141815451815637 | Epoch: 697 | 
MeanAbsoluteError: 0.0861149206757545 | Loss: 0.0129314811857815 | Epoch: 698 | 
MeanAbsoluteError: 0.0846960097551346 | Loss: 0.0120541747261692 | Epoch: 699 | 
MeanAbsoluteError: 0.0872166976332664 | Loss: 0.0128992301407076 | Epoch: 700 | 
MeanAbsoluteError: 0.0866595730185509 | Loss: 0.0130213049557642 | Epoch: 701 | 
MeanAbsoluteError: 0.0869608595967293 | Loss: 0.0124296186906152 | Epoch: 702 | 
MeanAbsoluteError: 0.0872699767351151 | Loss: 0.0127087680813565 | Epoch: 703 | 
MeanAbsoluteError: 0.0841317698359489 | Loss: 0.0123266009954386 | Epoch: 704 | 
MeanAbsoluteError: 0.0838478431105614 | Loss: 0.0118643810501165 | Epoch: 705 | 
MeanAbsoluteError: 0.0907689630985260 | Loss: 0.0131419796437694 | Epoch: 706 | 
MeanAbsoluteError: 0.0923736691474915 | Loss: 0.0144344044545627 | Epoch: 707 | 
MeanAbsoluteError: 0.0874848067760468 | Loss: 0.0127259459533767 | Epoch: 708 | 
MeanAbsoluteError: 0.0847158059477806 | Loss: 0.0120570911309843 | Epoch: 709 | 
MeanAbsoluteError: 0.0846907198429108 | Loss: 0.0122015894107123 | Epoch: 710 | 
MeanAbsoluteError: 0.0923567339777946 | Loss: 0.0139561093621645 | Epoch: 711 | 
MeanAbsoluteError: 0.0813598558306694 | Loss: 0.0111752887310467 | Epoch: 712 | 
MeanAbsoluteError: 0.0870706215500832 | Loss: 0.0123346273374167 | Epoch: 713 | 
MeanAbsoluteError: 0.0867228657007217 | Loss: 0.0130413301346258 | Epoch: 714 | 
MeanAbsoluteError: 0.0853150933980942 | Loss: 0.0122990863758908 | Epoch: 715 | 
MeanAbsoluteError: 0.0857815966010094 | Loss: 0.0125917645540418 | Epoch: 716 | 
MeanAbsoluteError: 0.0787195339798927 | Loss: 0.0110922103355612 | Epoch: 717 | 
MeanAbsoluteError: 0.0846261307597160 | Loss: 0.0128886540252953 | Epoch: 718 | 
MeanAbsoluteError: 0.0919289961457253 | Loss: 0.0144492278527954 | Epoch: 719 | 
MeanAbsoluteError: 0.0877352878451347 | Loss: 0.0127414701784922 | Epoch: 720 | 
MeanAbsoluteError: 0.0868565812706947 | Loss: 0.0131175352238643 | Epoch: 721 | 
MeanAbsoluteError: 0.0793544575572014 | Loss: 0.0110426154763991 | Epoch: 722 | 
MeanAbsoluteError: 0.0870934426784515 | Loss: 0.0129277984675718 | Epoch: 723 | 
MeanAbsoluteError: 0.0913423523306847 | Loss: 0.0143532960437733 | Epoch: 724 | 
MeanAbsoluteError: 0.0847107842564583 | Loss: 0.0122247315116086 | Epoch: 725 | 
MeanAbsoluteError: 0.0861899107694626 | Loss: 0.0122133094459423 | Epoch: 726 | 
MeanAbsoluteError: 0.0843392908573151 | Loss: 0.0121308150672121 | Epoch: 727 | 
MeanAbsoluteError: 0.0903706103563309 | Loss: 0.0136447772903678 | Epoch: 728 | 
MeanAbsoluteError: 0.0850528925657272 | Loss: 0.0121053997641866 | Epoch: 729 | 
MeanAbsoluteError: 0.0886157676577568 | Loss: 0.0128993192680355 | Epoch: 730 | 
MeanAbsoluteError: 0.0836841538548470 | Loss: 0.0119437256065915 | Epoch: 731 | 
MeanAbsoluteError: 0.0845359638333321 | Loss: 0.0126823827906888 | Epoch: 732 | 
MeanAbsoluteError: 0.0884646475315094 | Loss: 0.0134886265749810 | Epoch: 733 | 
MeanAbsoluteError: 0.0781354084610939 | Loss: 0.0104260638561633 | Epoch: 734 | 
MeanAbsoluteError: 0.0892178565263748 | Loss: 0.0127959528273641 | Epoch: 735 | 
MeanAbsoluteError: 0.0856087207794189 | Loss: 0.0125594279036159 | Epoch: 736 | 
MeanAbsoluteError: 0.0869164317846298 | Loss: 0.0136363014497495 | Epoch: 737 | 
MeanAbsoluteError: 0.0886043310165405 | Loss: 0.0125537945987404 | Epoch: 738 | 
MeanAbsoluteError: 0.0798406973481178 | Loss: 0.0114735874767454 | Epoch: 739 | 
MeanAbsoluteError: 0.0847795084118843 | Loss: 0.0123684825277026 | Epoch: 740 | 
MeanAbsoluteError: 0.0835280641913414 | Loss: 0.0121070020223851 | Epoch: 741 | 
MeanAbsoluteError: 0.0758345872163773 | Loss: 0.0101700595118746 | Epoch: 742 | 
MeanAbsoluteError: 0.0866424366831779 | Loss: 0.0130124807901060 | Epoch: 743 | 
MeanAbsoluteError: 0.0827291831374168 | Loss: 0.0115952412581343 | Epoch: 744 | 
MeanAbsoluteError: 0.0893577411770821 | Loss: 0.0131314118698598 | Epoch: 745 | 
MeanAbsoluteError: 0.0815343558788300 | Loss: 0.0107954051935485 | Epoch: 746 | 
MeanAbsoluteError: 0.0882723331451416 | Loss: 0.0130692929822302 | Epoch: 747 | 
MeanAbsoluteError: 0.0816751047968864 | Loss: 0.0118581207354146 | Epoch: 748 | 
MeanAbsoluteError: 0.0859503075480461 | Loss: 0.0119931101474261 | Epoch: 749 | 
MeanAbsoluteError: 0.0868570432066917 | Loss: 0.0135347506445639 | Epoch: 750 | 
MeanAbsoluteError: 0.0853116810321808 | Loss: 0.0129509823729556 | Epoch: 751 | 
MeanAbsoluteError: 0.0842114314436913 | Loss: 0.0114447023558508 | Epoch: 752 | 
MeanAbsoluteError: 0.0837864205241203 | Loss: 0.0117758664601449 | Epoch: 753 | 
MeanAbsoluteError: 0.0848613902926445 | Loss: 0.0121458923700266 | Epoch: 754 | 
MeanAbsoluteError: 0.0860714688897133 | Loss: 0.0132789638465329 | Epoch: 755 | 
MeanAbsoluteError: 0.0842629298567772 | Loss: 0.0122338818977657 | Epoch: 756 | 
MeanAbsoluteError: 0.0842579752206802 | Loss: 0.0117402255890435 | Epoch: 757 | 
MeanAbsoluteError: 0.0839567407965660 | Loss: 0.0113860609992844 | Epoch: 758 | 
MeanAbsoluteError: 0.0879777744412422 | Loss: 0.0127438877175397 | Epoch: 759 | 
MeanAbsoluteError: 0.0808393731713295 | Loss: 0.0117020922933201 | Epoch: 760 | 
MeanAbsoluteError: 0.0866187661886215 | Loss: 0.0123780815792998 | Epoch: 761 | 
MeanAbsoluteError: 0.0900759920477867 | Loss: 0.0135301536951738 | Epoch: 762 | 
MeanAbsoluteError: 0.0831434130668640 | Loss: 0.0120612022713370 | Epoch: 763 | 
MeanAbsoluteError: 0.0854535922408104 | Loss: 0.0122649531954812 | Epoch: 764 | 
MeanAbsoluteError: 0.0810860916972160 | Loss: 0.0108526033610906 | Epoch: 765 | 
MeanAbsoluteError: 0.0850465297698975 | Loss: 0.0119650142199437 | Epoch: 766 | 
MeanAbsoluteError: 0.0840029492974281 | Loss: 0.0119365388162987 | Epoch: 767 | 
MeanAbsoluteError: 0.0808563232421875 | Loss: 0.0114324077948064 | Epoch: 768 | 
MeanAbsoluteError: 0.0813310593366623 | Loss: 0.0114667138246781 | Epoch: 769 | 
MeanAbsoluteError: 0.0834070518612862 | Loss: 0.0116390952894775 | Epoch: 770 | 
MeanAbsoluteError: 0.0799439474940300 | Loss: 0.0109760382125023 | Epoch: 771 | 
MeanAbsoluteError: 0.0862026885151863 | Loss: 0.0121631451724655 | Epoch: 772 | 
MeanAbsoluteError: 0.0773942023515701 | Loss: 0.0100014267676367 | Epoch: 773 | 
MeanAbsoluteError: 0.0828531980514526 | Loss: 0.0120185061364706 | Epoch: 774 | 
MeanAbsoluteError: 0.0864127799868584 | Loss: 0.0125402316975427 | Epoch: 775 | 
MeanAbsoluteError: 0.0896718800067902 | Loss: 0.0133060978676076 | Epoch: 776 | 
MeanAbsoluteError: 0.0802150443196297 | Loss: 0.0118395192625515 | Epoch: 777 | 
MeanAbsoluteError: 0.0791711807250977 | Loss: 0.0100883760230651 | Epoch: 778 | 
MeanAbsoluteError: 0.0781316012144089 | Loss: 0.0107688300175020 | Epoch: 779 | 
MeanAbsoluteError: 0.0775944516062737 | Loss: 0.0104368809142549 | Epoch: 780 | 
MeanAbsoluteError: 0.0889874026179314 | Loss: 0.0134515109674248 | Epoch: 781 | 
MeanAbsoluteError: 0.0862208902835846 | Loss: 0.0122916398667197 | Epoch: 782 | 
MeanAbsoluteError: 0.0798108205199242 | Loss: 0.0110968768920672 | Epoch: 783 | 
MeanAbsoluteError: 0.0804963931441307 | Loss: 0.0118157476947817 | Epoch: 784 | 
MeanAbsoluteError: 0.0776522010564804 | Loss: 0.0103806896301345 | Epoch: 785 | 
MeanAbsoluteError: 0.0859545767307281 | Loss: 0.0132408880347975 | Epoch: 786 | 
MeanAbsoluteError: 0.0854678750038147 | Loss: 0.0121864469328041 | Epoch: 787 | 
MeanAbsoluteError: 0.0822122320532799 | Loss: 0.0114099829130161 | Epoch: 788 | 
MeanAbsoluteError: 0.0790107324719429 | Loss: 0.0107910923366580 | Epoch: 789 | 
MeanAbsoluteError: 0.0771248340606689 | Loss: 0.0102200264722342 | Epoch: 790 | 
MeanAbsoluteError: 0.0901091620326042 | Loss: 0.0141825376562580 | Epoch: 791 | 
MeanAbsoluteError: 0.0827606171369553 | Loss: 0.0113155116213602 | Epoch: 792 | 
MeanAbsoluteError: 0.0812526568770409 | Loss: 0.0117330015626673 | Epoch: 793 | 
MeanAbsoluteError: 0.0786401331424713 | Loss: 0.0105240611347229 | Epoch: 794 | 
MeanAbsoluteError: 0.0906210988759995 | Loss: 0.0140195084948148 | Epoch: 795 | 
MeanAbsoluteError: 0.0812895819544792 | Loss: 0.0112063214911905 | Epoch: 796 | 
MeanAbsoluteError: 0.0839850381016731 | Loss: 0.0120314592663393 | Epoch: 797 | 
MeanAbsoluteError: 0.0834412723779678 | Loss: 0.0115786623429934 | Epoch: 798 | 
MeanAbsoluteError: 0.0812151804566383 | Loss: 0.0106683049314112 | Epoch: 799 | 
MeanAbsoluteError: 0.0763742700219154 | Loss: 0.0103957144342106 | Epoch: 800 | 
MeanAbsoluteError: 0.0798877403140068 | Loss: 0.0112059782354754 | Epoch: 801 | 
MeanAbsoluteError: 0.0794545784592628 | Loss: 0.0113850245135473 | Epoch: 802 | 
MeanAbsoluteError: 0.0882772952318192 | Loss: 0.0136871946473548 | Epoch: 803 | 
MeanAbsoluteError: 0.0800916701555252 | Loss: 0.0110358890703962 | Epoch: 804 | 
MeanAbsoluteError: 0.0725259333848953 | Loss: 0.0090490159723655 | Epoch: 805 | 
MeanAbsoluteError: 0.0803226828575134 | Loss: 0.0112123991530340 | Epoch: 806 | 
MeanAbsoluteError: 0.0840378403663635 | Loss: 0.0119105132838498 | Epoch: 807 | 
MeanAbsoluteError: 0.0873498767614365 | Loss: 0.0131001907811636 | Epoch: 808 | 
MeanAbsoluteError: 0.0818428918719292 | Loss: 0.0120988382856255 | Epoch: 809 | 
MeanAbsoluteError: 0.0782985016703606 | Loss: 0.0106757854460254 | Epoch: 810 | 
MeanAbsoluteError: 0.0824560895562172 | Loss: 0.0119074617669533 | Epoch: 811 | 
MeanAbsoluteError: 0.0821293517947197 | Loss: 0.0119441724711457 | Epoch: 812 | 
MeanAbsoluteError: 0.0832219794392586 | Loss: 0.0115171739636571 | Epoch: 813 | 
MeanAbsoluteError: 0.0824938267469406 | Loss: 0.0110972798257656 | Epoch: 814 | 
MeanAbsoluteError: 0.0840878710150719 | Loss: 0.0117424935035827 | Epoch: 815 | 
MeanAbsoluteError: 0.0839302688837051 | Loss: 0.0118463204779709 | Epoch: 816 | 
MeanAbsoluteError: 0.0832107365131378 | Loss: 0.0124136097215523 | Epoch: 817 | 
MeanAbsoluteError: 0.0769073739647865 | Loss: 0.0101805126779558 | Epoch: 818 | 
MeanAbsoluteError: 0.0832949578762054 | Loss: 0.0117550637021971 | Epoch: 819 | 
MeanAbsoluteError: 0.0740096569061279 | Loss: 0.0095643966046312 | Epoch: 820 | 
MeanAbsoluteError: 0.0754168927669525 | Loss: 0.0096059564733393 | Epoch: 821 | 
MeanAbsoluteError: 0.0801299884915352 | Loss: 0.0109681259503122 | Epoch: 822 | 
MeanAbsoluteError: 0.0877290070056915 | Loss: 0.0132411294273576 | Epoch: 823 | 
MeanAbsoluteError: 0.0738099738955498 | Loss: 0.0091930555650833 | Epoch: 824 | 
MeanAbsoluteError: 0.0823216438293457 | Loss: 0.0113966476301236 | Epoch: 825 | 
MeanAbsoluteError: 0.0730762258172035 | Loss: 0.0096490480711994 | Epoch: 826 | 
MeanAbsoluteError: 0.0775209143757820 | Loss: 0.0108585520722651 | Epoch: 827 | 
MeanAbsoluteError: 0.0800625681877136 | Loss: 0.0106971635242614 | Epoch: 828 | 
MeanAbsoluteError: 0.0830442681908607 | Loss: 0.0114131947926944 | Epoch: 829 | 
MeanAbsoluteError: 0.0812834650278091 | Loss: 0.0124094398109749 | Epoch: 830 | 
MeanAbsoluteError: 0.0802404880523682 | Loss: 0.0111840228424990 | Epoch: 831 | 
MeanAbsoluteError: 0.0865611061453819 | Loss: 0.0122170231806558 | Epoch: 832 | 
MeanAbsoluteError: 0.0766393169760704 | Loss: 0.0107930416374681 | Epoch: 833 | 
MeanAbsoluteError: 0.0792775452136993 | Loss: 0.0110985868957990 | Epoch: 834 | 
MeanAbsoluteError: 0.0718979611992836 | Loss: 0.0087367886219439 | Epoch: 835 | 
MeanAbsoluteError: 0.0837861150503159 | Loss: 0.0112630593621968 | Epoch: 836 | 
MeanAbsoluteError: 0.0794481039047241 | Loss: 0.0112295329577501 | Epoch: 837 | 
MeanAbsoluteError: 0.0799805447459221 | Loss: 0.0108191633181499 | Epoch: 838 | 
MeanAbsoluteError: 0.0753138363361359 | Loss: 0.0100799758657983 | Epoch: 839 | 
MeanAbsoluteError: 0.0814361795783043 | Loss: 0.0113643640919690 | Epoch: 840 | 
MeanAbsoluteError: 0.0781028494238853 | Loss: 0.0107340678073494 | Epoch: 841 | 
MeanAbsoluteError: 0.0771855488419533 | Loss: 0.0102697229348511 | Epoch: 842 | 
MeanAbsoluteError: 0.0809403955936432 | Loss: 0.0111956146650179 | Epoch: 843 | 
MeanAbsoluteError: 0.0764201506972313 | Loss: 0.0105490690810499 | Epoch: 844 | 
MeanAbsoluteError: 0.0738255828619003 | Loss: 0.0097503840384767 | Epoch: 845 | 
MeanAbsoluteError: 0.0785881280899048 | Loss: 0.0117377337430662 | Epoch: 846 | 
MeanAbsoluteError: 0.0779688134789467 | Loss: 0.0101995708775818 | Epoch: 847 | 
MeanAbsoluteError: 0.0807364657521248 | Loss: 0.0107182800451119 | Epoch: 848 | 
MeanAbsoluteError: 0.0804117023944855 | Loss: 0.0113706592589006 | Epoch: 849 | 
MeanAbsoluteError: 0.0828294157981873 | Loss: 0.0110238781937854 | Epoch: 850 | 
MeanAbsoluteError: 0.0774060785770416 | Loss: 0.0108154441271048 | Epoch: 851 | 
MeanAbsoluteError: 0.0771163329482079 | Loss: 0.0102891369386793 | Epoch: 852 | 
MeanAbsoluteError: 0.0783403366804123 | Loss: 0.0100651222461117 | Epoch: 853 | 
MeanAbsoluteError: 0.0766426697373390 | Loss: 0.0103630085376911 | Epoch: 854 | 
MeanAbsoluteError: 0.0791056975722313 | Loss: 0.0108683706768594 | Epoch: 855 | 
MeanAbsoluteError: 0.0764939263463020 | Loss: 0.0102093208984782 | Epoch: 856 | 
MeanAbsoluteError: 0.0814418941736221 | Loss: 0.0116528933390024 | Epoch: 857 | 
MeanAbsoluteError: 0.0757196247577667 | Loss: 0.0098749243262379 | Epoch: 858 | 
MeanAbsoluteError: 0.0742248371243477 | Loss: 0.0095135539109712 | Epoch: 859 | 
MeanAbsoluteError: 0.0841125324368477 | Loss: 0.0119662338884882 | Epoch: 860 | 
MeanAbsoluteError: 0.0771385431289673 | Loss: 0.0106761798496397 | Epoch: 861 | 
MeanAbsoluteError: 0.0801075771450996 | Loss: 0.0110092316208102 | Epoch: 862 | 
MeanAbsoluteError: 0.0781409740447998 | Loss: 0.0107365397114578 | Epoch: 863 | 
MeanAbsoluteError: 0.0781718343496323 | Loss: 0.0104807782462619 | Epoch: 864 | 
MeanAbsoluteError: 0.0794635787606239 | Loss: 0.0108283075337143 | Epoch: 865 | 
MeanAbsoluteError: 0.0785385444760323 | Loss: 0.0109409504162371 | Epoch: 866 | 
MeanAbsoluteError: 0.0750286206603050 | Loss: 0.0095710122664362 | Epoch: 867 | 
MeanAbsoluteError: 0.0773174315690994 | Loss: 0.0098690391287285 | Epoch: 868 | 
MeanAbsoluteError: 0.0767803639173508 | Loss: 0.0110145149399553 | Epoch: 869 | 
MeanAbsoluteError: 0.0764931514859200 | Loss: 0.0102086972078018 | Epoch: 870 | 
MeanAbsoluteError: 0.0775896161794662 | Loss: 0.0095922199140356 | Epoch: 871 | 
MeanAbsoluteError: 0.0743670612573624 | Loss: 0.0099460433783421 | Epoch: 872 | 
MeanAbsoluteError: 0.0775201916694641 | Loss: 0.0103023139870250 | Epoch: 873 | 
MeanAbsoluteError: 0.0769089236855507 | Loss: 0.0104139984305948 | Epoch: 874 | 
MeanAbsoluteError: 0.0778351575136185 | Loss: 0.0103990351249134 | Epoch: 875 | 
MeanAbsoluteError: 0.0746545642614365 | Loss: 0.0097688974583192 | Epoch: 876 | 
MeanAbsoluteError: 0.0754441544413567 | Loss: 0.0104262638159222 | Epoch: 877 | 
MeanAbsoluteError: 0.0789302289485931 | Loss: 0.0107850675039663 | Epoch: 878 | 
MeanAbsoluteError: 0.0779957920312881 | Loss: 0.0104319902939460 | Epoch: 879 | 
MeanAbsoluteError: 0.0791888460516930 | Loss: 0.0109203641870196 | Epoch: 880 | 
MeanAbsoluteError: 0.0734420269727707 | Loss: 0.0102968009971179 | Epoch: 881 | 
MeanAbsoluteError: 0.0805623084306717 | Loss: 0.0116654501038829 | Epoch: 882 | 
MeanAbsoluteError: 0.0795516967773438 | Loss: 0.0110667387986662 | Epoch: 883 | 
MeanAbsoluteError: 0.0825117006897926 | Loss: 0.0111786892855404 | Epoch: 884 | 
MeanAbsoluteError: 0.0732105821371078 | Loss: 0.0095361146165912 | Epoch: 885 | 
MeanAbsoluteError: 0.0807303711771965 | Loss: 0.0109143830911247 | Epoch: 886 | 
MeanAbsoluteError: 0.0835117027163506 | Loss: 0.0127478042116854 | Epoch: 887 | 
MeanAbsoluteError: 0.0746336653828621 | Loss: 0.0095123651331717 | Epoch: 888 | 
MeanAbsoluteError: 0.0762807503342628 | Loss: 0.0101715381572285 | Epoch: 889 | 
MeanAbsoluteError: 0.0816012024879456 | Loss: 0.0111705045261381 | Epoch: 890 | 
MeanAbsoluteError: 0.0728234797716141 | Loss: 0.0093935145442568 | Epoch: 891 | 
MeanAbsoluteError: 0.0753166228532791 | Loss: 0.0100770461460039 | Epoch: 892 | 
MeanAbsoluteError: 0.0754622742533684 | Loss: 0.0094174520477827 | Epoch: 893 | 
MeanAbsoluteError: 0.0743034332990646 | Loss: 0.0098858077853705 | Epoch: 894 | 
MeanAbsoluteError: 0.0756712555885315 | Loss: 0.0095969021834026 | Epoch: 895 | 
MeanAbsoluteError: 0.0754574611783028 | Loss: 0.0102671565598575 | Epoch: 896 | 
MeanAbsoluteError: 0.0775607079267502 | Loss: 0.0100980512174040 | Epoch: 897 | 
MeanAbsoluteError: 0.0826487243175507 | Loss: 0.0122165740561710 | Epoch: 898 | 
MeanAbsoluteError: 0.0699848905205727 | Loss: 0.0087210551842266 | Epoch: 899 | 
MeanAbsoluteError: 0.0771350860595703 | Loss: 0.0101687256007184 | Epoch: 900 | 
MeanAbsoluteError: 0.0748658180236816 | Loss: 0.0101067419190076 | Epoch: 901 | 
MeanAbsoluteError: 0.0805472210049629 | Loss: 0.0112878356254078 | Epoch: 902 | 
MeanAbsoluteError: 0.0746419876813889 | Loss: 0.0098066572048750 | Epoch: 903 | 
MeanAbsoluteError: 0.0746952071785927 | Loss: 0.0098825468095553 | Epoch: 904 | 
MeanAbsoluteError: 0.0787869393825531 | Loss: 0.0108093548449203 | Epoch: 905 | 
MeanAbsoluteError: 0.0752108991146088 | Loss: 0.0097216395382808 | Epoch: 906 | 
MeanAbsoluteError: 0.0848613604903221 | Loss: 0.0121929631560245 | Epoch: 907 | 
MeanAbsoluteError: 0.0791209191083908 | Loss: 0.0117048701097398 | Epoch: 908 | 
MeanAbsoluteError: 0.0808530300855637 | Loss: 0.0113955594588333 | Epoch: 909 | 
MeanAbsoluteError: 0.0770772770047188 | Loss: 0.0103067371755454 | Epoch: 910 | 
MeanAbsoluteError: 0.0764493718743324 | Loss: 0.0102760676636361 | Epoch: 911 | 
MeanAbsoluteError: 0.0741509124636650 | Loss: 0.0092806246098189 | Epoch: 912 | 
MeanAbsoluteError: 0.0816884860396385 | Loss: 0.0119303727195802 | Epoch: 913 | 
MeanAbsoluteError: 0.0733480826020241 | Loss: 0.0095463680885344 | Epoch: 914 | 
MeanAbsoluteError: 0.0761298462748528 | Loss: 0.0099002483793690 | Epoch: 915 | 
MeanAbsoluteError: 0.0747096389532089 | Loss: 0.0095522906991149 | Epoch: 916 | 
MeanAbsoluteError: 0.0766460001468658 | Loss: 0.0108985542458746 | Epoch: 917 | 
MeanAbsoluteError: 0.0786527916789055 | Loss: 0.0104521911375923 | Epoch: 918 | 
MeanAbsoluteError: 0.0804752409458160 | Loss: 0.0116180918461760 | Epoch: 919 | 
MeanAbsoluteError: 0.0777545571327209 | Loss: 0.0103211307371870 | Epoch: 920 | 
MeanAbsoluteError: 0.0779756531119347 | Loss: 0.0102706307186115 | Epoch: 921 | 
MeanAbsoluteError: 0.0779359862208366 | Loss: 0.0108993076187714 | Epoch: 922 | 
MeanAbsoluteError: 0.0759358704090118 | Loss: 0.0103246881165008 | Epoch: 923 | 
MeanAbsoluteError: 0.0763984173536301 | Loss: 0.0100957613766999 | Epoch: 924 | 
MeanAbsoluteError: 0.0703286752104759 | Loss: 0.0090990765301346 | Epoch: 925 | 
MeanAbsoluteError: 0.0735248699784279 | Loss: 0.0098544619079621 | Epoch: 926 | 
MeanAbsoluteError: 0.0746264457702637 | Loss: 0.0100789326563730 | Epoch: 927 | 
MeanAbsoluteError: 0.0730664730072021 | Loss: 0.0090286806012470 | Epoch: 928 | 
MeanAbsoluteError: 0.0797500163316727 | Loss: 0.0102156727723680 | Epoch: 929 | 
MeanAbsoluteError: 0.0764885991811752 | Loss: 0.0098379029554053 | Epoch: 930 | 
MeanAbsoluteError: 0.0715815722942352 | Loss: 0.0089564489267408 | Epoch: 931 | 
MeanAbsoluteError: 0.0794423967599869 | Loss: 0.0112672232636032 | Epoch: 932 | 
MeanAbsoluteError: 0.0724268928170204 | Loss: 0.0090378722118112 | Epoch: 933 | 
MeanAbsoluteError: 0.0754097327589989 | Loss: 0.0099079379982322 | Epoch: 934 | 
MeanAbsoluteError: 0.0757404565811157 | Loss: 0.0097645578289424 | Epoch: 935 | 
MeanAbsoluteError: 0.0724296793341637 | Loss: 0.0089836852836985 | Epoch: 936 | 
MeanAbsoluteError: 0.0719136893749237 | Loss: 0.0088832404560041 | Epoch: 937 | 
MeanAbsoluteError: 0.0790272280573845 | Loss: 0.0099801414067042 | Epoch: 938 | 
MeanAbsoluteError: 0.0677152350544930 | Loss: 0.0081527328717190 | Epoch: 939 | 
MeanAbsoluteError: 0.0721540227532387 | Loss: 0.0091816935042637 | Epoch: 940 | 
MeanAbsoluteError: 0.0765955522656441 | Loss: 0.0094809635374744 | Epoch: 941 | 
MeanAbsoluteError: 0.0727129876613617 | Loss: 0.0095080480841231 | Epoch: 942 | 
MeanAbsoluteError: 0.0773292258381844 | Loss: 0.0103785896316579 | Epoch: 943 | 
MeanAbsoluteError: 0.0792438313364983 | Loss: 0.0110065474185346 | Epoch: 944 | 
MeanAbsoluteError: 0.0739024132490158 | Loss: 0.0095757057363274 | Epoch: 945 | 
MeanAbsoluteError: 0.0727039873600006 | Loss: 0.0089056415118163 | Epoch: 946 | 
MeanAbsoluteError: 0.0793486312031746 | Loss: 0.0110480698788888 | Epoch: 947 | 
MeanAbsoluteError: 0.0771549344062805 | Loss: 0.0105916457230827 | Epoch: 948 | 
MeanAbsoluteError: 0.0703706443309784 | Loss: 0.0090822723888171 | Epoch: 949 | 
MeanAbsoluteError: 0.0740337669849396 | Loss: 0.0102533181999267 | Epoch: 950 | 
MeanAbsoluteError: 0.0765396952629089 | Loss: 0.0100489563544882 | Epoch: 951 | 
MeanAbsoluteError: 0.0765357688069344 | Loss: 0.0101444794183408 | Epoch: 952 | 
MeanAbsoluteError: 0.0734773129224777 | Loss: 0.0099917671943695 | Epoch: 953 | 
MeanAbsoluteError: 0.0715711712837219 | Loss: 0.0095782629013411 | Epoch: 954 | 
MeanAbsoluteError: 0.0729345530271530 | Loss: 0.0094018803842967 | Epoch: 955 | 
MeanAbsoluteError: 0.0733283907175064 | Loss: 0.0096717089774756 | Epoch: 956 | 
MeanAbsoluteError: 0.0664042308926582 | Loss: 0.0075158126316516 | Epoch: 957 | 
MeanAbsoluteError: 0.0849085971713066 | Loss: 0.0119881409450318 | Epoch: 958 | 
MeanAbsoluteError: 0.0715690329670906 | Loss: 0.0091539401113626 | Epoch: 959 | 
MeanAbsoluteError: 0.0777297839522362 | Loss: 0.0104211996043159 | Epoch: 960 | 
MeanAbsoluteError: 0.0760367810726166 | Loss: 0.0104746409421205 | Epoch: 961 | 
MeanAbsoluteError: 0.0776511132717133 | Loss: 0.0111037619700316 | Epoch: 962 | 
MeanAbsoluteError: 0.0707922950387001 | Loss: 0.0090281871824603 | Epoch: 963 | 
MeanAbsoluteError: 0.0769897550344467 | Loss: 0.0107690826061783 | Epoch: 964 | 
MeanAbsoluteError: 0.0697699263691902 | Loss: 0.0081867781741797 | Epoch: 965 | 
MeanAbsoluteError: 0.0764012634754181 | Loss: 0.0108604474635892 | Epoch: 966 | 
MeanAbsoluteError: 0.0792110189795494 | Loss: 0.0113623218954369 | Epoch: 967 | 
MeanAbsoluteError: 0.0680814906954765 | Loss: 0.0083186678276009 | Epoch: 968 | 
MeanAbsoluteError: 0.0725850313901901 | Loss: 0.0094845377973009 | Epoch: 969 | 
MeanAbsoluteError: 0.0762547701597214 | Loss: 0.0102596534014204 | Epoch: 970 | 
MeanAbsoluteError: 0.0696619078516960 | Loss: 0.0081080010741910 | Epoch: 971 | 
MeanAbsoluteError: 0.0711411610245705 | Loss: 0.0090589344280428 | Epoch: 972 | 
MeanAbsoluteError: 0.0727351084351540 | Loss: 0.0092486638832391 | Epoch: 973 | 
MeanAbsoluteError: 0.0737860798835754 | Loss: 0.0092965269653359 | Epoch: 974 | 
MeanAbsoluteError: 0.0753273069858551 | Loss: 0.0099358842343402 | Epoch: 975 | 
MeanAbsoluteError: 0.0756720975041389 | Loss: 0.0098584534610563 | Epoch: 976 | 
MeanAbsoluteError: 0.0716525614261627 | Loss: 0.0090443917666077 | Epoch: 977 | 
MeanAbsoluteError: 0.0730086863040924 | Loss: 0.0097757532730611 | Epoch: 978 | 
MeanAbsoluteError: 0.0764009654521942 | Loss: 0.0101318568076385 | Epoch: 979 | 
MeanAbsoluteError: 0.0712708234786987 | Loss: 0.0090927594126212 | Epoch: 980 | 
MeanAbsoluteError: 0.0709680244326591 | Loss: 0.0096254755349582 | Epoch: 981 | 
MeanAbsoluteError: 0.0715130865573883 | Loss: 0.0096350274606569 | Epoch: 982 | 
MeanAbsoluteError: 0.0728397071361542 | Loss: 0.0099155692999648 | Epoch: 983 | 
MeanAbsoluteError: 0.0771391838788986 | Loss: 0.0107261698419461 | Epoch: 984 | 
MeanAbsoluteError: 0.0724724307656288 | Loss: 0.0090657099912035 | Epoch: 985 | 
MeanAbsoluteError: 0.0712971761822701 | Loss: 0.0090209147415165 | Epoch: 986 | 
MeanAbsoluteError: 0.0698899328708649 | Loss: 0.0085721351750302 | Epoch: 987 | 
MeanAbsoluteError: 0.0693163201212883 | Loss: 0.0077545857433385 | Epoch: 988 | 
MeanAbsoluteError: 0.0778072550892830 | Loss: 0.0107944230326878 | Epoch: 989 | 
MeanAbsoluteError: 0.0761123374104500 | Loss: 0.0094622577789490 | Epoch: 990 | 
MeanAbsoluteError: 0.0749316513538361 | Loss: 0.0101282367263229 | Epoch: 991 | 
MeanAbsoluteError: 0.0717362016439438 | Loss: 0.0088800959480674 | Epoch: 992 | 
MeanAbsoluteError: 0.0655228495597839 | Loss: 0.0076068037412733 | Epoch: 993 | 
MeanAbsoluteError: 0.0738191530108452 | Loss: 0.0094339414276571 | Epoch: 994 | 
MeanAbsoluteError: 0.0797284319996834 | Loss: 0.0114746082314766 | Epoch: 995 | 
MeanAbsoluteError: 0.0736414566636086 | Loss: 0.0100833321006697 | Epoch: 996 | 
MeanAbsoluteError: 0.0766720548272133 | Loss: 0.0103790204787462 | Epoch: 997 | 
MeanAbsoluteError: 0.0690694302320480 | Loss: 0.0089957126947896 | Epoch: 998 | 
MeanAbsoluteError: 0.0725758820772171 | Loss: 0.0092693577688866 | Epoch: 999 | 
MeanAbsoluteError: 0.0757641568779945 | Loss: 0.0099406880475484 | Epoch: 1000 | 
MeanAbsoluteError: 0.0723375603556633 | Loss: 0.0101366889583248 | Epoch: 1001 | 
MeanAbsoluteError: 0.0713929086923599 | Loss: 0.0091776353289364 | Epoch: 1002 | 
MeanAbsoluteError: 0.0694112330675125 | Loss: 0.0086696119510937 | Epoch: 1003 | 
MeanAbsoluteError: 0.0732303783297539 | Loss: 0.0095423594975849 | Epoch: 1004 | 
MeanAbsoluteError: 0.0719602331519127 | Loss: 0.0082926946849329 | Epoch: 1005 | 
MeanAbsoluteError: 0.0707664713263512 | Loss: 0.0089822108592731 | Epoch: 1006 | 
MeanAbsoluteError: 0.0708745792508125 | Loss: 0.0093132891812517 | Epoch: 1007 | 
MeanAbsoluteError: 0.0725696086883545 | Loss: 0.0094351426910725 | Epoch: 1008 | 
MeanAbsoluteError: 0.0679365545511246 | Loss: 0.0079000075886628 | Epoch: 1009 | 
MeanAbsoluteError: 0.0667665898799896 | Loss: 0.0092165257916046 | Epoch: 1010 | 
MeanAbsoluteError: 0.0719863474369049 | Loss: 0.0090799885893405 | Epoch: 1011 | 
MeanAbsoluteError: 0.0761761292815208 | Loss: 0.0102922801974637 | Epoch: 1012 | 
MeanAbsoluteError: 0.0675073340535164 | Loss: 0.0081174084200272 | Epoch: 1013 | 
MeanAbsoluteError: 0.0678270235657692 | Loss: 0.0079732331828806 | Epoch: 1014 | 
MeanAbsoluteError: 0.0752263218164444 | Loss: 0.0106562207843914 | Epoch: 1015 | 
MeanAbsoluteError: 0.0706823244690895 | Loss: 0.0092785234641300 | Epoch: 1016 | 
MeanAbsoluteError: 0.0702643245458603 | Loss: 0.0087310705716845 | Epoch: 1017 | 
MeanAbsoluteError: 0.0732280239462852 | Loss: 0.0096235771773142 | Epoch: 1018 | 
MeanAbsoluteError: 0.0692768841981888 | Loss: 0.0082831174120171 | Epoch: 1019 | 
MeanAbsoluteError: 0.0753551498055458 | Loss: 0.0096873664389326 | Epoch: 1020 | 
MeanAbsoluteError: 0.0788179561495781 | Loss: 0.0112903491220156 | Epoch: 1021 | 
MeanAbsoluteError: 0.0696059018373489 | Loss: 0.0085636919625783 | Epoch: 1022 | 
MeanAbsoluteError: 0.0750660821795464 | Loss: 0.0098088718126261 | Epoch: 1023 | 
MeanAbsoluteError: 0.0688222870230675 | Loss: 0.0089297082419822 | Epoch: 1024 | 
MeanAbsoluteError: 0.0734671279788017 | Loss: 0.0099654179563125 | Epoch: 1025 | 
MeanAbsoluteError: 0.0677940100431442 | Loss: 0.0084685865843433 | Epoch: 1026 | 
MeanAbsoluteError: 0.0730460286140442 | Loss: 0.0097838113074319 | Epoch: 1027 | 
MeanAbsoluteError: 0.0737103074789047 | Loss: 0.0096964498836314 | Epoch: 1028 | 
MeanAbsoluteError: 0.0693713650107384 | Loss: 0.0093506347872608 | Epoch: 1029 | 
MeanAbsoluteError: 0.0701157450675964 | Loss: 0.0087472067823546 | Epoch: 1030 | 
MeanAbsoluteError: 0.0719802454113960 | Loss: 0.0096490722182110 | Epoch: 1031 | 
MeanAbsoluteError: 0.0744744092226028 | Loss: 0.0104563620192145 | Epoch: 1032 | 
MeanAbsoluteError: 0.0747015625238419 | Loss: 0.0103342440272293 | Epoch: 1033 | 
MeanAbsoluteError: 0.0731337293982506 | Loss: 0.0096799701658892 | Epoch: 1034 | 
MeanAbsoluteError: 0.0718859583139420 | Loss: 0.0092115516729730 | Epoch: 1035 | 
MeanAbsoluteError: 0.0719785094261169 | Loss: 0.0090696068745698 | Epoch: 1036 | 
MeanAbsoluteError: 0.0762908458709717 | Loss: 0.0108155495210970 | Epoch: 1037 | 
MeanAbsoluteError: 0.0699102133512497 | Loss: 0.0090078560039175 | Epoch: 1038 | 
MeanAbsoluteError: 0.0694839209318161 | Loss: 0.0086378032860375 | Epoch: 1039 | 
MeanAbsoluteError: 0.0731324180960655 | Loss: 0.0096406716015917 | Epoch: 1040 | 
MeanAbsoluteError: 0.0663361102342606 | Loss: 0.0076710213937743 | Epoch: 1041 | 
MeanAbsoluteError: 0.0674593001604080 | Loss: 0.0081189934132271 | Epoch: 1042 | 
MeanAbsoluteError: 0.0701092034578323 | Loss: 0.0089317029489708 | Epoch: 1043 | 
MeanAbsoluteError: 0.0735797211527824 | Loss: 0.0096080499193583 | Epoch: 1044 | 
MeanAbsoluteError: 0.0681488066911697 | Loss: 0.0079945703036507 | Epoch: 1045 | 
MeanAbsoluteError: 0.0694965645670891 | Loss: 0.0086281360519691 | Epoch: 1046 | 
MeanAbsoluteError: 0.0708992630243301 | Loss: 0.0085548651159055 | Epoch: 1047 | 
MeanAbsoluteError: 0.0678436905145645 | Loss: 0.0080009132574439 | Epoch: 1048 | 
MeanAbsoluteError: 0.0731303021311760 | Loss: 0.0092584842301646 | Epoch: 1049 | 
MeanAbsoluteError: 0.0756253078579903 | Loss: 0.0105017330964862 | Epoch: 1050 | 
MeanAbsoluteError: 0.0721068158745766 | Loss: 0.0089157650391523 | Epoch: 1051 | 
MeanAbsoluteError: 0.0698562487959862 | Loss: 0.0081887228436244 | Epoch: 1052 | 
MeanAbsoluteError: 0.0688799545168877 | Loss: 0.0084516765458996 | Epoch: 1053 | 
MeanAbsoluteError: 0.0791916921734810 | Loss: 0.0116683767591409 | Epoch: 1054 | 
MeanAbsoluteError: 0.0730694830417633 | Loss: 0.0094450911650529 | Epoch: 1055 | 
MeanAbsoluteError: 0.0685431510210037 | Loss: 0.0087991150578576 | Epoch: 1056 | 
MeanAbsoluteError: 0.0678988918662071 | Loss: 0.0082361182645339 | Epoch: 1057 | 
MeanAbsoluteError: 0.0718125626444817 | Loss: 0.0095836025548518 | Epoch: 1058 | 
MeanAbsoluteError: 0.0689691454172134 | Loss: 0.0083297175485738 | Epoch: 1059 | 
MeanAbsoluteError: 0.0660716146230698 | Loss: 0.0076677496425570 | Epoch: 1060 | 
MeanAbsoluteError: 0.0669567584991455 | Loss: 0.0078201846442971 | Epoch: 1061 | 
MeanAbsoluteError: 0.0718378126621246 | Loss: 0.0092942472408079 | Epoch: 1062 | 
MeanAbsoluteError: 0.0683273673057556 | Loss: 0.0085367330375690 | Epoch: 1063 | 
MeanAbsoluteError: 0.0689010992646217 | Loss: 0.0087301500673228 | Epoch: 1064 | 
MeanAbsoluteError: 0.0643932297825813 | Loss: 0.0071408245173613 | Epoch: 1065 | 
MeanAbsoluteError: 0.0712036862969398 | Loss: 0.0091494820010121 | Epoch: 1066 | 
MeanAbsoluteError: 0.0682067498564720 | Loss: 0.0087686679004764 | Epoch: 1067 | 
MeanAbsoluteError: 0.0710598751902580 | Loss: 0.0090669604683111 | Epoch: 1068 | 
MeanAbsoluteError: 0.0675958842039108 | Loss: 0.0081680967913417 | Epoch: 1069 | 
MeanAbsoluteError: 0.0707667469978333 | Loss: 0.0094727789251677 | Epoch: 1070 | 
MeanAbsoluteError: 0.0663241595029831 | Loss: 0.0078773448887538 | Epoch: 1071 | 
MeanAbsoluteError: 0.0724717304110527 | Loss: 0.0093914666551670 | Epoch: 1072 | 
MeanAbsoluteError: 0.0717313811182976 | Loss: 0.0090600793244569 | Epoch: 1073 | 
MeanAbsoluteError: 0.0719677880406380 | Loss: 0.0091367837757692 | Epoch: 1074 | 
MeanAbsoluteError: 0.0674020349979401 | Loss: 0.0085003050091230 | Epoch: 1075 | 
MeanAbsoluteError: 0.0694231316447258 | Loss: 0.0089321442251821 | Epoch: 1076 | 
MeanAbsoluteError: 0.0661793649196625 | Loss: 0.0070797218290924 | Epoch: 1077 | 
MeanAbsoluteError: 0.0693086609244347 | Loss: 0.0086002728496048 | Epoch: 1078 | 
MeanAbsoluteError: 0.0682182610034943 | Loss: 0.0084075029252078 | Epoch: 1079 | 
MeanAbsoluteError: 0.0723419412970543 | Loss: 0.0090570476208813 | Epoch: 1080 | 
MeanAbsoluteError: 0.0651640966534615 | Loss: 0.0080746152600235 | Epoch: 1081 | 
MeanAbsoluteError: 0.0617406852543354 | Loss: 0.0069656755405716 | Epoch: 1082 | 
MeanAbsoluteError: 0.0633678138256073 | Loss: 0.0072673743660562 | Epoch: 1083 | 
MeanAbsoluteError: 0.0673019960522652 | Loss: 0.0079992112914139 | Epoch: 1084 | 
MeanAbsoluteError: 0.0694029703736305 | Loss: 0.0083690348218806 | Epoch: 1085 | 
MeanAbsoluteError: 0.0638776794075966 | Loss: 0.0074368117840095 | Epoch: 1086 | 
MeanAbsoluteError: 0.0665798112750053 | Loss: 0.0080212725897824 | Epoch: 1087 | 
MeanAbsoluteError: 0.0722908452153206 | Loss: 0.0093754962139550 | Epoch: 1088 | 
MeanAbsoluteError: 0.0764328837394714 | Loss: 0.0104183597763282 | Epoch: 1089 | 
MeanAbsoluteError: 0.0698969215154648 | Loss: 0.0095780186166182 | Epoch: 1090 | 
MeanAbsoluteError: 0.0676443576812744 | Loss: 0.0079124876828185 | Epoch: 1091 | 
MeanAbsoluteError: 0.0707011148333549 | Loss: 0.0085442703529285 | Epoch: 1092 | 
MeanAbsoluteError: 0.0677080750465393 | Loss: 0.0080793829660009 | Epoch: 1093 | 
MeanAbsoluteError: 0.0691639408469200 | Loss: 0.0086508790500860 | Epoch: 1094 | 
MeanAbsoluteError: 0.0643378347158432 | Loss: 0.0072232539331981 | Epoch: 1095 | 
MeanAbsoluteError: 0.0713246688246727 | Loss: 0.0092748370420062 | Epoch: 1096 | 
MeanAbsoluteError: 0.0711861550807953 | Loss: 0.0087414858707052 | Epoch: 1097 | 
MeanAbsoluteError: 0.0624565519392490 | Loss: 0.0068722203207653 | Epoch: 1098 | 
MeanAbsoluteError: 0.0719688534736633 | Loss: 0.0088836418749270 | Epoch: 1099 | 
MeanAbsoluteError: 0.0663241520524025 | Loss: 0.0074788226276473 | Epoch: 1100 | 
MeanAbsoluteError: 0.0681140944361687 | Loss: 0.0081330509797651 | Epoch: 1101 | 
MeanAbsoluteError: 0.0636119991540909 | Loss: 0.0069956652772574 | Epoch: 1102 | 
MeanAbsoluteError: 0.0701044127345085 | Loss: 0.0090232997812564 | Epoch: 1103 | 
MeanAbsoluteError: 0.0704035684466362 | Loss: 0.0088492787976065 | Epoch: 1104 | 
MeanAbsoluteError: 0.0680999532341957 | Loss: 0.0082811595315676 | Epoch: 1105 | 
MeanAbsoluteError: 0.0747594609856606 | Loss: 0.0104180746887384 | Epoch: 1106 | 
MeanAbsoluteError: 0.0672458261251450 | Loss: 0.0086416085725553 | Epoch: 1107 | 
MeanAbsoluteError: 0.0632396042346954 | Loss: 0.0071163129012992 | Epoch: 1108 | 
MeanAbsoluteError: 0.0686077326536179 | Loss: 0.0078957221242308 | Epoch: 1109 | 
MeanAbsoluteError: 0.0693401023745537 | Loss: 0.0088114524478200 | Epoch: 1110 | 
MeanAbsoluteError: 0.0736144557595253 | Loss: 0.0092911955611695 | Epoch: 1111 | 
MeanAbsoluteError: 0.0670956149697304 | Loss: 0.0083384482148055 | Epoch: 1112 | 
MeanAbsoluteError: 0.0610097646713257 | Loss: 0.0068200649288337 | Epoch: 1113 | 
MeanAbsoluteError: 0.0702242180705070 | Loss: 0.0086200210745604 | Epoch: 1114 | 
MeanAbsoluteError: 0.0643501579761505 | Loss: 0.0074991043059951 | Epoch: 1115 | 
MeanAbsoluteError: 0.0699807405471802 | Loss: 0.0084590349494465 | Epoch: 1116 | 
MeanAbsoluteError: 0.0649750903248787 | Loss: 0.0079310609535363 | Epoch: 1117 | 
MeanAbsoluteError: 0.0683524161577225 | Loss: 0.0086109045504539 | Epoch: 1118 | 
MeanAbsoluteError: 0.0705199390649796 | Loss: 0.0088848530270419 | Epoch: 1119 | 
MeanAbsoluteError: 0.0647038966417313 | Loss: 0.0078909225898678 | Epoch: 1120 | 
MeanAbsoluteError: 0.0658162757754326 | Loss: 0.0074180137240910 | Epoch: 1121 | 
MeanAbsoluteError: 0.0630656927824020 | Loss: 0.0073879817066942 | Epoch: 1122 | 
MeanAbsoluteError: 0.0704290568828583 | Loss: 0.0097256720506872 | Epoch: 1123 | 
MeanAbsoluteError: 0.0673821568489075 | Loss: 0.0086733655763722 | Epoch: 1124 | 
MeanAbsoluteError: 0.0633160769939423 | Loss: 0.0074544591983105 | Epoch: 1125 | 
MeanAbsoluteError: 0.0698489397764206 | Loss: 0.0092363261471716 | Epoch: 1126 | 
MeanAbsoluteError: 0.0667150542140007 | Loss: 0.0085544286544367 | Epoch: 1127 | 
MeanAbsoluteError: 0.0622264780104160 | Loss: 0.0073222268723475 | Epoch: 1128 | 
MeanAbsoluteError: 0.0700443759560585 | Loss: 0.0087137780142560 | Epoch: 1129 | 
MeanAbsoluteError: 0.0636391043663025 | Loss: 0.0080010952279796 | Epoch: 1130 | 
MeanAbsoluteError: 0.0685411989688873 | Loss: 0.0085516337645155 | Epoch: 1131 | 
MeanAbsoluteError: 0.0694776251912117 | Loss: 0.0088909361958455 | Epoch: 1132 | 
MeanAbsoluteError: 0.0710195824503899 | Loss: 0.0093507448901801 | Epoch: 1133 | 
MeanAbsoluteError: 0.0692139938473701 | Loss: 0.0095294034390342 | Epoch: 1134 | 
MeanAbsoluteError: 0.0640364289283752 | Loss: 0.0074145980762357 | Epoch: 1135 | 
MeanAbsoluteError: 0.0730346888303757 | Loss: 0.0099281933723008 | Epoch: 1136 | 
MeanAbsoluteError: 0.0645968988537788 | Loss: 0.0076082818453475 | Epoch: 1137 | 
MeanAbsoluteError: 0.0681149587035179 | Loss: 0.0081982624193188 | Epoch: 1138 | 
MeanAbsoluteError: 0.0568541400134563 | Loss: 0.0061345131113436 | Epoch: 1139 | 
MeanAbsoluteError: 0.0721034705638885 | Loss: 0.0091914032175312 | Epoch: 1140 | 
MeanAbsoluteError: 0.0628835782408714 | Loss: 0.0072235697410118 | Epoch: 1141 | 
MeanAbsoluteError: 0.0682444572448730 | Loss: 0.0088440893554556 | Epoch: 1142 | 
MeanAbsoluteError: 0.0657172799110413 | Loss: 0.0081542717427102 | Epoch: 1143 | 
MeanAbsoluteError: 0.0689317211508751 | Loss: 0.0088074087502294 | Epoch: 1144 | 
MeanAbsoluteError: 0.0665861964225769 | Loss: 0.0082033753929803 | Epoch: 1145 | 
MeanAbsoluteError: 0.0685911178588867 | Loss: 0.0083404243922996 | Epoch: 1146 | 
MeanAbsoluteError: 0.0693357139825821 | Loss: 0.0087487636282337 | Epoch: 1147 | 
MeanAbsoluteError: 0.0690763443708420 | Loss: 0.0085716901036115 | Epoch: 1148 | 
MeanAbsoluteError: 0.0654565021395683 | Loss: 0.0075826229208421 | Epoch: 1149 | 
MeanAbsoluteError: 0.0637311413884163 | Loss: 0.0080189988608921 | Epoch: 1150 | 
MeanAbsoluteError: 0.0630521327257156 | Loss: 0.0073405471866863 | Epoch: 1151 | 
MeanAbsoluteError: 0.0673010796308517 | Loss: 0.0082781683623974 | Epoch: 1152 | 
MeanAbsoluteError: 0.0652497187256813 | Loss: 0.0075149046512282 | Epoch: 1153 | 
MeanAbsoluteError: 0.0644122660160065 | Loss: 0.0076896131125432 | Epoch: 1154 | 
MeanAbsoluteError: 0.0695091784000397 | Loss: 0.0089211251551933 | Epoch: 1155 | 
MeanAbsoluteError: 0.0651471838355064 | Loss: 0.0078405609992236 | Epoch: 1156 | 
MeanAbsoluteError: 0.0650300532579422 | Loss: 0.0082767158206358 | Epoch: 1157 | 
MeanAbsoluteError: 0.0638088062405586 | Loss: 0.0075246719357043 | Epoch: 1158 | 
MeanAbsoluteError: 0.0634868741035461 | Loss: 0.0084015505952266 | Epoch: 1159 | 
MeanAbsoluteError: 0.0657244622707367 | Loss: 0.0075654348954837 | Epoch: 1160 | 
MeanAbsoluteError: 0.0686446800827980 | Loss: 0.0085990752160918 | Epoch: 1161 | 
MeanAbsoluteError: 0.0593461729586124 | Loss: 0.0063627362946863 | Epoch: 1162 | 
MeanAbsoluteError: 0.0659839585423470 | Loss: 0.0084608737313435 | Epoch: 1163 | 
MeanAbsoluteError: 0.0680202767252922 | Loss: 0.0081164759048746 | Epoch: 1164 | 
MeanAbsoluteError: 0.0614863261580467 | Loss: 0.0067693859304488 | Epoch: 1165 | 
MeanAbsoluteError: 0.0639742016792297 | Loss: 0.0075848067779407 | Epoch: 1166 | 
MeanAbsoluteError: 0.0661838501691818 | Loss: 0.0072266113433094 | Epoch: 1167 | 
MeanAbsoluteError: 0.0694292783737183 | Loss: 0.0087912789970475 | Epoch: 1168 | 
MeanAbsoluteError: 0.0628383010625839 | Loss: 0.0072622589636194 | Epoch: 1169 | 
MeanAbsoluteError: 0.0737675130367279 | Loss: 0.0095739141812858 | Epoch: 1170 | 
MeanAbsoluteError: 0.0631414502859116 | Loss: 0.0071509282972784 | Epoch: 1171 | 
MeanAbsoluteError: 0.0655021741986275 | Loss: 0.0075843964378995 | Epoch: 1172 | 
MeanAbsoluteError: 0.0635970532894135 | Loss: 0.0075995598383588 | Epoch: 1173 | 
MeanAbsoluteError: 0.0690304338932037 | Loss: 0.0088975602488790 | Epoch: 1174 | 
MeanAbsoluteError: 0.0650118961930275 | Loss: 0.0073082571775012 | Epoch: 1175 | 
MeanAbsoluteError: 0.0636664181947708 | Loss: 0.0084230540087447 | Epoch: 1176 | 
MeanAbsoluteError: 0.0656239017844200 | Loss: 0.0078917141198508 | Epoch: 1177 | 
MeanAbsoluteError: 0.0640999376773834 | Loss: 0.0077136761686173 | Epoch: 1178 | 
MeanAbsoluteError: 0.0677836909890175 | Loss: 0.0082124785569370 | Epoch: 1179 | 
MeanAbsoluteError: 0.0680667757987976 | Loss: 0.0084519529765930 | Epoch: 1180 | 
MeanAbsoluteError: 0.0644348189234734 | Loss: 0.0077755609569188 | Epoch: 1181 | 
MeanAbsoluteError: 0.0679789781570435 | Loss: 0.0082269871740209 | Epoch: 1182 | 
MeanAbsoluteError: 0.0693719983100891 | Loss: 0.0088834195684467 | Epoch: 1183 | 
MeanAbsoluteError: 0.0708234310150146 | Loss: 0.0084363166937449 | Epoch: 1184 | 
MeanAbsoluteError: 0.0643603578209877 | Loss: 0.0071625918989594 | Epoch: 1185 | 
MeanAbsoluteError: 0.0663974136114120 | Loss: 0.0078951712282408 | Epoch: 1186 | 
MeanAbsoluteError: 0.0646793991327286 | Loss: 0.0071780992643107 | Epoch: 1187 | 
MeanAbsoluteError: 0.0636620670557022 | Loss: 0.0079789436916326 | Epoch: 1188 | 
MeanAbsoluteError: 0.0629383102059364 | Loss: 0.0070229293719361 | Epoch: 1189 | 
MeanAbsoluteError: 0.0677320435643196 | Loss: 0.0090679464868541 | Epoch: 1190 | 
MeanAbsoluteError: 0.0631995424628258 | Loss: 0.0069566987120197 | Epoch: 1191 | 
MeanAbsoluteError: 0.0657962933182716 | Loss: 0.0077235924074193 | Epoch: 1192 | 
MeanAbsoluteError: 0.0663131698966026 | Loss: 0.0092412873707660 | Epoch: 1193 | 
MeanAbsoluteError: 0.0706317797303200 | Loss: 0.0083772922731199 | Epoch: 1194 | 
MeanAbsoluteError: 0.0617574639618397 | Loss: 0.0068849398712094 | Epoch: 1195 | 
MeanAbsoluteError: 0.0634381845593452 | Loss: 0.0072911292174892 | Epoch: 1196 | 
MeanAbsoluteError: 0.0610828660428524 | Loss: 0.0069242807231785 | Epoch: 1197 | 
MeanAbsoluteError: 0.0656199231743813 | Loss: 0.0077633254823741 | Epoch: 1198 | 
MeanAbsoluteError: 0.0640247687697411 | Loss: 0.0071229057681436 | Epoch: 1199 | 
MeanAbsoluteError: 0.0605994984507561 | Loss: 0.0064563069170739 | Epoch: 1200 | 
MeanAbsoluteError: 0.0638386979699135 | Loss: 0.0079527828085217 | Epoch: 1201 | 
MeanAbsoluteError: 0.0638684779405594 | Loss: 0.0074921829904876 | Epoch: 1202 | 
MeanAbsoluteError: 0.0665121003985405 | Loss: 0.0076121065080103 | Epoch: 1203 | 
MeanAbsoluteError: 0.0627066642045975 | Loss: 0.0067927504340817 | Epoch: 1204 | 
MeanAbsoluteError: 0.0616116859018803 | Loss: 0.0066306355282965 | Epoch: 1205 | 
MeanAbsoluteError: 0.0623222216963768 | Loss: 0.0068787825482286 | Epoch: 1206 | 
MeanAbsoluteError: 0.0655873268842697 | Loss: 0.0077651797419336 | Epoch: 1207 | 
MeanAbsoluteError: 0.0612384974956512 | Loss: 0.0075284201707594 | Epoch: 1208 | 
MeanAbsoluteError: 0.0662722215056419 | Loss: 0.0078261838824255 | Epoch: 1209 | 
MeanAbsoluteError: 0.0682407394051552 | Loss: 0.0078729740777150 | Epoch: 1210 | 
MeanAbsoluteError: 0.0614073686301708 | Loss: 0.0067319621486240 | Epoch: 1211 | 
MeanAbsoluteError: 0.0699118971824646 | Loss: 0.0092297816770345 | Epoch: 1212 | 
MeanAbsoluteError: 0.0663583725690842 | Loss: 0.0077028569242248 | Epoch: 1213 | 
MeanAbsoluteError: 0.0629780292510986 | Loss: 0.0072989186171132 | Epoch: 1214 | 
MeanAbsoluteError: 0.0623923316597939 | Loss: 0.0071688902984048 | Epoch: 1215 | 
MeanAbsoluteError: 0.0588259436190128 | Loss: 0.0064029444973736 | Epoch: 1216 | 
MeanAbsoluteError: 0.0604680627584457 | Loss: 0.0068228776528940 | Epoch: 1217 | 
MeanAbsoluteError: 0.0586263462901115 | Loss: 0.0064769137612226 | Epoch: 1218 | 
MeanAbsoluteError: 0.0602800883352757 | Loss: 0.0070878212951963 | Epoch: 1219 | 
MeanAbsoluteError: 0.0674337223172188 | Loss: 0.0092628806611174 | Epoch: 1220 | 
MeanAbsoluteError: 0.0636176913976669 | Loss: 0.0072799733443208 | Epoch: 1221 | 
MeanAbsoluteError: 0.0637678205966949 | Loss: 0.0073069029384836 | Epoch: 1222 | 
MeanAbsoluteError: 0.0659564435482025 | Loss: 0.0083267193833550 | Epoch: 1223 | 
MeanAbsoluteError: 0.0627924129366875 | Loss: 0.0073029461163727 | Epoch: 1224 | 
MeanAbsoluteError: 0.0610148310661316 | Loss: 0.0069422768032139 | Epoch: 1225 | 
MeanAbsoluteError: 0.0654839575290680 | Loss: 0.0077286712363032 | Epoch: 1226 | 
MeanAbsoluteError: 0.0612850524485111 | Loss: 0.0070277456571178 | Epoch: 1227 | 
MeanAbsoluteError: 0.0624229349195957 | Loss: 0.0072544638851347 | Epoch: 1228 | 
MeanAbsoluteError: 0.0678682103753090 | Loss: 0.0082256965307442 | Epoch: 1229 | 
MeanAbsoluteError: 0.0637050569057465 | Loss: 0.0075593736559676 | Epoch: 1230 | 
MeanAbsoluteError: 0.0608091801404953 | Loss: 0.0070597851579108 | Epoch: 1231 | 
MeanAbsoluteError: 0.0629947930574417 | Loss: 0.0079606243237504 | Epoch: 1232 | 
MeanAbsoluteError: 0.0592392273247242 | Loss: 0.0063577746347922 | Epoch: 1233 | 
MeanAbsoluteError: 0.0641319230198860 | Loss: 0.0074856198683119 | Epoch: 1234 | 
MeanAbsoluteError: 0.0640417709946632 | Loss: 0.0076579014409557 | Epoch: 1235 | 
MeanAbsoluteError: 0.0648472234606743 | Loss: 0.0072228103398447 | Epoch: 1236 | 
MeanAbsoluteError: 0.0654282867908478 | Loss: 0.0078260383226977 | Epoch: 1237 | 
MeanAbsoluteError: 0.0594246536493301 | Loss: 0.0063910981766579 | Epoch: 1238 | 
MeanAbsoluteError: 0.0600025355815887 | Loss: 0.0071964854974552 | Epoch: 1239 | 
MeanAbsoluteError: 0.0626812949776649 | Loss: 0.0070920031542361 | Epoch: 1240 | 
MeanAbsoluteError: 0.0636621788144112 | Loss: 0.0071963769529702 | Epoch: 1241 | 
MeanAbsoluteError: 0.0603998377919197 | Loss: 0.0066154810394194 | Epoch: 1242 | 
MeanAbsoluteError: 0.0580286346375942 | Loss: 0.0068103034042815 | Epoch: 1243 | 
MeanAbsoluteError: 0.0658731386065483 | Loss: 0.0077163204426567 | Epoch: 1244 | 
MeanAbsoluteError: 0.0682158097624779 | Loss: 0.0090915094003140 | Epoch: 1245 | 
MeanAbsoluteError: 0.0638194233179092 | Loss: 0.0076256748243153 | Epoch: 1246 | 
MeanAbsoluteError: 0.0638536140322685 | Loss: 0.0074687880871534 | Epoch: 1247 | 
MeanAbsoluteError: 0.0676750391721725 | Loss: 0.0083274144616007 | Epoch: 1248 | 
MeanAbsoluteError: 0.0632640346884727 | Loss: 0.0076300418087703 | Epoch: 1249 | 
MeanAbsoluteError: 0.0602971278131008 | Loss: 0.0067283271338359 | Epoch: 1250 | 
MeanAbsoluteError: 0.0630327090620995 | Loss: 0.0074337795241854 | Epoch: 1251 | 
MeanAbsoluteError: 0.0637849867343903 | Loss: 0.0076189291305491 | Epoch: 1252 | 
MeanAbsoluteError: 0.0609539151191711 | Loss: 0.0072467654468710 | Epoch: 1253 | 
MeanAbsoluteError: 0.0717900246381760 | Loss: 0.0093050736988031 | Epoch: 1254 | 
MeanAbsoluteError: 0.0611215718090534 | Loss: 0.0069163748118808 | Epoch: 1255 | 
MeanAbsoluteError: 0.0634086951613426 | Loss: 0.0077655467807199 | Epoch: 1256 | 
MeanAbsoluteError: 0.0623031929135323 | Loss: 0.0069076488720990 | Epoch: 1257 | 
MeanAbsoluteError: 0.0590523481369019 | Loss: 0.0064767875665954 | Epoch: 1258 | 
MeanAbsoluteError: 0.0597368627786636 | Loss: 0.0058900471955470 | Epoch: 1259 | 
MeanAbsoluteError: 0.0659222677350044 | Loss: 0.0078090839892623 | Epoch: 1260 | 
MeanAbsoluteError: 0.0587507560849190 | Loss: 0.0060456933487876 | Epoch: 1261 | 
MeanAbsoluteError: 0.0604133717715740 | Loss: 0.0064466639775977 | Epoch: 1262 | 
MeanAbsoluteError: 0.0602659657597542 | Loss: 0.0066147537159486 | Epoch: 1263 | 
MeanAbsoluteError: 0.0659210681915283 | Loss: 0.0075018033431297 | Epoch: 1264 | 
MeanAbsoluteError: 0.0629273429512978 | Loss: 0.0077414131077482 | Epoch: 1265 | 
MeanAbsoluteError: 0.0602748617529869 | Loss: 0.0069400191610233 | Epoch: 1266 | 
MeanAbsoluteError: 0.0618423782289028 | Loss: 0.0073407786262032 | Epoch: 1267 | 
MeanAbsoluteError: 0.0601481124758720 | Loss: 0.0072917424881962 | Epoch: 1268 | 
MeanAbsoluteError: 0.0637676566839218 | Loss: 0.0080641012059035 | Epoch: 1269 | 
MeanAbsoluteError: 0.0600695498287678 | Loss: 0.0066601895076504 | Epoch: 1270 | 
MeanAbsoluteError: 0.0643502548336983 | Loss: 0.0085518484201020 | Epoch: 1271 | 
MeanAbsoluteError: 0.0621754974126816 | Loss: 0.0069625924370969 | Epoch: 1272 | 
MeanAbsoluteError: 0.0601709112524986 | Loss: 0.0060629628669267 | Epoch: 1273 | 
MeanAbsoluteError: 0.0641725510358810 | Loss: 0.0077398539259896 | Epoch: 1274 | 
MeanAbsoluteError: 0.0588267147541046 | Loss: 0.0070124945870217 | Epoch: 1275 | 
MeanAbsoluteError: 0.0626857057213783 | Loss: 0.0071745190692188 | Epoch: 1276 | 
MeanAbsoluteError: 0.0624087601900101 | Loss: 0.0067718264816601 | Epoch: 1277 | 
MeanAbsoluteError: 0.0588923916220665 | Loss: 0.0065521929023392 | Epoch: 1278 | 
MeanAbsoluteError: 0.0618937946856022 | Loss: 0.0068137911330511 | Epoch: 1279 | 
MeanAbsoluteError: 0.0579067021608353 | Loss: 0.0057953725017069 | Epoch: 1280 | 
MeanAbsoluteError: 0.0647194832563400 | Loss: 0.0076527326156490 | Epoch: 1281 | 
MeanAbsoluteError: 0.0623487271368504 | Loss: 0.0070749801584073 | Epoch: 1282 | 
MeanAbsoluteError: 0.0650510042905807 | Loss: 0.0080797809162201 | Epoch: 1283 | 
MeanAbsoluteError: 0.0673635900020599 | Loss: 0.0075853963613433 | Epoch: 1284 | 
MeanAbsoluteError: 0.0673955306410789 | Loss: 0.0084427857683174 | Epoch: 1285 | 
MeanAbsoluteError: 0.0636771395802498 | Loss: 0.0071116609923289 | Epoch: 1286 | 
MeanAbsoluteError: 0.0557297952473164 | Loss: 0.0058030620970627 | Epoch: 1287 | 
MeanAbsoluteError: 0.0586284138262272 | Loss: 0.0068149602077998 | Epoch: 1288 | 
MeanAbsoluteError: 0.0616724006831646 | Loss: 0.0071897057637761 | Epoch: 1289 | 
MeanAbsoluteError: 0.0647143125534058 | Loss: 0.0073602350142028 | Epoch: 1290 | 
MeanAbsoluteError: 0.0561532340943813 | Loss: 0.0060248755173719 | Epoch: 1291 | 
MeanAbsoluteError: 0.0588872097432613 | Loss: 0.0066914881002716 | Epoch: 1292 | 
MeanAbsoluteError: 0.0592726506292820 | Loss: 0.0062342988254629 | Epoch: 1293 | 
MeanAbsoluteError: 0.0595637112855911 | Loss: 0.0066505825210455 | Epoch: 1294 | 
MeanAbsoluteError: 0.0549105443060398 | Loss: 0.0056616590865148 | Epoch: 1295 | 
MeanAbsoluteError: 0.0625222697854042 | Loss: 0.0068665233757565 | Epoch: 1296 | 
MeanAbsoluteError: 0.0566158629953861 | Loss: 0.0062104222044521 | Epoch: 1297 | 
MeanAbsoluteError: 0.0618584044277668 | Loss: 0.0070241265785050 | Epoch: 1298 | 
MeanAbsoluteError: 0.0594248883426189 | Loss: 0.0069459147612118 | Epoch: 1299 | 
MeanAbsoluteError: 0.0622272603213787 | Loss: 0.0074573160023526 | Epoch: 1300 | 
MeanAbsoluteError: 0.0594698637723923 | Loss: 0.0069741047012303 | Epoch: 1301 | 
MeanAbsoluteError: 0.0579961128532887 | Loss: 0.0069740403233360 | Epoch: 1302 | 
MeanAbsoluteError: 0.0599656663835049 | Loss: 0.0072865175659535 | Epoch: 1303 | 
MeanAbsoluteError: 0.0624936595559120 | Loss: 0.0073876735518328 | Epoch: 1304 | 
MeanAbsoluteError: 0.0610631369054317 | Loss: 0.0067687466252695 | Epoch: 1305 | 
MeanAbsoluteError: 0.0625288039445877 | Loss: 0.0072661710742106 | Epoch: 1306 | 
MeanAbsoluteError: 0.0603088513016701 | Loss: 0.0070992012679199 | Epoch: 1307 | 
MeanAbsoluteError: 0.0615134350955486 | Loss: 0.0068495385882003 | Epoch: 1308 | 
MeanAbsoluteError: 0.0575127936899662 | Loss: 0.0061127125966262 | Epoch: 1309 | 
MeanAbsoluteError: 0.0672807991504669 | Loss: 0.0086072244690392 | Epoch: 1310 | 
MeanAbsoluteError: 0.0644313320517540 | Loss: 0.0084025245387420 | Epoch: 1311 | 
MeanAbsoluteError: 0.0646878629922867 | Loss: 0.0071357543653236 | Epoch: 1312 | 
MeanAbsoluteError: 0.0562869086861610 | Loss: 0.0058477657335849 | Epoch: 1313 | 
MeanAbsoluteError: 0.0620988830924034 | Loss: 0.0074806166989447 | Epoch: 1314 | 
MeanAbsoluteError: 0.0671301335096359 | Loss: 0.0084829986490452 | Epoch: 1315 | 
MeanAbsoluteError: 0.0634774938225746 | Loss: 0.0082823823812214 | Epoch: 1316 | 
MeanAbsoluteError: 0.0584264993667603 | Loss: 0.0060556682418413 | Epoch: 1317 | 
MeanAbsoluteError: 0.0553562752902508 | Loss: 0.0055762075724730 | Epoch: 1318 | 
MeanAbsoluteError: 0.0631681606173515 | Loss: 0.0072884432606467 | Epoch: 1319 | 
MeanAbsoluteError: 0.0585636831820011 | Loss: 0.0067937828821899 | Epoch: 1320 | 
MeanAbsoluteError: 0.0601073652505875 | Loss: 0.0069069218236837 | Epoch: 1321 | 
MeanAbsoluteError: 0.0592857040464878 | Loss: 0.0060135061820135 | Epoch: 1322 | 
MeanAbsoluteError: 0.0585643053054810 | Loss: 0.0065385152722350 | Epoch: 1323 | 
MeanAbsoluteError: 0.0556948855519295 | Loss: 0.0055800235328085 | Epoch: 1324 | 
MeanAbsoluteError: 0.0630860254168510 | Loss: 0.0076132753168349 | Epoch: 1325 | 
MeanAbsoluteError: 0.0604993179440498 | Loss: 0.0065574741142821 | Epoch: 1326 | 
MeanAbsoluteError: 0.0557281114161015 | Loss: 0.0057680278202558 | Epoch: 1327 | 
MeanAbsoluteError: 0.0650261491537094 | Loss: 0.0077713587357236 | Epoch: 1328 | 
MeanAbsoluteError: 0.0594450384378433 | Loss: 0.0072241933765842 | Epoch: 1329 | 
MeanAbsoluteError: 0.0586771965026855 | Loss: 0.0064483105690548 | Epoch: 1330 | 
MeanAbsoluteError: 0.0587195083498955 | Loss: 0.0074206920600288 | Epoch: 1331 | 
MeanAbsoluteError: 0.0637977644801140 | Loss: 0.0067886768792232 | Epoch: 1332 | 
MeanAbsoluteError: 0.0652621686458588 | Loss: 0.0074189749639481 | Epoch: 1333 | 
MeanAbsoluteError: 0.0586406141519547 | Loss: 0.0060554788097761 | Epoch: 1334 | 
MeanAbsoluteError: 0.0655524730682373 | Loss: 0.0084028575081902 | Epoch: 1335 | 
MeanAbsoluteError: 0.0602464750409126 | Loss: 0.0068814275343660 | Epoch: 1336 | 
MeanAbsoluteError: 0.0621792227029800 | Loss: 0.0076427560026059 | Epoch: 1337 | 
MeanAbsoluteError: 0.0623363032937050 | Loss: 0.0070257983475676 | Epoch: 1338 | 
MeanAbsoluteError: 0.0573655441403389 | Loss: 0.0054982766404767 | Epoch: 1339 | 
MeanAbsoluteError: 0.0578860044479370 | Loss: 0.0061039369699392 | Epoch: 1340 | 
MeanAbsoluteError: 0.0609294176101685 | Loss: 0.0068390948525121 | Epoch: 1341 | 
MeanAbsoluteError: 0.0595331117510796 | Loss: 0.0063120169434114 | Epoch: 1342 | 
MeanAbsoluteError: 0.0590211860835552 | Loss: 0.0062593080263468 | Epoch: 1343 | 
MeanAbsoluteError: 0.0525709092617035 | Loss: 0.0055392229639582 | Epoch: 1344 | 
MeanAbsoluteError: 0.0588330067694187 | Loss: 0.0065999297063536 | Epoch: 1345 | 
MeanAbsoluteError: 0.0631908699870110 | Loss: 0.0074271243907181 | Epoch: 1346 | 
MeanAbsoluteError: 0.0613631233572960 | Loss: 0.0074646979543468 | Epoch: 1347 | 
MeanAbsoluteError: 0.0590438134968281 | Loss: 0.0071434897894263 | Epoch: 1348 | 
MeanAbsoluteError: 0.0591630823910236 | Loss: 0.0071320187094777 | Epoch: 1349 | 
MeanAbsoluteError: 0.0613437257707119 | Loss: 0.0066808529830450 | Epoch: 1350 | 
MeanAbsoluteError: 0.0550273023545742 | Loss: 0.0059833803693377 | Epoch: 1351 | 
MeanAbsoluteError: 0.0572957471013069 | Loss: 0.0063646000387477 | Epoch: 1352 | 
MeanAbsoluteError: 0.0646844133734703 | Loss: 0.0076713488257034 | Epoch: 1353 | 
MeanAbsoluteError: 0.0533348023891449 | Loss: 0.0051347972557172 | Epoch: 1354 | 
MeanAbsoluteError: 0.0610402487218380 | Loss: 0.0073597275284070 | Epoch: 1355 | 
MeanAbsoluteError: 0.0563038513064384 | Loss: 0.0062525593141618 | Epoch: 1356 | 
MeanAbsoluteError: 0.0623960494995117 | Loss: 0.0076754165287033 | Epoch: 1357 | 
MeanAbsoluteError: 0.0579704865813255 | Loss: 0.0062934564885048 | Epoch: 1358 | 
MeanAbsoluteError: 0.0580323673784733 | Loss: 0.0066176986267116 | Epoch: 1359 | 
MeanAbsoluteError: 0.0603172034025192 | Loss: 0.0070527732018794 | Epoch: 1360 | 
MeanAbsoluteError: 0.0595178268849850 | Loss: 0.0068137397707809 | Epoch: 1361 | 
MeanAbsoluteError: 0.0578610934317112 | Loss: 0.0060816108078507 | Epoch: 1362 | 
MeanAbsoluteError: 0.0583778880536556 | Loss: 0.0067611638918364 | Epoch: 1363 | 
MeanAbsoluteError: 0.0596525371074677 | Loss: 0.0068535130712644 | Epoch: 1364 | 
MeanAbsoluteError: 0.0559104867279530 | Loss: 0.0058111705333674 | Epoch: 1365 | 
MeanAbsoluteError: 0.0601880252361298 | Loss: 0.0059277274716806 | Epoch: 1366 | 
MeanAbsoluteError: 0.0602724775671959 | Loss: 0.0067496870191826 | Epoch: 1367 | 
MeanAbsoluteError: 0.0616057515144348 | Loss: 0.0070057805495283 | Epoch: 1368 | 
MeanAbsoluteError: 0.0639656782150269 | Loss: 0.0074389386884123 | Epoch: 1369 | 
MeanAbsoluteError: 0.0590878799557686 | Loss: 0.0075507379388485 | Epoch: 1370 | 
MeanAbsoluteError: 0.0593984089791775 | Loss: 0.0066270784619250 | Epoch: 1371 | 
MeanAbsoluteError: 0.0600770190358162 | Loss: 0.0073270322577506 | Epoch: 1372 | 
MeanAbsoluteError: 0.0575873292982578 | Loss: 0.0060493746074402 | Epoch: 1373 | 
MeanAbsoluteError: 0.0611264593899250 | Loss: 0.0066616562008373 | Epoch: 1374 | 
MeanAbsoluteError: 0.0570595860481262 | Loss: 0.0061177108495031 | Epoch: 1375 | 
MeanAbsoluteError: 0.0590573251247406 | Loss: 0.0069289187466105 | Epoch: 1376 | 
MeanAbsoluteError: 0.0594652816653252 | Loss: 0.0067402777333435 | Epoch: 1377 | 
MeanAbsoluteError: 0.0568242780864239 | Loss: 0.0059960014817868 | Epoch: 1378 | 
MeanAbsoluteError: 0.0597791299223900 | Loss: 0.0068522613890188 | Epoch: 1379 | 
MeanAbsoluteError: 0.0582293048501015 | Loss: 0.0064122937783501 | Epoch: 1380 | 
MeanAbsoluteError: 0.0601521506905556 | Loss: 0.0064453515933807 | Epoch: 1381 | 
MeanAbsoluteError: 0.0561903454363346 | Loss: 0.0060621916408551 | Epoch: 1382 | 
MeanAbsoluteError: 0.0584788769483566 | Loss: 0.0064061350609518 | Epoch: 1383 | 
MeanAbsoluteError: 0.0577516108751297 | Loss: 0.0066056292869689 | Epoch: 1384 | 
MeanAbsoluteError: 0.0612967237830162 | Loss: 0.0067308303606114 | Epoch: 1385 | 
MeanAbsoluteError: 0.0579466819763184 | Loss: 0.0063529075566233 | Epoch: 1386 | 
MeanAbsoluteError: 0.0639848709106445 | Loss: 0.0070912594742307 | Epoch: 1387 | 
MeanAbsoluteError: 0.0587789267301559 | Loss: 0.0062040600233498 | Epoch: 1388 | 
MeanAbsoluteError: 0.0607269592583179 | Loss: 0.0067732133742902 | Epoch: 1389 | 
MeanAbsoluteError: 0.0613276921212673 | Loss: 0.0070115517686645 | Epoch: 1390 | 
MeanAbsoluteError: 0.0588996559381485 | Loss: 0.0068311178821993 | Epoch: 1391 | 
MeanAbsoluteError: 0.0577615797519684 | Loss: 0.0061380676289749 | Epoch: 1392 | 
MeanAbsoluteError: 0.0582601614296436 | Loss: 0.0064320448323269 | Epoch: 1393 | 
MeanAbsoluteError: 0.0658429414033890 | Loss: 0.0076372725332112 | Epoch: 1394 | 
MeanAbsoluteError: 0.0565693043172359 | Loss: 0.0058412261591820 | Epoch: 1395 | 
MeanAbsoluteError: 0.0569558329880238 | Loss: 0.0064749789136295 | Epoch: 1396 | 
MeanAbsoluteError: 0.0563307143747807 | Loss: 0.0060115725524095 | Epoch: 1397 | 
MeanAbsoluteError: 0.0563693158328533 | Loss: 0.0061697309390790 | Epoch: 1398 | 
MeanAbsoluteError: 0.0614904612302780 | Loss: 0.0064544608261713 | Epoch: 1399 | 
MeanAbsoluteError: 0.0548842884600163 | Loss: 0.0055805883152667 | Epoch: 1400 | 
MeanAbsoluteError: 0.0557563863694668 | Loss: 0.0056326612958886 | Epoch: 1401 | 
MeanAbsoluteError: 0.0624559335410595 | Loss: 0.0067359105225235 | Epoch: 1402 | 
MeanAbsoluteError: 0.0552742183208466 | Loss: 0.0062173305620248 | Epoch: 1403 | 
MeanAbsoluteError: 0.0623117238283157 | Loss: 0.0073411542934628 | Epoch: 1404 | 
MeanAbsoluteError: 0.0573842041194439 | Loss: 0.0057818155378482 | Epoch: 1405 | 
MeanAbsoluteError: 0.0559544488787651 | Loss: 0.0059102018125607 | Epoch: 1406 | 
MeanAbsoluteError: 0.0587244294583797 | Loss: 0.0065422553435443 | Epoch: 1407 | 
MeanAbsoluteError: 0.0600770823657513 | Loss: 0.0059424061224126 | Epoch: 1408 | 
MeanAbsoluteError: 0.0608702786266804 | Loss: 0.0072758367889643 | Epoch: 1409 | 
MeanAbsoluteError: 0.0586856380105019 | Loss: 0.0066306086830203 | Epoch: 1410 | 
MeanAbsoluteError: 0.0574161447584629 | Loss: 0.0060549706985694 | Epoch: 1411 | 
MeanAbsoluteError: 0.0583676956593990 | Loss: 0.0063128329048292 | Epoch: 1412 | 
MeanAbsoluteError: 0.0566170886158943 | Loss: 0.0059740128747217 | Epoch: 1413 | 
MeanAbsoluteError: 0.0528923086822033 | Loss: 0.0055720553557073 | Epoch: 1414 | 
MeanAbsoluteError: 0.0579725652933121 | Loss: 0.0065579826983837 | Epoch: 1415 | 
MeanAbsoluteError: 0.0557838045060635 | Loss: 0.0060128550286451 | Epoch: 1416 | 
MeanAbsoluteError: 0.0618123114109039 | Loss: 0.0078098540362771 | Epoch: 1417 | 
MeanAbsoluteError: 0.0574797429144382 | Loss: 0.0060527243328337 | Epoch: 1418 | 
MeanAbsoluteError: 0.0591564439237118 | Loss: 0.0069078163054292 | Epoch: 1419 | 
MeanAbsoluteError: 0.0563187673687935 | Loss: 0.0067976737817662 | Epoch: 1420 | 
MeanAbsoluteError: 0.0591088868677616 | Loss: 0.0065378680860946 | Epoch: 1421 | 
MeanAbsoluteError: 0.0564135685563087 | Loss: 0.0059805855708692 | Epoch: 1422 | 
MeanAbsoluteError: 0.0571763738989830 | Loss: 0.0061837889390396 | Epoch: 1423 | 
MeanAbsoluteError: 0.0582145899534225 | Loss: 0.0061869906513675 | Epoch: 1424 | 
MeanAbsoluteError: 0.0524145551025867 | Loss: 0.0057837775284133 | Epoch: 1425 | 
MeanAbsoluteError: 0.0559653416275978 | Loss: 0.0063784418028844 | Epoch: 1426 | 
MeanAbsoluteError: 0.0564562417566776 | Loss: 0.0062507339088734 | Epoch: 1427 | 
MeanAbsoluteError: 0.0562570504844189 | Loss: 0.0060353516241594 | Epoch: 1428 | 
MeanAbsoluteError: 0.0584495477378368 | Loss: 0.0066283909364514 | Epoch: 1429 | 
MeanAbsoluteError: 0.0598415993154049 | Loss: 0.0064357079134182 | Epoch: 1430 | 
MeanAbsoluteError: 0.0590827576816082 | Loss: 0.0069418430483832 | Epoch: 1431 | 
MeanAbsoluteError: 0.0519671812653542 | Loss: 0.0053607662739159 | Epoch: 1432 | 
MeanAbsoluteError: 0.0585345886647701 | Loss: 0.0069909224350765 | Epoch: 1433 | 
MeanAbsoluteError: 0.0623789578676224 | Loss: 0.0078136000643159 | Epoch: 1434 | 
MeanAbsoluteError: 0.0573706887662411 | Loss: 0.0063272417403156 | Epoch: 1435 | 
MeanAbsoluteError: 0.0552980490028858 | Loss: 0.0054508830875178 | Epoch: 1436 | 
MeanAbsoluteError: 0.0565602742135525 | Loss: 0.0059347634245205 | Epoch: 1437 | 
MeanAbsoluteError: 0.0601707585155964 | Loss: 0.0070364983431076 | Epoch: 1438 | 
MeanAbsoluteError: 0.0586043857038021 | Loss: 0.0066380368627870 | Epoch: 1439 | 
MeanAbsoluteError: 0.0557993873953819 | Loss: 0.0063275659259822 | Epoch: 1440 | 
MeanAbsoluteError: 0.0584771856665611 | Loss: 0.0061750227016455 | Epoch: 1441 | 
MeanAbsoluteError: 0.0558768026530743 | Loss: 0.0058388078034629 | Epoch: 1442 | 
MeanAbsoluteError: 0.0602018088102341 | Loss: 0.0065983752051397 | Epoch: 1443 | 
MeanAbsoluteError: 0.0604710839688778 | Loss: 0.0068428725943947 | Epoch: 1444 | 
MeanAbsoluteError: 0.0585154667496681 | Loss: 0.0068361961480211 | Epoch: 1445 | 
MeanAbsoluteError: 0.0586277954280376 | Loss: 0.0064402937030294 | Epoch: 1446 | 
MeanAbsoluteError: 0.0596406571567059 | Loss: 0.0066237281124116 | Epoch: 1447 | 
MeanAbsoluteError: 0.0562896095216274 | Loss: 0.0065249161592025 | Epoch: 1448 | 
MeanAbsoluteError: 0.0565231181681156 | Loss: 0.0057698578926769 | Epoch: 1449 | 
MeanAbsoluteError: 0.0595677681267262 | Loss: 0.0070670291615049 | Epoch: 1450 | 
MeanAbsoluteError: 0.0566757060587406 | Loss: 0.0064075071495366 | Epoch: 1451 | 
MeanAbsoluteError: 0.0553364939987659 | Loss: 0.0060599146505653 | Epoch: 1452 | 
MeanAbsoluteError: 0.0541689358651638 | Loss: 0.0056800012578363 | Epoch: 1453 | 
MeanAbsoluteError: 0.0576780438423157 | Loss: 0.0062125273360531 | Epoch: 1454 | 
MeanAbsoluteError: 0.0583593435585499 | Loss: 0.0059080858032636 | Epoch: 1455 | 
MeanAbsoluteError: 0.0580403059720993 | Loss: 0.0062801733252369 | Epoch: 1456 | 
MeanAbsoluteError: 0.0542672164738178 | Loss: 0.0054260122053751 | Epoch: 1457 | 
MeanAbsoluteError: 0.0566761456429958 | Loss: 0.0053721861707163 | Epoch: 1458 | 
MeanAbsoluteError: 0.0600563809275627 | Loss: 0.0072668787061169 | Epoch: 1459 | 
MeanAbsoluteError: 0.0601928122341633 | Loss: 0.0066354076128603 | Epoch: 1460 | 
MeanAbsoluteError: 0.0615716874599457 | Loss: 0.0072449304795388 | Epoch: 1461 | 
MeanAbsoluteError: 0.0623099952936172 | Loss: 0.0071688099633502 | Epoch: 1462 | 
MeanAbsoluteError: 0.0587708987295628 | Loss: 0.0062015076691750 | Epoch: 1463 | 
MeanAbsoluteError: 0.0552529580891132 | Loss: 0.0051825371613813 | Epoch: 1464 | 
MeanAbsoluteError: 0.0548544265329838 | Loss: 0.0059621526295329 | Epoch: 1465 | 
MeanAbsoluteError: 0.0582481063902378 | Loss: 0.0062729384214375 | Epoch: 1466 | 
MeanAbsoluteError: 0.0540102384984493 | Loss: 0.0055912430056681 | Epoch: 1467 | 
MeanAbsoluteError: 0.0622882954776287 | Loss: 0.0075493527316454 | Epoch: 1468 | 
MeanAbsoluteError: 0.0575348027050495 | Loss: 0.0066178210571858 | Epoch: 1469 | 
MeanAbsoluteError: 0.0573052652180195 | Loss: 0.0067825304956811 | Epoch: 1470 | 
MeanAbsoluteError: 0.0569934137165546 | Loss: 0.0060027882429373 | Epoch: 1471 | 
MeanAbsoluteError: 0.0584323443472385 | Loss: 0.0064521284073029 | Epoch: 1472 | 
MeanAbsoluteError: 0.0580769143998623 | Loss: 0.0066684547921795 | Epoch: 1473 | 
MeanAbsoluteError: 0.0551889874041080 | Loss: 0.0058412185238558 | Epoch: 1474 | 
MeanAbsoluteError: 0.0520878881216049 | Loss: 0.0056936428788564 | Epoch: 1475 | 
MeanAbsoluteError: 0.0621255300939083 | Loss: 0.0079296191722460 | Epoch: 1476 | 
MeanAbsoluteError: 0.0540063343942165 | Loss: 0.0054856804448415 | Epoch: 1477 | 
MeanAbsoluteError: 0.0582624301314354 | Loss: 0.0072453686078128 | Epoch: 1478 | 
MeanAbsoluteError: 0.0582592338323593 | Loss: 0.0060820765321720 | Epoch: 1479 | 
MeanAbsoluteError: 0.0589326173067093 | Loss: 0.0064547484678769 | Epoch: 1480 | 
MeanAbsoluteError: 0.0584228076040745 | Loss: 0.0064737026568825 | Epoch: 1481 | 
MeanAbsoluteError: 0.0592902749776840 | Loss: 0.0067171421772218 | Early stopping at epoch 1480
Returned to Spot: Validation loss: 0.006717142177221831

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.1773189149831582, 'lr_mult': 9.06715620679689, 'batch_size': 4, 'epochs': 4, 'k_folds': 1, 'patience': 8, 'optimizer': 'Adamax', 'sgd_momentum': 0.22706194978124503}
Epoch: 1 | MeanAbsoluteError: 0.1381864845752716 | Loss: 0.0297331442420060 | Epoch: 2 | 
MeanAbsoluteError: 0.1159845590591431 | Loss: 0.0210684445997079 | Epoch: 3 | MeanAbsoluteError: 0.1160452365875244 | Loss: 0.0212142537068576 | Epoch: 4 | 
MeanAbsoluteError: 0.1114576458930969 | Loss: 0.0190360272970671 | Returned to Spot: Validation loss: 0.019036027297067146

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3840970624671163, 'lr_mult': 4.593111165984917, 'batch_size': 8, 'epochs': 256, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.8945915831939406}
Epoch: 1 | MeanAbsoluteError: 0.1367287337779999 | Loss: 0.0290687176104831 | Epoch: 2 | MeanAbsoluteError: 0.1259801238775253 | Loss: 0.0249685674146014 | Epoch: 3 | MeanAbsoluteError: 0.1244917139410973 | Loss: 0.0237616484641637 | Epoch: 4 | 
MeanAbsoluteError: 0.1225666180253029 | Loss: 0.0229102625560604 | Epoch: 5 | MeanAbsoluteError: 0.0983595475554466 | Loss: 0.0152016369821994 | Epoch: 6 | MeanAbsoluteError: 0.1012638658285141 | Loss: 0.0163994073794272 | Epoch: 7 | MeanAbsoluteError: 0.1008819043636322 | Loss: 0.0156029170244246 | Epoch: 8 | 
MeanAbsoluteError: 0.0898438915610313 | Loss: 0.0128116580339051 | Epoch: 9 | MeanAbsoluteError: 0.0833219662308693 | Loss: 0.0105152710120341 | Epoch: 10 | MeanAbsoluteError: 0.0846344903111458 | Loss: 0.0115213508190783 | Epoch: 11 | MeanAbsoluteError: 0.0785620138049126 | Loss: 0.0105242014764563 | Epoch: 12 | 
MeanAbsoluteError: 0.0725310593843460 | Loss: 0.0082105176100556 | Epoch: 13 | MeanAbsoluteError: 0.0768526941537857 | Loss: 0.0098556312609856 | Epoch: 14 | MeanAbsoluteError: 0.0649687424302101 | Loss: 0.0075180405891795 | Epoch: 15 | MeanAbsoluteError: 0.0714496076107025 | Loss: 0.0081526298094296 | Epoch: 16 | 
MeanAbsoluteError: 0.0666156485676765 | Loss: 0.0078232451280775 | Epoch: 17 | MeanAbsoluteError: 0.0639944300055504 | Loss: 0.0072961616051065 | Epoch: 18 | MeanAbsoluteError: 0.0713141337037086 | Loss: 0.0088125942091114 | Epoch: 19 | MeanAbsoluteError: 0.0730975046753883 | Loss: 0.0090542598351787 | Epoch: 20 | 
MeanAbsoluteError: 0.0646980032324791 | Loss: 0.0073157171044793 | Epoch: 21 | MeanAbsoluteError: 0.0672253146767616 | Loss: 0.0078984906829550 | Epoch: 22 | MeanAbsoluteError: 0.0568662695586681 | Loss: 0.0057325467075172 | Epoch: 23 | MeanAbsoluteError: 0.0676896497607231 | Loss: 0.0076013721868788 | Epoch: 24 | 
MeanAbsoluteError: 0.0629585757851601 | Loss: 0.0066645811710164 | Epoch: 25 | MeanAbsoluteError: 0.0628982931375504 | Loss: 0.0071594645943199 | Epoch: 26 | MeanAbsoluteError: 0.0588145144283772 | Loss: 0.0064130426142487 | Epoch: 27 | 
MeanAbsoluteError: 0.0643735900521278 | Loss: 0.0066883668462795 | Epoch: 28 | MeanAbsoluteError: 0.0623006559908390 | Loss: 0.0068946850767947 | Epoch: 29 | MeanAbsoluteError: 0.0644125342369080 | Loss: 0.0068537936435620 | Epoch: 30 | MeanAbsoluteError: 0.0620048977434635 | Loss: 0.0064293940974350 | Epoch: 31 | 
MeanAbsoluteError: 0.0563510134816170 | Loss: 0.0054817110955666 | Epoch: 32 | MeanAbsoluteError: 0.0541640855371952 | Loss: 0.0054238190580355 | Epoch: 33 | MeanAbsoluteError: 0.0554178804159164 | Loss: 0.0058718559326065 | Epoch: 34 | MeanAbsoluteError: 0.0536763779819012 | Loss: 0.0044348455757197 | Epoch: 35 | 
MeanAbsoluteError: 0.0620102696120739 | Loss: 0.0068847409290213 | Epoch: 36 | MeanAbsoluteError: 0.0601697154343128 | Loss: 0.0064660886602819 | Epoch: 37 | MeanAbsoluteError: 0.0540896542370319 | Loss: 0.0049975185844998 | Epoch: 38 | MeanAbsoluteError: 0.0628583505749702 | Loss: 0.0080273249554203 | Epoch: 39 | 
MeanAbsoluteError: 0.0563287734985352 | Loss: 0.0056473667224820 | Epoch: 40 | MeanAbsoluteError: 0.0590554885566235 | Loss: 0.0067543984485766 | Epoch: 41 | MeanAbsoluteError: 0.0638937354087830 | Loss: 0.0076363018505569 | Epoch: 42 | MeanAbsoluteError: 0.0579698123037815 | Loss: 0.0069268529983482 | Epoch: 43 | 
MeanAbsoluteError: 0.0578466467559338 | Loss: 0.0062805863425111 | Epoch: 44 | MeanAbsoluteError: 0.0641067400574684 | Loss: 0.0073892042549376 | Epoch: 45 | MeanAbsoluteError: 0.0518079549074173 | Loss: 0.0048954987938295 | Epoch: 46 | MeanAbsoluteError: 0.0503163449466228 | Loss: 0.0051259728237423 | Epoch: 47 | 
MeanAbsoluteError: 0.0511813722550869 | Loss: 0.0052415561022874 | Epoch: 48 | MeanAbsoluteError: 0.0546074658632278 | Loss: 0.0053263859774329 | Epoch: 49 | MeanAbsoluteError: 0.0514329001307487 | Loss: 0.0048348851315064 | Epoch: 50 | MeanAbsoluteError: 0.0560775361955166 | Loss: 0.0056822850785561 | Epoch: 51 | 
MeanAbsoluteError: 0.0491376481950283 | Loss: 0.0045534768371573 | Epoch: 52 | MeanAbsoluteError: 0.0514286756515503 | Loss: 0.0051956659927351 | Epoch: 53 | MeanAbsoluteError: 0.0707381442189217 | Loss: 0.0080786086741443 | Epoch: 54 | MeanAbsoluteError: 0.0535416975617409 | Loss: 0.0051124632652653 | Epoch: 55 | 
MeanAbsoluteError: 0.0560877807438374 | Loss: 0.0053623238498786 | Epoch: 56 | MeanAbsoluteError: 0.0680474862456322 | Loss: 0.0077096539132885 | Epoch: 57 | MeanAbsoluteError: 0.0634890049695969 | Loss: 0.0075894465614845 | Epoch: 58 | MeanAbsoluteError: 0.0538508147001266 | Loss: 0.0051713026592839 | Epoch: 59 | 
MeanAbsoluteError: 0.0533880852162838 | Loss: 0.0051999232573986 | Epoch: 60 | MeanAbsoluteError: 0.0571823939681053 | Loss: 0.0062568328055357 | Epoch: 61 | MeanAbsoluteError: 0.0547717176377773 | Loss: 0.0055355410747181 | Epoch: 62 | MeanAbsoluteError: 0.0630423128604889 | Loss: 0.0066528442119689 | Epoch: 63 | 
MeanAbsoluteError: 0.0542029887437820 | Loss: 0.0051952790113558 | Epoch: 64 | MeanAbsoluteError: 0.0524552017450333 | Loss: 0.0051679399253580 | Epoch: 65 | MeanAbsoluteError: 0.0595495291054249 | Loss: 0.0063223883227788 | Epoch: 66 | MeanAbsoluteError: 0.0605428554117680 | Loss: 0.0059999938361886 | Epoch: 67 | 
MeanAbsoluteError: 0.0604771412909031 | Loss: 0.0059012059830007 | Epoch: 68 | MeanAbsoluteError: 0.0520688518881798 | Loss: 0.0049734828475936 | Epoch: 69 | MeanAbsoluteError: 0.0497259870171547 | Loss: 0.0047130969852381 | Epoch: 70 | MeanAbsoluteError: 0.0503780171275139 | Loss: 0.0057410109239802 | Epoch: 71 | 
MeanAbsoluteError: 0.0533940196037292 | Loss: 0.0047218548348419 | Epoch: 72 | MeanAbsoluteError: 0.0587881840765476 | Loss: 0.0057495791238341 | Epoch: 73 | MeanAbsoluteError: 0.0542731285095215 | Loss: 0.0055826458602065 | Epoch: 74 | MeanAbsoluteError: 0.0508222766220570 | Loss: 0.0049763083546790 | Epoch: 75 | 
MeanAbsoluteError: 0.0478166267275810 | Loss: 0.0041767671385682 | Epoch: 76 | MeanAbsoluteError: 0.0713439807295799 | Loss: 0.0077906880055946 | Epoch: 77 | MeanAbsoluteError: 0.0548217259347439 | Loss: 0.0057669209414407 | Epoch: 78 | MeanAbsoluteError: 0.0519948042929173 | Loss: 0.0049195504352132 | Epoch: 79 | 
MeanAbsoluteError: 0.0507967621088028 | Loss: 0.0050012943990480 | Epoch: 80 | MeanAbsoluteError: 0.0581576153635979 | Loss: 0.0060965828107376 | Epoch: 81 | MeanAbsoluteError: 0.0500195659697056 | Loss: 0.0051155700378953 | Epoch: 82 | MeanAbsoluteError: 0.0584947317838669 | Loss: 0.0059314732084443 | Epoch: 83 | 
MeanAbsoluteError: 0.0496803484857082 | Loss: 0.0045010412072052 | Epoch: 84 | MeanAbsoluteError: 0.0586543157696724 | Loss: 0.0054211143624822 | Epoch: 85 | MeanAbsoluteError: 0.0515358150005341 | Loss: 0.0041499671106545 | Epoch: 86 | MeanAbsoluteError: 0.0490731187164783 | Loss: 0.0047594601852133 | Epoch: 87 | 
MeanAbsoluteError: 0.0488664358854294 | Loss: 0.0038823238910960 | Epoch: 88 | MeanAbsoluteError: 0.0500534586608410 | Loss: 0.0048268302971816 | Epoch: 89 | MeanAbsoluteError: 0.0607672818005085 | Loss: 0.0063695129141898 | Epoch: 90 | MeanAbsoluteError: 0.0428543426096439 | Loss: 0.0036700186365603 | Epoch: 91 | 
MeanAbsoluteError: 0.0489945039153099 | Loss: 0.0045739252236672 | Epoch: 92 | MeanAbsoluteError: 0.0520430393517017 | Loss: 0.0047456365764925 | Epoch: 93 | MeanAbsoluteError: 0.0543636642396450 | Loss: 0.0048432723177891 | Epoch: 94 | MeanAbsoluteError: 0.0530404150485992 | Loss: 0.0045820627404426 | Epoch: 95 | 
MeanAbsoluteError: 0.0580774620175362 | Loss: 0.0075225431462872 | Epoch: 96 | MeanAbsoluteError: 0.0577180087566376 | Loss: 0.0058256526750292 | Epoch: 97 | MeanAbsoluteError: 0.0548297166824341 | Loss: 0.0050166448008416 | Epoch: 98 | MeanAbsoluteError: 0.0510147586464882 | Loss: 0.0043236548678435 | Epoch: 99 | 
MeanAbsoluteError: 0.0489062331616879 | Loss: 0.0049819172372257 | Epoch: 100 | MeanAbsoluteError: 0.0548061318695545 | Loss: 0.0052323131132748 | Epoch: 101 | MeanAbsoluteError: 0.0488793328404427 | Loss: 0.0049164316044066 | Epoch: 102 | MeanAbsoluteError: 0.0488803721964359 | Loss: 0.0046381750251289 | Epoch: 103 | 
MeanAbsoluteError: 0.0509681552648544 | Loss: 0.0048525189340580 | Epoch: 104 | MeanAbsoluteError: 0.0491908341646194 | Loss: 0.0052498484636951 | Epoch: 105 | MeanAbsoluteError: 0.0425129868090153 | Loss: 0.0035697827238197 | Epoch: 106 | MeanAbsoluteError: 0.0436878465116024 | Loss: 0.0039610523281705 | Epoch: 107 | 
MeanAbsoluteError: 0.0485272705554962 | Loss: 0.0046347123999639 | Epoch: 108 | MeanAbsoluteError: 0.0554202981293201 | Loss: 0.0058226880929923 | Epoch: 109 | MeanAbsoluteError: 0.0496334806084633 | Loss: 0.0041041335207410 | Epoch: 110 | MeanAbsoluteError: 0.0453495830297470 | Loss: 0.0038953279083791 | Epoch: 111 | 
MeanAbsoluteError: 0.0618671551346779 | Loss: 0.0070297461015319 | Epoch: 112 | MeanAbsoluteError: 0.0542057938873768 | Loss: 0.0050549143772131 | Epoch: 113 | MeanAbsoluteError: 0.0492808520793915 | Loss: 0.0043026664812044 | Epoch: 114 | MeanAbsoluteError: 0.0484163425862789 | Loss: 0.0047312997921836 | Epoch: 115 | 
MeanAbsoluteError: 0.0516265779733658 | Loss: 0.0047109486431030 | Epoch: 116 | MeanAbsoluteError: 0.0554279536008835 | Loss: 0.0051839629856036 | Epoch: 117 | MeanAbsoluteError: 0.0505538955330849 | Loss: 0.0044117799920251 | Epoch: 118 | MeanAbsoluteError: 0.0594808459281921 | Loss: 0.0066723095476750 | Epoch: 119 | 
MeanAbsoluteError: 0.0599228926002979 | Loss: 0.0057428399695231 | Epoch: 120 | MeanAbsoluteError: 0.0562699325382710 | Loss: 0.0057977399249610 | Epoch: 121 | MeanAbsoluteError: 0.0478807128965855 | Loss: 0.0042656366338059 | Epoch: 122 | MeanAbsoluteError: 0.0586617775261402 | Loss: 0.0055336583816250 | Epoch: 123 | 
MeanAbsoluteError: 0.0511167757213116 | Loss: 0.0049591601372844 | Epoch: 124 | MeanAbsoluteError: 0.0521170832216740 | Loss: 0.0058747629166311 | Epoch: 125 | MeanAbsoluteError: 0.0510618127882481 | Loss: 0.0054301748781367 | Epoch: 126 | MeanAbsoluteError: 0.0506604351103306 | Loss: 0.0055878796035693 | Epoch: 127 | 
MeanAbsoluteError: 0.0459920614957809 | Loss: 0.0044727184890929 | Epoch: 128 | MeanAbsoluteError: 0.0547601245343685 | Loss: 0.0052383679430932 | Epoch: 129 | MeanAbsoluteError: 0.0491955019533634 | Loss: 0.0049548119484251 | Epoch: 130 | MeanAbsoluteError: 0.0438412912189960 | Loss: 0.0038714492739497 | Epoch: 131 | 
MeanAbsoluteError: 0.0474081598222256 | Loss: 0.0043321530584332 | Epoch: 132 | MeanAbsoluteError: 0.0512751340866089 | Loss: 0.0053074758999221 | Epoch: 133 | MeanAbsoluteError: 0.0506840944290161 | Loss: 0.0049041046816120 | Epoch: 134 | MeanAbsoluteError: 0.0503975600004196 | Loss: 0.0046255082829463 | Epoch: 135 | 
MeanAbsoluteError: 0.0514578670263290 | Loss: 0.0046365413827037 | Epoch: 136 | MeanAbsoluteError: 0.0429868102073669 | Loss: 0.0038907637690978 | Epoch: 137 | MeanAbsoluteError: 0.0517872311174870 | Loss: 0.0052856638672222 | Epoch: 138 | MeanAbsoluteError: 0.0490264147520065 | Loss: 0.0055678513308521 | Epoch: 139 | 
MeanAbsoluteError: 0.0468524545431137 | Loss: 0.0044361190996010 | Epoch: 140 | MeanAbsoluteError: 0.0439177379012108 | Loss: 0.0035369486339684 | Epoch: 141 | MeanAbsoluteError: 0.0429758094251156 | Loss: 0.0041910637473369 | Epoch: 142 | MeanAbsoluteError: 0.0474017336964607 | Loss: 0.0044765033495710 | Epoch: 143 | 
MeanAbsoluteError: 0.0468146316707134 | Loss: 0.0045256495949089 | Epoch: 144 | MeanAbsoluteError: 0.0450309887528419 | Loss: 0.0040496404935287 | Epoch: 145 | MeanAbsoluteError: 0.0531271509826183 | Loss: 0.0053307719001743 | Epoch: 146 | MeanAbsoluteError: 0.0545204356312752 | Loss: 0.0051992138185980 | Epoch: 147 | 
MeanAbsoluteError: 0.0518081746995449 | Loss: 0.0049699235563534 | Epoch: 148 | MeanAbsoluteError: 0.0483873113989830 | Loss: 0.0048898270148416 | Epoch: 149 | MeanAbsoluteError: 0.0497963503003120 | Loss: 0.0047151859662814 | Epoch: 150 | MeanAbsoluteError: 0.0496476590633392 | Loss: 0.0040573689590306 | Epoch: 151 | 
MeanAbsoluteError: 0.0524070486426353 | Loss: 0.0054542568947287 | Epoch: 152 | MeanAbsoluteError: 0.0505332611501217 | Loss: 0.0048935819895154 | Epoch: 153 | MeanAbsoluteError: 0.0507277175784111 | Loss: 0.0047233196857728 | Epoch: 154 | MeanAbsoluteError: 0.0589441992342472 | Loss: 0.0060576029569156 | Epoch: 155 | 
MeanAbsoluteError: 0.0493478477001190 | Loss: 0.0050585214860468 | Epoch: 156 | MeanAbsoluteError: 0.0452038049697876 | Loss: 0.0039320529513612 | Epoch: 157 | MeanAbsoluteError: 0.0542941726744175 | Loss: 0.0061444614456329 | Epoch: 158 | MeanAbsoluteError: 0.0519544743001461 | Loss: 0.0042957149868782 | Epoch: 159 | 
MeanAbsoluteError: 0.0478351339697838 | Loss: 0.0044496219151800 | Epoch: 160 | MeanAbsoluteError: 0.0506627932190895 | Loss: 0.0046664074057174 | Epoch: 161 | MeanAbsoluteError: 0.0595928654074669 | Loss: 0.0060352605528590 | Epoch: 162 | MeanAbsoluteError: 0.0485134012997150 | Loss: 0.0045875538520417 | Epoch: 163 | 
MeanAbsoluteError: 0.0478660501539707 | Loss: 0.0050134028102835 | Epoch: 164 | MeanAbsoluteError: 0.0431748777627945 | Loss: 0.0044437562342194 | Epoch: 165 | MeanAbsoluteError: 0.0508107058703899 | Loss: 0.0049127247000701 | Epoch: 166 | MeanAbsoluteError: 0.0444596372544765 | Loss: 0.0036638728542082 | Epoch: 167 | 
MeanAbsoluteError: 0.0607872270047665 | Loss: 0.0063403996418377 | Epoch: 168 | MeanAbsoluteError: 0.0453608371317387 | Loss: 0.0039731377803132 | Epoch: 169 | MeanAbsoluteError: 0.0529519580304623 | Loss: 0.0055553546484780 | Epoch: 170 | MeanAbsoluteError: 0.0549007542431355 | Loss: 0.0048428522576088 | Epoch: 171 | 
MeanAbsoluteError: 0.0537488944828510 | Loss: 0.0053144181361667 | Epoch: 172 | MeanAbsoluteError: 0.0455558821558952 | Loss: 0.0042871075259571 | Epoch: 173 | MeanAbsoluteError: 0.0492472946643829 | Loss: 0.0046557970345020 | Epoch: 174 | MeanAbsoluteError: 0.0547079406678677 | Loss: 0.0058127329562252 | Epoch: 175 | 
MeanAbsoluteError: 0.0525230020284653 | Loss: 0.0053306434328031 | Epoch: 176 | MeanAbsoluteError: 0.0546562559902668 | Loss: 0.0057274464266620 | Epoch: 177 | MeanAbsoluteError: 0.0501013584434986 | Loss: 0.0045049431194600 | Epoch: 178 | MeanAbsoluteError: 0.0558300763368607 | Loss: 0.0068474685019617 | Epoch: 179 | 
MeanAbsoluteError: 0.0521060526371002 | Loss: 0.0049656669664393 | Epoch: 180 | MeanAbsoluteError: 0.0508404523134232 | Loss: 0.0052835445170977 | Epoch: 181 | MeanAbsoluteError: 0.0538774542510509 | Loss: 0.0055624233990736 | Epoch: 182 | MeanAbsoluteError: 0.0559035427868366 | Loss: 0.0059318734381936 | 
Epoch: 183 | MeanAbsoluteError: 0.0557606443762779 | Loss: 0.0051081028527972 | Epoch: 184 | MeanAbsoluteError: 0.0463708415627480 | Loss: 0.0044224821498287 | Epoch: 185 | MeanAbsoluteError: 0.0526744425296783 | Loss: 0.0057336210509100 | Epoch: 186 | 
MeanAbsoluteError: 0.0501622892916203 | Loss: 0.0045316611726058 | Epoch: 187 | MeanAbsoluteError: 0.0611898042261600 | Loss: 0.0058761916650263 | Epoch: 188 | MeanAbsoluteError: 0.0636456534266472 | Loss: 0.0070122339683095 | Epoch: 189 | MeanAbsoluteError: 0.0552155748009682 | Loss: 0.0061342076553142 | Epoch: 190 | 
MeanAbsoluteError: 0.0575042106211185 | Loss: 0.0062321281798895 | Epoch: 191 | MeanAbsoluteError: 0.0633357688784599 | Loss: 0.0066737483966311 | Epoch: 192 | MeanAbsoluteError: 0.0526954010128975 | Loss: 0.0048711087239146 | Epoch: 193 | 
MeanAbsoluteError: 0.0534703508019447 | Loss: 0.0061190333462467 | Epoch: 194 | MeanAbsoluteError: 0.0434292070567608 | Loss: 0.0037385614169149 | Epoch: 195 | MeanAbsoluteError: 0.0527493730187416 | Loss: 0.0050137670722937 | Epoch: 196 | MeanAbsoluteError: 0.0511577390134335 | Loss: 0.0055822811861473 | Epoch: 197 | 
MeanAbsoluteError: 0.0461829006671906 | Loss: 0.0041071279847529 | Epoch: 198 | MeanAbsoluteError: 0.0441893897950649 | Loss: 0.0041920666837158 | Epoch: 199 | MeanAbsoluteError: 0.0424262396991253 | Loss: 0.0038943349975039 | Epoch: 200 | MeanAbsoluteError: 0.0599287971854210 | Loss: 0.0065689984338334 | Epoch: 201 | 
MeanAbsoluteError: 0.0564301051199436 | Loss: 0.0053871131814575 | Epoch: 202 | MeanAbsoluteError: 0.0521859116852283 | Loss: 0.0052646369210714 | Epoch: 203 | MeanAbsoluteError: 0.0509782694280148 | Loss: 0.0051318406231554 | Epoch: 204 | MeanAbsoluteError: 0.0482540242373943 | Loss: 0.0052256613845729 | Early stopping at epoch 203
Returned to Spot: Validation loss: 0.0052256613845728635

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.19558603900286908, 'lr_mult': 7.448008656603053, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.2026605518977484}
Epoch: 1 | MeanAbsoluteError: 0.1576537489891052 | Loss: 0.0371241024450252 | Epoch: 2 | MeanAbsoluteError: 0.1471570283174515 | Loss: 0.0325738389633204 | Epoch: 3 | MeanAbsoluteError: 0.1492935568094254 | Loss: 0.0329533073266870 | Epoch: 4 | MeanAbsoluteError: 0.1501051336526871 | Loss: 0.0332149744622017 | Epoch: 5 | MeanAbsoluteError: 0.1239315047860146 | Loss: 0.0231538510048076 | Epoch: 6 | MeanAbsoluteError: 0.1269563585519791 | Loss: 0.0240062994784430 | Epoch: 7 | 
MeanAbsoluteError: 0.1274782866239548 | Loss: 0.0240387253365234 | Epoch: 8 | MeanAbsoluteError: 0.0920177921652794 | Loss: 0.0141485493973290 | Epoch: 9 | MeanAbsoluteError: 0.1368053257465363 | Loss: 0.0272907239237898 | Epoch: 10 | MeanAbsoluteError: 0.1077526733279228 | Loss: 0.0178965055628827 | Epoch: 11 | MeanAbsoluteError: 0.1315215378999710 | Loss: 0.0250200458655232 | Epoch: 12 | MeanAbsoluteError: 0.1343497782945633 | Loss: 0.0243506257079150 | Epoch: 13 | 
MeanAbsoluteError: 0.1047645881772041 | Loss: 0.0159218440714635 | Epoch: 14 | MeanAbsoluteError: 0.0796423628926277 | Loss: 0.0098755388814760 | Epoch: 15 | MeanAbsoluteError: 0.1257768571376801 | Loss: 0.0232023755578618 | Epoch: 16 | MeanAbsoluteError: 0.1160022765398026 | Loss: 0.0193196493446043 | Epoch: 17 | MeanAbsoluteError: 0.1055991798639297 | Loss: 0.0166633820504342 | Epoch: 18 | MeanAbsoluteError: 0.0647322982549667 | Loss: 0.0070547177211234 | Epoch: 19 | MeanAbsoluteError: 0.0877254679799080 | Loss: 0.0118277318481552 | Epoch: 20 | 
MeanAbsoluteError: 0.0680278241634369 | Loss: 0.0075104305226552 | Epoch: 21 | MeanAbsoluteError: 0.0869466066360474 | Loss: 0.0107279598810955 | Epoch: 22 | MeanAbsoluteError: 0.0515963397920132 | Loss: 0.0044496981243260 | Epoch: 23 | MeanAbsoluteError: 0.1082045584917068 | Loss: 0.0156988123137700 | Epoch: 24 | MeanAbsoluteError: 0.0948655977845192 | Loss: 0.0148853029761659 | Epoch: 25 | MeanAbsoluteError: 0.0914654955267906 | Loss: 0.0113117591183829 | Epoch: 26 | MeanAbsoluteError: 0.1070964336395264 | Loss: 0.0162888841311398 | Epoch: 27 | 
MeanAbsoluteError: 0.1275680959224701 | Loss: 0.0205569811851570 | Epoch: 28 | MeanAbsoluteError: 0.1066668704152107 | Loss: 0.0164664581810173 | Epoch: 29 | MeanAbsoluteError: 0.0915611088275909 | Loss: 0.0121749116254872 | Epoch: 30 | MeanAbsoluteError: 0.1468640714883804 | Loss: 0.0253135073733957 | Epoch: 31 | MeanAbsoluteError: 0.0894179567694664 | Loss: 0.0112113211500017 | Epoch: 32 | MeanAbsoluteError: 0.1215740442276001 | Loss: 0.0203687704511379 | Epoch: 33 | MeanAbsoluteError: 0.0825090259313583 | Loss: 0.0098643455850451 | Epoch: 34 | 
MeanAbsoluteError: 0.1420194953680038 | Loss: 0.0242505659790416 | Epoch: 35 | MeanAbsoluteError: 0.1187702715396881 | Loss: 0.0179499383819731 | Epoch: 36 | MeanAbsoluteError: 0.0694108381867409 | Loss: 0.0078946906632107 | Epoch: 37 | MeanAbsoluteError: 0.2029510438442230 | Loss: 0.0467401168456203 | Epoch: 38 | MeanAbsoluteError: 0.1284051388502121 | Loss: 0.0194381534268982 | Epoch: 39 | MeanAbsoluteError: 0.0699532106518745 | Loss: 0.0073772401818515 | Epoch: 40 | MeanAbsoluteError: 0.0822278559207916 | Loss: 0.0103401182170369 | Epoch: 41 | 
MeanAbsoluteError: 0.1275567263364792 | Loss: 0.0202132698246523 | Epoch: 42 | MeanAbsoluteError: 0.0822138637304306 | Loss: 0.0095945177844873 | Epoch: 43 | MeanAbsoluteError: 0.0949029996991158 | Loss: 0.0117541412136665 | Epoch: 44 | MeanAbsoluteError: 0.1071104034781456 | Loss: 0.0147900009331735 | Epoch: 45 | MeanAbsoluteError: 0.0533463172614574 | Loss: 0.0048009353248697 | Epoch: 46 | MeanAbsoluteError: 0.0854016840457916 | Loss: 0.0096584585201191 | Epoch: 47 | MeanAbsoluteError: 0.1756445020437241 | Loss: 0.0348618976575764 | Epoch: 48 | 
MeanAbsoluteError: 0.1411600857973099 | Loss: 0.0231789311296061 | Epoch: 49 | MeanAbsoluteError: 0.1830604523420334 | Loss: 0.0377721063988773 | Epoch: 50 | MeanAbsoluteError: 0.0447322987020016 | Loss: 0.0037836054413530 | Epoch: 51 | MeanAbsoluteError: 0.0662365108728409 | Loss: 0.0068458562079621 | Epoch: 52 | MeanAbsoluteError: 0.0728638619184494 | Loss: 0.0084670631362027 | Epoch: 53 | MeanAbsoluteError: 0.0451635122299194 | Loss: 0.0035227882908657 | Epoch: 54 | MeanAbsoluteError: 0.1325897276401520 | Loss: 0.0208423241580787 | Epoch: 55 | 
MeanAbsoluteError: 0.0425529330968857 | Loss: 0.0029730352229978 | Epoch: 56 | MeanAbsoluteError: 0.0665653720498085 | Loss: 0.0066926432650928 | Epoch: 57 | MeanAbsoluteError: 0.0648057833313942 | Loss: 0.0065936142407162 | Epoch: 58 | MeanAbsoluteError: 0.0764665976166725 | Loss: 0.0087257562156178 | Epoch: 59 | MeanAbsoluteError: 0.0647575855255127 | Loss: 0.0068094634549006 | Epoch: 60 | MeanAbsoluteError: 0.1141515970230103 | Loss: 0.0153538074442431 | Epoch: 61 | MeanAbsoluteError: 0.0621096976101398 | Loss: 0.0058136796333680 | Epoch: 62 | 
MeanAbsoluteError: 0.0917228683829308 | Loss: 0.0116327084404858 | Epoch: 63 | MeanAbsoluteError: 0.0398471243679523 | Loss: 0.0030277344937387 | Epoch: 64 | MeanAbsoluteError: 0.0483802109956741 | Loss: 0.0037164699996969 | Epoch: 65 | MeanAbsoluteError: 0.0566176660358906 | Loss: 0.0056012707431556 | Epoch: 66 | MeanAbsoluteError: 0.0924349948763847 | Loss: 0.0120169794628103 | Epoch: 67 | MeanAbsoluteError: 0.1201274618506432 | Loss: 0.0175358587385792 | Epoch: 68 | MeanAbsoluteError: 0.0584267303347588 | Loss: 0.0052532542276343 | Epoch: 69 | 
MeanAbsoluteError: 0.0945024043321609 | Loss: 0.0114184025871126 | Epoch: 70 | MeanAbsoluteError: 0.0656167343258858 | Loss: 0.0073606126059435 | Epoch: 71 | MeanAbsoluteError: 0.0455515421926975 | Loss: 0.0035209118474373 | Epoch: 72 | MeanAbsoluteError: 0.0780214518308640 | Loss: 0.0086096337212152 | Epoch: 73 | MeanAbsoluteError: 0.0909908413887024 | Loss: 0.0125607886645747 | Epoch: 74 | MeanAbsoluteError: 0.1064788997173309 | Loss: 0.0145660996633141 | Epoch: 75 | MeanAbsoluteError: 0.0474500954151154 | Loss: 0.0037225035301067 | 
Epoch: 76 | MeanAbsoluteError: 0.0450612939894199 | Loss: 0.0036978027078715 | Epoch: 77 | MeanAbsoluteError: 0.0656636655330658 | Loss: 0.0061879804186327 | Epoch: 78 | MeanAbsoluteError: 0.0954613089561462 | Loss: 0.0136571459864315 | Epoch: 79 | MeanAbsoluteError: 0.0975570902228355 | Loss: 0.0117609786653989 | Epoch: 80 | MeanAbsoluteError: 0.0919706895947456 | Loss: 0.0103534069402437 | Epoch: 81 | MeanAbsoluteError: 0.1014891713857651 | Loss: 0.0138107162753218 | Epoch: 82 | 
MeanAbsoluteError: 0.0416049137711525 | Loss: 0.0029494661935850 | Epoch: 83 | MeanAbsoluteError: 0.0613561868667603 | Loss: 0.0056663459951156 | Epoch: 84 | MeanAbsoluteError: 0.0763662010431290 | Loss: 0.0083116293688746 | Epoch: 85 | MeanAbsoluteError: 0.0417902097105980 | Loss: 0.0037397252744995 | Epoch: 86 | MeanAbsoluteError: 0.0334540791809559 | Loss: 0.0024299689470545 | Epoch: 87 | MeanAbsoluteError: 0.0332052484154701 | Loss: 0.0022006698908578 | Epoch: 88 | MeanAbsoluteError: 0.1122358292341232 | Loss: 0.0149577136494611 | 
Epoch: 89 | MeanAbsoluteError: 0.1020331755280495 | Loss: 0.0126010056241955 | Epoch: 90 | MeanAbsoluteError: 0.0396909527480602 | Loss: 0.0030961804900711 | Epoch: 91 | MeanAbsoluteError: 0.1081202477216721 | Loss: 0.0138301801328596 | Epoch: 92 | MeanAbsoluteError: 0.0674472749233246 | Loss: 0.0070134538814033 | Epoch: 93 | MeanAbsoluteError: 0.0580549500882626 | Loss: 0.0058899535797536 | Epoch: 94 | MeanAbsoluteError: 0.0749015584588051 | Loss: 0.0076906123737756 | Epoch: 95 | 
MeanAbsoluteError: 0.0617745481431484 | Loss: 0.0054860806558281 | Epoch: 96 | MeanAbsoluteError: 0.0387640483677387 | Loss: 0.0025077120425474 | Epoch: 97 | MeanAbsoluteError: 0.0398495160043240 | Loss: 0.0025881833311072 | Epoch: 98 | MeanAbsoluteError: 0.0641623586416245 | Loss: 0.0061485287243206 | Epoch: 99 | MeanAbsoluteError: 0.0481731966137886 | Loss: 0.0037534644851755 | Epoch: 100 | MeanAbsoluteError: 0.0834775790572166 | Loss: 0.0101221051116131 | Epoch: 101 | MeanAbsoluteError: 0.0494153425097466 | Loss: 0.0037208378719362 | Epoch: 102 | 
MeanAbsoluteError: 0.0643165335059166 | Loss: 0.0070793805031204 | Epoch: 103 | MeanAbsoluteError: 0.0336097702383995 | Loss: 0.0027760651259757 | Epoch: 104 | MeanAbsoluteError: 0.0892196074128151 | Loss: 0.0110575409459048 | Epoch: 105 | MeanAbsoluteError: 0.0867274925112724 | Loss: 0.0103284524459588 | Epoch: 106 | MeanAbsoluteError: 0.0610234625637531 | Loss: 0.0063360634039303 | Epoch: 107 | MeanAbsoluteError: 0.0748942419886589 | Loss: 0.0071669835107107 | Epoch: 108 | MeanAbsoluteError: 0.0323297381401062 | Loss: 0.0020163563986946 | Epoch: 109 | 
MeanAbsoluteError: 0.0509131066501141 | Loss: 0.0042308698114204 | Epoch: 110 | MeanAbsoluteError: 0.0554416738450527 | Loss: 0.0041554260900930 | Epoch: 111 | MeanAbsoluteError: 0.0896003693342209 | Loss: 0.0123715768568218 | Epoch: 112 | MeanAbsoluteError: 0.0528755113482475 | Loss: 0.0043795672306595 | Epoch: 113 | MeanAbsoluteError: 0.0375675633549690 | Loss: 0.0022228274028748 | Epoch: 114 | MeanAbsoluteError: 0.0377793684601784 | Loss: 0.0025471264257488 | Epoch: 115 | MeanAbsoluteError: 0.0929443687200546 | Loss: 0.0110290685276452 | Epoch: 116 | 
MeanAbsoluteError: 0.0676704570651054 | Loss: 0.0077043650426755 | Epoch: 117 | MeanAbsoluteError: 0.0437710434198380 | Loss: 0.0030783187708278 | Epoch: 118 | MeanAbsoluteError: 0.0900241881608963 | Loss: 0.0121118107957667 | Epoch: 119 | MeanAbsoluteError: 0.0480575002729893 | Loss: 0.0033555762401145 | Epoch: 120 | MeanAbsoluteError: 0.0444488637149334 | Loss: 0.0030485767209412 | Epoch: 121 | MeanAbsoluteError: 0.0383355952799320 | Loss: 0.0029661963834721 | Epoch: 122 | MeanAbsoluteError: 0.0302641522139311 | Loss: 0.0017723058760901 | Epoch: 123 | 
MeanAbsoluteError: 0.0851379558444023 | Loss: 0.0089884101364173 | Epoch: 124 | MeanAbsoluteError: 0.0345459207892418 | Loss: 0.0026770742291487 | Epoch: 125 | MeanAbsoluteError: 0.0559882931411266 | Loss: 0.0054141532899322 | Epoch: 126 | MeanAbsoluteError: 0.1069112494587898 | Loss: 0.0150831753731166 | Epoch: 127 | MeanAbsoluteError: 0.0583681166172028 | Loss: 0.0056309016715539 | Epoch: 128 | MeanAbsoluteError: 0.0445699132978916 | Loss: 0.0032556749586212 | Epoch: 129 | 
MeanAbsoluteError: 0.0385826490819454 | Loss: 0.0027404263444049 | Epoch: 130 | MeanAbsoluteError: 0.0448647737503052 | Loss: 0.0034524563601927 | Epoch: 131 | MeanAbsoluteError: 0.1035506054759026 | Loss: 0.0145944684841915 | Epoch: 132 | MeanAbsoluteError: 0.1147233843803406 | Loss: 0.0157100716115613 | Epoch: 133 | MeanAbsoluteError: 0.0363160148262978 | Loss: 0.0030762090923657 | Epoch: 134 | MeanAbsoluteError: 0.0323437564074993 | Loss: 0.0019925239642984 | Epoch: 135 | MeanAbsoluteError: 0.0739214271306992 | Loss: 0.0080497873162753 | Epoch: 136 | 
MeanAbsoluteError: 0.0411022827029228 | Loss: 0.0028896050858556 | Epoch: 137 | MeanAbsoluteError: 0.0412372425198555 | Loss: 0.0034573169878537 | Epoch: 138 | MeanAbsoluteError: 0.0618519671261311 | Loss: 0.0058549801255331 | Epoch: 139 | MeanAbsoluteError: 0.1049729064106941 | Loss: 0.0150201167225053 | Epoch: 140 | MeanAbsoluteError: 0.0797232463955879 | Loss: 0.0076377691799089 | Epoch: 141 | MeanAbsoluteError: 0.0625488013029099 | Loss: 0.0061527529706884 | Epoch: 142 | MeanAbsoluteError: 0.0906795486807823 | Loss: 0.0096524439899153 | Epoch: 143 | 
MeanAbsoluteError: 0.0528330951929092 | Loss: 0.0047645299744449 | Epoch: 144 | MeanAbsoluteError: 0.0792476907372475 | Loss: 0.0088629078267044 | Epoch: 145 | MeanAbsoluteError: 0.0496252775192261 | Loss: 0.0042281732159226 | Epoch: 146 | MeanAbsoluteError: 0.0675916597247124 | Loss: 0.0076860514910598 | Epoch: 147 | MeanAbsoluteError: 0.0787084251642227 | Loss: 0.0078451158723941 | Epoch: 148 | MeanAbsoluteError: 0.0551900789141655 | Loss: 0.0047364975938475 | Epoch: 149 | MeanAbsoluteError: 0.0457645766437054 | Loss: 0.0032280414414249 | Epoch: 150 | 
MeanAbsoluteError: 0.0541663281619549 | Loss: 0.0049092210706716 | Epoch: 151 | MeanAbsoluteError: 0.0864453464746475 | Loss: 0.0095365917016017 | Epoch: 152 | MeanAbsoluteError: 0.0583800114691257 | Loss: 0.0054500419769044 | Epoch: 153 | MeanAbsoluteError: 0.0333236381411552 | Loss: 0.0020449859316853 | Epoch: 154 | MeanAbsoluteError: 0.0875927582383156 | Loss: 0.0114209121828409 | Early stopping at epoch 153
Returned to Spot: Validation loss: 0.011420912182840862
spotPython tuning: 0.0016865455361671354 [#---------] 9.97% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.20293466636782523, 'lr_mult': 7.331342800164574, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07385999410782093}
Epoch: 1 | MeanAbsoluteError: 0.1481190621852875 | Loss: 0.0351861426116605 | Epoch: 2 | MeanAbsoluteError: 0.2296435236930847 | Loss: 0.0734963628806566 | Epoch: 3 | MeanAbsoluteError: 0.1444450914859772 | Loss: 0.0323482019532668 | Epoch: 4 | MeanAbsoluteError: 0.1341279894113541 | Loss: 0.0273765427991748 | Epoch: 5 | MeanAbsoluteError: 0.1876977533102036 | Loss: 0.0500323460682442 | Epoch: 6 | MeanAbsoluteError: 0.1284587234258652 | Loss: 0.0260072121592729 | Epoch: 7 | 
MeanAbsoluteError: 0.1082618460059166 | Loss: 0.0190536104828904 | Epoch: 8 | MeanAbsoluteError: 0.1435684114694595 | Loss: 0.0307440780789444 | Epoch: 9 | MeanAbsoluteError: 0.1095892339944839 | Loss: 0.0190283575242287 | Epoch: 10 | MeanAbsoluteError: 0.1321545988321304 | Loss: 0.0257497121040758 | Epoch: 11 | MeanAbsoluteError: 0.1560886055231094 | Loss: 0.0349246550743517 | Epoch: 12 | MeanAbsoluteError: 0.1256589442491531 | Loss: 0.0231270027395926 | Epoch: 13 | MeanAbsoluteError: 0.0800815448164940 | Loss: 0.0110155394251801 | Epoch: 14 | 
MeanAbsoluteError: 0.1274072229862213 | Loss: 0.0233194364823009 | Epoch: 15 | MeanAbsoluteError: 0.1206636652350426 | Loss: 0.0213027470990231 | Epoch: 16 | MeanAbsoluteError: 0.1268581002950668 | Loss: 0.0221626165470010 | Epoch: 17 | MeanAbsoluteError: 0.0873751938343048 | Loss: 0.0125727030007463 | Epoch: 18 | MeanAbsoluteError: 0.1269076168537140 | Loss: 0.0210259428836013 | Epoch: 19 | MeanAbsoluteError: 0.1651039272546768 | Loss: 0.0348334485959066 | Epoch: 20 | MeanAbsoluteError: 0.1611952632665634 | Loss: 0.0323765680782105 | Epoch: 21 | 
MeanAbsoluteError: 0.0808896347880363 | Loss: 0.0113541026550688 | Epoch: 22 | MeanAbsoluteError: 0.1088504940271378 | Loss: 0.0167615907756906 | Epoch: 23 | MeanAbsoluteError: 0.1086405590176582 | Loss: 0.0174419982358813 | Epoch: 24 | MeanAbsoluteError: 0.0746236294507980 | Loss: 0.0090405947626813 | Epoch: 25 | MeanAbsoluteError: 0.1475295275449753 | Loss: 0.0270385210843463 | Epoch: 26 | MeanAbsoluteError: 0.0979473814368248 | Loss: 0.0142573277515016 | Epoch: 27 | MeanAbsoluteError: 0.1282038539648056 | Loss: 0.0220263218507171 | Epoch: 28 | 
MeanAbsoluteError: 0.1415963172912598 | Loss: 0.0241755500043693 | Epoch: 29 | MeanAbsoluteError: 0.0660176500678062 | Loss: 0.0073338131738925 | Epoch: 30 | MeanAbsoluteError: 0.1480638384819031 | Loss: 0.0272101940293061 | Epoch: 31 | MeanAbsoluteError: 0.0611344017088413 | Loss: 0.0066793774695773 | Epoch: 32 | MeanAbsoluteError: 0.0902462005615234 | Loss: 0.0114521482273152 | Epoch: 33 | MeanAbsoluteError: 0.0760840103030205 | Loss: 0.0086295364032450 | Epoch: 34 | 
MeanAbsoluteError: 0.1102590709924698 | Loss: 0.0169183374627640 | Epoch: 35 | MeanAbsoluteError: 0.0789994671940804 | Loss: 0.0094542671730252 | Epoch: 36 | MeanAbsoluteError: 0.0467006415128708 | Loss: 0.0039529639761895 | Epoch: 37 | MeanAbsoluteError: 0.0483433902263641 | Loss: 0.0046784447285494 | Epoch: 38 | MeanAbsoluteError: 0.1078801602125168 | Loss: 0.0179967784175747 | Epoch: 39 | MeanAbsoluteError: 0.0616567730903625 | Loss: 0.0064066827395245 | Epoch: 40 | MeanAbsoluteError: 0.0755830928683281 | Loss: 0.0093122180061121 | Epoch: 41 | 
MeanAbsoluteError: 0.0729920640587807 | Loss: 0.0088524674187954 | Epoch: 42 | MeanAbsoluteError: 0.0696488469839096 | Loss: 0.0074459726456553 | Epoch: 43 | MeanAbsoluteError: 0.0644034221768379 | Loss: 0.0062645287498047 | Epoch: 44 | MeanAbsoluteError: 0.0459934920072556 | Loss: 0.0038433927601497 | Epoch: 45 | MeanAbsoluteError: 0.0632072985172272 | Loss: 0.0062141059040043 | Epoch: 46 | MeanAbsoluteError: 0.0568670332431793 | Loss: 0.0052832348982951 | Epoch: 47 | MeanAbsoluteError: 0.1483700126409531 | Loss: 0.0273461933002660 | Epoch: 48 | 
MeanAbsoluteError: 0.1641799360513687 | Loss: 0.0306064282592974 | Epoch: 49 | MeanAbsoluteError: 0.0556607060134411 | Loss: 0.0054449436352833 | Epoch: 50 | MeanAbsoluteError: 0.0599934943020344 | Loss: 0.0061060821416935 | Epoch: 51 | MeanAbsoluteError: 0.0708895623683929 | Loss: 0.0071078496740053 | Epoch: 52 | MeanAbsoluteError: 0.0860849395394325 | Loss: 0.0101291497090929 | Epoch: 53 | MeanAbsoluteError: 0.0756759420037270 | Loss: 0.0080445469602158 | Epoch: 54 | MeanAbsoluteError: 0.0419364310801029 | Loss: 0.0025509907557678 | 
Epoch: 55 | MeanAbsoluteError: 0.0941273868083954 | Loss: 0.0146793393222125 | Epoch: 56 | MeanAbsoluteError: 0.0719385221600533 | Loss: 0.0079206199581294 | Epoch: 57 | MeanAbsoluteError: 0.0573008395731449 | Loss: 0.0059069342617142 | Epoch: 58 | MeanAbsoluteError: 0.0366118066012859 | Loss: 0.0031193618043816 | Epoch: 59 | MeanAbsoluteError: 0.0481633096933365 | Loss: 0.0051094932408121 | Epoch: 60 | MeanAbsoluteError: 0.0432921573519707 | Loss: 0.0031951448978170 | Epoch: 61 | 
MeanAbsoluteError: 0.0987340062856674 | Loss: 0.0130418953975957 | Epoch: 62 | MeanAbsoluteError: 0.0488846600055695 | Loss: 0.0045877398775989 | Epoch: 63 | MeanAbsoluteError: 0.0439203083515167 | Loss: 0.0040492112533876 | Epoch: 64 | MeanAbsoluteError: 0.0865890011191368 | Loss: 0.0102151406095608 | Epoch: 65 | MeanAbsoluteError: 0.0579838491976261 | Loss: 0.0054967170152323 | Epoch: 66 | MeanAbsoluteError: 0.0494345240294933 | Loss: 0.0046315880761923 | Epoch: 67 | 
MeanAbsoluteError: 0.0750915333628654 | Loss: 0.0078714436998493 | Epoch: 68 | MeanAbsoluteError: 0.0500153936445713 | Loss: 0.0045422815999604 | Epoch: 69 | MeanAbsoluteError: 0.0552171319723129 | Loss: 0.0053961106306432 | Epoch: 70 | MeanAbsoluteError: 0.0433135218918324 | Loss: 0.0035646185309528 | Epoch: 71 | MeanAbsoluteError: 0.0342347994446754 | Loss: 0.0020871621519817 | Epoch: 72 | MeanAbsoluteError: 0.0768425613641739 | Loss: 0.0075823354877924 | Epoch: 73 | 
MeanAbsoluteError: 0.0406748615205288 | Loss: 0.0029606488594589 | Epoch: 74 | MeanAbsoluteError: 0.0398087874054909 | Loss: 0.0033795871728982 | Epoch: 75 | MeanAbsoluteError: 0.0358989015221596 | Loss: 0.0027715965989046 | Epoch: 76 | MeanAbsoluteError: 0.0643030107021332 | Loss: 0.0067213039330550 | Epoch: 77 | MeanAbsoluteError: 0.1265082806348801 | Loss: 0.0195160851764836 | Epoch: 78 | MeanAbsoluteError: 0.0565533749759197 | Loss: 0.0057808661000117 | Epoch: 79 | MeanAbsoluteError: 0.0484305955469608 | Loss: 0.0040960964428163 | Epoch: 80 | 
MeanAbsoluteError: 0.0525996014475822 | Loss: 0.0046421496050530 | Epoch: 81 | MeanAbsoluteError: 0.0586946308612823 | Loss: 0.0055326864638023 | Epoch: 82 | MeanAbsoluteError: 0.0676841139793396 | Loss: 0.0069681631744300 | Epoch: 83 | MeanAbsoluteError: 0.0543542802333832 | Loss: 0.0049179383234954 | Epoch: 84 | MeanAbsoluteError: 0.0412385798990726 | Loss: 0.0032702302437668 | Epoch: 85 | MeanAbsoluteError: 0.0463594868779182 | Loss: 0.0044245045252242 | Epoch: 86 | 
MeanAbsoluteError: 0.0499199889600277 | Loss: 0.0042035687886375 | Epoch: 87 | MeanAbsoluteError: 0.0877544432878494 | Loss: 0.0095016691637667 | Epoch: 88 | MeanAbsoluteError: 0.0680326968431473 | Loss: 0.0063553116480379 | Epoch: 89 | MeanAbsoluteError: 0.0574696101248264 | Loss: 0.0054286075143242 | Epoch: 90 | MeanAbsoluteError: 0.0559617988765240 | Loss: 0.0060383668169379 | Epoch: 91 | MeanAbsoluteError: 0.0354569964110851 | Loss: 0.0023289478941526 | Epoch: 92 | 
MeanAbsoluteError: 0.0633278563618660 | Loss: 0.0054519355150038 | Epoch: 93 | MeanAbsoluteError: 0.0343352742493153 | Loss: 0.0021643228200877 | Epoch: 94 | MeanAbsoluteError: 0.0583045817911625 | Loss: 0.0050673272436191 | Epoch: 95 | MeanAbsoluteError: 0.0342233069241047 | Loss: 0.0025239704041987 | Epoch: 96 | MeanAbsoluteError: 0.0324185937643051 | Loss: 0.0018319249379841 | Epoch: 97 | MeanAbsoluteError: 0.0388868004083633 | Loss: 0.0028020055033267 | Epoch: 98 | MeanAbsoluteError: 0.0590264834463596 | Loss: 0.0054105004344724 | Epoch: 99 | 
MeanAbsoluteError: 0.0488727502524853 | Loss: 0.0050522936385517 | Epoch: 100 | MeanAbsoluteError: 0.0395724549889565 | Loss: 0.0028538861079141 | Epoch: 101 | MeanAbsoluteError: 0.0539633296430111 | Loss: 0.0049963399375740 | Epoch: 102 | MeanAbsoluteError: 0.0661612898111343 | Loss: 0.0073537388081221 | Epoch: 103 | MeanAbsoluteError: 0.0377688966691494 | Loss: 0.0034127391363175 | Epoch: 104 | MeanAbsoluteError: 0.0406253263354301 | Loss: 0.0030880064188846 | Epoch: 105 | 
MeanAbsoluteError: 0.0519772320985794 | Loss: 0.0045116723784687 | Epoch: 106 | MeanAbsoluteError: 0.0593646317720413 | Loss: 0.0054692994974750 | Epoch: 107 | MeanAbsoluteError: 0.0565544515848160 | Loss: 0.0048185733122457 | Epoch: 108 | MeanAbsoluteError: 0.0330779217183590 | Loss: 0.0024780322901758 | Epoch: 109 | MeanAbsoluteError: 0.0797168910503387 | Loss: 0.0099280166537746 | Epoch: 110 | MeanAbsoluteError: 0.0415970720350742 | Loss: 0.0031937708048836 | Epoch: 111 | MeanAbsoluteError: 0.0399437546730042 | Loss: 0.0026601927207881 | Epoch: 112 | 
MeanAbsoluteError: 0.0321070514619350 | Loss: 0.0023903332093093 | Epoch: 113 | MeanAbsoluteError: 0.0348392240703106 | Loss: 0.0026369688505503 | Epoch: 114 | MeanAbsoluteError: 0.0482833944261074 | Loss: 0.0035892588601105 | Epoch: 115 | MeanAbsoluteError: 0.0337658151984215 | Loss: 0.0023644521287152 | Epoch: 116 | MeanAbsoluteError: 0.0361211858689785 | Loss: 0.0026008575958641 | Epoch: 117 | MeanAbsoluteError: 0.0479185767471790 | Loss: 0.0036706814150277 | Epoch: 118 | MeanAbsoluteError: 0.0308922696858644 | Loss: 0.0020325092911279 | Epoch: 119 | 
MeanAbsoluteError: 0.0357330180704594 | Loss: 0.0025906358634146 | Epoch: 120 | MeanAbsoluteError: 0.0496012829244137 | Loss: 0.0033790164896728 | Epoch: 121 | MeanAbsoluteError: 0.0388898327946663 | Loss: 0.0027859953636500 | Epoch: 122 | MeanAbsoluteError: 0.0522147864103317 | Loss: 0.0045562184072639 | Epoch: 123 | MeanAbsoluteError: 0.0423006042838097 | Loss: 0.0029173759670046 | Epoch: 124 | MeanAbsoluteError: 0.0633006989955902 | Loss: 0.0061865827362788 | Epoch: 125 | 
MeanAbsoluteError: 0.0545157045125961 | Loss: 0.0045204942702855 | Epoch: 126 | MeanAbsoluteError: 0.0527162849903107 | Loss: 0.0040186530861415 | Epoch: 127 | MeanAbsoluteError: 0.0341289006173611 | Loss: 0.0024458148461570 | Epoch: 128 | MeanAbsoluteError: 0.0599071681499481 | Loss: 0.0055913199106918 | Early stopping at epoch 127
Returned to Spot: Validation loss: 0.005591319910691757
spotPython tuning: 0.0016865455361671354 [##--------] 18.79% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.25510864074110584, 'lr_mult': 6.682745556929787, 'batch_size': 16, 'epochs': 512, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.0737933434711498}
Epoch: 1 | MeanAbsoluteError: 0.1411451846361160 | Loss: 0.0329482532841595 | Epoch: 2 | MeanAbsoluteError: 0.1301981657743454 | Loss: 0.0275649635219260 | Epoch: 3 | MeanAbsoluteError: 0.1686934679746628 | Loss: 0.0414238211355711 | Epoch: 4 | MeanAbsoluteError: 0.1127321496605873 | Loss: 0.0206676844605490 | Epoch: 5 | MeanAbsoluteError: 0.1000201106071472 | Loss: 0.0156618065788950 | Epoch: 6 | MeanAbsoluteError: 0.1532903909683228 | Loss: 0.0341786000093347 | Epoch: 7 | 
MeanAbsoluteError: 0.1021260544657707 | Loss: 0.0164125133060703 | Epoch: 8 | MeanAbsoluteError: 0.1037562564015388 | Loss: 0.0170796997600088 | Epoch: 9 | MeanAbsoluteError: 0.0899926871061325 | Loss: 0.0129961904481445 | Epoch: 10 | MeanAbsoluteError: 0.0879220739006996 | Loss: 0.0127490211866404 | Epoch: 11 | MeanAbsoluteError: 0.0836207717657089 | Loss: 0.0112634660970224 | Epoch: 12 | MeanAbsoluteError: 0.0898287743330002 | Loss: 0.0127140685033641 | Epoch: 13 | MeanAbsoluteError: 0.2529143989086151 | Loss: 0.0805570451836837 | Epoch: 14 | 
MeanAbsoluteError: 0.0879751890897751 | Loss: 0.0122884641107368 | Epoch: 15 | MeanAbsoluteError: 0.0883802846074104 | Loss: 0.0120937815916381 | Epoch: 16 | MeanAbsoluteError: 0.0863505452871323 | Loss: 0.0111356058501099 | Epoch: 17 | MeanAbsoluteError: 0.1188684105873108 | Loss: 0.0193066983728817 | Epoch: 18 | MeanAbsoluteError: 0.0919379442930222 | Loss: 0.0124192708416989 | Epoch: 19 | MeanAbsoluteError: 0.1411439180374146 | Loss: 0.0259680619561359 | Epoch: 20 | MeanAbsoluteError: 0.1026713848114014 | Loss: 0.0166507925053960 | Epoch: 21 | 
MeanAbsoluteError: 0.0703604221343994 | Loss: 0.0077717269427682 | Epoch: 22 | MeanAbsoluteError: 0.1078173592686653 | Loss: 0.0154909842010391 | Epoch: 23 | MeanAbsoluteError: 0.0720687210559845 | Loss: 0.0085032128630892 | Epoch: 24 | MeanAbsoluteError: 0.0697471946477890 | Loss: 0.0081570624055243 | Epoch: 25 | MeanAbsoluteError: 0.0705946087837219 | Loss: 0.0085952782782873 | Epoch: 26 | MeanAbsoluteError: 0.1518678367137909 | Loss: 0.0295024505375247 | Epoch: 27 | MeanAbsoluteError: 0.0527811795473099 | Loss: 0.0046927543651117 | Epoch: 28 | 
MeanAbsoluteError: 0.0551533252000809 | Loss: 0.0051696838590464 | Epoch: 29 | MeanAbsoluteError: 0.1320069730281830 | Loss: 0.0226200205813113 | Epoch: 30 | MeanAbsoluteError: 0.0545597448945045 | Loss: 0.0048334990309453 | Epoch: 31 | MeanAbsoluteError: 0.1024013683199883 | Loss: 0.0136948108280960 | Epoch: 32 | MeanAbsoluteError: 0.1106904596090317 | Loss: 0.0158800520002842 | Epoch: 33 | MeanAbsoluteError: 0.1337603181600571 | Loss: 0.0223250721434229 | Epoch: 34 | 
MeanAbsoluteError: 0.0754746794700623 | Loss: 0.0082022045175300 | Epoch: 35 | MeanAbsoluteError: 0.0931829065084457 | Loss: 0.0130392550980966 | Epoch: 36 | MeanAbsoluteError: 0.0562764108181000 | Loss: 0.0050317424619080 | Epoch: 37 | MeanAbsoluteError: 0.0552414506673813 | Loss: 0.0053756044086951 | Epoch: 38 | MeanAbsoluteError: 0.1409416049718857 | Loss: 0.0252038111027918 | Epoch: 39 | MeanAbsoluteError: 0.0954449996352196 | Loss: 0.0119333239762407 | Epoch: 40 | 
MeanAbsoluteError: 0.0514725483953953 | Loss: 0.0045575683103188 | Epoch: 41 | MeanAbsoluteError: 0.0958909392356873 | Loss: 0.0124702872463355 | Epoch: 42 | MeanAbsoluteError: 0.0770309120416641 | Loss: 0.0087097864352951 | Epoch: 43 | MeanAbsoluteError: 0.0765042081475258 | Loss: 0.0101482915005794 | Epoch: 44 | MeanAbsoluteError: 0.0833160877227783 | Loss: 0.0102958265741013 | Epoch: 45 | MeanAbsoluteError: 0.0528903901576996 | Loss: 0.0042680738138427 | Epoch: 46 | 
MeanAbsoluteError: 0.0547968558967113 | Loss: 0.0053453613930431 | Epoch: 47 | MeanAbsoluteError: 0.0741902366280556 | Loss: 0.0073892613872886 | Epoch: 48 | MeanAbsoluteError: 0.0535256564617157 | Loss: 0.0048782779026384 | Epoch: 49 | MeanAbsoluteError: 0.0526989065110683 | Loss: 0.0044621617141131 | Epoch: 50 | MeanAbsoluteError: 0.0616895742714405 | Loss: 0.0059887516238776 | Epoch: 51 | MeanAbsoluteError: 0.0520833581686020 | Loss: 0.0045518596215468 | Epoch: 52 | 
MeanAbsoluteError: 0.0903702154755592 | Loss: 0.0107357079947465 | Epoch: 53 | MeanAbsoluteError: 0.0782530754804611 | Loss: 0.0082242356515244 | Epoch: 54 | MeanAbsoluteError: 0.0468942373991013 | Loss: 0.0042067127314543 | Epoch: 55 | MeanAbsoluteError: 0.0898789018392563 | Loss: 0.0107523226669352 | Epoch: 56 | MeanAbsoluteError: 0.1399024128913879 | Loss: 0.0225276336269943 | Epoch: 57 | MeanAbsoluteError: 0.0503925941884518 | Loss: 0.0045925923561873 | Epoch: 58 | 
MeanAbsoluteError: 0.1171971485018730 | Loss: 0.0174134025644315 | Epoch: 59 | MeanAbsoluteError: 0.0639824271202087 | Loss: 0.0068032881857729 | Epoch: 60 | MeanAbsoluteError: 0.0825405269861221 | Loss: 0.0110480672630825 | Epoch: 61 | MeanAbsoluteError: 0.0666983798146248 | Loss: 0.0060825400348557 | Epoch: 62 | MeanAbsoluteError: 0.0484755225479603 | Loss: 0.0041521097239303 | Epoch: 63 | MeanAbsoluteError: 0.0608979538083076 | Loss: 0.0059298083284184 | Epoch: 64 | 
MeanAbsoluteError: 0.0662580728530884 | Loss: 0.0066928394432915 | Epoch: 65 | MeanAbsoluteError: 0.0652610361576080 | Loss: 0.0067459356015254 | Epoch: 66 | MeanAbsoluteError: 0.0894910991191864 | Loss: 0.0110750209147993 | Epoch: 67 | MeanAbsoluteError: 0.0524198636412621 | Loss: 0.0047757453775327 | Epoch: 68 | MeanAbsoluteError: 0.0576754137873650 | Loss: 0.0056425264889472 | Epoch: 69 | MeanAbsoluteError: 0.0584304444491863 | Loss: 0.0056640702471333 | Epoch: 70 | 
MeanAbsoluteError: 0.1284833252429962 | Loss: 0.0205715942245565 | Epoch: 71 | MeanAbsoluteError: 0.1024889349937439 | Loss: 0.0122400700408769 | Epoch: 72 | MeanAbsoluteError: 0.0857445672154427 | Loss: 0.0108983097352872 | Epoch: 73 | MeanAbsoluteError: 0.0841549634933472 | Loss: 0.0095226800706434 | Epoch: 74 | MeanAbsoluteError: 0.0533630102872849 | Loss: 0.0044629295650674 | Epoch: 75 | MeanAbsoluteError: 0.0714913979172707 | Loss: 0.0070237300456747 | Epoch: 76 | 
MeanAbsoluteError: 0.0715184062719345 | Loss: 0.0067278028122689 | Epoch: 77 | MeanAbsoluteError: 0.1102884560823441 | Loss: 0.0149558259076194 | Epoch: 78 | MeanAbsoluteError: 0.0441016070544720 | Loss: 0.0032488156024269 | Epoch: 79 | MeanAbsoluteError: 0.0971882343292236 | Loss: 0.0121626948545638 | Epoch: 80 | MeanAbsoluteError: 0.0468503907322884 | Loss: 0.0039996565380869 | Epoch: 81 | MeanAbsoluteError: 0.0785930603742599 | Loss: 0.0094328568513064 | Epoch: 82 | 
MeanAbsoluteError: 0.0538606308400631 | Loss: 0.0043563526491389 | Epoch: 83 | MeanAbsoluteError: 0.0990554988384247 | Loss: 0.0132584149802202 | Epoch: 84 | MeanAbsoluteError: 0.0580057129263878 | Loss: 0.0055092051625252 | Epoch: 85 | MeanAbsoluteError: 0.0564382299780846 | Loss: 0.0050563034478967 | Epoch: 86 | MeanAbsoluteError: 0.0387417525053024 | Loss: 0.0028376284508819 | Epoch: 87 | MeanAbsoluteError: 0.0593950077891350 | Loss: 0.0054922234634624 | Epoch: 88 | 
MeanAbsoluteError: 0.0761637017130852 | Loss: 0.0086712877290617 | Epoch: 89 | MeanAbsoluteError: 0.0772276818752289 | Loss: 0.0085821399024050 | Epoch: 90 | MeanAbsoluteError: 0.0913972035050392 | Loss: 0.0101495818480065 | Epoch: 91 | MeanAbsoluteError: 0.0406248085200787 | Loss: 0.0032002333318815 | Epoch: 92 | MeanAbsoluteError: 0.0967370346188545 | Loss: 0.0115715295909659 | Epoch: 93 | MeanAbsoluteError: 0.0424547493457794 | Loss: 0.0031125962574917 | Epoch: 94 | 
MeanAbsoluteError: 0.0777878612279892 | Loss: 0.0084601583351430 | Epoch: 95 | MeanAbsoluteError: 0.0632546395063400 | Loss: 0.0056258926633745 | Epoch: 96 | MeanAbsoluteError: 0.0686591789126396 | Loss: 0.0065108695386076 | Epoch: 97 | MeanAbsoluteError: 0.0441911742091179 | Loss: 0.0038042973212310 | Epoch: 98 | MeanAbsoluteError: 0.0685882717370987 | Loss: 0.0073102913233206 | Epoch: 99 | MeanAbsoluteError: 0.0592508427798748 | Loss: 0.0048387749243136 | Epoch: 100 | 
MeanAbsoluteError: 0.0568911917507648 | Loss: 0.0054090532449711 | Epoch: 101 | MeanAbsoluteError: 0.0718745812773705 | Loss: 0.0075704037996107 | Epoch: 102 | MeanAbsoluteError: 0.0800816714763641 | Loss: 0.0094338507195444 | Epoch: 103 | MeanAbsoluteError: 0.0619429908692837 | Loss: 0.0059410754321633 | Epoch: 104 | MeanAbsoluteError: 0.0568243153393269 | Loss: 0.0054730290890132 | Epoch: 105 | MeanAbsoluteError: 0.0428995303809643 | Loss: 0.0030854248662332 | Epoch: 106 | 
MeanAbsoluteError: 0.0441084317862988 | Loss: 0.0032554059932744 | Epoch: 107 | MeanAbsoluteError: 0.0532350167632103 | Loss: 0.0044108330223121 | Epoch: 108 | MeanAbsoluteError: 0.0739809796214104 | Loss: 0.0078968603752161 | Epoch: 109 | MeanAbsoluteError: 0.0772759020328522 | Loss: 0.0091110019405421 | Epoch: 110 | MeanAbsoluteError: 0.0570787042379379 | Loss: 0.0052170622848759 | Epoch: 111 | MeanAbsoluteError: 0.0845476686954498 | Loss: 0.0090088255605415 | Epoch: 112 | 
MeanAbsoluteError: 0.0880574733018875 | Loss: 0.0096076822496558 | Epoch: 113 | MeanAbsoluteError: 0.0542082153260708 | Loss: 0.0049846280415199 | Epoch: 114 | MeanAbsoluteError: 0.0408620312809944 | Loss: 0.0033501064662184 | Epoch: 115 | MeanAbsoluteError: 0.0480766445398331 | Loss: 0.0042038702859396 | Epoch: 116 | MeanAbsoluteError: 0.0482040159404278 | Loss: 0.0043074043136776 | Epoch: 117 | MeanAbsoluteError: 0.0855235829949379 | Loss: 0.0103288693353534 | Epoch: 118 | 
MeanAbsoluteError: 0.0708552524447441 | Loss: 0.0074186609861882 | Early stopping at epoch 117
Returned to Spot: Validation loss: 0.007418660986188211
spotPython tuning: 0.0016865455361671354 [###-------] 27.21% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.18210053285731978, 'lr_mult': 4.145645903441473, 'batch_size': 16, 'epochs': 4096, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07389588052209951}
Epoch: 1 | MeanAbsoluteError: 0.1510715037584305 | Loss: 0.0348600451099245 | Epoch: 2 | MeanAbsoluteError: 0.1677903831005096 | Loss: 0.0402877731738906 | Epoch: 3 | MeanAbsoluteError: 0.1649329215288162 | Loss: 0.0411432138399074 | Epoch: 4 | MeanAbsoluteError: 0.1227035000920296 | Loss: 0.0226395169371053 | Epoch: 5 | MeanAbsoluteError: 0.1237877905368805 | Loss: 0.0225847010059576 | Epoch: 6 | 
MeanAbsoluteError: 0.1228028833866119 | Loss: 0.0230636332478178 | Epoch: 7 | MeanAbsoluteError: 0.1011502668261528 | Loss: 0.0170266857664836 | Epoch: 8 | MeanAbsoluteError: 0.1126715093851089 | Loss: 0.0185367420903946 | Epoch: 9 | MeanAbsoluteError: 0.1053979545831680 | Loss: 0.0164926255023793 | Epoch: 10 | MeanAbsoluteError: 0.0881671905517578 | Loss: 0.0122470555238818 | Epoch: 11 | MeanAbsoluteError: 0.1026106104254723 | Loss: 0.0157625036510198 | Epoch: 12 | 
MeanAbsoluteError: 0.0949876680970192 | Loss: 0.0133393215456683 | Epoch: 13 | MeanAbsoluteError: 0.1006518676877022 | Loss: 0.0147040106454178 | Epoch: 14 | MeanAbsoluteError: 0.0868162065744400 | Loss: 0.0129225310673447 | Epoch: 15 | MeanAbsoluteError: 0.1102227643132210 | Loss: 0.0174189978524258 | Epoch: 16 | MeanAbsoluteError: 0.0993279218673706 | Loss: 0.0138373526891595 | Epoch: 17 | MeanAbsoluteError: 0.0985213071107864 | Loss: 0.0141461504329192 | Epoch: 18 | 
MeanAbsoluteError: 0.1038579493761063 | Loss: 0.0153038649280605 | Epoch: 19 | MeanAbsoluteError: 0.0738792493939400 | Loss: 0.0090230030840949 | Epoch: 20 | MeanAbsoluteError: 0.0835223272442818 | Loss: 0.0109227882747195 | Epoch: 21 | MeanAbsoluteError: 0.0700853243470192 | Loss: 0.0084208809942203 | Epoch: 22 | MeanAbsoluteError: 0.1197453960776329 | Loss: 0.0184383869269177 | Epoch: 23 | MeanAbsoluteError: 0.0684595555067062 | Loss: 0.0072747760109211 | Epoch: 24 | 
MeanAbsoluteError: 0.0593805685639381 | Loss: 0.0057427459764049 | Epoch: 25 | MeanAbsoluteError: 0.0721145123243332 | Loss: 0.0079667599822738 | Epoch: 26 | MeanAbsoluteError: 0.1053508594632149 | Loss: 0.0154605424521785 | Epoch: 27 | MeanAbsoluteError: 0.0578169748187065 | Loss: 0.0055258690109967 | Epoch: 28 | MeanAbsoluteError: 0.0556134842336178 | Loss: 0.0052058747356856 | Epoch: 29 | MeanAbsoluteError: 0.0625869110226631 | Loss: 0.0068291512587549 | Epoch: 30 | 
MeanAbsoluteError: 0.0554748661816120 | Loss: 0.0053333045522633 | Epoch: 31 | MeanAbsoluteError: 0.0528598278760910 | Loss: 0.0049620144265263 | Epoch: 32 | MeanAbsoluteError: 0.0582905374467373 | Loss: 0.0053232845262085 | Epoch: 33 | MeanAbsoluteError: 0.0443428382277489 | Loss: 0.0034380854891711 | Epoch: 34 | MeanAbsoluteError: 0.0675997361540794 | Loss: 0.0064084766261084 | Epoch: 35 | MeanAbsoluteError: 0.0813370421528816 | Loss: 0.0105080436670074 | Epoch: 36 | 
MeanAbsoluteError: 0.0535647906363010 | Loss: 0.0046465418816201 | Epoch: 37 | MeanAbsoluteError: 0.0836703032255173 | Loss: 0.0101584730865924 | Epoch: 38 | MeanAbsoluteError: 0.1146064475178719 | Loss: 0.0173246430625257 | Epoch: 39 | MeanAbsoluteError: 0.0476101562380791 | Loss: 0.0042397529560778 | Epoch: 40 | MeanAbsoluteError: 0.0473390370607376 | Loss: 0.0037047677477332 | Epoch: 41 | MeanAbsoluteError: 0.0441756211221218 | Loss: 0.0039710398383537 | Epoch: 42 | 
MeanAbsoluteError: 0.0809314846992493 | Loss: 0.0092284079935206 | Epoch: 43 | MeanAbsoluteError: 0.0889466628432274 | Loss: 0.0104182550536567 | Epoch: 44 | MeanAbsoluteError: 0.0466123819351196 | Loss: 0.0041841014570213 | Epoch: 45 | MeanAbsoluteError: 0.1251759380102158 | Loss: 0.0189066705735106 | Epoch: 46 | MeanAbsoluteError: 0.0441707447171211 | Loss: 0.0033637277757455 | Epoch: 47 | MeanAbsoluteError: 0.0481294207274914 | Loss: 0.0037117171481154 | Epoch: 48 | 
MeanAbsoluteError: 0.0463805235922337 | Loss: 0.0037776903482154 | Epoch: 49 | MeanAbsoluteError: 0.1094159409403801 | Loss: 0.0143276859859103 | Epoch: 50 | MeanAbsoluteError: 0.0437755808234215 | Loss: 0.0033916201332192 | Epoch: 51 | MeanAbsoluteError: 0.0420886985957623 | Loss: 0.0033417411981837 | Epoch: 52 | MeanAbsoluteError: 0.0663302689790726 | Loss: 0.0061594995326902 | Epoch: 53 | MeanAbsoluteError: 0.0935564935207367 | Loss: 0.0111547258780583 | Epoch: 54 | 
MeanAbsoluteError: 0.1056240573525429 | Loss: 0.0132143862153354 | Epoch: 55 | MeanAbsoluteError: 0.0467321686446667 | Loss: 0.0035520005775125 | Epoch: 56 | MeanAbsoluteError: 0.0464514419436455 | Loss: 0.0036388483805288 | Epoch: 57 | MeanAbsoluteError: 0.0444678105413914 | Loss: 0.0035916111052134 | Epoch: 58 | MeanAbsoluteError: 0.0423909649252892 | Loss: 0.0036235663941816 | Epoch: 59 | MeanAbsoluteError: 0.0456958375871181 | Loss: 0.0034156885721084 | Epoch: 60 | 
MeanAbsoluteError: 0.0419648997485638 | Loss: 0.0033961875290659 | Epoch: 61 | MeanAbsoluteError: 0.0814950838685036 | Loss: 0.0090624820931177 | Epoch: 62 | MeanAbsoluteError: 0.0379744768142700 | Loss: 0.0031438570555398 | Epoch: 63 | MeanAbsoluteError: 0.0512192770838737 | Loss: 0.0047978065528074 | Epoch: 64 | MeanAbsoluteError: 0.0365622229874134 | Loss: 0.0026761091890206 | Epoch: 65 | MeanAbsoluteError: 0.0822122022509575 | Loss: 0.0087449053351424 | Epoch: 66 | 
MeanAbsoluteError: 0.0358048081398010 | Loss: 0.0020942501723766 | Epoch: 67 | MeanAbsoluteError: 0.0472905598580837 | Loss: 0.0036121838860900 | Epoch: 68 | MeanAbsoluteError: 0.0404467023909092 | Loss: 0.0031013682815491 | Epoch: 69 | MeanAbsoluteError: 0.0761424750089645 | Loss: 0.0079381991864035 | Epoch: 70 | MeanAbsoluteError: 0.0635052025318146 | Loss: 0.0056275470108774 | Epoch: 71 | MeanAbsoluteError: 0.0873593911528587 | Loss: 0.0098655101549076 | Epoch: 72 | 
MeanAbsoluteError: 0.0528490282595158 | Loss: 0.0043591684416721 | Epoch: 73 | MeanAbsoluteError: 0.0475092418491840 | Loss: 0.0034328331178250 | Epoch: 74 | MeanAbsoluteError: 0.0421996675431728 | Loss: 0.0029436163971887 | Epoch: 75 | MeanAbsoluteError: 0.0508451126515865 | Loss: 0.0042869513180401 | Epoch: 76 | MeanAbsoluteError: 0.0698316991329193 | Loss: 0.0080046646640097 | Epoch: 77 | MeanAbsoluteError: 0.0633583515882492 | Loss: 0.0062113911967332 | Epoch: 78 | 
MeanAbsoluteError: 0.0367655195295811 | Loss: 0.0024710077865932 | Epoch: 79 | MeanAbsoluteError: 0.0352463312447071 | Loss: 0.0025052661995256 | Epoch: 80 | MeanAbsoluteError: 0.0402095206081867 | Loss: 0.0029730100527798 | Epoch: 81 | MeanAbsoluteError: 0.0682507902383804 | Loss: 0.0059525306875768 | Epoch: 82 | MeanAbsoluteError: 0.0637520104646683 | Loss: 0.0058518801448180 | Epoch: 83 | MeanAbsoluteError: 0.0347662940621376 | Loss: 0.0024452330850947 | Epoch: 84 | 
MeanAbsoluteError: 0.0442682057619095 | Loss: 0.0036167056716390 | Epoch: 85 | MeanAbsoluteError: 0.0566255897283554 | Loss: 0.0046928002204942 | Epoch: 86 | MeanAbsoluteError: 0.0391930006444454 | Loss: 0.0022738382624658 | Epoch: 87 | MeanAbsoluteError: 0.0575834326446056 | Loss: 0.0053594850346838 | Epoch: 88 | MeanAbsoluteError: 0.0324719175696373 | Loss: 0.0020072248375264 | Epoch: 89 | MeanAbsoluteError: 0.0678680315613747 | Loss: 0.0059136913010949 | Epoch: 90 | 
MeanAbsoluteError: 0.0513483658432961 | Loss: 0.0044952854269037 | Epoch: 91 | MeanAbsoluteError: 0.0860264077782631 | Loss: 0.0091906950416926 | Epoch: 92 | MeanAbsoluteError: 0.0476998686790466 | Loss: 0.0039243623859396 | Epoch: 93 | MeanAbsoluteError: 0.0330855809152126 | Loss: 0.0018128274149556 | Epoch: 94 | MeanAbsoluteError: 0.0415225289762020 | Loss: 0.0036544070952866 | Epoch: 95 | MeanAbsoluteError: 0.0606722310185432 | Loss: 0.0059158924942542 | Epoch: 96 | 
MeanAbsoluteError: 0.0428741872310638 | Loss: 0.0034495269279241 | Epoch: 97 | MeanAbsoluteError: 0.0499206185340881 | Loss: 0.0034599816549177 | Epoch: 98 | MeanAbsoluteError: 0.0514412671327591 | Loss: 0.0046133454276347 | Epoch: 99 | MeanAbsoluteError: 0.0350880436599255 | Loss: 0.0022591002175192 | Epoch: 100 | MeanAbsoluteError: 0.0610078573226929 | Loss: 0.0048582576288793 | Epoch: 101 | MeanAbsoluteError: 0.0416010208427906 | Loss: 0.0025462933178795 | Epoch: 102 | 
MeanAbsoluteError: 0.0419684201478958 | Loss: 0.0032739848339636 | Epoch: 103 | MeanAbsoluteError: 0.1057098805904388 | Loss: 0.0137534981201354 | Epoch: 104 | MeanAbsoluteError: 0.0445479117333889 | Loss: 0.0032335897527733 | Epoch: 105 | MeanAbsoluteError: 0.0564788803458214 | Loss: 0.0046333655788514 | Epoch: 106 | MeanAbsoluteError: 0.0770518332719803 | Loss: 0.0089575763987867 | Epoch: 107 | MeanAbsoluteError: 0.0480571985244751 | Loss: 0.0037892409355233 | Epoch: 108 | 
MeanAbsoluteError: 0.0389656983315945 | Loss: 0.0024939042755010 | Epoch: 109 | MeanAbsoluteError: 0.0325474366545677 | Loss: 0.0022453106633437 | Epoch: 110 | MeanAbsoluteError: 0.0303068645298481 | Loss: 0.0020240312809811 | Epoch: 111 | MeanAbsoluteError: 0.0345090217888355 | Loss: 0.0021130870384360 | Epoch: 112 | MeanAbsoluteError: 0.0649151355028152 | Loss: 0.0057745679330669 | Epoch: 113 | MeanAbsoluteError: 0.0308011379092932 | Loss: 0.0019766327888264 | Epoch: 114 | 
MeanAbsoluteError: 0.0424479246139526 | Loss: 0.0034096448094045 | Epoch: 115 | MeanAbsoluteError: 0.1083185672760010 | Loss: 0.0138444200550255 | Epoch: 116 | MeanAbsoluteError: 0.0519213303923607 | Loss: 0.0036953989734971 | Epoch: 117 | MeanAbsoluteError: 0.0319641232490540 | Loss: 0.0019922055561390 | Epoch: 118 | MeanAbsoluteError: 0.0472927801311016 | Loss: 0.0036114323761706 | Epoch: 119 | MeanAbsoluteError: 0.0632354989647865 | Loss: 0.0057123310275768 | Epoch: 120 | 
MeanAbsoluteError: 0.0544564165174961 | Loss: 0.0046442420540476 | Epoch: 121 | MeanAbsoluteError: 0.0479065962135792 | Loss: 0.0042961893823782 | Epoch: 122 | MeanAbsoluteError: 0.0427553355693817 | Loss: 0.0026994696144309 | Epoch: 123 | MeanAbsoluteError: 0.0413568541407585 | Loss: 0.0031074657362249 | Epoch: 124 | MeanAbsoluteError: 0.0393105112016201 | Loss: 0.0025557625524111 | Epoch: 125 | MeanAbsoluteError: 0.0311317760497332 | Loss: 0.0020169751859564 | Early stopping at epoch 124
Returned to Spot: Validation loss: 0.0020169751859564137
spotPython tuning: 0.0016865455361671354 [####------] 36.77% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.1655924245415988, 'lr_mult': 4.186124343189683, 'batch_size': 8, 'epochs': 4096, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07400725452261472}
Epoch: 1 | MeanAbsoluteError: 0.1433156728744507 | Loss: 0.0317698864168242 | Epoch: 2 | MeanAbsoluteError: 0.1077210754156113 | Loss: 0.0199597315789249 | Epoch: 3 | MeanAbsoluteError: 0.1358648240566254 | Loss: 0.0286035667982345 | Epoch: 4 | 
MeanAbsoluteError: 0.0936248227953911 | Loss: 0.0137669800897129 | Epoch: 5 | MeanAbsoluteError: 0.2011478245258331 | Loss: 0.0528701998195366 | Epoch: 6 | MeanAbsoluteError: 0.1253282278776169 | Loss: 0.0233725803340540 | Epoch: 7 | MeanAbsoluteError: 0.1103350445628166 | Loss: 0.0185727979497690 | Epoch: 8 | 
MeanAbsoluteError: 0.1494184434413910 | Loss: 0.0303587605441479 | Epoch: 9 | MeanAbsoluteError: 0.1199197545647621 | Loss: 0.0211458043195307 | Epoch: 10 | MeanAbsoluteError: 0.0853046551346779 | Loss: 0.0112305307258411 | Epoch: 11 | 
MeanAbsoluteError: 0.0867602825164795 | Loss: 0.0117865284770041 | Epoch: 12 | MeanAbsoluteError: 0.1464235931634903 | Loss: 0.0270001979201640 | Epoch: 13 | MeanAbsoluteError: 0.0632371902465820 | Loss: 0.0068117594468947 | Epoch: 14 | MeanAbsoluteError: 0.0591665394604206 | Loss: 0.0059866935909285 | Epoch: 15 | 
MeanAbsoluteError: 0.1551410853862762 | Loss: 0.0285145454108715 | Epoch: 16 | MeanAbsoluteError: 0.0796796903014183 | Loss: 0.0092711056227257 | Epoch: 17 | MeanAbsoluteError: 0.1647668182849884 | Loss: 0.0318275019526482 | Epoch: 18 | MeanAbsoluteError: 0.1273580789566040 | Loss: 0.0192090110902331 | Epoch: 19 | 
MeanAbsoluteError: 0.1583123207092285 | Loss: 0.0287323988189823 | Epoch: 20 | MeanAbsoluteError: 0.0889066904783249 | Loss: 0.0101355453462977 | Epoch: 21 | MeanAbsoluteError: 0.0402554906904697 | Loss: 0.0028584898575087 | Epoch: 22 | MeanAbsoluteError: 0.0548315383493900 | Loss: 0.0054480082900754 | Epoch: 23 | 
MeanAbsoluteError: 0.1301368325948715 | Loss: 0.0200042311151169 | Epoch: 24 | MeanAbsoluteError: 0.0638134703040123 | Loss: 0.0060557747247482 | Epoch: 25 | MeanAbsoluteError: 0.0492803230881691 | Loss: 0.0045492584697633 | Epoch: 26 | MeanAbsoluteError: 0.0757982134819031 | Loss: 0.0084610304513358 | Epoch: 27 | 
MeanAbsoluteError: 0.0568373873829842 | Loss: 0.0058499354329941 | Epoch: 28 | MeanAbsoluteError: 0.0509321652352810 | Loss: 0.0039346609708829 | Epoch: 29 | MeanAbsoluteError: 0.0939457044005394 | Loss: 0.0114728698666257 | Epoch: 30 | MeanAbsoluteError: 0.0918205603957176 | Loss: 0.0108464024348282 | Epoch: 31 | 
MeanAbsoluteError: 0.0348728448152542 | Loss: 0.0023071200565410 | Epoch: 32 | MeanAbsoluteError: 0.0892713665962219 | Loss: 0.0098597169179763 | Epoch: 33 | MeanAbsoluteError: 0.0982627198100090 | Loss: 0.0121003363808421 | Epoch: 34 | MeanAbsoluteError: 0.0749465152621269 | Loss: 0.0081167979913421 | Epoch: 35 | 
MeanAbsoluteError: 0.0544821433722973 | Loss: 0.0048271324378316 | Epoch: 36 | MeanAbsoluteError: 0.0469895265996456 | Loss: 0.0043270995504970 | Epoch: 37 | MeanAbsoluteError: 0.0580547600984573 | Loss: 0.0049637836912696 | Epoch: 38 | MeanAbsoluteError: 0.0492579899728298 | Loss: 0.0042126491990578 | Epoch: 39 | 
MeanAbsoluteError: 0.0465013608336449 | Loss: 0.0040810151718018 | Epoch: 40 | MeanAbsoluteError: 0.0379331782460213 | Loss: 0.0027486923193608 | Epoch: 41 | MeanAbsoluteError: 0.0435043498873711 | Loss: 0.0032878087766125 | Epoch: 42 | 
MeanAbsoluteError: 0.0777021050453186 | Loss: 0.0078760499845406 | Epoch: 43 | MeanAbsoluteError: 0.0473294816911221 | Loss: 0.0036540160163943 | Epoch: 44 | MeanAbsoluteError: 0.0589992664754391 | Loss: 0.0051829171072888 | Epoch: 45 | 
MeanAbsoluteError: 0.0707777962088585 | Loss: 0.0074570441165155 | Epoch: 46 | MeanAbsoluteError: 0.0432029701769352 | Loss: 0.0034410358042040 | Epoch: 47 | MeanAbsoluteError: 0.0445966459810734 | Loss: 0.0035259091160505 | Epoch: 48 | MeanAbsoluteError: 0.1084797680377960 | Loss: 0.0140293672386753 | Epoch: 49 | 
MeanAbsoluteError: 0.0549661256372929 | Loss: 0.0041594281853912 | Epoch: 50 | MeanAbsoluteError: 0.0747778043150902 | Loss: 0.0074303244841040 | Epoch: 51 | MeanAbsoluteError: 0.0945710018277168 | Loss: 0.0105414620085963 | Epoch: 52 | 
MeanAbsoluteError: 0.0762613490223885 | Loss: 0.0078675688342436 | Epoch: 53 | MeanAbsoluteError: 0.0493956133723259 | Loss: 0.0043000129226130 | Epoch: 54 | MeanAbsoluteError: 0.0555500164628029 | Loss: 0.0043365547776614 | Epoch: 55 | MeanAbsoluteError: 0.0598309263586998 | Loss: 0.0052468307365320 | Epoch: 56 | 
MeanAbsoluteError: 0.0329393930733204 | Loss: 0.0020734917090618 | Epoch: 57 | MeanAbsoluteError: 0.0404770001769066 | Loss: 0.0031077778824654 | Epoch: 58 | MeanAbsoluteError: 0.0555892698466778 | Loss: 0.0045445883297361 | Epoch: 59 | 
MeanAbsoluteError: 0.0468966774642467 | Loss: 0.0033414713980164 | Epoch: 60 | MeanAbsoluteError: 0.0563718341290951 | Loss: 0.0051860077747781 | Epoch: 61 | MeanAbsoluteError: 0.0424660667777061 | Loss: 0.0030413540692902 | Epoch: 62 | MeanAbsoluteError: 0.1158791109919548 | Loss: 0.0152969174822302 | Epoch: 63 | 
MeanAbsoluteError: 0.0663797110319138 | Loss: 0.0058999160384318 | Epoch: 64 | MeanAbsoluteError: 0.0392418503761292 | Loss: 0.0024691784867747 | Epoch: 65 | MeanAbsoluteError: 0.0544494502246380 | Loss: 0.0041672889140165 | Epoch: 66 | MeanAbsoluteError: 0.0401127897202969 | Loss: 0.0033251352096589 | Epoch: 67 | 
MeanAbsoluteError: 0.0417618378996849 | Loss: 0.0032784872830809 | Epoch: 68 | MeanAbsoluteError: 0.0399833060801029 | Loss: 0.0024777196399794 | Epoch: 69 | MeanAbsoluteError: 0.0496730692684650 | Loss: 0.0044523973269143 | Epoch: 70 | MeanAbsoluteError: 0.0393033884465694 | Loss: 0.0031038368898934 | Epoch: 71 | 
MeanAbsoluteError: 0.0409729778766632 | Loss: 0.0026980710221994 | Epoch: 72 | MeanAbsoluteError: 0.0515343993902206 | Loss: 0.0040403044534430 | Epoch: 73 | MeanAbsoluteError: 0.0723844394087791 | Loss: 0.0065969499685851 | Epoch: 74 | 
MeanAbsoluteError: 0.0442191176116467 | Loss: 0.0039995709161495 | Epoch: 75 | MeanAbsoluteError: 0.0310031156986952 | Loss: 0.0023022315412833 | Epoch: 76 | MeanAbsoluteError: 0.0406266339123249 | Loss: 0.0028260915561604 | Epoch: 77 | MeanAbsoluteError: 0.0432776920497417 | Loss: 0.0032250563457829 | Epoch: 78 | 
MeanAbsoluteError: 0.0298453234136105 | Loss: 0.0018974501788187 | Epoch: 79 | MeanAbsoluteError: 0.0314425006508827 | Loss: 0.0020496374276454 | Epoch: 80 | MeanAbsoluteError: 0.0335666313767433 | Loss: 0.0023995053795117 | Epoch: 81 | MeanAbsoluteError: 0.0344706960022449 | Loss: 0.0021623216376419 | Epoch: 82 | 
MeanAbsoluteError: 0.0415444262325764 | Loss: 0.0030644259547300 | Epoch: 83 | MeanAbsoluteError: 0.0692752450704575 | Loss: 0.0062767654767652 | Epoch: 84 | MeanAbsoluteError: 0.0311493333429098 | Loss: 0.0017555375601851 | Epoch: 85 | 
MeanAbsoluteError: 0.0355323888361454 | Loss: 0.0021747921235051 | Epoch: 86 | MeanAbsoluteError: 0.0422970950603485 | Loss: 0.0033907214835237 | Epoch: 87 | MeanAbsoluteError: 0.0385040752589703 | Loss: 0.0028096964984127 | Epoch: 88 | MeanAbsoluteError: 0.0273792371153831 | Loss: 0.0015120058861181 | Epoch: 89 | 
MeanAbsoluteError: 0.0287412777543068 | Loss: 0.0015610137591131 | Epoch: 90 | MeanAbsoluteError: 0.0659797191619873 | Loss: 0.0054557203915656 | Epoch: 91 | MeanAbsoluteError: 0.0503903962671757 | Loss: 0.0039288383130425 | Epoch: 92 | MeanAbsoluteError: 0.0581425800919533 | Loss: 0.0043326037212912 | Epoch: 93 | 
MeanAbsoluteError: 0.0596519671380520 | Loss: 0.0047509503661116 | Epoch: 94 | MeanAbsoluteError: 0.0790813490748405 | Loss: 0.0079904495321802 | Epoch: 95 | MeanAbsoluteError: 0.0281944368034601 | Loss: 0.0019260513447654 | Epoch: 96 | MeanAbsoluteError: 0.0574879199266434 | Loss: 0.0044915959955879 | Epoch: 97 | 
MeanAbsoluteError: 0.0494038276374340 | Loss: 0.0036898090145673 | Epoch: 98 | MeanAbsoluteError: 0.0390399396419525 | Loss: 0.0024527001369279 | Epoch: 99 | MeanAbsoluteError: 0.0381138995289803 | Loss: 0.0027087510159043 | Epoch: 100 | 
MeanAbsoluteError: 0.0349858999252319 | Loss: 0.0026118503125250 | Epoch: 101 | MeanAbsoluteError: 0.0267128460109234 | Loss: 0.0014775866446526 | Epoch: 102 | MeanAbsoluteError: 0.0758635997772217 | Loss: 0.0069290173950752 | Epoch: 103 | 
MeanAbsoluteError: 0.0866968184709549 | Loss: 0.0090268361872356 | Epoch: 104 | MeanAbsoluteError: 0.0525853559374809 | Loss: 0.0038558984310121 | Epoch: 105 | MeanAbsoluteError: 0.0395242646336555 | Loss: 0.0024938020092362 | Epoch: 106 | MeanAbsoluteError: 0.0361433550715446 | Loss: 0.0020884014600980 | Epoch: 107 | 
MeanAbsoluteError: 0.0371121279895306 | Loss: 0.0023102222522108 | Epoch: 108 | MeanAbsoluteError: 0.0432554148137569 | Loss: 0.0027490350399411 | Epoch: 109 | MeanAbsoluteError: 0.0958300530910492 | Loss: 0.0103212850977127 | Epoch: 110 | 
MeanAbsoluteError: 0.0346485376358032 | Loss: 0.0019383802244097 | Epoch: 111 | MeanAbsoluteError: 0.0483232475817204 | Loss: 0.0031274103614698 | Epoch: 112 | MeanAbsoluteError: 0.0380366258323193 | Loss: 0.0022880063701642 | Epoch: 113 | MeanAbsoluteError: 0.0361789427697659 | Loss: 0.0022067215759307 | Epoch: 114 | 
MeanAbsoluteError: 0.0422288700938225 | Loss: 0.0028567414648071 | Epoch: 115 | MeanAbsoluteError: 0.0332167409360409 | Loss: 0.0021350907581540 | Epoch: 116 | MeanAbsoluteError: 0.0461190082132816 | Loss: 0.0036727716628536 | Epoch: 117 | 
MeanAbsoluteError: 0.0297139585018158 | Loss: 0.0017428383396595 | Epoch: 118 | MeanAbsoluteError: 0.0319145731627941 | Loss: 0.0018224509013204 | Epoch: 119 | MeanAbsoluteError: 0.0523652657866478 | Loss: 0.0035953894104367 | Epoch: 120 | MeanAbsoluteError: 0.0308775193989277 | Loss: 0.0019727989577069 | Epoch: 121 | 
MeanAbsoluteError: 0.0380588546395302 | Loss: 0.0025029510740607 | Epoch: 122 | MeanAbsoluteError: 0.0521793328225613 | Loss: 0.0038856518696871 | Epoch: 123 | MeanAbsoluteError: 0.0521558262407780 | Loss: 0.0047132230400549 | Epoch: 124 | MeanAbsoluteError: 0.0342336818575859 | Loss: 0.0017670369538552 | Epoch: 125 | 
MeanAbsoluteError: 0.0514237023890018 | Loss: 0.0038471080387305 | Epoch: 126 | MeanAbsoluteError: 0.0337896011769772 | Loss: 0.0024018972203760 | Epoch: 127 | MeanAbsoluteError: 0.0575005859136581 | Loss: 0.0043675560400037 | Epoch: 128 | MeanAbsoluteError: 0.0307668652385473 | Loss: 0.0017569017662409 | Epoch: 129 | 
MeanAbsoluteError: 0.0546893440186977 | Loss: 0.0044947090056284 | Epoch: 130 | MeanAbsoluteError: 0.0545606799423695 | Loss: 0.0038167422202318 | Epoch: 131 | MeanAbsoluteError: 0.0481868050992489 | Loss: 0.0038378140490845 | Epoch: 132 | MeanAbsoluteError: 0.0511673726141453 | Loss: 0.0035002874792553 | Epoch: 133 | 
MeanAbsoluteError: 0.0263822227716446 | Loss: 0.0014845179156462 | Early stopping at epoch 132
Returned to Spot: Validation loss: 0.0014845179156461534
spotPython tuning: 0.0014845179156461534 [#####-----] 54.24% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3840969125323748, 'lr_mult': 5.222659248964803, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 64, 'optimizer': 'ASGD', 'sgd_momentum': 0.8945915552616069}
Epoch: 1 | MeanAbsoluteError: 0.1484626531600952 | Loss: 0.0347542677956976 | Epoch: 2 | 
MeanAbsoluteError: 0.1376029700040817 | Loss: 0.0296495529872022 | Epoch: 3 | MeanAbsoluteError: 0.1371929943561554 | Loss: 0.0296445256711817 | Epoch: 4 | 
MeanAbsoluteError: 0.1359080821275711 | Loss: 0.0294256364485543 | Epoch: 5 | MeanAbsoluteError: 0.1360796540975571 | Loss: 0.0287509211461599 | Epoch: 6 | 
MeanAbsoluteError: 0.1318965852260590 | Loss: 0.0281507429470749 | Epoch: 7 | MeanAbsoluteError: 0.1323259621858597 | Loss: 0.0287798682570850 | Epoch: 8 | 
MeanAbsoluteError: 0.1320481449365616 | Loss: 0.0284630910150315 | Epoch: 9 | MeanAbsoluteError: 0.1261648088693619 | Loss: 0.0265650699638124 | Epoch: 10 | 
MeanAbsoluteError: 0.1331644356250763 | Loss: 0.0284663193344482 | Epoch: 11 | MeanAbsoluteError: 0.1310403645038605 | Loss: 0.0281333864580742 | Epoch: 12 | 
MeanAbsoluteError: 0.1328123658895493 | Loss: 0.0286446425107945 | Epoch: 13 | MeanAbsoluteError: 0.1256147027015686 | Loss: 0.0261497390579040 | Epoch: 14 | 
MeanAbsoluteError: 0.1266266107559204 | Loss: 0.0262581179482176 | Epoch: 15 | MeanAbsoluteError: 0.1287048906087875 | Loss: 0.0263573711272329 | Epoch: 16 | 
MeanAbsoluteError: 0.1278899908065796 | Loss: 0.0271047620151780 | Epoch: 17 | MeanAbsoluteError: 0.1279558241367340 | Loss: 0.0270365220249483 | Epoch: 18 | 
MeanAbsoluteError: 0.1264368742704391 | Loss: 0.0259645239719631 | Epoch: 19 | MeanAbsoluteError: 0.1265907734632492 | Loss: 0.0249606126453727 | Epoch: 20 | 
MeanAbsoluteError: 0.1276822090148926 | Loss: 0.0258632998018967 | Epoch: 21 | 
MeanAbsoluteError: 0.1213972866535187 | Loss: 0.0239642008673400 | Epoch: 22 | MeanAbsoluteError: 0.1253378093242645 | Loss: 0.0249380984123012 | Epoch: 23 | MeanAbsoluteError: 0.1249600872397423 | Loss: 0.0241136999163581 | Epoch: 24 | 
MeanAbsoluteError: 0.1243551746010780 | Loss: 0.0252211378323600 | Epoch: 25 | 
MeanAbsoluteError: 0.1208659112453461 | Loss: 0.0234011679054483 | Epoch: 26 | MeanAbsoluteError: 0.1205481588840485 | Loss: 0.0245629931726542 | Epoch: 27 | MeanAbsoluteError: 0.1259896308183670 | Loss: 0.0249244584456870 | Epoch: 28 | 
MeanAbsoluteError: 0.1214140951633453 | Loss: 0.0248758095243063 | Epoch: 29 | 
MeanAbsoluteError: 0.1196177527308464 | Loss: 0.0233122700469961 | Epoch: 30 | MeanAbsoluteError: 0.1156355887651443 | Loss: 0.0233179663038371 | Epoch: 31 | MeanAbsoluteError: 0.1196913495659828 | Loss: 0.0227068110589722 | Epoch: 32 | 
MeanAbsoluteError: 0.1186462789773941 | Loss: 0.0231075846884204 | Epoch: 33 | 
MeanAbsoluteError: 0.1126268878579140 | Loss: 0.0219727296896867 | Epoch: 34 | MeanAbsoluteError: 0.1162924692034721 | Loss: 0.0217907584983071 | Epoch: 35 | MeanAbsoluteError: 0.1209706589579582 | Loss: 0.0230527088952888 | Epoch: 36 | 
MeanAbsoluteError: 0.1136435940861702 | Loss: 0.0200268344304181 | Epoch: 37 | 
MeanAbsoluteError: 0.1120243966579437 | Loss: 0.0205758406143439 | Epoch: 38 | MeanAbsoluteError: 0.1070275977253914 | Loss: 0.0191006068336336 | Epoch: 39 | MeanAbsoluteError: 0.1170909404754639 | Loss: 0.0223734691114116 | Epoch: 40 | 
MeanAbsoluteError: 0.1075686365365982 | Loss: 0.0198765659925381 | Epoch: 41 | 
MeanAbsoluteError: 0.1087775900959969 | Loss: 0.0194169298598641 | Epoch: 42 | MeanAbsoluteError: 0.1103932932019234 | Loss: 0.0200265646654818 | Epoch: 43 | MeanAbsoluteError: 0.1097161620855331 | Loss: 0.0205630945213335 | Epoch: 44 | 
MeanAbsoluteError: 0.1068583279848099 | Loss: 0.0180320290076595 | Epoch: 45 | 
MeanAbsoluteError: 0.1084680706262589 | Loss: 0.0202545437005986 | Epoch: 46 | MeanAbsoluteError: 0.1014720201492310 | Loss: 0.0174357497966603 | Epoch: 47 | MeanAbsoluteError: 0.1036062017083168 | Loss: 0.0174685240429091 | Epoch: 48 | 
MeanAbsoluteError: 0.1052749082446098 | Loss: 0.0182511263196111 | Epoch: 49 | 
MeanAbsoluteError: 0.0966863408684731 | Loss: 0.0153703196709485 | Epoch: 50 | MeanAbsoluteError: 0.1040564924478531 | Loss: 0.0176442014849990 | Epoch: 51 | 
MeanAbsoluteError: 0.1022606566548347 | Loss: 0.0163276261331415 | Epoch: 52 | MeanAbsoluteError: 0.0925017371773720 | Loss: 0.0144119317226700 | 
Epoch: 53 | MeanAbsoluteError: 0.0945189893245697 | Loss: 0.0151630184845999 | Epoch: 54 | MeanAbsoluteError: 0.0995326265692711 | Loss: 0.0157204835038436 | Epoch: 55 | 
MeanAbsoluteError: 0.0916156619787216 | Loss: 0.0142426734152985 | Epoch: 56 | 
MeanAbsoluteError: 0.0947979390621185 | Loss: 0.0148047510546779 | Epoch: 57 | MeanAbsoluteError: 0.0959380790591240 | Loss: 0.0157815617215084 | Epoch: 58 | MeanAbsoluteError: 0.0888242945075035 | Loss: 0.0128873252481418 | Epoch: 59 | 
MeanAbsoluteError: 0.0933695808053017 | Loss: 0.0134336640874512 | Epoch: 60 | 
MeanAbsoluteError: 0.0951983034610748 | Loss: 0.0152086828051037 | Epoch: 61 | MeanAbsoluteError: 0.0917086973786354 | Loss: 0.0133841572893097 | Epoch: 62 | MeanAbsoluteError: 0.0886269956827164 | Loss: 0.0128626695092718 | Epoch: 63 | 
MeanAbsoluteError: 0.0851012244820595 | Loss: 0.0115872545314855 | Epoch: 64 | 
MeanAbsoluteError: 0.0891181305050850 | Loss: 0.0128270530472755 | Epoch: 65 | MeanAbsoluteError: 0.0981935113668442 | Loss: 0.0146168097608576 | Epoch: 66 | MeanAbsoluteError: 0.0902533009648323 | Loss: 0.0131731714538642 | Epoch: 67 | 
MeanAbsoluteError: 0.0854485109448433 | Loss: 0.0128296477180955 | Epoch: 68 | 
MeanAbsoluteError: 0.0853529199957848 | Loss: 0.0123007992362162 | Epoch: 69 | MeanAbsoluteError: 0.1071798056364059 | Loss: 0.0171611276577766 | Epoch: 70 | MeanAbsoluteError: 0.0876831561326981 | Loss: 0.0131920555385908 | Epoch: 71 | 
MeanAbsoluteError: 0.0797162726521492 | Loss: 0.0110203995259087 | Epoch: 72 | 
MeanAbsoluteError: 0.0888556614518166 | Loss: 0.0121744081108390 | Epoch: 73 | MeanAbsoluteError: 0.0780879184603691 | Loss: 0.0104574859142303 | Epoch: 74 | MeanAbsoluteError: 0.0820376724004745 | Loss: 0.0112578649668170 | Epoch: 75 | 
MeanAbsoluteError: 0.0897957459092140 | Loss: 0.0125297880425167 | Epoch: 76 | 
MeanAbsoluteError: 0.0820805728435516 | Loss: 0.0116065514188162 | Epoch: 77 | MeanAbsoluteError: 0.0809870436787605 | Loss: 0.0113346505217793 | Epoch: 78 | MeanAbsoluteError: 0.0813824236392975 | Loss: 0.0119170993382699 | Epoch: 79 | 
MeanAbsoluteError: 0.0813125446438789 | Loss: 0.0118148176943099 | Epoch: 80 | 
MeanAbsoluteError: 0.0822135210037231 | Loss: 0.0117135195116709 | Epoch: 81 | MeanAbsoluteError: 0.0792344138026237 | Loss: 0.0109744592582023 | Epoch: 82 | MeanAbsoluteError: 0.0936757251620293 | Loss: 0.0143759323308538 | 
Epoch: 83 | MeanAbsoluteError: 0.0696745887398720 | Loss: 0.0080971515639440 | Epoch: 84 | 
MeanAbsoluteError: 0.0764572620391846 | Loss: 0.0096807446680032 | Epoch: 85 | MeanAbsoluteError: 0.0806878060102463 | Loss: 0.0108598050612368 | Epoch: 86 | 
MeanAbsoluteError: 0.0718123167753220 | Loss: 0.0090759093352397 | Epoch: 87 | MeanAbsoluteError: 0.0773670151829720 | Loss: 0.0104017688212671 | Epoch: 88 | 
MeanAbsoluteError: 0.0735909268260002 | Loss: 0.0105060545641831 | Epoch: 89 | MeanAbsoluteError: 0.0903312563896179 | Loss: 0.0119840141269378 | Epoch: 90 | 
MeanAbsoluteError: 0.0753822103142738 | Loss: 0.0096769084553479 | Epoch: 91 | MeanAbsoluteError: 0.0756677687168121 | Loss: 0.0103687396959255 | Epoch: 92 | 
MeanAbsoluteError: 0.0734286531805992 | Loss: 0.0094129407294340 | Epoch: 93 | MeanAbsoluteError: 0.0823372304439545 | Loss: 0.0105715934064631 | Epoch: 94 | 
MeanAbsoluteError: 0.0782692506909370 | Loss: 0.0112351490411368 | Epoch: 95 | MeanAbsoluteError: 0.0735914334654808 | Loss: 0.0096990607930102 | Epoch: 96 | 
MeanAbsoluteError: 0.0776935964822769 | Loss: 0.0101845112175828 | Epoch: 97 | MeanAbsoluteError: 0.0913263037800789 | Loss: 0.0131962554112665 | Epoch: 98 | 
MeanAbsoluteError: 0.0721559301018715 | Loss: 0.0088397628646099 | Epoch: 99 | MeanAbsoluteError: 0.0676499456167221 | Loss: 0.0078814220063290 | Epoch: 100 | 
MeanAbsoluteError: 0.0749300047755241 | Loss: 0.0094689225876018 | Epoch: 101 | MeanAbsoluteError: 0.0727406665682793 | Loss: 0.0098496531932860 | Epoch: 102 | 
MeanAbsoluteError: 0.0701709911227226 | Loss: 0.0088093907474295 | Epoch: 103 | MeanAbsoluteError: 0.0841309428215027 | Loss: 0.0109406359444715 | Epoch: 104 | 
MeanAbsoluteError: 0.0707982033491135 | Loss: 0.0088555532336039 | Epoch: 105 | MeanAbsoluteError: 0.0761038959026337 | Loss: 0.0099360932455104 | Epoch: 106 | 
MeanAbsoluteError: 0.0733223631978035 | Loss: 0.0096679325766959 | Epoch: 107 | MeanAbsoluteError: 0.0728358998894691 | Loss: 0.0091220776697523 | Epoch: 108 | 
MeanAbsoluteError: 0.0678948163986206 | Loss: 0.0080376295066488 | Epoch: 109 | MeanAbsoluteError: 0.0998151823878288 | Loss: 0.0150744385196288 | Epoch: 110 | 
MeanAbsoluteError: 0.0639514625072479 | Loss: 0.0071893201185096 | Epoch: 111 | MeanAbsoluteError: 0.0645435824990273 | Loss: 0.0076520513669637 | Epoch: 112 | 
MeanAbsoluteError: 0.0664180219173431 | Loss: 0.0076895217552144 | Epoch: 113 | MeanAbsoluteError: 0.0685925632715225 | Loss: 0.0080108378437887 | Epoch: 114 | 
MeanAbsoluteError: 0.0694915726780891 | Loss: 0.0073349445470070 | Epoch: 115 | MeanAbsoluteError: 0.0610979795455933 | Loss: 0.0068046733687975 | Epoch: 116 | 
MeanAbsoluteError: 0.0612682551145554 | Loss: 0.0065525298383651 | Epoch: 117 | MeanAbsoluteError: 0.0760220363736153 | Loss: 0.0087528145798531 | Epoch: 118 | 
MeanAbsoluteError: 0.0758399739861488 | Loss: 0.0096607358121362 | Epoch: 119 | 
MeanAbsoluteError: 0.0641864612698555 | Loss: 0.0076051390895277 | Epoch: 120 | MeanAbsoluteError: 0.0692536160349846 | Loss: 0.0087750128433598 | Epoch: 121 | 
MeanAbsoluteError: 0.0631876885890961 | Loss: 0.0075474095494045 | Epoch: 122 | 
MeanAbsoluteError: 0.0593885853886604 | Loss: 0.0064107698792788 | Epoch: 123 | MeanAbsoluteError: 0.0699779912829399 | Loss: 0.0079353427220332 | Epoch: 124 | 
MeanAbsoluteError: 0.0632705017924309 | Loss: 0.0070930818573719 | Epoch: 125 | 
MeanAbsoluteError: 0.0687699541449547 | Loss: 0.0087150927253166 | Epoch: 126 | MeanAbsoluteError: 0.0644011870026588 | Loss: 0.0081850338610820 | Epoch: 127 | 
MeanAbsoluteError: 0.0613687336444855 | Loss: 0.0065821571502295 | Epoch: 128 | 
MeanAbsoluteError: 0.0675194710493088 | Loss: 0.0078604066082718 | Epoch: 129 | MeanAbsoluteError: 0.0647462010383606 | Loss: 0.0075825554729243 | Epoch: 130 | MeanAbsoluteError: 0.0604964047670364 | Loss: 0.0065711106320745 | Epoch: 131 | 
MeanAbsoluteError: 0.0606276839971542 | Loss: 0.0061835079104640 | Epoch: 132 | 
MeanAbsoluteError: 0.0649345144629478 | Loss: 0.0067558406980855 | Epoch: 133 | MeanAbsoluteError: 0.0700250715017319 | Loss: 0.0087997192014499 | Epoch: 134 | MeanAbsoluteError: 0.0658221319317818 | Loss: 0.0082103622017281 | Epoch: 135 | 
MeanAbsoluteError: 0.0623395331203938 | Loss: 0.0072638231642103 | Epoch: 136 | 
MeanAbsoluteError: 0.0692525729537010 | Loss: 0.0083139725305189 | Epoch: 137 | MeanAbsoluteError: 0.0615884028375149 | Loss: 0.0064281543692280 | Epoch: 138 | MeanAbsoluteError: 0.0639452263712883 | Loss: 0.0079015905227463 | Epoch: 139 | 
MeanAbsoluteError: 0.0638834983110428 | Loss: 0.0071687649898721 | Epoch: 140 | 
MeanAbsoluteError: 0.0683363378047943 | Loss: 0.0084703465016853 | Epoch: 141 | MeanAbsoluteError: 0.0623353198170662 | Loss: 0.0065750344702361 | Epoch: 142 | MeanAbsoluteError: 0.0615076385438442 | Loss: 0.0065451042763399 | 
Epoch: 143 | 
MeanAbsoluteError: 0.0600095167756081 | Loss: 0.0065730983777413 | Epoch: 144 | MeanAbsoluteError: 0.0652786418795586 | Loss: 0.0077757252821405 | Epoch: 145 | MeanAbsoluteError: 0.0589739307761192 | Loss: 0.0061458142161810 | Epoch: 146 | 
MeanAbsoluteError: 0.0575554482638836 | Loss: 0.0060203835616305 | Epoch: 147 | 
MeanAbsoluteError: 0.0681682005524635 | Loss: 0.0087332997017687 | Epoch: 148 | MeanAbsoluteError: 0.0622477009892464 | Loss: 0.0069021634806536 | Epoch: 149 | MeanAbsoluteError: 0.0607391856610775 | Loss: 0.0066279198263625 | Epoch: 150 | 
MeanAbsoluteError: 0.0619794391095638 | Loss: 0.0073528092578176 | Epoch: 151 | 
MeanAbsoluteError: 0.0532309301197529 | Loss: 0.0048935368448790 | Epoch: 152 | MeanAbsoluteError: 0.0597691610455513 | Loss: 0.0068328659422389 | Epoch: 153 | MeanAbsoluteError: 0.0574103668332100 | Loss: 0.0061347114602349 | Epoch: 154 | 
MeanAbsoluteError: 0.0578564777970314 | Loss: 0.0069699554189451 | Epoch: 155 | 
MeanAbsoluteError: 0.0561916343867779 | Loss: 0.0058546636075909 | Epoch: 156 | MeanAbsoluteError: 0.0720038339495659 | Loss: 0.0086964950100274 | Epoch: 157 | MeanAbsoluteError: 0.0548319183290005 | Loss: 0.0055787420079516 | Epoch: 158 | 
MeanAbsoluteError: 0.0610565952956676 | Loss: 0.0064982056133694 | Epoch: 159 | 
MeanAbsoluteError: 0.0637579485774040 | Loss: 0.0070806923690007 | Epoch: 160 | MeanAbsoluteError: 0.0696950033307076 | Loss: 0.0083177802704373 | Epoch: 161 | MeanAbsoluteError: 0.0531266741454601 | Loss: 0.0051785726192113 | Epoch: 162 | 
MeanAbsoluteError: 0.0628887116909027 | Loss: 0.0075323162569762 | Epoch: 163 | 
MeanAbsoluteError: 0.0630517601966858 | Loss: 0.0068249780084252 | Epoch: 164 | MeanAbsoluteError: 0.0617038905620575 | Loss: 0.0069494730805194 | Epoch: 165 | MeanAbsoluteError: 0.0612441636621952 | Loss: 0.0070910700198606 | Epoch: 166 | 
MeanAbsoluteError: 0.0585346594452858 | Loss: 0.0058759608502059 | Epoch: 167 | 
MeanAbsoluteError: 0.0592509731650352 | Loss: 0.0069091836247887 | Epoch: 168 | MeanAbsoluteError: 0.0634653046727180 | Loss: 0.0072934784448559 | Epoch: 169 | MeanAbsoluteError: 0.0594917610287666 | Loss: 0.0067763689562286 | Epoch: 170 | 
MeanAbsoluteError: 0.0579071678221226 | Loss: 0.0066468201372405 | Epoch: 171 | 
MeanAbsoluteError: 0.0689772665500641 | Loss: 0.0085507652991892 | Epoch: 172 | MeanAbsoluteError: 0.0743187740445137 | Loss: 0.0091092717178215 | Epoch: 173 | 
MeanAbsoluteError: 0.0593688599765301 | Loss: 0.0068718268670828 | Epoch: 174 | MeanAbsoluteError: 0.0573926866054535 | Loss: 0.0059074133406332 | Epoch: 175 | 
MeanAbsoluteError: 0.0588221028447151 | Loss: 0.0060330975040989 | Epoch: 176 | MeanAbsoluteError: 0.0579331219196320 | Loss: 0.0069481165096237 | 
Epoch: 177 | MeanAbsoluteError: 0.0524351485073566 | Loss: 0.0054050463950261 | Epoch: 178 | MeanAbsoluteError: 0.0591617822647095 | Loss: 0.0056288513036347 | Epoch: 179 | 
MeanAbsoluteError: 0.0524825863540173 | Loss: 0.0049967125110255 | Epoch: 180 | 
MeanAbsoluteError: 0.0724572986364365 | Loss: 0.0088172616424823 | Epoch: 181 | MeanAbsoluteError: 0.0654797554016113 | Loss: 0.0071294626985419 | Epoch: 182 | MeanAbsoluteError: 0.0518214553594589 | Loss: 0.0047711538285703 | Epoch: 183 | 
MeanAbsoluteError: 0.0559534393250942 | Loss: 0.0060798674316366 | Epoch: 184 | 
MeanAbsoluteError: 0.0511371530592442 | Loss: 0.0049053175822145 | Epoch: 185 | MeanAbsoluteError: 0.0518407262861729 | Loss: 0.0050929289090594 | Epoch: 186 | MeanAbsoluteError: 0.0560934767127037 | Loss: 0.0056336540790079 | Epoch: 187 | 
MeanAbsoluteError: 0.0635787472128868 | Loss: 0.0065772981431923 | Epoch: 188 | 
MeanAbsoluteError: 0.0650602206587791 | Loss: 0.0074197149369866 | Epoch: 189 | MeanAbsoluteError: 0.0578531958162785 | Loss: 0.0059215082376460 | Epoch: 190 | 
MeanAbsoluteError: 0.0494736246764660 | Loss: 0.0042421762543534 | Epoch: 191 | MeanAbsoluteError: 0.0724660307168961 | Loss: 0.0087837962200865 | Epoch: 192 | 
MeanAbsoluteError: 0.0550707168877125 | Loss: 0.0059105275891182 | Epoch: 193 | MeanAbsoluteError: 0.0595854520797729 | Loss: 0.0058037282127005 | Epoch: 194 | 
MeanAbsoluteError: 0.0583632215857506 | Loss: 0.0055343655066712 | Epoch: 195 | MeanAbsoluteError: 0.0724096521735191 | Loss: 0.0080128156175641 | Epoch: 196 | 
MeanAbsoluteError: 0.0519710183143616 | Loss: 0.0052383702668043 | Epoch: 197 | MeanAbsoluteError: 0.0583337135612965 | Loss: 0.0068106379415105 | Epoch: 198 | 
MeanAbsoluteError: 0.0547879673540592 | Loss: 0.0060135620633924 | Epoch: 199 | MeanAbsoluteError: 0.0529088973999023 | Loss: 0.0049747918919342 | Epoch: 200 | 
MeanAbsoluteError: 0.0632351413369179 | Loss: 0.0070556181507479 | Epoch: 201 | MeanAbsoluteError: 0.0568281859159470 | Loss: 0.0059673591228937 | Epoch: 202 | 
MeanAbsoluteError: 0.0524623803794384 | Loss: 0.0047075584098868 | Epoch: 203 | MeanAbsoluteError: 0.0590325854718685 | Loss: 0.0060032739374468 | 
Epoch: 204 | MeanAbsoluteError: 0.0592683143913746 | Loss: 0.0067987406846920 | Epoch: 205 | 
MeanAbsoluteError: 0.0506991632282734 | Loss: 0.0046032256933885 | Epoch: 206 | 
MeanAbsoluteError: 0.0576860681176186 | Loss: 0.0067315095925312 | Epoch: 207 | MeanAbsoluteError: 0.0530574135482311 | Loss: 0.0055777254203445 | Epoch: 208 | MeanAbsoluteError: 0.0489558130502701 | Loss: 0.0052356466323162 | Epoch: 209 | 
MeanAbsoluteError: 0.0556717105209827 | Loss: 0.0053919128258713 | Epoch: 210 | 
MeanAbsoluteError: 0.0547465123236179 | Loss: 0.0058934181885745 | Epoch: 211 | MeanAbsoluteError: 0.0548751465976238 | Loss: 0.0064806067384779 | Epoch: 212 | MeanAbsoluteError: 0.0552970394492149 | Loss: 0.0060856258466007 | Epoch: 213 | 
MeanAbsoluteError: 0.0578633546829224 | Loss: 0.0059569063075622 | Epoch: 214 | 
MeanAbsoluteError: 0.0551117844879627 | Loss: 0.0051995676813500 | Epoch: 215 | MeanAbsoluteError: 0.0571993589401245 | Loss: 0.0062214425890584 | Epoch: 216 | MeanAbsoluteError: 0.0556403659284115 | Loss: 0.0055973850447979 | Epoch: 217 | 
MeanAbsoluteError: 0.0499943383038044 | Loss: 0.0048046032438594 | Epoch: 218 | 
MeanAbsoluteError: 0.0572885498404503 | Loss: 0.0066044491587060 | Epoch: 219 | MeanAbsoluteError: 0.0643353238701820 | Loss: 0.0070885298743011 | Epoch: 220 | MeanAbsoluteError: 0.0500331409275532 | Loss: 0.0050221494978024 | Epoch: 221 | 
MeanAbsoluteError: 0.0514225251972675 | Loss: 0.0053879888421905 | Epoch: 222 | 
MeanAbsoluteError: 0.0574217289686203 | Loss: 0.0059297246993274 | Epoch: 223 | MeanAbsoluteError: 0.0512963533401489 | Loss: 0.0058342185925300 | Epoch: 224 | MeanAbsoluteError: 0.0549992173910141 | Loss: 0.0062409570060768 | Epoch: 225 | 
MeanAbsoluteError: 0.0604144744575024 | Loss: 0.0077674115707755 | Epoch: 226 | 
MeanAbsoluteError: 0.0616002082824707 | Loss: 0.0067100787755886 | Epoch: 227 | MeanAbsoluteError: 0.0538181066513062 | Loss: 0.0057959017515379 | Epoch: 228 | MeanAbsoluteError: 0.0522722937166691 | Loss: 0.0047962576599706 | Epoch: 229 | 
MeanAbsoluteError: 0.0535470396280289 | Loss: 0.0057346303028202 | Epoch: 230 | 
MeanAbsoluteError: 0.0679422765970230 | Loss: 0.0073958520569201 | Epoch: 231 | MeanAbsoluteError: 0.0511571504175663 | Loss: 0.0050448284907217 | Epoch: 232 | MeanAbsoluteError: 0.0478421598672867 | Loss: 0.0043366839343339 | Epoch: 233 | 
MeanAbsoluteError: 0.0483090095221996 | Loss: 0.0039749212936792 | Epoch: 234 | 
MeanAbsoluteError: 0.0495321415364742 | Loss: 0.0045163590586622 | Epoch: 235 | MeanAbsoluteError: 0.0508005209267139 | Loss: 0.0048518195674804 | Epoch: 236 | MeanAbsoluteError: 0.0506273731589317 | Loss: 0.0048551004989636 | Epoch: 237 | 
MeanAbsoluteError: 0.0615115240216255 | Loss: 0.0067278578820773 | Epoch: 238 | 
MeanAbsoluteError: 0.0518819950520992 | Loss: 0.0051837380068671 | Epoch: 239 | MeanAbsoluteError: 0.0550008825957775 | Loss: 0.0060088495635060 | Epoch: 240 | MeanAbsoluteError: 0.0495546758174896 | Loss: 0.0050656861643993 | Epoch: 241 | 
MeanAbsoluteError: 0.0499860458076000 | Loss: 0.0059339176177194 | Epoch: 242 | 
MeanAbsoluteError: 0.0561373531818390 | Loss: 0.0059761182791063 | Epoch: 243 | MeanAbsoluteError: 0.0534929521381855 | Loss: 0.0055593407826229 | Epoch: 244 | MeanAbsoluteError: 0.0624603889882565 | Loss: 0.0064177193470593 | Epoch: 245 | 
MeanAbsoluteError: 0.0504726357758045 | Loss: 0.0044595295116060 | Epoch: 246 | 
MeanAbsoluteError: 0.0540331527590752 | Loss: 0.0052537596784532 | Epoch: 247 | MeanAbsoluteError: 0.0492245890200138 | Loss: 0.0047357137556997 | Epoch: 248 | MeanAbsoluteError: 0.0509700886905193 | Loss: 0.0057799126156361 | Epoch: 249 | 
MeanAbsoluteError: 0.0499537512660027 | Loss: 0.0047341525481132 | Epoch: 250 | 
MeanAbsoluteError: 0.0473000556230545 | Loss: 0.0047825003857724 | Epoch: 251 | MeanAbsoluteError: 0.0493862368166447 | Loss: 0.0042680533370003 | Epoch: 252 | MeanAbsoluteError: 0.0557649023830891 | Loss: 0.0055984221919636 | Epoch: 253 | 
MeanAbsoluteError: 0.0485947132110596 | Loss: 0.0045380078625289 | Epoch: 254 | 
MeanAbsoluteError: 0.0472091883420944 | Loss: 0.0044437498620123 | Epoch: 255 | MeanAbsoluteError: 0.0439030602574348 | Loss: 0.0033929256023839 | Epoch: 256 | 
MeanAbsoluteError: 0.0511254072189331 | Loss: 0.0045950685499089 | Epoch: 257 | 
MeanAbsoluteError: 0.0512596219778061 | Loss: 0.0048584968631315 | Epoch: 258 | MeanAbsoluteError: 0.0530676916241646 | Loss: 0.0054226482683780 | Epoch: 259 | MeanAbsoluteError: 0.0466409064829350 | Loss: 0.0046651180370980 | Epoch: 260 | 
MeanAbsoluteError: 0.0559468008577824 | Loss: 0.0052178795725156 | Epoch: 261 | 
MeanAbsoluteError: 0.0556795001029968 | Loss: 0.0050892579602078 | Epoch: 262 | MeanAbsoluteError: 0.0540579855442047 | Loss: 0.0055207787449227 | Epoch: 263 | MeanAbsoluteError: 0.0483750700950623 | Loss: 0.0043740026885644 | Epoch: 264 | 
MeanAbsoluteError: 0.0546494945883751 | Loss: 0.0054079308205186 | Epoch: 265 | 
MeanAbsoluteError: 0.0483251325786114 | Loss: 0.0048091413290853 | Epoch: 266 | MeanAbsoluteError: 0.0539024993777275 | Loss: 0.0051196760553131 | Epoch: 267 | MeanAbsoluteError: 0.0479310862720013 | Loss: 0.0043954355044805 | Epoch: 268 | 
MeanAbsoluteError: 0.0540158599615097 | Loss: 0.0056552773029053 | Epoch: 269 | 
MeanAbsoluteError: 0.0489614866673946 | Loss: 0.0048781714255088 | Epoch: 270 | MeanAbsoluteError: 0.0471969135105610 | Loss: 0.0043652107982014 | Epoch: 271 | MeanAbsoluteError: 0.0520505569875240 | Loss: 0.0047598729908809 | Epoch: 272 | 
MeanAbsoluteError: 0.0458981022238731 | Loss: 0.0044028544430866 | Epoch: 273 | 
MeanAbsoluteError: 0.0503049008548260 | Loss: 0.0053065429245563 | Epoch: 274 | MeanAbsoluteError: 0.0485126972198486 | Loss: 0.0047815723090408 | Epoch: 275 | MeanAbsoluteError: 0.0448011681437492 | Loss: 0.0033408306373626 | Epoch: 276 | 
MeanAbsoluteError: 0.0464547649025917 | Loss: 0.0045896124333682 | Epoch: 277 | 
MeanAbsoluteError: 0.0492053516209126 | Loss: 0.0045981393027193 | Epoch: 278 | MeanAbsoluteError: 0.0486301183700562 | Loss: 0.0047406154412065 | Epoch: 279 | MeanAbsoluteError: 0.0541929677128792 | Loss: 0.0054536147952987 | Epoch: 280 | 
MeanAbsoluteError: 0.0498691461980343 | Loss: 0.0047164251430475 | Epoch: 281 | 
MeanAbsoluteError: 0.0503102168440819 | Loss: 0.0045307943395241 | Epoch: 282 | MeanAbsoluteError: 0.0503310821950436 | Loss: 0.0052635660042717 | Epoch: 283 | 
MeanAbsoluteError: 0.0496870093047619 | Loss: 0.0046522493020778 | Epoch: 284 | MeanAbsoluteError: 0.0492931529879570 | Loss: 0.0048070204410530 | 
Epoch: 285 | MeanAbsoluteError: 0.0614605024456978 | Loss: 0.0061016572075651 | Epoch: 286 | MeanAbsoluteError: 0.0493427217006683 | Loss: 0.0040915920215316 | Epoch: 287 | 
MeanAbsoluteError: 0.0451818257570267 | Loss: 0.0040305955182320 | Epoch: 288 | 
MeanAbsoluteError: 0.0492741465568542 | Loss: 0.0048880002654378 | Epoch: 289 | MeanAbsoluteError: 0.0507424548268318 | Loss: 0.0052648375950460 | Epoch: 290 | MeanAbsoluteError: 0.0515524111688137 | Loss: 0.0050615872023627 | Epoch: 291 | 
MeanAbsoluteError: 0.0518330000340939 | Loss: 0.0050014178260953 | Epoch: 292 | 
MeanAbsoluteError: 0.0476048551499844 | Loss: 0.0041292278941623 | Epoch: 293 | MeanAbsoluteError: 0.0523502565920353 | Loss: 0.0047984903381133 | Epoch: 294 | MeanAbsoluteError: 0.0501916520297527 | Loss: 0.0048103639473036 | Epoch: 295 | 
MeanAbsoluteError: 0.0462520867586136 | Loss: 0.0043836722294432 | Epoch: 296 | 
MeanAbsoluteError: 0.0458452068269253 | Loss: 0.0040243154201706 | Epoch: 297 | MeanAbsoluteError: 0.0487683154642582 | Loss: 0.0045953804954862 | Epoch: 298 | MeanAbsoluteError: 0.0435664989054203 | Loss: 0.0031693628636851 | Epoch: 299 | 
MeanAbsoluteError: 0.0473316907882690 | Loss: 0.0041108429722954 | Epoch: 300 | 
MeanAbsoluteError: 0.0472872965037823 | Loss: 0.0039366024782219 | Epoch: 301 | MeanAbsoluteError: 0.0447707884013653 | Loss: 0.0038182047520470 | Epoch: 302 | MeanAbsoluteError: 0.0497904904186726 | Loss: 0.0045722577947584 | Epoch: 303 | 
MeanAbsoluteError: 0.0457661263644695 | Loss: 0.0040411592038397 | Epoch: 304 | 
MeanAbsoluteError: 0.0470734611153603 | Loss: 0.0042264651703207 | Epoch: 305 | MeanAbsoluteError: 0.0439123995602131 | Loss: 0.0038358958370640 | Epoch: 306 | MeanAbsoluteError: 0.0470329262316227 | Loss: 0.0050604320904791 | 
Epoch: 307 | 
MeanAbsoluteError: 0.0469612441956997 | Loss: 0.0038333327147963 | Epoch: 308 | MeanAbsoluteError: 0.0479018203914165 | Loss: 0.0048072240391967 | Epoch: 309 | 
MeanAbsoluteError: 0.0432702787220478 | Loss: 0.0038489941829252 | Epoch: 310 | 
MeanAbsoluteError: 0.0447205603122711 | Loss: 0.0042268326306887 | Epoch: 311 | MeanAbsoluteError: 0.0464688763022423 | Loss: 0.0043599558779725 | Epoch: 312 | 
MeanAbsoluteError: 0.0459820255637169 | Loss: 0.0037818311048843 | Epoch: 313 | 
MeanAbsoluteError: 0.0475686341524124 | Loss: 0.0041141334567280 | Epoch: 314 | MeanAbsoluteError: 0.0461256243288517 | Loss: 0.0039698160284101 | Epoch: 315 | MeanAbsoluteError: 0.0540930032730103 | Loss: 0.0050925297546200 | Epoch: 316 | 
MeanAbsoluteError: 0.0538097955286503 | Loss: 0.0051410642918199 | Epoch: 317 | 
MeanAbsoluteError: 0.0484753772616386 | Loss: 0.0046070948194124 | Epoch: 318 | MeanAbsoluteError: 0.0443462319672108 | Loss: 0.0040630505567319 | Epoch: 319 | 
MeanAbsoluteError: 0.0487367324531078 | Loss: 0.0044706096492806 | Epoch: 320 | 
MeanAbsoluteError: 0.0460803173482418 | Loss: 0.0043025450477695 | Epoch: 321 | MeanAbsoluteError: 0.0486814230680466 | Loss: 0.0041445448219556 | Epoch: 322 | MeanAbsoluteError: 0.0511639229953289 | Loss: 0.0054869270074720 | Epoch: 323 | 
MeanAbsoluteError: 0.0506905317306519 | Loss: 0.0045728312474430 | Epoch: 324 | MeanAbsoluteError: 0.0468969196081161 | Loss: 0.0047997396583301 | Epoch: 325 | MeanAbsoluteError: 0.0474677644670010 | Loss: 0.0039598473568300 | Epoch: 326 | MeanAbsoluteError: 0.0469854697585106 | Loss: 0.0041551016612701 | Epoch: 327 | 
MeanAbsoluteError: 0.0487009063363075 | Loss: 0.0045138641266691 | Epoch: 328 | MeanAbsoluteError: 0.0457778498530388 | Loss: 0.0042384732284853 | Epoch: 329 | MeanAbsoluteError: 0.0477174147963524 | Loss: 0.0047562958421431 | Epoch: 330 | MeanAbsoluteError: 0.0486002862453461 | Loss: 0.0045494551764262 | Epoch: 331 | 
MeanAbsoluteError: 0.0427714996039867 | Loss: 0.0037145379710158 | Epoch: 332 | MeanAbsoluteError: 0.0527529083192348 | Loss: 0.0047984617321115 | Epoch: 333 | MeanAbsoluteError: 0.0479133911430836 | Loss: 0.0046101288209780 | Epoch: 334 | MeanAbsoluteError: 0.0541633367538452 | Loss: 0.0063094982025704 | Epoch: 335 | 
MeanAbsoluteError: 0.0694153755903244 | Loss: 0.0074997540060921 | Epoch: 336 | MeanAbsoluteError: 0.0425396077334881 | Loss: 0.0037189976673720 | Epoch: 337 | MeanAbsoluteError: 0.0435471124947071 | Loss: 0.0038632170663301 | Epoch: 338 | MeanAbsoluteError: 0.0472558438777924 | Loss: 0.0040682157153864 | Epoch: 339 | 
MeanAbsoluteError: 0.0509439855813980 | Loss: 0.0047217654983366 | Epoch: 340 | MeanAbsoluteError: 0.0456587076187134 | Loss: 0.0038851029561269 | Epoch: 341 | MeanAbsoluteError: 0.0456298328936100 | Loss: 0.0037321368581615 | Epoch: 342 | MeanAbsoluteError: 0.0447536259889603 | Loss: 0.0036915059042114 | Epoch: 343 | 
MeanAbsoluteError: 0.0503547452390194 | Loss: 0.0051857893704437 | Epoch: 344 | MeanAbsoluteError: 0.0472966581583023 | Loss: 0.0045352896666277 | Epoch: 345 | MeanAbsoluteError: 0.0444068722426891 | Loss: 0.0042510596686043 | Epoch: 346 | MeanAbsoluteError: 0.0594302378594875 | Loss: 0.0060798001573666 | Epoch: 347 | 
MeanAbsoluteError: 0.0442530103027821 | Loss: 0.0036052324997543 | Epoch: 348 | MeanAbsoluteError: 0.0552905388176441 | Loss: 0.0057069955203731 | Epoch: 349 | MeanAbsoluteError: 0.0448282659053802 | Loss: 0.0040668896912585 | Epoch: 350 | MeanAbsoluteError: 0.0456380136311054 | Loss: 0.0044634249536198 | Epoch: 351 | 
MeanAbsoluteError: 0.0456311851739883 | Loss: 0.0041069215880462 | Epoch: 352 | MeanAbsoluteError: 0.0410260260105133 | Loss: 0.0032362864294555 | Epoch: 353 | MeanAbsoluteError: 0.0469582229852676 | Loss: 0.0047763392140041 | Epoch: 354 | MeanAbsoluteError: 0.0453887432813644 | Loss: 0.0037095605466196 | Epoch: 355 | 
MeanAbsoluteError: 0.0429217405617237 | Loss: 0.0035599842253999 | Epoch: 356 | MeanAbsoluteError: 0.0417798534035683 | Loss: 0.0035519720848625 | Epoch: 357 | MeanAbsoluteError: 0.0488666817545891 | Loss: 0.0050569893102970 | Epoch: 358 | 
MeanAbsoluteError: 0.0443731583654881 | Loss: 0.0036934177685333 | Epoch: 359 | MeanAbsoluteError: 0.0455661676824093 | Loss: 0.0039853778235786 | Epoch: 360 | MeanAbsoluteError: 0.0454290173947811 | Loss: 0.0049067590367294 | Epoch: 361 | MeanAbsoluteError: 0.0428311899304390 | Loss: 0.0039591678972724 | Epoch: 362 | 
MeanAbsoluteError: 0.0459176413714886 | Loss: 0.0041223880222165 | Early stopping at epoch 361
Returned to Spot: Validation loss: 0.0041223880222165275
spotPython tuning: 0.0014845179156461534 [#########-] 94.72% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.38417736466355884, 'lr_mult': 3.169391450838062, 'batch_size': 8, 'epochs': 64, 'k_folds': 1, 'patience': 32, 'optimizer': 'ASGD', 'sgd_momentum': 0.8945927266330584}
Epoch: 1 | MeanAbsoluteError: 0.1585001647472382 | Loss: 0.0405805645216452 | Epoch: 2 | MeanAbsoluteError: 0.1578270047903061 | Loss: 0.0382436540124840 | Epoch: 3 | MeanAbsoluteError: 0.1428824365139008 | Loss: 0.0321536707495780 | Epoch: 4 | 
MeanAbsoluteError: 0.1407608687877655 | Loss: 0.0319244542624801 | Epoch: 5 | MeanAbsoluteError: 0.1416269093751907 | Loss: 0.0305134468515845 | Epoch: 6 | MeanAbsoluteError: 0.1395539045333862 | Loss: 0.0301287271523554 | Epoch: 7 | MeanAbsoluteError: 0.1364879757165909 | Loss: 0.0292286382939078 | Epoch: 8 | 
MeanAbsoluteError: 0.1369781494140625 | Loss: 0.0301595286858317 | Epoch: 9 | MeanAbsoluteError: 0.1392475366592407 | Loss: 0.0299852371313854 | Epoch: 10 | MeanAbsoluteError: 0.1365408897399902 | Loss: 0.0297113419878051 | Epoch: 11 | MeanAbsoluteError: 0.1345017105340958 | Loss: 0.0284792987115093 | Epoch: 12 | 
MeanAbsoluteError: 0.1372570246458054 | Loss: 0.0294479299336672 | Epoch: 13 | MeanAbsoluteError: 0.1331439763307571 | Loss: 0.0289367710877406 | Epoch: 14 | MeanAbsoluteError: 0.1386047303676605 | Loss: 0.0300451049360594 | Epoch: 15 | MeanAbsoluteError: 0.1357330530881882 | Loss: 0.0290226741130219 | Epoch: 16 | 
MeanAbsoluteError: 0.1320520639419556 | Loss: 0.0267325505295670 | Epoch: 17 | MeanAbsoluteError: 0.1345394998788834 | Loss: 0.0290141117906100 | Epoch: 18 | MeanAbsoluteError: 0.1356309056282043 | Loss: 0.0282241909176503 | Epoch: 19 | MeanAbsoluteError: 0.1363601535558701 | Loss: 0.0297506086920437 | Epoch: 20 | 
MeanAbsoluteError: 0.1299503296613693 | Loss: 0.0260085995970784 | Epoch: 21 | MeanAbsoluteError: 0.1342062503099442 | Loss: 0.0283630575224953 | Epoch: 22 | MeanAbsoluteError: 0.1304711848497391 | Loss: 0.0272065787208512 | Epoch: 23 | MeanAbsoluteError: 0.1314798593521118 | Loss: 0.0271379749878849 | Epoch: 24 | 
MeanAbsoluteError: 0.1315853148698807 | Loss: 0.0275095645338297 | Epoch: 25 | MeanAbsoluteError: 0.1287586688995361 | Loss: 0.0269135665025954 | Epoch: 26 | MeanAbsoluteError: 0.1281345933675766 | Loss: 0.0265756048335645 | Epoch: 27 | MeanAbsoluteError: 0.1325922906398773 | Loss: 0.0274063126968318 | Epoch: 28 | 
MeanAbsoluteError: 0.1372847855091095 | Loss: 0.0294226328352172 | Epoch: 29 | MeanAbsoluteError: 0.1287570744752884 | Loss: 0.0267353513474135 | Epoch: 30 | MeanAbsoluteError: 0.1284257322549820 | Loss: 0.0257873945428353 | Epoch: 31 | MeanAbsoluteError: 0.1262739747762680 | Loss: 0.0249822424773715 | Epoch: 32 | 
MeanAbsoluteError: 0.1306410729885101 | Loss: 0.0264191410112146 | Epoch: 33 | MeanAbsoluteError: 0.1314244419336319 | Loss: 0.0271287925639435 | Epoch: 34 | MeanAbsoluteError: 0.1295363903045654 | Loss: 0.0259337107601919 | Epoch: 35 | MeanAbsoluteError: 0.1311121582984924 | Loss: 0.0272267039767221 | Epoch: 36 | 
MeanAbsoluteError: 0.1275248080492020 | Loss: 0.0262124702628506 | Epoch: 37 | MeanAbsoluteError: 0.1291990578174591 | Loss: 0.0253255722468327 | Epoch: 38 | MeanAbsoluteError: 0.1310543268918991 | Loss: 0.0267823826350076 | Epoch: 39 | MeanAbsoluteError: 0.1268945038318634 | Loss: 0.0255983623577968 | 
Epoch: 40 | MeanAbsoluteError: 0.1313838213682175 | Loss: 0.0268957358784974 | Epoch: 41 | MeanAbsoluteError: 0.1285571306943893 | Loss: 0.0266549859171439 | Epoch: 42 | MeanAbsoluteError: 0.1217050552368164 | Loss: 0.0235584019193132 | Epoch: 43 | 
MeanAbsoluteError: 0.1304609179496765 | Loss: 0.0268348508244871 | Epoch: 44 | MeanAbsoluteError: 0.1249709948897362 | Loss: 0.0257774698670561 | Epoch: 45 | MeanAbsoluteError: 0.1253469139337540 | Loss: 0.0249895656628436 | Epoch: 46 | 
MeanAbsoluteError: 0.1269769817590714 | Loss: 0.0251346409541408 | Epoch: 47 | MeanAbsoluteError: 0.1308682709932327 | Loss: 0.0264744837768376 | Epoch: 48 | MeanAbsoluteError: 0.1212792992591858 | Loss: 0.0238714892123091 | Epoch: 49 | MeanAbsoluteError: 0.1203782632946968 | Loss: 0.0240090171880040 | Epoch: 50 | 
MeanAbsoluteError: 0.1216805651783943 | Loss: 0.0232146932792507 | Epoch: 51 | MeanAbsoluteError: 0.1219237744808197 | Loss: 0.0237753141524368 | Epoch: 52 | MeanAbsoluteError: 0.1205148175358772 | Loss: 0.0233872304670513 | Epoch: 53 | MeanAbsoluteError: 0.1219332888722420 | Loss: 0.0235888884574371 | Epoch: 54 | 
MeanAbsoluteError: 0.1223147809505463 | Loss: 0.0236224806377370 | Epoch: 55 | MeanAbsoluteError: 0.1196036413311958 | Loss: 0.0228681574073179 | Epoch: 56 | MeanAbsoluteError: 0.1156745627522469 | Loss: 0.0212055349869556 | Epoch: 57 | MeanAbsoluteError: 0.1215284764766693 | Loss: 0.0243003902662742 | Epoch: 58 | 
MeanAbsoluteError: 0.1178852245211601 | Loss: 0.0223038498998473 | Epoch: 59 | MeanAbsoluteError: 0.1184795647859573 | Loss: 0.0227552560084548 | Epoch: 60 | MeanAbsoluteError: 0.1213038787245750 | Loss: 0.0232084330514466 | Epoch: 61 | 
MeanAbsoluteError: 0.1145102456212044 | Loss: 0.0219273658616370 | Epoch: 62 | MeanAbsoluteError: 0.1150166094303131 | Loss: 0.0214327334205767 | Epoch: 63 | MeanAbsoluteError: 0.1104280054569244 | Loss: 0.0192062534747253 | Epoch: 64 | MeanAbsoluteError: 0.1202467978000641 | Loss: 0.0240537151326670 | Returned to Spot: Validation loss: 0.024053715132667047
spotPython tuning: 0.0014845179156461534 [##########] 100.00% Done...
<spotPython.spot.spot.Spot at 0x185c5e530>

19.9 Step 9: Tensorboard

The textual output shown in the console (or code cell) can be visualized with Tensorboard as described in Section 14.9, see also the description in the documentation: Tensorboard.

19.10 Step 10: Results

After the hyperparameter tuning run is finished, the results can be analyzed as described in Section 14.10.

spot_tuner.plot_progress(log_y=False,
    filename="./figures/" + experiment_name+"_progress.png")

Progress plot. Black dots denote results from the initial design. Red dots illustrate the improvement found by the surrogate model based optimization.
print(gen_design_table(fun_control=fun_control, spot=spot_tuner))
| name         | type   | default   |   lower |   upper |               tuned | transform             |   importance | stars   |
|--------------|--------|-----------|---------|---------|---------------------|-----------------------|--------------|---------|
| _L_in        | int    | 10        |    10.0 |    10.0 |                10.0 | None                  |         0.00 |         |
| _L_out       | int    | 1         |     1.0 |     1.0 |                 1.0 | None                  |         0.00 |         |
| l1           | int    | 3         |     3.0 |     8.0 |                 5.0 | transform_power_2_int |        27.63 | *       |
| dropout_prob | float  | 0.01      |     0.0 |     0.9 |  0.1655924245415988 | None                  |         1.78 | *       |
| lr_mult      | float  | 1.0       |     0.1 |    10.0 |   4.186124343189683 | None                  |         0.00 |         |
| batch_size   | int    | 4         |     1.0 |     4.0 |                 3.0 | transform_power_2_int |         0.00 |         |
| epochs       | int    | 4         |     2.0 |    16.0 |                12.0 | transform_power_2_int |         0.00 |         |
| k_folds      | int    | 1         |     1.0 |     1.0 |                 1.0 | None                  |         0.00 |         |
| patience     | int    | 2         |     3.0 |     7.0 |                 5.0 | transform_power_2_int |       100.00 | ***     |
| optimizer    | factor | SGD       |     0.0 |     6.0 |                 0.0 | None                  |         0.00 |         |
| sgd_momentum | float  | 0.0       |     0.0 |     1.0 | 0.07400725452261472 | None                  |       100.00 | ***     |
spot_tuner.plot_importance(threshold=0.025,
    filename="./figures/" + experiment_name+"_importance.png")

Variable importance plot, threshold 0.025.

19.10.1 Get the Tuned Architecture (SPOT Results)

from spotPython.hyperparameters.values import get_one_core_model_from_X
X = spot_tuner.to_all_dim(spot_tuner.min_X.reshape(1,-1))
model_spot = get_one_core_model_from_X(X, fun_control)
model_spot
Net_lin_reg(
  (fc1): Linear(in_features=10, out_features=32, bias=True)
  (fc2): Linear(in_features=32, out_features=16, bias=True)
  (fc3): Linear(in_features=16, out_features=1, bias=True)
  (relu): ReLU()
  (softmax): Softmax(dim=1)
  (dropout1): Dropout(p=0.1655924245415988, inplace=False)
  (dropout2): Dropout(p=0.0827962122707994, inplace=False)
)

19.10.2 Evaluation of the Tuned Architecture

from spotPython.torch.traintest import (
    train_tuned,
    test_tuned,
    )
train_tuned(net=model_spot, train_dataset=train,
        loss_function=fun_control["loss_function"],
        metric=fun_control["metric_torch"],
        shuffle=True,
        device = fun_control["device"],
        path=None,
        task=fun_control["task"],)
Epoch: 1 | MeanAbsoluteError: 0.1678686439990997 | Loss: 0.0415245869049900 | Epoch: 2 | MeanAbsoluteError: 0.2018080651760101 | Loss: 0.0556347076045839 | Epoch: 3 | 
MeanAbsoluteError: 0.1642994284629822 | Loss: 0.0387321374084997 | Epoch: 4 | MeanAbsoluteError: 0.1346424818038940 | Loss: 0.0288674441950494 | Epoch: 5 | MeanAbsoluteError: 0.0992065966129303 | Loss: 0.0164879764228030 | Epoch: 6 | MeanAbsoluteError: 0.0922971665859222 | Loss: 0.0146343178287345 | Epoch: 7 | 
MeanAbsoluteError: 0.1301292032003403 | Loss: 0.0248359673117336 | Epoch: 8 | MeanAbsoluteError: 0.0920179784297943 | Loss: 0.0133763144687308 | Epoch: 9 | MeanAbsoluteError: 0.1702187657356262 | Loss: 0.0372787415246038 | Epoch: 10 | MeanAbsoluteError: 0.0864455699920654 | Loss: 0.0109137440664007 | Epoch: 11 | 
MeanAbsoluteError: 0.0618227720260620 | Loss: 0.0063364888529146 | Epoch: 12 | MeanAbsoluteError: 0.0740733444690704 | Loss: 0.0089116764812436 | Epoch: 13 | MeanAbsoluteError: 0.0781511515378952 | Loss: 0.0098323904921448 | Epoch: 14 | MeanAbsoluteError: 0.1336168795824051 | Loss: 0.0214700098884733 | Epoch: 15 | 
MeanAbsoluteError: 0.0972406193614006 | Loss: 0.0127034277875761 | Epoch: 16 | MeanAbsoluteError: 0.1216661483049393 | Loss: 0.0185365356308849 | Epoch: 17 | MeanAbsoluteError: 0.1235914602875710 | Loss: 0.0182898343834830 | Epoch: 18 | MeanAbsoluteError: 0.0641001611948013 | Loss: 0.0064767005770639 | Epoch: 19 | 
MeanAbsoluteError: 0.1034787893295288 | Loss: 0.0135908842478928 | Epoch: 20 | MeanAbsoluteError: 0.1171517297625542 | Loss: 0.0178285199340041 | Epoch: 21 | MeanAbsoluteError: 0.0469146370887756 | Loss: 0.0039287728309558 | Epoch: 22 | MeanAbsoluteError: 0.0652711391448975 | Loss: 0.0062761867210563 | Epoch: 23 | 
MeanAbsoluteError: 0.0584483332931995 | Loss: 0.0053154195223837 | Epoch: 24 | MeanAbsoluteError: 0.0616878718137741 | Loss: 0.0063272681467137 | Epoch: 25 | MeanAbsoluteError: 0.0761990919709206 | Loss: 0.0077292629529869 | Epoch: 26 | MeanAbsoluteError: 0.1596315205097198 | Loss: 0.0292793917959850 | Epoch: 27 | 
MeanAbsoluteError: 0.0687899366021156 | Loss: 0.0063495487464886 | Epoch: 28 | MeanAbsoluteError: 0.0584662519395351 | Loss: 0.0053630514670850 | Epoch: 29 | MeanAbsoluteError: 0.0660423934459686 | Loss: 0.0068905997001198 | Epoch: 30 | MeanAbsoluteError: 0.1544043421745300 | Loss: 0.0277340222444189 | Epoch: 31 | 
MeanAbsoluteError: 0.0557027310132980 | Loss: 0.0054981975362783 | Epoch: 32 | MeanAbsoluteError: 0.0597739778459072 | Loss: 0.0047285030105788 | Epoch: 33 | MeanAbsoluteError: 0.0788968205451965 | Loss: 0.0080578588071818 | Epoch: 34 | 
MeanAbsoluteError: 0.0780604854226112 | Loss: 0.0080844750198977 | Epoch: 35 | MeanAbsoluteError: 0.0499155372381210 | Loss: 0.0037250397451173 | Epoch: 36 | MeanAbsoluteError: 0.0381345413625240 | Loss: 0.0021513511080564 | Epoch: 37 | MeanAbsoluteError: 0.0432948693633080 | Loss: 0.0030143020236497 | Epoch: 38 | 
MeanAbsoluteError: 0.0486651435494423 | Loss: 0.0042370011766539 | Epoch: 39 | MeanAbsoluteError: 0.0963760092854500 | Loss: 0.0112078578799571 | Epoch: 40 | MeanAbsoluteError: 0.0856875330209732 | Loss: 0.0096293318967678 | Epoch: 41 | MeanAbsoluteError: 0.0349216461181641 | Loss: 0.0024065763174899 | Epoch: 42 | 
MeanAbsoluteError: 0.0813871771097183 | Loss: 0.0083017653761137 | Epoch: 43 | MeanAbsoluteError: 0.0707879289984703 | Loss: 0.0069443789237228 | Epoch: 44 | MeanAbsoluteError: 0.0366703495383263 | Loss: 0.0026067191172747 | Epoch: 45 | MeanAbsoluteError: 0.0431893505156040 | Loss: 0.0029295591949975 | Epoch: 46 | 
MeanAbsoluteError: 0.0353074669837952 | Loss: 0.0023966342230683 | Epoch: 47 | MeanAbsoluteError: 0.0790981501340866 | Loss: 0.0077035885095890 | Epoch: 48 | MeanAbsoluteError: 0.0388236008584499 | Loss: 0.0027053273645977 | Epoch: 49 | MeanAbsoluteError: 0.0338908210396767 | Loss: 0.0022864458220092 | Epoch: 50 | 
MeanAbsoluteError: 0.0859320834279060 | Loss: 0.0089933298846805 | Epoch: 51 | MeanAbsoluteError: 0.0459516160190105 | Loss: 0.0030370979312513 | Epoch: 52 | MeanAbsoluteError: 0.0691199377179146 | Loss: 0.0060503205750138 | Epoch: 53 | MeanAbsoluteError: 0.0618400312960148 | Loss: 0.0055092778485759 | Epoch: 54 | 
MeanAbsoluteError: 0.0805207639932632 | Loss: 0.0079827956107788 | Epoch: 55 | MeanAbsoluteError: 0.0629020035266876 | Loss: 0.0055336537648385 | Epoch: 56 | MeanAbsoluteError: 0.0525086075067520 | Loss: 0.0041749019904895 | Epoch: 57 | MeanAbsoluteError: 0.0765953063964844 | Loss: 0.0083759495502914 | Epoch: 58 | 
MeanAbsoluteError: 0.0560604855418205 | Loss: 0.0046339860725168 | Epoch: 59 | MeanAbsoluteError: 0.0591124966740608 | Loss: 0.0050711241201498 | Epoch: 60 | MeanAbsoluteError: 0.0464487448334694 | Loss: 0.0033754461665491 | Epoch: 61 | MeanAbsoluteError: 0.0616556033492088 | Loss: 0.0050701380915646 | Epoch: 62 | 
MeanAbsoluteError: 0.0319836065173149 | Loss: 0.0017065389294753 | Epoch: 63 | MeanAbsoluteError: 0.0457256846129894 | Loss: 0.0035619183189211 | Epoch: 64 | MeanAbsoluteError: 0.0632246732711792 | Loss: 0.0061981225245338 | Epoch: 65 | MeanAbsoluteError: 0.0628468841314316 | Loss: 0.0063809089999842 | Epoch: 66 | 
MeanAbsoluteError: 0.0926478281617165 | Loss: 0.0105614383263808 | Epoch: 67 | MeanAbsoluteError: 0.0652354210615158 | Loss: 0.0055359265534207 | Epoch: 68 | MeanAbsoluteError: 0.0358318462967873 | Loss: 0.0023979616265646 | Epoch: 69 | MeanAbsoluteError: 0.0369929261505604 | Loss: 0.0025769700763416 | Epoch: 70 | 
MeanAbsoluteError: 0.0569209344685078 | Loss: 0.0049989201591081 | Epoch: 71 | MeanAbsoluteError: 0.0693854615092278 | Loss: 0.0069586352053049 | Epoch: 72 | MeanAbsoluteError: 0.1012104153633118 | Loss: 0.0115599578467051 | Epoch: 73 | MeanAbsoluteError: 0.0640594139695168 | Loss: 0.0060198672213837 | Epoch: 74 | 
MeanAbsoluteError: 0.0441990233957767 | Loss: 0.0030880957125000 | Epoch: 75 | MeanAbsoluteError: 0.0316720530390739 | Loss: 0.0021496313167613 | Epoch: 76 | MeanAbsoluteError: 0.0285287126898766 | Loss: 0.0015454786947598 | Epoch: 77 | MeanAbsoluteError: 0.0534472540020943 | Loss: 0.0045489685787623 | Epoch: 78 | 
MeanAbsoluteError: 0.0440044514834881 | Loss: 0.0028492274991310 | Epoch: 79 | MeanAbsoluteError: 0.0318125225603580 | Loss: 0.0022441958893691 | Epoch: 80 | MeanAbsoluteError: 0.0384223051369190 | Loss: 0.0027008446034559 | Epoch: 81 | MeanAbsoluteError: 0.0705695599317551 | Loss: 0.0067415590410268 | Epoch: 82 | 
MeanAbsoluteError: 0.0447182692587376 | Loss: 0.0032265477286848 | Epoch: 83 | MeanAbsoluteError: 0.0383287332952023 | Loss: 0.0023734707562988 | Epoch: 84 | MeanAbsoluteError: 0.0811735540628433 | Loss: 0.0079978436819817 | Epoch: 85 | MeanAbsoluteError: 0.0492363348603249 | Loss: 0.0036681449319555 | Epoch: 86 | 
MeanAbsoluteError: 0.0399366281926632 | Loss: 0.0024037688884786 | Epoch: 87 | MeanAbsoluteError: 0.0413369759917259 | Loss: 0.0029510575971615 | Epoch: 88 | MeanAbsoluteError: 0.0582383461296558 | Loss: 0.0041568922062748 | Epoch: 89 | MeanAbsoluteError: 0.0561642013490200 | Loss: 0.0043097041504409 | Epoch: 90 | 
MeanAbsoluteError: 0.0356510058045387 | Loss: 0.0024450175804209 | Epoch: 91 | MeanAbsoluteError: 0.0407227911055088 | Loss: 0.0024868458981234 | Epoch: 92 | MeanAbsoluteError: 0.0317498296499252 | Loss: 0.0020718688166725 | Epoch: 93 | MeanAbsoluteError: 0.0326390191912651 | Loss: 0.0020079248191139 | Epoch: 94 | 
MeanAbsoluteError: 0.0493461266160011 | Loss: 0.0040166056577092 | Epoch: 95 | MeanAbsoluteError: 0.0825998783111572 | Loss: 0.0083545166754017 | Epoch: 96 | MeanAbsoluteError: 0.0667102113366127 | Loss: 0.0057614839476484 | Epoch: 97 | MeanAbsoluteError: 0.0772523358464241 | Loss: 0.0073698044411446 | Epoch: 98 | 
MeanAbsoluteError: 0.0319283008575439 | Loss: 0.0018072337131200 | Epoch: 99 | MeanAbsoluteError: 0.0816550105810165 | Loss: 0.0086567116913533 | Epoch: 100 | MeanAbsoluteError: 0.0253611523658037 | Loss: 0.0013047145082390 | Epoch: 101 | MeanAbsoluteError: 0.0785370245575905 | Loss: 0.0076281747498893 | Epoch: 102 | 
MeanAbsoluteError: 0.0253805406391621 | Loss: 0.0015186642822779 | Epoch: 103 | MeanAbsoluteError: 0.0613956116139889 | Loss: 0.0057200843339639 | Epoch: 104 | MeanAbsoluteError: 0.0938466861844063 | Loss: 0.0098868786406360 | Epoch: 105 | 
MeanAbsoluteError: 0.0556458160281181 | Loss: 0.0044113906363859 | Epoch: 106 | MeanAbsoluteError: 0.0352439619600773 | Loss: 0.0023212766996278 | Epoch: 107 | MeanAbsoluteError: 0.0315434597432613 | Loss: 0.0019621336893914 | Epoch: 108 | MeanAbsoluteError: 0.0457984097301960 | Loss: 0.0035203659101267 | Epoch: 109 | 
MeanAbsoluteError: 0.0330135263502598 | Loss: 0.0017260538297705 | Epoch: 110 | MeanAbsoluteError: 0.0308540053665638 | Loss: 0.0018586280677578 | Epoch: 111 | MeanAbsoluteError: 0.0316943787038326 | Loss: 0.0021485443476673 | Epoch: 112 | MeanAbsoluteError: 0.0391510799527168 | Loss: 0.0029566771914496 | Epoch: 113 | 
MeanAbsoluteError: 0.0282119661569595 | Loss: 0.0014895923810208 | Epoch: 114 | MeanAbsoluteError: 0.0298472754657269 | Loss: 0.0016312472840869 | Epoch: 115 | MeanAbsoluteError: 0.0495871528983116 | Loss: 0.0032455842991016 | Epoch: 116 | MeanAbsoluteError: 0.0328770391643047 | Loss: 0.0021653914522367 | Epoch: 117 | 
MeanAbsoluteError: 0.0378827340900898 | Loss: 0.0030827897924035 | Epoch: 118 | MeanAbsoluteError: 0.0720904916524887 | Loss: 0.0073881856974606 | Epoch: 119 | MeanAbsoluteError: 0.0302197840064764 | Loss: 0.0013594284253869 | Epoch: 120 | MeanAbsoluteError: 0.0275334510952234 | Loss: 0.0014433852216155 | Epoch: 121 | 
MeanAbsoluteError: 0.0542115345597267 | Loss: 0.0036980819667837 | Epoch: 122 | MeanAbsoluteError: 0.0496502183377743 | Loss: 0.0032673369982819 | Epoch: 123 | MeanAbsoluteError: 0.0294468402862549 | Loss: 0.0015348586825176 | Epoch: 124 | MeanAbsoluteError: 0.0491634830832481 | Loss: 0.0037221840497008 | Epoch: 125 | 
MeanAbsoluteError: 0.0589740760624409 | Loss: 0.0058027939766792 | Epoch: 126 | MeanAbsoluteError: 0.0293857604265213 | Loss: 0.0015178054347512 | Epoch: 127 | MeanAbsoluteError: 0.0623869001865387 | Loss: 0.0047659733773846 | Epoch: 128 | MeanAbsoluteError: 0.0329865291714668 | Loss: 0.0018144440170880 | Epoch: 129 | 
MeanAbsoluteError: 0.0284435153007507 | Loss: 0.0015525735086014 | Epoch: 130 | MeanAbsoluteError: 0.0283574797213078 | Loss: 0.0014997565081821 | Epoch: 131 | MeanAbsoluteError: 0.0785648897290230 | Loss: 0.0075077092777447 | Epoch: 132 | MeanAbsoluteError: 0.0347967259585857 | Loss: 0.0018465771718184 | Early stopping at epoch 131
Returned to Spot: Validation loss: 0.0018465771718183532

If path is set to a filename, e.g., path = "model_spot_trained.pt", the weights of the trained model will be loaded from this file.

test_tuned(net=model_spot, test_dataset=test,
            shuffle=False,
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            device = fun_control["device"],
            task=fun_control["task"],)
MeanAbsoluteError: 0.0362048856914043 | Loss: 0.0019534178973117 | Final evaluation: Validation loss: 0.0019534178973117378
Final evaluation: Validation metric: 0.03620488569140434
----------------------------------------------
(0.0019534178973117378, nan, tensor(0.0362))

19.10.3 Cross-validated Evaluations

  • This is the evaluation that will be used in the comparison (evaluatecv has to be updated before, to get metric vlaues!):
from spotPython.torch.traintest import evaluate_cv
# modify k-kolds:
setattr(model_spot, "k_folds",  10)
df_eval, df_preds, df_metrics = evaluate_cv(net=model_spot,
            dataset=fun_control["data"],
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            task=fun_control["task"],
            writer=fun_control["writer"],
            writerId="model_spot_cv",
            device = fun_control["device"])
Fold: 1
Epoch: 1 | MeanAbsoluteError: 0.1618047505617142 | Loss: 0.0394422174789585 | Epoch: 2 | 
MeanAbsoluteError: 0.0948168635368347 | Loss: 0.0141746504590488 | Epoch: 3 | MeanAbsoluteError: 0.0821267440915108 | Loss: 0.0107249320269777 | Epoch: 4 | 
MeanAbsoluteError: 0.0913791954517365 | Loss: 0.0127206999235428 | Epoch: 5 | MeanAbsoluteError: 0.0598355084657669 | Loss: 0.0056427746760444 | Epoch: 6 | 
MeanAbsoluteError: 0.0670675933361053 | Loss: 0.0079651997388842 | Epoch: 7 | MeanAbsoluteError: 0.1292499303817749 | Loss: 0.0211380985207283 | Epoch: 8 | 
MeanAbsoluteError: 0.1018431410193443 | Loss: 0.0132685123512951 | Epoch: 9 | MeanAbsoluteError: 0.0542722977697849 | Loss: 0.0051638167441035 | Epoch: 10 | 
MeanAbsoluteError: 0.0775565877556801 | Loss: 0.0098437746592726 | Epoch: 11 | MeanAbsoluteError: 0.0937005728483200 | Loss: 0.0114590499478464 | Epoch: 12 | 
MeanAbsoluteError: 0.0553506389260292 | Loss: 0.0042343608802184 | Epoch: 13 | MeanAbsoluteError: 0.1231693550944328 | Loss: 0.0178886598262649 | Epoch: 14 | 
MeanAbsoluteError: 0.0724197700619698 | Loss: 0.0086849843724989 | Epoch: 15 | MeanAbsoluteError: 0.0601353347301483 | Loss: 0.0058145349433359 | Epoch: 16 | 
MeanAbsoluteError: 0.0443972237408161 | Loss: 0.0034246930870442 | Epoch: 17 | MeanAbsoluteError: 0.0525197349488735 | Loss: 0.0043401776884611 | Epoch: 18 | 
MeanAbsoluteError: 0.0570652782917023 | Loss: 0.0047597716060969 | Epoch: 19 | MeanAbsoluteError: 0.0543795153498650 | Loss: 0.0054893779765385 | Epoch: 20 | 
MeanAbsoluteError: 0.0432649999856949 | Loss: 0.0029426976644362 | Epoch: 21 | MeanAbsoluteError: 0.0361913293600082 | Loss: 0.0027457713149488 | Epoch: 22 | 
MeanAbsoluteError: 0.0645979940891266 | Loss: 0.0059385592153726 | Epoch: 23 | MeanAbsoluteError: 0.0960647761821747 | Loss: 0.0117363586412886 | Epoch: 24 | 
MeanAbsoluteError: 0.0365579873323441 | Loss: 0.0024502074005655 | Epoch: 25 | MeanAbsoluteError: 0.0616183169186115 | Loss: 0.0054446791047947 | Epoch: 26 | 
MeanAbsoluteError: 0.0322105512022972 | Loss: 0.0017122150479386 | Epoch: 27 | MeanAbsoluteError: 0.0895606502890587 | Loss: 0.0105132291523310 | Epoch: 28 | 
MeanAbsoluteError: 0.0573455579578876 | Loss: 0.0051780047002607 | Epoch: 29 | MeanAbsoluteError: 0.0312262102961540 | Loss: 0.0017386589964959 | Epoch: 30 | 
MeanAbsoluteError: 0.0529483743011951 | Loss: 0.0053945709861672 | Epoch: 31 | MeanAbsoluteError: 0.0695150643587112 | Loss: 0.0059437921557289 | Epoch: 32 | 
MeanAbsoluteError: 0.0374334193766117 | Loss: 0.0026350526649577 | Epoch: 33 | MeanAbsoluteError: 0.0425673685967922 | Loss: 0.0026405658662462 | Epoch: 34 | 
MeanAbsoluteError: 0.0649197697639465 | Loss: 0.0066424999744273 | Epoch: 35 | MeanAbsoluteError: 0.0320014618337154 | Loss: 0.0017401188043340 | Epoch: 36 | 
MeanAbsoluteError: 0.0379110276699066 | Loss: 0.0021584174604728 | Epoch: 37 | MeanAbsoluteError: 0.0313809663057327 | Loss: 0.0017957171971480 | Epoch: 38 | 
MeanAbsoluteError: 0.0689054951071739 | Loss: 0.0069304433328888 | Epoch: 39 | MeanAbsoluteError: 0.0712393447756767 | Loss: 0.0070008190277104 | Epoch: 40 | 
MeanAbsoluteError: 0.0774688571691513 | Loss: 0.0082886646358440 | Epoch: 41 | MeanAbsoluteError: 0.0474285706877708 | Loss: 0.0032272364747209 | Epoch: 42 | 
MeanAbsoluteError: 0.0803026407957077 | Loss: 0.0073229097761214 | Epoch: 43 | MeanAbsoluteError: 0.0363925658166409 | Loss: 0.0020434111714936 | Epoch: 44 | 
MeanAbsoluteError: 0.0545536242425442 | Loss: 0.0049339817353309 | Epoch: 45 | MeanAbsoluteError: 0.0352949351072311 | Loss: 0.0025646976831083 | Epoch: 46 | 
MeanAbsoluteError: 0.0491816811263561 | Loss: 0.0031038886562993 | Epoch: 47 | MeanAbsoluteError: 0.0633549764752388 | Loss: 0.0051773153782751 | Epoch: 48 | 
MeanAbsoluteError: 0.0338786877691746 | Loss: 0.0020380532480955 | Epoch: 49 | MeanAbsoluteError: 0.0579497329890728 | Loss: 0.0041638990828338 | Epoch: 50 | 
MeanAbsoluteError: 0.0299410913139582 | Loss: 0.0017625350290193 | Epoch: 51 | MeanAbsoluteError: 0.0759929493069649 | Loss: 0.0072865994611325 | Epoch: 52 | 
MeanAbsoluteError: 0.0308872535824776 | Loss: 0.0018491343989109 | Epoch: 53 | MeanAbsoluteError: 0.0891566649079323 | Loss: 0.0102489839952726 | Epoch: 54 | 
MeanAbsoluteError: 0.0261515323072672 | Loss: 0.0012303415927678 | Epoch: 55 | MeanAbsoluteError: 0.0560870207846165 | Loss: 0.0042396391598651 | Epoch: 56 | 
MeanAbsoluteError: 0.0305423717945814 | Loss: 0.0020965277318073 | Epoch: 57 | MeanAbsoluteError: 0.1082722842693329 | Loss: 0.0148260296107485 | Epoch: 58 | 
MeanAbsoluteError: 0.0310138911008835 | Loss: 0.0021432984324817 | Epoch: 59 | MeanAbsoluteError: 0.0362440459430218 | Loss: 0.0022657999741988 | Epoch: 60 | 
MeanAbsoluteError: 0.0278909578919411 | Loss: 0.0016212499109455 | Epoch: 61 | MeanAbsoluteError: 0.0307350065559149 | Loss: 0.0012876898623430 | Epoch: 62 | 
MeanAbsoluteError: 0.0358627326786518 | Loss: 0.0019277437464692 | Epoch: 63 | MeanAbsoluteError: 0.0280392076820135 | Loss: 0.0014673817114761 | Epoch: 64 | 
MeanAbsoluteError: 0.0428690947592258 | Loss: 0.0028987330778574 | Epoch: 65 | MeanAbsoluteError: 0.0576479397714138 | Loss: 0.0051042788859027 | Epoch: 66 | 
MeanAbsoluteError: 0.0324590206146240 | Loss: 0.0020066216820851 | Epoch: 67 | MeanAbsoluteError: 0.0551687255501747 | Loss: 0.0039030958074503 | Epoch: 68 | 
MeanAbsoluteError: 0.0372074879705906 | Loss: 0.0019988693887941 | Epoch: 69 | MeanAbsoluteError: 0.0325563065707684 | Loss: 0.0018911197996483 | Epoch: 70 | 
MeanAbsoluteError: 0.0469849854707718 | Loss: 0.0033260236064402 | Epoch: 71 | MeanAbsoluteError: 0.0240812972187996 | Loss: 0.0014303888243516 | Epoch: 72 | 
MeanAbsoluteError: 0.0613652132451534 | Loss: 0.0043922790791839 | Epoch: 73 | MeanAbsoluteError: 0.0335457883775234 | Loss: 0.0018916126371970 | Epoch: 74 | 
MeanAbsoluteError: 0.0326935388147831 | Loss: 0.0021480596534765 | Epoch: 75 | MeanAbsoluteError: 0.0328181087970734 | Loss: 0.0015986603371298 | Epoch: 76 | 
MeanAbsoluteError: 0.0729192495346069 | Loss: 0.0069603923564920 | Epoch: 77 | MeanAbsoluteError: 0.0478911027312279 | Loss: 0.0033632888404939 | Epoch: 78 | 
MeanAbsoluteError: 0.0352767892181873 | Loss: 0.0017835934682248 | Epoch: 79 | MeanAbsoluteError: 0.0862318500876427 | Loss: 0.0085684736975684 | Epoch: 80 | 
MeanAbsoluteError: 0.0846154689788818 | Loss: 0.0088662661146373 | Epoch: 81 | MeanAbsoluteError: 0.0463497154414654 | Loss: 0.0031633907123111 | Epoch: 82 | 
MeanAbsoluteError: 0.0338572300970554 | Loss: 0.0017945189230466 | Epoch: 83 | MeanAbsoluteError: 0.0370304137468338 | Loss: 0.0023098792567348 | Epoch: 84 | 
MeanAbsoluteError: 0.0377095714211464 | Loss: 0.0023885265064354 | Epoch: 85 | MeanAbsoluteError: 0.0347837135195732 | Loss: 0.0024837391728607 | Epoch: 86 | 
MeanAbsoluteError: 0.0580969750881195 | Loss: 0.0039928689724408 | Early stopping at epoch 85
Fold: 2
Epoch: 1 | MeanAbsoluteError: 0.1210427284240723 | Loss: 0.0232378422425917 | Epoch: 2 | 
MeanAbsoluteError: 0.0971136540174484 | Loss: 0.0145270234117141 | Epoch: 3 | MeanAbsoluteError: 0.1082396730780602 | Loss: 0.0167163557086426 | Epoch: 4 | 
MeanAbsoluteError: 0.0941592678427696 | Loss: 0.0136342877880312 | Epoch: 5 | MeanAbsoluteError: 0.1127286031842232 | Loss: 0.0175349722043253 | Epoch: 6 | 
MeanAbsoluteError: 0.0576534420251846 | Loss: 0.0057649175242449 | Epoch: 7 | MeanAbsoluteError: 0.0717851445078850 | Loss: 0.0073035650600034 | Epoch: 8 | 
MeanAbsoluteError: 0.0551515594124794 | Loss: 0.0052624709832554 | Epoch: 9 | MeanAbsoluteError: 0.0639993399381638 | Loss: 0.0063609613571316 | Epoch: 10 | 
MeanAbsoluteError: 0.0574899241328239 | Loss: 0.0052092311939654 | Epoch: 11 | MeanAbsoluteError: 0.0511795468628407 | Loss: 0.0044416818731966 | Epoch: 12 | 
MeanAbsoluteError: 0.0916891843080521 | Loss: 0.0108246649973668 | Epoch: 13 | MeanAbsoluteError: 0.0635578036308289 | Loss: 0.0055400849355815 | Epoch: 14 | 
MeanAbsoluteError: 0.0474723912775517 | Loss: 0.0032757236264073 | Epoch: 15 | MeanAbsoluteError: 0.0455380119383335 | Loss: 0.0042995981684026 | Epoch: 16 | 
MeanAbsoluteError: 0.0662908628582954 | Loss: 0.0076314375485079 | Epoch: 17 | MeanAbsoluteError: 0.0895552560687065 | Loss: 0.0099806159089964 | Epoch: 18 | 
MeanAbsoluteError: 0.0578889809548855 | Loss: 0.0054974844947887 | Epoch: 19 | MeanAbsoluteError: 0.0413420200347900 | Loss: 0.0035049886568091 | Epoch: 20 | 
MeanAbsoluteError: 0.0409970618784428 | Loss: 0.0031804373093809 | Epoch: 21 | MeanAbsoluteError: 0.0565304942429066 | Loss: 0.0051717226429341 | Epoch: 22 | 
MeanAbsoluteError: 0.0581042952835560 | Loss: 0.0053307732674651 | Epoch: 23 | MeanAbsoluteError: 0.0562559217214584 | Loss: 0.0043826545230471 | Epoch: 24 | 
MeanAbsoluteError: 0.0790787190198898 | Loss: 0.0077061902803297 | Epoch: 25 | MeanAbsoluteError: 0.0663733556866646 | Loss: 0.0067779881736407 | Epoch: 26 | 
MeanAbsoluteError: 0.0446581616997719 | Loss: 0.0027957009241128 | Epoch: 27 | MeanAbsoluteError: 0.0651144385337830 | Loss: 0.0062882552245775 | Epoch: 28 | 
MeanAbsoluteError: 0.0584244057536125 | Loss: 0.0042952514038636 | Epoch: 29 | MeanAbsoluteError: 0.0362142883241177 | Loss: 0.0030877480569940 | Epoch: 30 | 
MeanAbsoluteError: 0.0634226948022842 | Loss: 0.0053216522165502 | Epoch: 31 | MeanAbsoluteError: 0.0558205507695675 | Loss: 0.0040538682279965 | Epoch: 32 | 
MeanAbsoluteError: 0.0327978432178497 | Loss: 0.0021329234766129 | Epoch: 33 | MeanAbsoluteError: 0.0594015568494797 | Loss: 0.0055378245350976 | Epoch: 34 | 
MeanAbsoluteError: 0.0735566541552544 | Loss: 0.0066518652825975 | Epoch: 35 | MeanAbsoluteError: 0.0628775656223297 | Loss: 0.0068512232884621 | Epoch: 36 | 
MeanAbsoluteError: 0.0507698543369770 | Loss: 0.0044060353762828 | Epoch: 37 | MeanAbsoluteError: 0.0471728667616844 | Loss: 0.0041673505374302 | Epoch: 38 | 
MeanAbsoluteError: 0.0340292416512966 | Loss: 0.0019375911125770 | Epoch: 39 | MeanAbsoluteError: 0.0503892265260220 | Loss: 0.0041683715087577 | Epoch: 40 | 
MeanAbsoluteError: 0.0952877774834633 | Loss: 0.0101471229169804 | Epoch: 41 | MeanAbsoluteError: 0.0386420190334320 | Loss: 0.0025232952141848 | Epoch: 42 | 
MeanAbsoluteError: 0.0570842325687408 | Loss: 0.0045551993490125 | Epoch: 43 | MeanAbsoluteError: 0.1012826561927795 | Loss: 0.0111592142627789 | Epoch: 44 | 
MeanAbsoluteError: 0.0544559583067894 | Loss: 0.0043733635057624 | Epoch: 45 | MeanAbsoluteError: 0.0253615472465754 | Loss: 0.0014648897743497 | Epoch: 46 | 
MeanAbsoluteError: 0.0533788762986660 | Loss: 0.0041271784150292 | Epoch: 47 | MeanAbsoluteError: 0.0447540134191513 | Loss: 0.0033322268237288 | Epoch: 48 | 
MeanAbsoluteError: 0.0498334281146526 | Loss: 0.0033228628677674 | Epoch: 49 | MeanAbsoluteError: 0.0661871507763863 | Loss: 0.0066973534054481 | Epoch: 50 | 
MeanAbsoluteError: 0.1092068180441856 | Loss: 0.0138584222071446 | Epoch: 51 | MeanAbsoluteError: 0.0472214035689831 | Loss: 0.0032750072333818 | Epoch: 52 | 
MeanAbsoluteError: 0.0257588960230350 | Loss: 0.0013870140201806 | Epoch: 53 | MeanAbsoluteError: 0.0462865680456161 | Loss: 0.0035545551934494 | Epoch: 54 | 
MeanAbsoluteError: 0.0330822132527828 | Loss: 0.0016881228478339 | Epoch: 55 | MeanAbsoluteError: 0.0646588876843452 | Loss: 0.0052432517449443 | Epoch: 56 | 
MeanAbsoluteError: 0.0334593765437603 | Loss: 0.0021068099259327 | Epoch: 57 | MeanAbsoluteError: 0.0272022839635611 | Loss: 0.0013308256188443 | Epoch: 58 | 
MeanAbsoluteError: 0.0374362431466579 | Loss: 0.0028740897541866 | Epoch: 59 | MeanAbsoluteError: 0.0386285670101643 | Loss: 0.0025590753379779 | Epoch: 60 | 
MeanAbsoluteError: 0.0476181395351887 | Loss: 0.0032054041422760 | Epoch: 61 | MeanAbsoluteError: 0.0559419728815556 | Loss: 0.0044539202398692 | Epoch: 62 | 
MeanAbsoluteError: 0.0221635792404413 | Loss: 0.0015338865274456 | Epoch: 63 | MeanAbsoluteError: 0.0278351996093988 | Loss: 0.0018524339628549 | Epoch: 64 | 
MeanAbsoluteError: 0.0344574041664600 | Loss: 0.0022858139217043 | Epoch: 65 | MeanAbsoluteError: 0.0418969430029392 | Loss: 0.0030333722287861 | Epoch: 66 | 
MeanAbsoluteError: 0.0327552743256092 | Loss: 0.0020217526448855 | Epoch: 67 | MeanAbsoluteError: 0.0496373213827610 | Loss: 0.0033627718579597 | Epoch: 68 | 
MeanAbsoluteError: 0.0421554371714592 | Loss: 0.0023812933986147 | Epoch: 69 | MeanAbsoluteError: 0.0243937131017447 | Loss: 0.0014644278260396 | Epoch: 70 | 
MeanAbsoluteError: 0.0337637700140476 | Loss: 0.0027833441003727 | Epoch: 71 | MeanAbsoluteError: 0.0318746082484722 | Loss: 0.0021676858931852 | Epoch: 72 | 
MeanAbsoluteError: 0.0341422557830811 | Loss: 0.0019972750675291 | Epoch: 73 | MeanAbsoluteError: 0.0472048744559288 | Loss: 0.0038978335752080 | Epoch: 74 | 
MeanAbsoluteError: 0.0273774806410074 | Loss: 0.0013954009135397 | Epoch: 75 | MeanAbsoluteError: 0.0201969463378191 | Loss: 0.0008769651131633 | Epoch: 76 | 
MeanAbsoluteError: 0.0364593453705311 | Loss: 0.0023139983129043 | Epoch: 77 | MeanAbsoluteError: 0.0677185878157616 | Loss: 0.0054784645505536 | Epoch: 78 | 
MeanAbsoluteError: 0.0466333962976933 | Loss: 0.0025956316743619 | Epoch: 79 | MeanAbsoluteError: 0.0608448646962643 | Loss: 0.0046451351282975 | Epoch: 80 | 
MeanAbsoluteError: 0.0425164140760899 | Loss: 0.0032064071632563 | Epoch: 81 | MeanAbsoluteError: 0.0440618991851807 | Loss: 0.0027699935196254 | Epoch: 82 | 
MeanAbsoluteError: 0.0778444558382034 | Loss: 0.0071815219886888 | Epoch: 83 | MeanAbsoluteError: 0.0308453440666199 | Loss: 0.0016489740877520 | Epoch: 84 | 
MeanAbsoluteError: 0.0302984956651926 | Loss: 0.0017717327886763 | Epoch: 85 | MeanAbsoluteError: 0.0279617309570312 | Loss: 0.0014760369443908 | Epoch: 86 | 
MeanAbsoluteError: 0.0493060834705830 | Loss: 0.0034059206417833 | Epoch: 87 | MeanAbsoluteError: 0.0304992459714413 | Loss: 0.0020885650659553 | Epoch: 88 | 
MeanAbsoluteError: 0.0381759330630302 | Loss: 0.0022709620176241 | Epoch: 89 | MeanAbsoluteError: 0.0434022992849350 | Loss: 0.0045287668293055 | Epoch: 90 | 
MeanAbsoluteError: 0.0505503304302692 | Loss: 0.0033935281770447 | Epoch: 91 | MeanAbsoluteError: 0.0354275815188885 | Loss: 0.0021154315819821 | Epoch: 92 | 
MeanAbsoluteError: 0.0356516614556313 | Loss: 0.0020675322963283 | Epoch: 93 | MeanAbsoluteError: 0.0399623215198517 | Loss: 0.0023545790821887 | Epoch: 94 | 
MeanAbsoluteError: 0.0703497678041458 | Loss: 0.0053893277027573 | Epoch: 95 | MeanAbsoluteError: 0.0316573493182659 | Loss: 0.0016984358953778 | Epoch: 96 | 
MeanAbsoluteError: 0.0345632173120975 | Loss: 0.0026033959696248 | Epoch: 97 | MeanAbsoluteError: 0.0486009232699871 | Loss: 0.0030947438835238 | Epoch: 98 | 
MeanAbsoluteError: 0.0295199174433947 | Loss: 0.0016001898822231 | Epoch: 99 | MeanAbsoluteError: 0.0240722522139549 | Loss: 0.0012215821927664 | Epoch: 100 | 
MeanAbsoluteError: 0.0251525696367025 | Loss: 0.0010048355347513 | Epoch: 101 | MeanAbsoluteError: 0.0320860780775547 | Loss: 0.0015870903309685 | Epoch: 102 | 
MeanAbsoluteError: 0.0552912652492523 | Loss: 0.0045466636164257 | Epoch: 103 | MeanAbsoluteError: 0.0280942562967539 | Loss: 0.0016389358676791 | Epoch: 104 | 
MeanAbsoluteError: 0.0369178503751755 | Loss: 0.0022814114748214 | Epoch: 105 | MeanAbsoluteError: 0.0380741730332375 | Loss: 0.0026458789361641 | Epoch: 106 | 
MeanAbsoluteError: 0.0337572507560253 | Loss: 0.0018191981138303 | Epoch: 107 | MeanAbsoluteError: 0.0501131974160671 | Loss: 0.0031544054195715 | Early stopping at epoch 106
Fold: 3
Epoch: 1 | 
MeanAbsoluteError: 0.1106576845049858 | Loss: 0.0189367327480935 | Epoch: 2 | MeanAbsoluteError: 0.0824960693717003 | Loss: 0.0101787202740805 | Epoch: 3 | 
MeanAbsoluteError: 0.0982738807797432 | Loss: 0.0140791730238841 | Epoch: 4 | MeanAbsoluteError: 0.1074456945061684 | Loss: 0.0150275832185378 | Epoch: 5 | 
MeanAbsoluteError: 0.1125353351235390 | Loss: 0.0161447196554106 | Epoch: 6 | MeanAbsoluteError: 0.0472255498170853 | Loss: 0.0035851755931687 | Epoch: 7 | MeanAbsoluteError: 0.0799888148903847 | Loss: 0.0081726278966436 | 
Epoch: 8 | MeanAbsoluteError: 0.0505995228886604 | Loss: 0.0037156348519672 | Epoch: 9 | 
MeanAbsoluteError: 0.0800606906414032 | Loss: 0.0099723924560329 | Epoch: 10 | MeanAbsoluteError: 0.0406498722732067 | Loss: 0.0032811103155836 | Epoch: 11 | 
MeanAbsoluteError: 0.0613486431539059 | Loss: 0.0054539138128838 | Epoch: 12 | MeanAbsoluteError: 0.0524198114871979 | Loss: 0.0035905207220752 | Epoch: 13 | 
MeanAbsoluteError: 0.0422636717557907 | Loss: 0.0034522012664148 | Epoch: 14 | MeanAbsoluteError: 0.0485951006412506 | Loss: 0.0039898190611544 | Epoch: 15 | 
MeanAbsoluteError: 0.0377292856574059 | Loss: 0.0022977507413508 | Epoch: 16 | MeanAbsoluteError: 0.1248728334903717 | Loss: 0.0170691285568934 | Epoch: 17 | 
MeanAbsoluteError: 0.0457675121724606 | Loss: 0.0028961827315820 | Epoch: 18 | MeanAbsoluteError: 0.0840506330132484 | Loss: 0.0093123354375936 | Epoch: 19 | 
MeanAbsoluteError: 0.0386841967701912 | Loss: 0.0023773076917188 | Epoch: 20 | MeanAbsoluteError: 0.0948448777198792 | Loss: 0.0103700400258486 | Epoch: 21 | 
MeanAbsoluteError: 0.0304872654378414 | Loss: 0.0021557314657212 | Epoch: 22 | MeanAbsoluteError: 0.0444978997111320 | Loss: 0.0038369042942157 | Epoch: 23 | 
MeanAbsoluteError: 0.0281046796590090 | Loss: 0.0012135672687481 | Epoch: 24 | MeanAbsoluteError: 0.0381292551755905 | Loss: 0.0023152525402391 | Epoch: 25 | 
MeanAbsoluteError: 0.0270831491798162 | Loss: 0.0012781705378214 | Epoch: 26 | MeanAbsoluteError: 0.0407160185277462 | Loss: 0.0025233460608153 | Epoch: 27 | 
MeanAbsoluteError: 0.0480317361652851 | Loss: 0.0031511885955786 | Epoch: 28 | MeanAbsoluteError: 0.0253189783543348 | Loss: 0.0009912751198639 | Epoch: 29 | 
MeanAbsoluteError: 0.0572737306356430 | Loss: 0.0043721814604046 | Epoch: 30 | MeanAbsoluteError: 0.0371986590325832 | Loss: 0.0020167505673061 | Epoch: 31 | 
MeanAbsoluteError: 0.0357491485774517 | Loss: 0.0022889177601498 | Epoch: 32 | MeanAbsoluteError: 0.0812306106090546 | Loss: 0.0079719146641974 | Epoch: 33 | 
MeanAbsoluteError: 0.0668872967362404 | Loss: 0.0066449732448046 | Epoch: 34 | MeanAbsoluteError: 0.0282367523759604 | Loss: 0.0017532258375118 | Epoch: 35 | 
MeanAbsoluteError: 0.0974341705441475 | Loss: 0.0113310729368375 | Epoch: 36 | MeanAbsoluteError: 0.0418497622013092 | Loss: 0.0027155633747148 | Epoch: 37 | 
MeanAbsoluteError: 0.0921027287840843 | Loss: 0.0098722960370091 | Epoch: 38 | MeanAbsoluteError: 0.0444820486009121 | Loss: 0.0032841981916975 | Epoch: 39 | 
MeanAbsoluteError: 0.0267196223139763 | Loss: 0.0020752533365829 | Epoch: 40 | MeanAbsoluteError: 0.0520577244460583 | Loss: 0.0035231751210701 | Epoch: 41 | 
MeanAbsoluteError: 0.0286450237035751 | Loss: 0.0013095136651268 | Epoch: 42 | MeanAbsoluteError: 0.0841861665248871 | Loss: 0.0078707832055023 | Epoch: 43 | 
MeanAbsoluteError: 0.0603476725518703 | Loss: 0.0055438662574698 | Epoch: 44 | MeanAbsoluteError: 0.0502706393599510 | Loss: 0.0042966067379054 | Epoch: 45 | 
MeanAbsoluteError: 0.0772638618946075 | Loss: 0.0071885076423104 | Epoch: 46 | MeanAbsoluteError: 0.0671011283993721 | Loss: 0.0052439364461372 | Epoch: 47 | 
MeanAbsoluteError: 0.0444660224020481 | Loss: 0.0026622511213645 | Epoch: 48 | MeanAbsoluteError: 0.0874466896057129 | Loss: 0.0098583904238274 | Epoch: 49 | 
MeanAbsoluteError: 0.0316732488572598 | Loss: 0.0020529174899611 | Epoch: 50 | MeanAbsoluteError: 0.0279488116502762 | Loss: 0.0013189636833536 | Epoch: 51 | 
MeanAbsoluteError: 0.1126269325613976 | Loss: 0.0149403880708493 | Epoch: 52 | MeanAbsoluteError: 0.0253227520734072 | Loss: 0.0012036828568223 | Epoch: 53 | 
MeanAbsoluteError: 0.0267635639756918 | Loss: 0.0016729601148444 | Epoch: 54 | MeanAbsoluteError: 0.0381686165928841 | Loss: 0.0025215701517971 | Epoch: 55 | 
MeanAbsoluteError: 0.0304826274514198 | Loss: 0.0020707782151966 | Epoch: 56 | MeanAbsoluteError: 0.0505411922931671 | Loss: 0.0032462998060510 | Epoch: 57 | 
MeanAbsoluteError: 0.0287924911826849 | Loss: 0.0020590132447139 | Epoch: 58 | MeanAbsoluteError: 0.0414799638092518 | Loss: 0.0023208344444776 | Epoch: 59 | 
MeanAbsoluteError: 0.0765146687626839 | Loss: 0.0071452638098540 | Epoch: 60 | MeanAbsoluteError: 0.0775769650936127 | Loss: 0.0073455982626631 | Early stopping at epoch 59
Fold: 4
Epoch: 1 | 
MeanAbsoluteError: 0.1514385640621185 | Loss: 0.0357459982713828 | Epoch: 2 | MeanAbsoluteError: 0.1605004370212555 | Loss: 0.0361737743593179 | Epoch: 3 | 
MeanAbsoluteError: 0.0806147456169128 | Loss: 0.0108424092401177 | Epoch: 4 | MeanAbsoluteError: 0.1227970793843269 | Loss: 0.0203366774635819 | Epoch: 5 | 
MeanAbsoluteError: 0.0747844353318214 | Loss: 0.0094273441220419 | Epoch: 6 | MeanAbsoluteError: 0.0862156078219414 | Loss: 0.0095506514279315 | Epoch: 7 | 
MeanAbsoluteError: 0.0722914189100266 | Loss: 0.0086861469138127 | Epoch: 8 | MeanAbsoluteError: 0.0724989399313927 | Loss: 0.0079954230190756 | Epoch: 9 | 
MeanAbsoluteError: 0.0745676234364510 | Loss: 0.0077011100052354 | Epoch: 10 | MeanAbsoluteError: 0.0491537339985371 | Loss: 0.0039134459802881 | Epoch: 11 | 
MeanAbsoluteError: 0.0700660869479179 | Loss: 0.0077364158530075 | Epoch: 12 | MeanAbsoluteError: 0.0464042536914349 | Loss: 0.0036279122488430 | Epoch: 13 | 
MeanAbsoluteError: 0.0842755809426308 | Loss: 0.0093502603435459 | Epoch: 14 | MeanAbsoluteError: 0.0664646402001381 | Loss: 0.0066575635081300 | Epoch: 15 | 
MeanAbsoluteError: 0.0827620476484299 | Loss: 0.0099086636462464 | Epoch: 16 | MeanAbsoluteError: 0.0683882832527161 | Loss: 0.0064558467935198 | Epoch: 17 | 
MeanAbsoluteError: 0.0719112083315849 | Loss: 0.0065859162535232 | Epoch: 18 | MeanAbsoluteError: 0.0973545834422112 | Loss: 0.0116373905195640 | Epoch: 19 | 
MeanAbsoluteError: 0.0839462280273438 | Loss: 0.0106433534708161 | Epoch: 20 | MeanAbsoluteError: 0.0838665515184402 | Loss: 0.0085816286289348 | Epoch: 21 | 
MeanAbsoluteError: 0.0494406186044216 | Loss: 0.0042909547337331 | Epoch: 22 | MeanAbsoluteError: 0.0521163716912270 | Loss: 0.0042309163568112 | Epoch: 23 | 
MeanAbsoluteError: 0.0596068389713764 | Loss: 0.0046383107815368 | Epoch: 24 | MeanAbsoluteError: 0.0521014221012592 | Loss: 0.0041986252226007 | Epoch: 25 | 
MeanAbsoluteError: 0.0434372238814831 | Loss: 0.0040412821242801 | Epoch: 26 | MeanAbsoluteError: 0.0365696884691715 | Loss: 0.0026817987941635 | Epoch: 27 | 
MeanAbsoluteError: 0.0420030318200588 | Loss: 0.0033097558099633 | Epoch: 28 | MeanAbsoluteError: 0.0514625608921051 | Loss: 0.0043059411243750 | Epoch: 29 | 
MeanAbsoluteError: 0.0713812410831451 | Loss: 0.0067926097231416 | Epoch: 30 | MeanAbsoluteError: 0.0479836687445641 | Loss: 0.0035191340586887 | Epoch: 31 | 
MeanAbsoluteError: 0.0400275103747845 | Loss: 0.0031396552356175 | Epoch: 32 | MeanAbsoluteError: 0.0526493266224861 | Loss: 0.0044798342188677 | Epoch: 33 | 
MeanAbsoluteError: 0.0456048399209976 | Loss: 0.0029108393937349 | Epoch: 34 | MeanAbsoluteError: 0.0385325998067856 | Loss: 0.0024958368426619 | Epoch: 35 | 
MeanAbsoluteError: 0.0454170741140842 | Loss: 0.0033794439111191 | Epoch: 36 | MeanAbsoluteError: 0.0341375172138214 | Loss: 0.0028066968370695 | Epoch: 37 | 
MeanAbsoluteError: 0.0590975955128670 | Loss: 0.0050150440074503 | Epoch: 38 | MeanAbsoluteError: 0.0276094432920218 | Loss: 0.0021367075454551 | Epoch: 39 | 
MeanAbsoluteError: 0.0327249653637409 | Loss: 0.0020687592572918 | Epoch: 40 | MeanAbsoluteError: 0.0562841556966305 | Loss: 0.0039516744347146 | Epoch: 41 | 
MeanAbsoluteError: 0.0450308769941330 | Loss: 0.0037826731210001 | Epoch: 42 | MeanAbsoluteError: 0.0715281590819359 | Loss: 0.0079610900272830 | Epoch: 43 | 
MeanAbsoluteError: 0.0262169465422630 | Loss: 0.0015466173667497 | Epoch: 44 | MeanAbsoluteError: 0.0666737332940102 | Loss: 0.0065075833207140 | Epoch: 45 | 
MeanAbsoluteError: 0.0598567016422749 | Loss: 0.0047310979571193 | Epoch: 46 | MeanAbsoluteError: 0.0375489816069603 | Loss: 0.0026907791571620 | Epoch: 47 | 
MeanAbsoluteError: 0.0341865122318268 | Loss: 0.0020197276026011 | Epoch: 48 | MeanAbsoluteError: 0.0299750156700611 | Loss: 0.0015668082901706 | Epoch: 49 | 
MeanAbsoluteError: 0.0489186793565750 | Loss: 0.0039847489410581 | Epoch: 50 | MeanAbsoluteError: 0.0662066861987114 | Loss: 0.0063510939049033 | Epoch: 51 | 
MeanAbsoluteError: 0.0466285236179829 | Loss: 0.0036128816964964 | Epoch: 52 | MeanAbsoluteError: 0.0363123603165150 | Loss: 0.0019496765274268 | Epoch: 53 | 
MeanAbsoluteError: 0.0297894421964884 | Loss: 0.0019253837862589 | Epoch: 54 | MeanAbsoluteError: 0.0772207453846931 | Loss: 0.0074105618091730 | Epoch: 55 | 
MeanAbsoluteError: 0.0391364395618439 | Loss: 0.0027718948504816 | Epoch: 56 | MeanAbsoluteError: 0.0607472322881222 | Loss: 0.0058959815472078 | Epoch: 57 | 
MeanAbsoluteError: 0.0443273447453976 | Loss: 0.0029747906194713 | Epoch: 58 | MeanAbsoluteError: 0.0565614216029644 | Loss: 0.0051450308663054 | Epoch: 59 | 
MeanAbsoluteError: 0.0366040430963039 | Loss: 0.0023358557328510 | Epoch: 60 | MeanAbsoluteError: 0.0286666657775640 | Loss: 0.0018488362212128 | Epoch: 61 | 
MeanAbsoluteError: 0.0370644293725491 | Loss: 0.0034640602848063 | Epoch: 62 | MeanAbsoluteError: 0.0363792553544044 | Loss: 0.0024923449337411 | Epoch: 63 | 
MeanAbsoluteError: 0.0481804646551609 | Loss: 0.0034175076289102 | Epoch: 64 | MeanAbsoluteError: 0.0256719868630171 | Loss: 0.0012862814093331 | Epoch: 65 | 
MeanAbsoluteError: 0.0460330620408058 | Loss: 0.0036752702390703 | Epoch: 66 | MeanAbsoluteError: 0.0517075434327126 | Loss: 0.0038369793731433 | Epoch: 67 | 
MeanAbsoluteError: 0.0241170693188906 | Loss: 0.0014083647334841 | Epoch: 68 | MeanAbsoluteError: 0.0476483926177025 | Loss: 0.0038018013493946 | Epoch: 69 | 
MeanAbsoluteError: 0.0578094273805618 | Loss: 0.0043261012671372 | Epoch: 70 | MeanAbsoluteError: 0.0354970656335354 | Loss: 0.0021817542325992 | Epoch: 71 | 
MeanAbsoluteError: 0.0277659706771374 | Loss: 0.0014435418774016 | Epoch: 72 | MeanAbsoluteError: 0.0342580229043961 | Loss: 0.0021925798903864 | Epoch: 73 | 
MeanAbsoluteError: 0.0506163984537125 | Loss: 0.0042302688727012 | Epoch: 74 | MeanAbsoluteError: 0.0263762734830379 | Loss: 0.0012236600517868 | Epoch: 75 | 
MeanAbsoluteError: 0.0327108353376389 | Loss: 0.0022147434400932 | Epoch: 76 | MeanAbsoluteError: 0.0401576422154903 | Loss: 0.0027690668715737 | Epoch: 77 | 
MeanAbsoluteError: 0.0376440733671188 | Loss: 0.0027790313358240 | Epoch: 78 | MeanAbsoluteError: 0.0352755859494209 | Loss: 0.0027781487420165 | Epoch: 79 | 
MeanAbsoluteError: 0.0539066120982170 | Loss: 0.0045657978715518 | Epoch: 80 | MeanAbsoluteError: 0.0371148027479649 | Loss: 0.0024883459778861 | Epoch: 81 | 
MeanAbsoluteError: 0.0229254085570574 | Loss: 0.0015004761315560 | Epoch: 82 | MeanAbsoluteError: 0.0263133216649294 | Loss: 0.0016597884801181 | Epoch: 83 | 
MeanAbsoluteError: 0.0466855205595493 | Loss: 0.0039504610064726 | Epoch: 84 | MeanAbsoluteError: 0.0343150645494461 | Loss: 0.0023751278819803 | Epoch: 85 | 
MeanAbsoluteError: 0.0330653153359890 | Loss: 0.0019100183003152 | Epoch: 86 | MeanAbsoluteError: 0.0297854598611593 | Loss: 0.0016291662961101 | Epoch: 87 | 
MeanAbsoluteError: 0.0244446750730276 | Loss: 0.0012023922754452 | Epoch: 88 | MeanAbsoluteError: 0.0307070203125477 | Loss: 0.0013540663416139 | Epoch: 89 | 
MeanAbsoluteError: 0.0284834727644920 | Loss: 0.0016851099790074 | Epoch: 90 | MeanAbsoluteError: 0.0327592641115189 | Loss: 0.0022194716371954 | Epoch: 91 | 
MeanAbsoluteError: 0.0294019300490618 | Loss: 0.0018419920592211 | Epoch: 92 | MeanAbsoluteError: 0.0467455349862576 | Loss: 0.0030609717449317 | Epoch: 93 | 
MeanAbsoluteError: 0.0390585213899612 | Loss: 0.0023200103493694 | Epoch: 94 | MeanAbsoluteError: 0.0290260910987854 | Loss: 0.0015629471454304 | Epoch: 95 | 
MeanAbsoluteError: 0.0312719047069550 | Loss: 0.0025763658766384 | Epoch: 96 | MeanAbsoluteError: 0.0435429662466049 | Loss: 0.0029812559682446 | Epoch: 97 | 
MeanAbsoluteError: 0.0457846671342850 | Loss: 0.0032055502435049 | Epoch: 98 | MeanAbsoluteError: 0.0325483568012714 | Loss: 0.0018701697453462 | Epoch: 99 | 
MeanAbsoluteError: 0.0523834042251110 | Loss: 0.0040996556725496 | Epoch: 100 | MeanAbsoluteError: 0.0305967908352613 | Loss: 0.0016787028110300 | Epoch: 101 | 
MeanAbsoluteError: 0.0297599583864212 | Loss: 0.0015300053346436 | Epoch: 102 | MeanAbsoluteError: 0.0409477725625038 | Loss: 0.0029761611054150 | Epoch: 103 | 
MeanAbsoluteError: 0.0243237614631653 | Loss: 0.0014045981448502 | Epoch: 104 | MeanAbsoluteError: 0.0391042716801167 | Loss: 0.0030777796771592 | Epoch: 105 | 
MeanAbsoluteError: 0.0477706827223301 | Loss: 0.0033327991124959 | Epoch: 106 | MeanAbsoluteError: 0.0324060283601284 | Loss: 0.0016559864251086 | Epoch: 107 | 
MeanAbsoluteError: 0.0733323544263840 | Loss: 0.0068320642010524 | Epoch: 108 | MeanAbsoluteError: 0.0350386202335358 | Loss: 0.0021443626297136 | Epoch: 109 | 
MeanAbsoluteError: 0.0290016178041697 | Loss: 0.0013661358209972 | Epoch: 110 | MeanAbsoluteError: 0.0419034771621227 | Loss: 0.0026097416865433 | Epoch: 111 | 
MeanAbsoluteError: 0.0356074534356594 | Loss: 0.0025239702797710 | Epoch: 112 | MeanAbsoluteError: 0.0194163918495178 | Loss: 0.0009662528707570 | Epoch: 113 | 
MeanAbsoluteError: 0.0463360361754894 | Loss: 0.0040385628459402 | Epoch: 114 | MeanAbsoluteError: 0.0366642847657204 | Loss: 0.0022223678041393 | Epoch: 115 | 
MeanAbsoluteError: 0.0302158910781145 | Loss: 0.0027975914249859 | Epoch: 116 | MeanAbsoluteError: 0.0387972220778465 | Loss: 0.0021083403172759 | Epoch: 117 | 
MeanAbsoluteError: 0.0242009498178959 | Loss: 0.0009381682835878 | Epoch: 118 | MeanAbsoluteError: 0.0250363666564226 | Loss: 0.0011959396976566 | Epoch: 119 | 
MeanAbsoluteError: 0.0245595909655094 | Loss: 0.0011050662478038 | Epoch: 120 | MeanAbsoluteError: 0.0520405136048794 | Loss: 0.0044582203532068 | Epoch: 121 | 
MeanAbsoluteError: 0.0564197860658169 | Loss: 0.0042377294112857 | Epoch: 122 | MeanAbsoluteError: 0.0584289021790028 | Loss: 0.0040966762552181 | Epoch: 123 | 
MeanAbsoluteError: 0.0505269616842270 | Loss: 0.0032138569513336 | Epoch: 124 | MeanAbsoluteError: 0.0541839972138405 | Loss: 0.0038546169928920 | Epoch: 125 | 
MeanAbsoluteError: 0.0314659327268600 | Loss: 0.0032592798804846 | Epoch: 126 | MeanAbsoluteError: 0.0309383794665337 | Loss: 0.0017616296469126 | Epoch: 127 | 
MeanAbsoluteError: 0.0259263254702091 | Loss: 0.0012428166715276 | Epoch: 128 | MeanAbsoluteError: 0.0460400804877281 | Loss: 0.0037656780869628 | Epoch: 129 | 
MeanAbsoluteError: 0.0411160886287689 | Loss: 0.0024717622436583 | Epoch: 130 | MeanAbsoluteError: 0.0312079004943371 | Loss: 0.0016355594808164 | Epoch: 131 | 
MeanAbsoluteError: 0.0355005376040936 | Loss: 0.0029493122128770 | Epoch: 132 | MeanAbsoluteError: 0.0256740115582943 | Loss: 0.0012963211316114 | Epoch: 133 | 
MeanAbsoluteError: 0.0404820293188095 | Loss: 0.0022524095838889 | Epoch: 134 | MeanAbsoluteError: 0.0336085520684719 | Loss: 0.0016871277878706 | Epoch: 135 | 
MeanAbsoluteError: 0.0268746186047792 | Loss: 0.0014845404791861 | Epoch: 136 | MeanAbsoluteError: 0.0366922877728939 | Loss: 0.0023676717179254 | Epoch: 137 | 
MeanAbsoluteError: 0.0379302836954594 | Loss: 0.0027087222372826 | Epoch: 138 | MeanAbsoluteError: 0.0320591889321804 | Loss: 0.0017812311416492 | Epoch: 139 | 
MeanAbsoluteError: 0.0403431206941605 | Loss: 0.0028926679750349 | Epoch: 140 | MeanAbsoluteError: 0.0306163113564253 | Loss: 0.0021392983247866 | Epoch: 141 | 
MeanAbsoluteError: 0.0430852472782135 | Loss: 0.0028004427798665 | Epoch: 142 | MeanAbsoluteError: 0.0596091113984585 | Loss: 0.0046385931603324 | Epoch: 143 | 
MeanAbsoluteError: 0.0348816476762295 | Loss: 0.0017921975455605 | Epoch: 144 | MeanAbsoluteError: 0.0265861600637436 | Loss: 0.0013725084852642 | Epoch: 145 | 
MeanAbsoluteError: 0.0267718117684126 | Loss: 0.0011947644569983 | Epoch: 146 | MeanAbsoluteError: 0.0274367071688175 | Loss: 0.0011865112240999 | Epoch: 147 | 
MeanAbsoluteError: 0.0327492803335190 | Loss: 0.0020140875623418 | Epoch: 148 | MeanAbsoluteError: 0.0362480804324150 | Loss: 0.0022873677740930 | Epoch: 149 | 
MeanAbsoluteError: 0.0313147753477097 | Loss: 0.0014512072420285 | Early stopping at epoch 148
Fold: 5
Epoch: 1 | MeanAbsoluteError: 0.1940964311361313 | Loss: 0.0529680634633853 | Epoch: 2 | 
MeanAbsoluteError: 0.1037736386060715 | Loss: 0.0151608680518201 | Epoch: 3 | MeanAbsoluteError: 0.1024381071329117 | Loss: 0.0154673360431424 | Epoch: 4 | 
MeanAbsoluteError: 0.0883397012948990 | Loss: 0.0112916637713519 | Epoch: 5 | MeanAbsoluteError: 0.0680453702807426 | Loss: 0.0067569168212895 | Epoch: 6 | 
MeanAbsoluteError: 0.0911471396684647 | Loss: 0.0121865520755259 | Epoch: 7 | MeanAbsoluteError: 0.1721939146518707 | Loss: 0.0397345061199023 | Epoch: 8 | 
MeanAbsoluteError: 0.1259443312883377 | Loss: 0.0199666316262805 | Epoch: 9 | MeanAbsoluteError: 0.0925381109118462 | Loss: 0.0129636928009299 | Epoch: 10 | 
MeanAbsoluteError: 0.0907426178455353 | Loss: 0.0101297019192806 | Epoch: 11 | MeanAbsoluteError: 0.0601799376308918 | Loss: 0.0049524624437953 | Epoch: 12 | 
MeanAbsoluteError: 0.1286324560642242 | Loss: 0.0217508662921878 | Epoch: 13 | MeanAbsoluteError: 0.0932965502142906 | Loss: 0.0108293710419765 | Epoch: 14 | 
MeanAbsoluteError: 0.0450498312711716 | Loss: 0.0035154006014077 | Epoch: 15 | MeanAbsoluteError: 0.0713797658681870 | Loss: 0.0070702599791380 | Epoch: 16 | 
MeanAbsoluteError: 0.1086339652538300 | Loss: 0.0142873059958220 | Epoch: 17 | MeanAbsoluteError: 0.0609544739127159 | Loss: 0.0046950522989321 | Epoch: 18 | 
MeanAbsoluteError: 0.0664475932717323 | Loss: 0.0057559199452114 | Epoch: 19 | MeanAbsoluteError: 0.0841013416647911 | Loss: 0.0088164334257062 | Epoch: 20 | 
MeanAbsoluteError: 0.0537449233233929 | Loss: 0.0045036757543970 | Epoch: 21 | MeanAbsoluteError: 0.0596281811594963 | Loss: 0.0054884293125584 | Epoch: 22 | 
MeanAbsoluteError: 0.1098860353231430 | Loss: 0.0169710179146093 | Epoch: 23 | MeanAbsoluteError: 0.0455439053475857 | Loss: 0.0031112148963775 | Epoch: 24 | 
MeanAbsoluteError: 0.0625247731804848 | Loss: 0.0053505155419071 | Epoch: 25 | MeanAbsoluteError: 0.0468878075480461 | Loss: 0.0034016058153401 | Epoch: 26 | 
MeanAbsoluteError: 0.0708045139908791 | Loss: 0.0078202823284440 | Epoch: 27 | MeanAbsoluteError: 0.0439370870590210 | Loss: 0.0030981164801723 | Epoch: 28 | 
MeanAbsoluteError: 0.0740147307515144 | Loss: 0.0073594601753239 | Epoch: 29 | MeanAbsoluteError: 0.0774781480431557 | Loss: 0.0073728546715127 | Epoch: 30 | 
MeanAbsoluteError: 0.0415130034089088 | Loss: 0.0035930987528095 | Epoch: 31 | MeanAbsoluteError: 0.0401997119188309 | Loss: 0.0032763489468310 | Epoch: 32 | 
MeanAbsoluteError: 0.0427530556917191 | Loss: 0.0042804747533340 | Epoch: 33 | MeanAbsoluteError: 0.0492745824158192 | Loss: 0.0031553881708533 | Epoch: 34 | 
MeanAbsoluteError: 0.0303096286952496 | Loss: 0.0016219085037637 | Epoch: 35 | MeanAbsoluteError: 0.0859863311052322 | Loss: 0.0111991691474731 | Epoch: 36 | 
MeanAbsoluteError: 0.0342826209962368 | Loss: 0.0020417858434554 | Epoch: 37 | MeanAbsoluteError: 0.0534961894154549 | Loss: 0.0048779838969215 | Epoch: 38 | 
MeanAbsoluteError: 0.0819529369473457 | Loss: 0.0085897359352272 | Epoch: 39 | MeanAbsoluteError: 0.0246742181479931 | Loss: 0.0013767497372240 | Epoch: 40 | 
MeanAbsoluteError: 0.0411276705563068 | Loss: 0.0033256742798795 | Epoch: 41 | MeanAbsoluteError: 0.0993355959653854 | Loss: 0.0113503547170414 | Epoch: 42 | 
MeanAbsoluteError: 0.0454586856067181 | Loss: 0.0035414176348310 | Epoch: 43 | MeanAbsoluteError: 0.0261768456548452 | Loss: 0.0014484697211838 | Epoch: 44 | 
MeanAbsoluteError: 0.0417152270674706 | Loss: 0.0031107160388134 | Epoch: 45 | MeanAbsoluteError: 0.0344084613025188 | Loss: 0.0018070030715675 | Epoch: 46 | 
MeanAbsoluteError: 0.0276019889861345 | Loss: 0.0021961276988105 | Epoch: 47 | MeanAbsoluteError: 0.0328064598143101 | Loss: 0.0016252908569116 | Epoch: 48 | 
MeanAbsoluteError: 0.0443143174052238 | Loss: 0.0029611022910103 | Epoch: 49 | MeanAbsoluteError: 0.0415125563740730 | Loss: 0.0023983201558272 | Epoch: 50 | 
MeanAbsoluteError: 0.0462977215647697 | Loss: 0.0032892203442036 | Epoch: 51 | MeanAbsoluteError: 0.0663610398769379 | Loss: 0.0065803276733137 | Epoch: 52 | 
MeanAbsoluteError: 0.0283489897847176 | Loss: 0.0016895886040472 | Epoch: 53 | MeanAbsoluteError: 0.0465280637145042 | Loss: 0.0039929317829844 | Epoch: 54 | 
MeanAbsoluteError: 0.0611473359167576 | Loss: 0.0051516056992114 | Epoch: 55 | MeanAbsoluteError: 0.0268218237906694 | Loss: 0.0016489440738671 | Epoch: 56 | 
MeanAbsoluteError: 0.0874474719166756 | Loss: 0.0087892629134540 | Epoch: 57 | MeanAbsoluteError: 0.0687697604298592 | Loss: 0.0057661175512924 | Epoch: 58 | 
MeanAbsoluteError: 0.0342605821788311 | Loss: 0.0027194319028730 | Epoch: 59 | MeanAbsoluteError: 0.0557247921824455 | Loss: 0.0042155644713113 | Epoch: 60 | 
MeanAbsoluteError: 0.0257919151335955 | Loss: 0.0012255321735910 | Epoch: 61 | MeanAbsoluteError: 0.0276594310998917 | Loss: 0.0015496385413616 | Epoch: 62 | 
MeanAbsoluteError: 0.0615654364228249 | Loss: 0.0045509674013234 | Epoch: 63 | MeanAbsoluteError: 0.0441809929907322 | Loss: 0.0035958632629795 | Epoch: 64 | 
MeanAbsoluteError: 0.0449857600033283 | Loss: 0.0041857361659193 | Epoch: 65 | MeanAbsoluteError: 0.0447483509778976 | Loss: 0.0030539053438518 | Epoch: 66 | 
MeanAbsoluteError: 0.0266420654952526 | Loss: 0.0012135091954126 | Epoch: 67 | MeanAbsoluteError: 0.0315947160124779 | Loss: 0.0018551998229948 | Epoch: 68 | 
MeanAbsoluteError: 0.0688930079340935 | Loss: 0.0073656662761305 | Epoch: 69 | MeanAbsoluteError: 0.0273813456296921 | Loss: 0.0023852646000495 | Epoch: 70 | 
MeanAbsoluteError: 0.0329585596919060 | Loss: 0.0021188824679344 | Epoch: 71 | MeanAbsoluteError: 0.0303115434944630 | Loss: 0.0013720564736734 | Epoch: 72 | 
MeanAbsoluteError: 0.0498217679560184 | Loss: 0.0039318983371441 | Epoch: 73 | MeanAbsoluteError: 0.0257346369326115 | Loss: 0.0015555420283748 | Epoch: 74 | 
MeanAbsoluteError: 0.0312236174941063 | Loss: 0.0022571678318155 | Epoch: 75 | MeanAbsoluteError: 0.0393389575183392 | Loss: 0.0024816477402615 | Epoch: 76 | 
MeanAbsoluteError: 0.0359724126756191 | Loss: 0.0028056018726112 | Epoch: 77 | MeanAbsoluteError: 0.0314324982464314 | Loss: 0.0016929625820082 | Epoch: 78 | 
MeanAbsoluteError: 0.0335180014371872 | Loss: 0.0030893175146328 | Epoch: 79 | MeanAbsoluteError: 0.0297219734638929 | Loss: 0.0016205535122516 | Epoch: 80 | 
MeanAbsoluteError: 0.0293328072875738 | Loss: 0.0018226521105344 | Epoch: 81 | MeanAbsoluteError: 0.0293821450322866 | Loss: 0.0016776093521352 | Epoch: 82 | 
MeanAbsoluteError: 0.0255958512425423 | Loss: 0.0021173147621224 | Epoch: 83 | MeanAbsoluteError: 0.0250193979591131 | Loss: 0.0011375471904802 | Epoch: 84 | 
MeanAbsoluteError: 0.0278031583875418 | Loss: 0.0014556702002525 | Epoch: 85 | MeanAbsoluteError: 0.0485100522637367 | Loss: 0.0038420466410641 | Epoch: 86 | 
MeanAbsoluteError: 0.0231483560055494 | Loss: 0.0013799175749927 | Epoch: 87 | MeanAbsoluteError: 0.0594229884445667 | Loss: 0.0052324445165980 | Epoch: 88 | 
MeanAbsoluteError: 0.0420096628367901 | Loss: 0.0028526257105673 | Epoch: 89 | MeanAbsoluteError: 0.0304953996092081 | Loss: 0.0019655581944300 | Epoch: 90 | 
MeanAbsoluteError: 0.0194805413484573 | Loss: 0.0006444030486119 | Epoch: 91 | MeanAbsoluteError: 0.0262201353907585 | Loss: 0.0013431029622622 | Epoch: 92 | 
MeanAbsoluteError: 0.0275841187685728 | Loss: 0.0016856150446424 | Epoch: 93 | MeanAbsoluteError: 0.0243037994951010 | Loss: 0.0009297275593361 | Epoch: 94 | 
MeanAbsoluteError: 0.0282230041921139 | Loss: 0.0014793445365145 | Epoch: 95 | MeanAbsoluteError: 0.0289127826690674 | Loss: 0.0013967997085554 | Epoch: 96 | 
MeanAbsoluteError: 0.0555804073810577 | Loss: 0.0041483210292287 | Epoch: 97 | MeanAbsoluteError: 0.0374896377325058 | Loss: 0.0025486974314285 | Epoch: 98 | 
MeanAbsoluteError: 0.0342480652034283 | Loss: 0.0020118495158385 | Epoch: 99 | MeanAbsoluteError: 0.0355798751115799 | Loss: 0.0033515990384890 | Epoch: 100 | 
MeanAbsoluteError: 0.0288295391947031 | Loss: 0.0014184577493534 | Epoch: 101 | MeanAbsoluteError: 0.0475284010171890 | Loss: 0.0031602265707289 | Epoch: 102 | 
MeanAbsoluteError: 0.0339241400361061 | Loss: 0.0029046865798031 | Epoch: 103 | MeanAbsoluteError: 0.0291924960911274 | Loss: 0.0019352338545454 | Epoch: 104 | 
MeanAbsoluteError: 0.0508102923631668 | Loss: 0.0035383596729774 | Epoch: 105 | MeanAbsoluteError: 0.0380007065832615 | Loss: 0.0022487461750503 | Epoch: 106 | 
MeanAbsoluteError: 0.0505762770771980 | Loss: 0.0044018738509084 | Epoch: 107 | MeanAbsoluteError: 0.0358751714229584 | Loss: 0.0019559680681246 | Epoch: 108 | 
MeanAbsoluteError: 0.0291441138833761 | Loss: 0.0015848892149874 | Epoch: 109 | MeanAbsoluteError: 0.0406509526073933 | Loss: 0.0026180989270170 | Epoch: 110 | 
MeanAbsoluteError: 0.0226606409996748 | Loss: 0.0009156773851898 | Epoch: 111 | MeanAbsoluteError: 0.0298017971217632 | Loss: 0.0018288045097366 | Epoch: 112 | 
MeanAbsoluteError: 0.0711091011762619 | Loss: 0.0067013068876874 | Epoch: 113 | MeanAbsoluteError: 0.0249262191355228 | Loss: 0.0012476877163863 | Epoch: 114 | 
MeanAbsoluteError: 0.0554409921169281 | Loss: 0.0040316201316623 | Epoch: 115 | MeanAbsoluteError: 0.0285650901496410 | Loss: 0.0013543635857506 | Epoch: 116 | 
MeanAbsoluteError: 0.0249174181371927 | Loss: 0.0009794597773669 | Epoch: 117 | MeanAbsoluteError: 0.0236152820289135 | Loss: 0.0012136874317478 | Epoch: 118 | 
MeanAbsoluteError: 0.0242767669260502 | Loss: 0.0012442641555726 | Epoch: 119 | MeanAbsoluteError: 0.0743736624717712 | Loss: 0.0077060943541045 | Epoch: 120 | 
MeanAbsoluteError: 0.0318383015692234 | Loss: 0.0017043124579896 | Epoch: 121 | MeanAbsoluteError: 0.0327102579176426 | Loss: 0.0017322592208914 | Epoch: 122 | 
MeanAbsoluteError: 0.0233708266168833 | Loss: 0.0011399339642734 | Early stopping at epoch 121
Fold: 6
Epoch: 1 | MeanAbsoluteError: 0.1773740351200104 | Loss: 0.0439214139030530 | Epoch: 2 | 
MeanAbsoluteError: 0.1051445677876472 | Loss: 0.0175915617997257 | Epoch: 3 | MeanAbsoluteError: 0.1234500408172607 | Loss: 0.0242155164910051 | Epoch: 4 | 
MeanAbsoluteError: 0.0926514565944672 | Loss: 0.0130429828109650 | Epoch: 5 | MeanAbsoluteError: 0.0761003866791725 | Loss: 0.0101591357961297 | Epoch: 6 | 
MeanAbsoluteError: 0.0905516147613525 | Loss: 0.0131743490122832 | Epoch: 7 | MeanAbsoluteError: 0.0866081267595291 | Loss: 0.0129577297036751 | Epoch: 8 | 
MeanAbsoluteError: 0.0819032266736031 | Loss: 0.0092078857661153 | Epoch: 9 | MeanAbsoluteError: 0.0539977028965950 | Loss: 0.0050384841787700 | Epoch: 10 | 
MeanAbsoluteError: 0.1006224155426025 | Loss: 0.0148330771435912 | Epoch: 11 | MeanAbsoluteError: 0.0531488284468651 | Loss: 0.0041864260028188 | Epoch: 12 | 
MeanAbsoluteError: 0.0456364862620831 | Loss: 0.0037095824149079 | Epoch: 13 | MeanAbsoluteError: 0.0384437926113605 | Loss: 0.0031080372730055 | Epoch: 14 | 
MeanAbsoluteError: 0.0558214485645294 | Loss: 0.0062420265838647 | Epoch: 15 | MeanAbsoluteError: 0.0437386184930801 | Loss: 0.0037367002223618 | Epoch: 16 | 
MeanAbsoluteError: 0.1123922765254974 | Loss: 0.0193174013581413 | Epoch: 17 | MeanAbsoluteError: 0.0388851687312126 | Loss: 0.0029144548551323 | Epoch: 18 | 
MeanAbsoluteError: 0.0535868406295776 | Loss: 0.0056025078251528 | Epoch: 19 | MeanAbsoluteError: 0.0564925819635391 | Loss: 0.0042102292287522 | Epoch: 20 | 
MeanAbsoluteError: 0.0710642561316490 | Loss: 0.0090181923005730 | Epoch: 21 | MeanAbsoluteError: 0.0710497573018074 | Loss: 0.0076552798273042 | Epoch: 22 | 
MeanAbsoluteError: 0.0518988929688931 | Loss: 0.0055474969782293 | Epoch: 23 | MeanAbsoluteError: 0.0559867918491364 | Loss: 0.0052847763021978 | Epoch: 24 | 
MeanAbsoluteError: 0.0375592298805714 | Loss: 0.0024737917925589 | Epoch: 25 | MeanAbsoluteError: 0.0413585081696510 | Loss: 0.0036574169509829 | Epoch: 26 | 
MeanAbsoluteError: 0.0309556368738413 | Loss: 0.0019542638104982 | Epoch: 27 | MeanAbsoluteError: 0.0613207370042801 | Loss: 0.0052778678050695 | Epoch: 28 | 
MeanAbsoluteError: 0.0402868539094925 | Loss: 0.0029716040097320 | Epoch: 29 | MeanAbsoluteError: 0.0369621887803078 | Loss: 0.0032839939925067 | Epoch: 30 | 
MeanAbsoluteError: 0.0567086786031723 | Loss: 0.0046753195481590 | Epoch: 31 | MeanAbsoluteError: 0.0419683158397675 | Loss: 0.0028773455414921 | Epoch: 32 | 
MeanAbsoluteError: 0.1180953085422516 | Loss: 0.0171120016334149 | Epoch: 33 | MeanAbsoluteError: 0.0586405023932457 | Loss: 0.0054926153388806 | Epoch: 34 | 
MeanAbsoluteError: 0.0966121181845665 | Loss: 0.0127073350147559 | Epoch: 35 | MeanAbsoluteError: 0.0415692850947380 | Loss: 0.0043821644951374 | Epoch: 36 | 
MeanAbsoluteError: 0.0628375560045242 | Loss: 0.0059970660905282 | Epoch: 37 | MeanAbsoluteError: 0.0417812503874302 | Loss: 0.0027488718400351 | Epoch: 38 | 
MeanAbsoluteError: 0.0451613143086433 | Loss: 0.0030788400461181 | Epoch: 39 | MeanAbsoluteError: 0.0355466157197952 | Loss: 0.0023927502423668 | Epoch: 40 | 
MeanAbsoluteError: 0.0455550663173199 | Loss: 0.0032295483845071 | Epoch: 41 | MeanAbsoluteError: 0.0287611931562424 | Loss: 0.0018859374730919 | Epoch: 42 | 
MeanAbsoluteError: 0.0602814070880413 | Loss: 0.0056687516625971 | Epoch: 43 | MeanAbsoluteError: 0.0488346852362156 | Loss: 0.0036136473958882 | Epoch: 44 | 
MeanAbsoluteError: 0.0426491312682629 | Loss: 0.0029243143239560 | Epoch: 45 | MeanAbsoluteError: 0.0672030150890350 | Loss: 0.0065451492018138 | Epoch: 46 | 
MeanAbsoluteError: 0.0582808442413807 | Loss: 0.0042237151915637 | Epoch: 47 | MeanAbsoluteError: 0.0348503887653351 | Loss: 0.0017705052562703 | Epoch: 48 | 
MeanAbsoluteError: 0.0433768704533577 | Loss: 0.0034941920491222 | Epoch: 49 | MeanAbsoluteError: 0.0369308292865753 | Loss: 0.0027118885235933 | Epoch: 50 | 
MeanAbsoluteError: 0.0419469252228737 | Loss: 0.0027373476500193 | Epoch: 51 | MeanAbsoluteError: 0.0388978123664856 | Loss: 0.0027305435237045 | Epoch: 52 | 
MeanAbsoluteError: 0.0795767754316330 | Loss: 0.0082582135040026 | Epoch: 53 | MeanAbsoluteError: 0.0290689822286367 | Loss: 0.0015348304027262 | Epoch: 54 | 
MeanAbsoluteError: 0.0735091120004654 | Loss: 0.0075749174440996 | Epoch: 55 | MeanAbsoluteError: 0.0594896189868450 | Loss: 0.0046399123966694 | Epoch: 56 | 
MeanAbsoluteError: 0.0441880561411381 | Loss: 0.0034758094698191 | Epoch: 57 | MeanAbsoluteError: 0.0337444171309471 | Loss: 0.0023495497970054 | Epoch: 58 | 
MeanAbsoluteError: 0.0750773921608925 | Loss: 0.0064214364840434 | Epoch: 59 | MeanAbsoluteError: 0.0462127178907394 | Loss: 0.0036622549478824 | Epoch: 60 | 
MeanAbsoluteError: 0.0521817691624165 | Loss: 0.0050249007136489 | Epoch: 61 | MeanAbsoluteError: 0.0702246576547623 | Loss: 0.0064261247260639 | Epoch: 62 | 
MeanAbsoluteError: 0.0561900287866592 | Loss: 0.0050264165306894 | Epoch: 63 | MeanAbsoluteError: 0.0417803041636944 | Loss: 0.0027869487933528 | Epoch: 64 | 
MeanAbsoluteError: 0.0467034578323364 | Loss: 0.0033031822218058 | Epoch: 65 | MeanAbsoluteError: 0.0987203121185303 | Loss: 0.0120486315841285 | Epoch: 66 | 
MeanAbsoluteError: 0.0334020406007767 | Loss: 0.0020290773525351 | Epoch: 67 | MeanAbsoluteError: 0.0384381487965584 | Loss: 0.0021805807930202 | Epoch: 68 | 
MeanAbsoluteError: 0.0319847911596298 | Loss: 0.0021565292767124 | Epoch: 69 | MeanAbsoluteError: 0.0505523793399334 | Loss: 0.0037706843935526 | Epoch: 70 | 
MeanAbsoluteError: 0.0428840592503548 | Loss: 0.0029401911865884 | Epoch: 71 | MeanAbsoluteError: 0.0396988950669765 | Loss: 0.0026069047027984 | Epoch: 72 | 
MeanAbsoluteError: 0.0272354967892170 | Loss: 0.0015840791871037 | Epoch: 73 | MeanAbsoluteError: 0.0524217411875725 | Loss: 0.0042650405801116 | Epoch: 74 | 
MeanAbsoluteError: 0.0336233936250210 | Loss: 0.0019344711024762 | Epoch: 75 | MeanAbsoluteError: 0.0322909913957119 | Loss: 0.0027461643442691 | Epoch: 76 | 
MeanAbsoluteError: 0.0311421751976013 | Loss: 0.0017377148391321 | Epoch: 77 | MeanAbsoluteError: 0.0399336703121662 | Loss: 0.0023065828270494 | Epoch: 78 | 
MeanAbsoluteError: 0.0717094242572784 | Loss: 0.0061883135304715 | Epoch: 79 | MeanAbsoluteError: 0.0418188795447350 | Loss: 0.0028479689633689 | Epoch: 80 | 
MeanAbsoluteError: 0.0873696133494377 | Loss: 0.0100450945946460 | Epoch: 81 | MeanAbsoluteError: 0.0315829925239086 | Loss: 0.0022852277884690 | Epoch: 82 | 
MeanAbsoluteError: 0.0337243117392063 | Loss: 0.0020317407839824 | Epoch: 83 | MeanAbsoluteError: 0.0586292035877705 | Loss: 0.0055795020979041 | Epoch: 84 | 
MeanAbsoluteError: 0.0357621125876904 | Loss: 0.0020573903983369 | Epoch: 85 | MeanAbsoluteError: 0.0501384064555168 | Loss: 0.0042150775194526 | Early stopping at epoch 84
Fold: 7
Epoch: 1 | 
MeanAbsoluteError: 0.1181101053953171 | Loss: 0.0207998535524194 | Epoch: 2 | MeanAbsoluteError: 0.1153534948825836 | Loss: 0.0208732955730878 | Epoch: 3 | 
MeanAbsoluteError: 0.1253294646739960 | Loss: 0.0225796740358839 | Epoch: 4 | MeanAbsoluteError: 0.0700437575578690 | Loss: 0.0077568123546930 | Epoch: 5 | 
MeanAbsoluteError: 0.0905140936374664 | Loss: 0.0132385202182027 | Epoch: 6 | MeanAbsoluteError: 0.0529728308320045 | Loss: 0.0045573539190138 | Epoch: 7 | 
MeanAbsoluteError: 0.0688776522874832 | Loss: 0.0072345151028668 | Epoch: 8 | MeanAbsoluteError: 0.0744774863123894 | Loss: 0.0089734583161771 | Epoch: 9 | 
MeanAbsoluteError: 0.0736842602491379 | Loss: 0.0072026569933559 | Epoch: 10 | MeanAbsoluteError: 0.0389936976134777 | Loss: 0.0026266262015829 | Epoch: 11 | 
MeanAbsoluteError: 0.0782508105039597 | Loss: 0.0082479237507169 | Epoch: 12 | MeanAbsoluteError: 0.0801834687590599 | Loss: 0.0083413417451084 | Epoch: 13 | 
MeanAbsoluteError: 0.0621398575603962 | Loss: 0.0054982596148665 | Epoch: 14 | MeanAbsoluteError: 0.0660902336239815 | Loss: 0.0063000959165108 | Epoch: 15 | 
MeanAbsoluteError: 0.0335745848715305 | Loss: 0.0021558927384411 | Epoch: 16 | MeanAbsoluteError: 0.0430635735392570 | Loss: 0.0030361398553046 | Epoch: 17 | 
MeanAbsoluteError: 0.0458005107939243 | Loss: 0.0042439127484193 | Epoch: 18 | MeanAbsoluteError: 0.0410297922790051 | Loss: 0.0029347268237661 | Epoch: 19 | 
MeanAbsoluteError: 0.0441776514053345 | Loss: 0.0027292787921257 | Epoch: 20 | MeanAbsoluteError: 0.0984501615166664 | Loss: 0.0122051638049575 | Epoch: 21 | 
MeanAbsoluteError: 0.0359511263668537 | Loss: 0.0021718123282951 | Epoch: 22 | MeanAbsoluteError: 0.0881988406181335 | Loss: 0.0109550640560113 | Epoch: 23 | 
MeanAbsoluteError: 0.0367610566318035 | Loss: 0.0028986775992402 | Epoch: 24 | MeanAbsoluteError: 0.0333069488406181 | Loss: 0.0017260737255968 | Epoch: 25 | 
MeanAbsoluteError: 0.0441513620316982 | Loss: 0.0028870862711651 | Epoch: 26 | MeanAbsoluteError: 0.0437800548970699 | Loss: 0.0028337441617623 | Epoch: 27 | 
MeanAbsoluteError: 0.0543140992522240 | Loss: 0.0040151120091860 | Epoch: 28 | MeanAbsoluteError: 0.0991411581635475 | Loss: 0.0118068777597868 | Epoch: 29 | 
MeanAbsoluteError: 0.0288309101015329 | Loss: 0.0014520277461718 | Epoch: 30 | MeanAbsoluteError: 0.0253664236515760 | Loss: 0.0012729741462793 | Epoch: 31 | 
MeanAbsoluteError: 0.0259126964956522 | Loss: 0.0012397431978920 | Epoch: 32 | MeanAbsoluteError: 0.0281384959816933 | Loss: 0.0015126011466446 | Epoch: 33 | 
MeanAbsoluteError: 0.0317005664110184 | Loss: 0.0014227875452399 | Epoch: 34 | MeanAbsoluteError: 0.0312511511147022 | Loss: 0.0015726857102261 | Epoch: 35 | 
MeanAbsoluteError: 0.0665730759501457 | Loss: 0.0057888871703583 | Epoch: 36 | MeanAbsoluteError: 0.0470962636172771 | Loss: 0.0026848312610617 | Epoch: 37 | 
MeanAbsoluteError: 0.0275910180062056 | Loss: 0.0014056670389926 | Epoch: 38 | MeanAbsoluteError: 0.0225949715822935 | Loss: 0.0009237668329241 | Epoch: 39 | 
MeanAbsoluteError: 0.0249668676406145 | Loss: 0.0011471343190911 | Epoch: 40 | MeanAbsoluteError: 0.0252728704363108 | Loss: 0.0013049602969729 | Epoch: 41 | 
MeanAbsoluteError: 0.0731166526675224 | Loss: 0.0063893144878630 | Epoch: 42 | MeanAbsoluteError: 0.0364318937063217 | Loss: 0.0020803860209596 | Epoch: 43 | 
MeanAbsoluteError: 0.0641200914978981 | Loss: 0.0059991085257095 | Epoch: 44 | MeanAbsoluteError: 0.0402345769107342 | Loss: 0.0027360056500094 | Epoch: 45 | 
MeanAbsoluteError: 0.0999278351664543 | Loss: 0.0135999687660772 | Epoch: 46 | MeanAbsoluteError: 0.0353898741304874 | Loss: 0.0017384161115982 | Epoch: 47 | 
MeanAbsoluteError: 0.0250954087823629 | Loss: 0.0011521725956789 | Epoch: 48 | MeanAbsoluteError: 0.0306360535323620 | Loss: 0.0015543243767192 | Epoch: 49 | 
MeanAbsoluteError: 0.0545343905687332 | Loss: 0.0040793491151327 | Epoch: 50 | MeanAbsoluteError: 0.0540192797780037 | Loss: 0.0037610104414993 | Epoch: 51 | 
MeanAbsoluteError: 0.0466722473502159 | Loss: 0.0031522543151648 | Epoch: 52 | MeanAbsoluteError: 0.0296292826533318 | Loss: 0.0016569966795102 | Epoch: 53 | 
MeanAbsoluteError: 0.0592239722609520 | Loss: 0.0044626619648905 | Epoch: 54 | MeanAbsoluteError: 0.0574457496404648 | Loss: 0.0045362501673830 | Epoch: 55 | 
MeanAbsoluteError: 0.0551084093749523 | Loss: 0.0043240901476775 | Epoch: 56 | MeanAbsoluteError: 0.0469177626073360 | Loss: 0.0039049181639432 | Epoch: 57 | 
MeanAbsoluteError: 0.0525187142193317 | Loss: 0.0034824634382788 | Epoch: 58 | MeanAbsoluteError: 0.0262475796043873 | Loss: 0.0012162955737529 | Epoch: 59 | 
MeanAbsoluteError: 0.0404592081904411 | Loss: 0.0035595883516810 | Epoch: 60 | MeanAbsoluteError: 0.0738216787576675 | Loss: 0.0063488618291628 | Epoch: 61 | 
MeanAbsoluteError: 0.0207434110343456 | Loss: 0.0008147807429151 | Epoch: 62 | MeanAbsoluteError: 0.0747889131307602 | Loss: 0.0063467595654611 | Epoch: 63 | 
MeanAbsoluteError: 0.0857309922575951 | Loss: 0.0086719789900459 | Epoch: 64 | MeanAbsoluteError: 0.0217770058661699 | Loss: 0.0007570192952139 | Epoch: 65 | 
MeanAbsoluteError: 0.0422223806381226 | Loss: 0.0025495063388147 | Epoch: 66 | MeanAbsoluteError: 0.0258751586079597 | Loss: 0.0012570427430686 | Epoch: 67 | 
MeanAbsoluteError: 0.0204244144260883 | Loss: 0.0009361278644064 | Epoch: 68 | MeanAbsoluteError: 0.0335008427500725 | Loss: 0.0020614913754308 | Epoch: 69 | 
MeanAbsoluteError: 0.0493414290249348 | Loss: 0.0029193841440317 | Epoch: 70 | MeanAbsoluteError: 0.0528689920902252 | Loss: 0.0039249445902757 | Epoch: 71 | 
MeanAbsoluteError: 0.0239349585026503 | Loss: 0.0011352377645940 | Epoch: 72 | MeanAbsoluteError: 0.0381822362542152 | Loss: 0.0019076018092724 | Epoch: 73 | 
MeanAbsoluteError: 0.0302163250744343 | Loss: 0.0017691476163096 | Epoch: 74 | MeanAbsoluteError: 0.0226002819836140 | Loss: 0.0012321534427778 | Epoch: 75 | 
MeanAbsoluteError: 0.0696694478392601 | Loss: 0.0059372557756992 | Epoch: 76 | MeanAbsoluteError: 0.0233580525964499 | Loss: 0.0013044937603319 | Epoch: 77 | 
MeanAbsoluteError: 0.0349907167255878 | Loss: 0.0017468114114868 | Epoch: 78 | MeanAbsoluteError: 0.0436283685266972 | Loss: 0.0030336518897317 | Epoch: 79 | 
MeanAbsoluteError: 0.0210644751787186 | Loss: 0.0008677685014286 | Epoch: 80 | MeanAbsoluteError: 0.0756637826561928 | Loss: 0.0071904012718453 | Epoch: 81 | 
MeanAbsoluteError: 0.0225141961127520 | Loss: 0.0009310801945573 | Epoch: 82 | MeanAbsoluteError: 0.0373008884489536 | Loss: 0.0020972181541415 | Epoch: 83 | 
MeanAbsoluteError: 0.0223175119608641 | Loss: 0.0012254775501788 | Epoch: 84 | MeanAbsoluteError: 0.0304762106388807 | Loss: 0.0019173311571089 | Epoch: 85 | 
MeanAbsoluteError: 0.0253804940730333 | Loss: 0.0012278735890644 | Epoch: 86 | MeanAbsoluteError: 0.0448698997497559 | Loss: 0.0025643626174245 | Epoch: 87 | 
MeanAbsoluteError: 0.0273349545896053 | Loss: 0.0017297964659519 | Epoch: 88 | MeanAbsoluteError: 0.0240903813391924 | Loss: 0.0009489376165080 | Epoch: 89 | 
MeanAbsoluteError: 0.0310506895184517 | Loss: 0.0017849312951932 | Epoch: 90 | MeanAbsoluteError: 0.0280214548110962 | Loss: 0.0014390910733849 | Epoch: 91 | 
MeanAbsoluteError: 0.0250516384840012 | Loss: 0.0009422168693093 | Epoch: 92 | MeanAbsoluteError: 0.0515293888747692 | Loss: 0.0032855225547862 | Epoch: 93 | 
MeanAbsoluteError: 0.0422587841749191 | Loss: 0.0023549312295822 | Epoch: 94 | MeanAbsoluteError: 0.0211135335266590 | Loss: 0.0010021254767288 | Epoch: 95 | 
MeanAbsoluteError: 0.0238582175225019 | Loss: 0.0022915812095072 | Epoch: 96 | MeanAbsoluteError: 0.0298856254667044 | Loss: 0.0013761315494776 | Early stopping at epoch 95
Fold: 8
Epoch: 1 | 
MeanAbsoluteError: 0.1431737393140793 | Loss: 0.0297155630273315 | Epoch: 2 | MeanAbsoluteError: 0.0979822054505348 | Loss: 0.0149032766572558 | Epoch: 3 | 
MeanAbsoluteError: 0.1129568964242935 | Loss: 0.0186832501696279 | Epoch: 4 | MeanAbsoluteError: 0.0943659320473671 | Loss: 0.0125634294056978 | Epoch: 5 | 
MeanAbsoluteError: 0.0553855448961258 | Loss: 0.0045964737297394 | Epoch: 6 | MeanAbsoluteError: 0.1556160897016525 | Loss: 0.0288750012047016 | Epoch: 7 | 
MeanAbsoluteError: 0.0534265078604221 | Loss: 0.0055840972345322 | Epoch: 8 | MeanAbsoluteError: 0.0493400245904922 | Loss: 0.0042354307997112 | Epoch: 9 | 
MeanAbsoluteError: 0.0946155488491058 | Loss: 0.0114883354936655 | Epoch: 10 | MeanAbsoluteError: 0.0423538126051426 | Loss: 0.0027401172466433 | Epoch: 11 | 
MeanAbsoluteError: 0.0351461879909039 | Loss: 0.0020505198761104 | Epoch: 12 | MeanAbsoluteError: 0.0480113923549652 | Loss: 0.0040886364877224 | Epoch: 13 | 
MeanAbsoluteError: 0.0439841262996197 | Loss: 0.0038868219573767 | Epoch: 14 | MeanAbsoluteError: 0.0638391748070717 | Loss: 0.0054950068095842 | Epoch: 15 | 
MeanAbsoluteError: 0.1192435994744301 | Loss: 0.0159111410522690 | Epoch: 16 | MeanAbsoluteError: 0.0589677467942238 | Loss: 0.0052910261124802 | Epoch: 17 | 
MeanAbsoluteError: 0.0729183182120323 | Loss: 0.0082608756358520 | Epoch: 18 | MeanAbsoluteError: 0.1073377057909966 | Loss: 0.0140280528710439 | Epoch: 19 | 
MeanAbsoluteError: 0.0503072515130043 | Loss: 0.0031655384585834 | Epoch: 20 | MeanAbsoluteError: 0.0477770604193211 | Loss: 0.0032537641057458 | Epoch: 21 | 
MeanAbsoluteError: 0.0945181250572205 | Loss: 0.0103931006115790 | Epoch: 22 | MeanAbsoluteError: 0.1071113124489784 | Loss: 0.0133012296775213 | Epoch: 23 | 
MeanAbsoluteError: 0.1143421381711960 | Loss: 0.0153395225867056 | Epoch: 24 | MeanAbsoluteError: 0.0863622650504112 | Loss: 0.0086360396100925 | Epoch: 25 | 
MeanAbsoluteError: 0.0397533327341080 | Loss: 0.0027962174857608 | Epoch: 26 | MeanAbsoluteError: 0.0846616327762604 | Loss: 0.0085669091831033 | Epoch: 27 | 
MeanAbsoluteError: 0.0651302039623260 | Loss: 0.0055486265247544 | Epoch: 28 | MeanAbsoluteError: 0.0617596469819546 | Loss: 0.0051428441388103 | Epoch: 29 | 
MeanAbsoluteError: 0.0416619293391705 | Loss: 0.0028471509173799 | Epoch: 30 | MeanAbsoluteError: 0.0667578577995300 | Loss: 0.0072206025047658 | Epoch: 31 | 
MeanAbsoluteError: 0.0665900632739067 | Loss: 0.0057332516970256 | Epoch: 32 | MeanAbsoluteError: 0.0492728725075722 | Loss: 0.0039361229461904 | Epoch: 33 | 
MeanAbsoluteError: 0.0287870652973652 | Loss: 0.0014105396201977 | Epoch: 34 | MeanAbsoluteError: 0.0765824392437935 | Loss: 0.0078775890064068 | Epoch: 35 | 
MeanAbsoluteError: 0.0240901187062263 | Loss: 0.0012200706024977 | Epoch: 36 | MeanAbsoluteError: 0.0312281101942062 | Loss: 0.0015832204864217 | Epoch: 37 | 
MeanAbsoluteError: 0.0459063164889812 | Loss: 0.0026319806840127 | Epoch: 38 | MeanAbsoluteError: 0.0482817403972149 | Loss: 0.0033260556743838 | Epoch: 39 | 
MeanAbsoluteError: 0.0221337098628283 | Loss: 0.0010073897898949 | Epoch: 40 | MeanAbsoluteError: 0.0266560502350330 | Loss: 0.0012543881535888 | Epoch: 41 | 
MeanAbsoluteError: 0.0456602275371552 | Loss: 0.0031009974638717 | Epoch: 42 | MeanAbsoluteError: 0.0508091226220131 | Loss: 0.0034397990048791 | Epoch: 43 | 
MeanAbsoluteError: 0.0592089258134365 | Loss: 0.0048350690228220 | Epoch: 44 | MeanAbsoluteError: 0.1064393594861031 | Loss: 0.0138514584933336 | Epoch: 45 | 
MeanAbsoluteError: 0.0305355302989483 | Loss: 0.0014669969274949 | Epoch: 46 | MeanAbsoluteError: 0.1018797606229782 | Loss: 0.0115100211965350 | Epoch: 47 | 
MeanAbsoluteError: 0.0365908853709698 | Loss: 0.0018272739700758 | Epoch: 48 | MeanAbsoluteError: 0.0455583520233631 | Loss: 0.0027226381666528 | Epoch: 49 | 
MeanAbsoluteError: 0.0324256122112274 | Loss: 0.0017734024485645 | Epoch: 50 | MeanAbsoluteError: 0.0700961798429489 | Loss: 0.0063161553922468 | Epoch: 51 | 
MeanAbsoluteError: 0.0339218154549599 | Loss: 0.0018092689570040 | Epoch: 52 | MeanAbsoluteError: 0.0395412147045135 | Loss: 0.0031876995792398 | Epoch: 53 | 
MeanAbsoluteError: 0.0467526912689209 | Loss: 0.0033993757007500 | Epoch: 54 | MeanAbsoluteError: 0.0657270252704620 | Loss: 0.0050424695229874 | Epoch: 55 | 
MeanAbsoluteError: 0.0267228260636330 | Loss: 0.0012468975417925 | Epoch: 56 | MeanAbsoluteError: 0.0888774991035461 | Loss: 0.0104726223776547 | Epoch: 57 | 
MeanAbsoluteError: 0.0554147996008396 | Loss: 0.0036517197731882 | Epoch: 58 | MeanAbsoluteError: 0.0862249732017517 | Loss: 0.0086900711847612 | Epoch: 59 | 
MeanAbsoluteError: 0.0930708870291710 | Loss: 0.0117698269896209 | Epoch: 60 | MeanAbsoluteError: 0.0540821738541126 | Loss: 0.0039154727083559 | Epoch: 61 | 
MeanAbsoluteError: 0.0537774898111820 | Loss: 0.0038655340814820 | Epoch: 62 | MeanAbsoluteError: 0.0358793921768665 | Loss: 0.0019586821883702 | Epoch: 63 | 
MeanAbsoluteError: 0.0589980781078339 | Loss: 0.0045726656501826 | Epoch: 64 | MeanAbsoluteError: 0.0345667302608490 | Loss: 0.0017900427024310 | Epoch: 65 | 
MeanAbsoluteError: 0.0501065701246262 | Loss: 0.0042323238292458 | Epoch: 66 | MeanAbsoluteError: 0.0297361034899950 | Loss: 0.0014620681736582 | Epoch: 67 | 
MeanAbsoluteError: 0.0429092869162560 | Loss: 0.0024519963548161 | Epoch: 68 | MeanAbsoluteError: 0.0476307719945908 | Loss: 0.0035094571783422 | Epoch: 69 | 
MeanAbsoluteError: 0.0951257795095444 | Loss: 0.0117127123073890 | Epoch: 70 | MeanAbsoluteError: 0.0943414121866226 | Loss: 0.0099429420482081 | Epoch: 71 | 
MeanAbsoluteError: 0.0720366686582565 | Loss: 0.0061199199408293 | Early stopping at epoch 70
Fold: 9
Epoch: 1 | MeanAbsoluteError: 0.1086572632193565 | Loss: 0.0201941847156447 | Epoch: 2 | 
MeanAbsoluteError: 0.0934930890798569 | Loss: 0.0132137790967066 | Epoch: 3 | MeanAbsoluteError: 0.0819859951734543 | Loss: 0.0120301532308356 | Epoch: 4 | 
MeanAbsoluteError: 0.1148278936743736 | Loss: 0.0181591486415038 | Epoch: 5 | MeanAbsoluteError: 0.0935956314206123 | Loss: 0.0131809331763249 | Epoch: 6 | 
MeanAbsoluteError: 0.0536819882690907 | Loss: 0.0049353318038182 | Epoch: 7 | MeanAbsoluteError: 0.0684894397854805 | Loss: 0.0075561053728541 | Epoch: 8 | 
MeanAbsoluteError: 0.0468758679926395 | Loss: 0.0042865142369500 | Epoch: 9 | MeanAbsoluteError: 0.1544614732265472 | Loss: 0.0271111378589502 | Epoch: 10 | MeanAbsoluteError: 0.0847063735127449 | Loss: 0.0097189633390651 | 
Epoch: 11 | MeanAbsoluteError: 0.0736495330929756 | Loss: 0.0074686508339185 | Epoch: 12 | 
MeanAbsoluteError: 0.0432135835289955 | Loss: 0.0031628017851080 | Epoch: 13 | MeanAbsoluteError: 0.1651920378208160 | Loss: 0.0308150535879227 | Epoch: 14 | 
MeanAbsoluteError: 0.0511817075312138 | Loss: 0.0040703032147856 | Epoch: 15 | MeanAbsoluteError: 0.0866676270961761 | Loss: 0.0099664122725909 | Epoch: 16 | 
MeanAbsoluteError: 0.0734004080295563 | Loss: 0.0079386382399557 | Epoch: 17 | MeanAbsoluteError: 0.0390841849148273 | Loss: 0.0031982973674670 | Epoch: 18 | 
MeanAbsoluteError: 0.0533525831997395 | Loss: 0.0053185556652562 | Epoch: 19 | MeanAbsoluteError: 0.0935209915041924 | Loss: 0.0104045784100890 | Epoch: 20 | 
MeanAbsoluteError: 0.0363047607243061 | Loss: 0.0024912555538601 | Epoch: 21 | MeanAbsoluteError: 0.0479883439838886 | Loss: 0.0043351766653359 | Epoch: 22 | 
MeanAbsoluteError: 0.0610373467206955 | Loss: 0.0052513868297235 | Epoch: 23 | MeanAbsoluteError: 0.0976396948099136 | Loss: 0.0114679692599636 | Epoch: 24 | 
MeanAbsoluteError: 0.0613874159753323 | Loss: 0.0052542760610007 | Epoch: 25 | MeanAbsoluteError: 0.0984010919928551 | Loss: 0.0114450192508789 | Epoch: 26 | 
MeanAbsoluteError: 0.0693091303110123 | Loss: 0.0061025300528854 | Epoch: 27 | MeanAbsoluteError: 0.0398853309452534 | Loss: 0.0028328646260958 | Epoch: 28 | 
MeanAbsoluteError: 0.0648953393101692 | Loss: 0.0056319030431601 | Epoch: 29 | MeanAbsoluteError: 0.0658134296536446 | Loss: 0.0058128746011509 | Epoch: 30 | 
MeanAbsoluteError: 0.0419357866048813 | Loss: 0.0025325226284062 | Epoch: 31 | MeanAbsoluteError: 0.0540123097598553 | Loss: 0.0047163527208165 | Epoch: 32 | 
MeanAbsoluteError: 0.1496698707342148 | Loss: 0.0284518737059373 | Epoch: 33 | MeanAbsoluteError: 0.0338962376117706 | Loss: 0.0020971461154449 | Epoch: 34 | 
MeanAbsoluteError: 0.0420939400792122 | Loss: 0.0029378762253775 | Epoch: 35 | MeanAbsoluteError: 0.0465684644877911 | Loss: 0.0034515825637545 | Epoch: 36 | 
MeanAbsoluteError: 0.0472426787018776 | Loss: 0.0035645313865434 | Epoch: 37 | MeanAbsoluteError: 0.0555932484567165 | Loss: 0.0044940011038517 | Epoch: 38 | 
MeanAbsoluteError: 0.0334420390427113 | Loss: 0.0018805347678538 | Epoch: 39 | MeanAbsoluteError: 0.0620423182845116 | Loss: 0.0047945086844265 | Epoch: 40 | 
MeanAbsoluteError: 0.0577748380601406 | Loss: 0.0045770559853946 | Epoch: 41 | MeanAbsoluteError: 0.0485756210982800 | Loss: 0.0030834896830269 | Epoch: 42 | 
MeanAbsoluteError: 0.0622712858021259 | Loss: 0.0048845905201653 | Epoch: 43 | MeanAbsoluteError: 0.0626275464892387 | Loss: 0.0051192051301209 | Epoch: 44 | 
MeanAbsoluteError: 0.0280416067689657 | Loss: 0.0012979594545099 | Epoch: 45 | MeanAbsoluteError: 0.0287515502423048 | Loss: 0.0015638152097101 | Epoch: 46 | 
MeanAbsoluteError: 0.0370311625301838 | Loss: 0.0021517566817168 | Epoch: 47 | MeanAbsoluteError: 0.0365834720432758 | Loss: 0.0019869502195014 | Epoch: 48 | 
MeanAbsoluteError: 0.0498456619679928 | Loss: 0.0033377350415461 | Epoch: 49 | MeanAbsoluteError: 0.0550659671425819 | Loss: 0.0044816960759747 | Epoch: 50 | 
MeanAbsoluteError: 0.0342269428074360 | Loss: 0.0024432269274257 | Epoch: 51 | MeanAbsoluteError: 0.0326109901070595 | Loss: 0.0016954553541906 | Epoch: 52 | 
MeanAbsoluteError: 0.0275215916335583 | Loss: 0.0017103685397440 | Epoch: 53 | MeanAbsoluteError: 0.0352741926908493 | Loss: 0.0023544918580088 | Epoch: 54 | 
MeanAbsoluteError: 0.0475216731429100 | Loss: 0.0033263715449721 | Epoch: 55 | MeanAbsoluteError: 0.0550783835351467 | Loss: 0.0048227261286229 | Epoch: 56 | 
MeanAbsoluteError: 0.0269825179129839 | Loss: 0.0015262023214466 | Epoch: 57 | MeanAbsoluteError: 0.1286444514989853 | Loss: 0.0193954112294775 | Epoch: 58 | 
MeanAbsoluteError: 0.0481035858392715 | Loss: 0.0030576877492981 | Epoch: 59 | MeanAbsoluteError: 0.0701488852500916 | Loss: 0.0062899007282865 | Epoch: 60 | 
MeanAbsoluteError: 0.0348006188869476 | Loss: 0.0021571580168361 | Epoch: 61 | MeanAbsoluteError: 0.0402648746967316 | Loss: 0.0023749786241052 | Epoch: 62 | 
MeanAbsoluteError: 0.0433100834488869 | Loss: 0.0030014084320730 | Epoch: 63 | MeanAbsoluteError: 0.0829662904143333 | Loss: 0.0083932152662713 | Epoch: 64 | MeanAbsoluteError: 0.0368292331695557 | Loss: 0.0022006317314943 | 
Epoch: 65 | MeanAbsoluteError: 0.0455167181789875 | Loss: 0.0028438735484647 | Epoch: 66 | 
MeanAbsoluteError: 0.0346639454364777 | Loss: 0.0026473766237569 | Epoch: 67 | MeanAbsoluteError: 0.0280375294387341 | Loss: 0.0023740698547604 | Epoch: 68 | 
MeanAbsoluteError: 0.0393413081765175 | Loss: 0.0024064552674715 | Epoch: 69 | MeanAbsoluteError: 0.0856825336813927 | Loss: 0.0088412939714125 | Epoch: 70 | 
MeanAbsoluteError: 0.0429924204945564 | Loss: 0.0036360692734329 | Epoch: 71 | MeanAbsoluteError: 0.0370028130710125 | Loss: 0.0019261342150947 | Epoch: 72 | 
MeanAbsoluteError: 0.0283342413604259 | Loss: 0.0014326131987708 | Epoch: 73 | MeanAbsoluteError: 0.0426306538283825 | Loss: 0.0027582993923436 | Epoch: 74 | 
MeanAbsoluteError: 0.0248284824192524 | Loss: 0.0011423179440988 | Epoch: 75 | MeanAbsoluteError: 0.0842589363455772 | Loss: 0.0081789739644871 | Epoch: 76 | 
MeanAbsoluteError: 0.0541838854551315 | Loss: 0.0036633575979907 | Epoch: 77 | MeanAbsoluteError: 0.0229559559375048 | Loss: 0.0018114411118754 | Epoch: 78 | 
MeanAbsoluteError: 0.0337822660803795 | Loss: 0.0022683073050128 | Epoch: 79 | MeanAbsoluteError: 0.0265091247856617 | Loss: 0.0016316230198404 | Epoch: 80 | 
MeanAbsoluteError: 0.0424452647566795 | Loss: 0.0025676231777582 | Epoch: 81 | MeanAbsoluteError: 0.0303706694394350 | Loss: 0.0018454023632400 | Epoch: 82 | 
MeanAbsoluteError: 0.0406265556812286 | Loss: 0.0028339416290132 | Epoch: 83 | MeanAbsoluteError: 0.0215833280235529 | Loss: 0.0010552232639524 | Epoch: 84 | 
MeanAbsoluteError: 0.0894842147827148 | Loss: 0.0091304753620464 | Epoch: 85 | MeanAbsoluteError: 0.0944845750927925 | Loss: 0.0111624370687283 | Epoch: 86 | 
MeanAbsoluteError: 0.0290435925126076 | Loss: 0.0014850749284960 | Epoch: 87 | MeanAbsoluteError: 0.0415287464857101 | Loss: 0.0024133880551045 | Epoch: 88 | 
MeanAbsoluteError: 0.0618923716247082 | Loss: 0.0047182171748808 | Epoch: 89 | MeanAbsoluteError: 0.0388554185628891 | Loss: 0.0021036934877674 | Epoch: 90 | 
MeanAbsoluteError: 0.0302210804075003 | Loss: 0.0014596949868764 | Epoch: 91 | MeanAbsoluteError: 0.0506407916545868 | Loss: 0.0040071159243011 | Epoch: 92 | 
MeanAbsoluteError: 0.0830024927854538 | Loss: 0.0094769958478327 | Epoch: 93 | MeanAbsoluteError: 0.0343385227024555 | Loss: 0.0021392405503250 | Epoch: 94 | 
MeanAbsoluteError: 0.0241335630416870 | Loss: 0.0013569568803247 | Epoch: 95 | MeanAbsoluteError: 0.0242911409586668 | Loss: 0.0009741493267938 | Epoch: 96 | 
MeanAbsoluteError: 0.0336342975497246 | Loss: 0.0016523559640448 | Epoch: 97 | MeanAbsoluteError: 0.0313345417380333 | Loss: 0.0020297960346887 | Epoch: 98 | 
MeanAbsoluteError: 0.0257233269512653 | Loss: 0.0010881706100638 | Epoch: 99 | MeanAbsoluteError: 0.0198325999081135 | Loss: 0.0008587495551463 | Epoch: 100 | 
MeanAbsoluteError: 0.0739192664623260 | Loss: 0.0075177455571695 | Epoch: 101 | MeanAbsoluteError: 0.0733011737465858 | Loss: 0.0070328450618455 | Epoch: 102 | 
MeanAbsoluteError: 0.0277944896370173 | Loss: 0.0014599524751807 | Epoch: 103 | MeanAbsoluteError: 0.0258369632065296 | Loss: 0.0009560288274840 | Epoch: 104 | 
MeanAbsoluteError: 0.0678363814949989 | Loss: 0.0059429356971612 | Epoch: 105 | MeanAbsoluteError: 0.0697866082191467 | Loss: 0.0057467751455708 | Epoch: 106 | 
MeanAbsoluteError: 0.0383042171597481 | Loss: 0.0021507579412383 | Epoch: 107 | MeanAbsoluteError: 0.0477462634444237 | Loss: 0.0030369138828694 | Epoch: 108 | 
MeanAbsoluteError: 0.0220116600394249 | Loss: 0.0009775411912974 | Epoch: 109 | MeanAbsoluteError: 0.0345799624919891 | Loss: 0.0017890198483096 | Epoch: 110 | 
MeanAbsoluteError: 0.0365606099367142 | Loss: 0.0032283642839712 | Epoch: 111 | MeanAbsoluteError: 0.0220957621932030 | Loss: 0.0010646011886330 | Epoch: 112 | 
MeanAbsoluteError: 0.0753240957856178 | Loss: 0.0066646417387976 | Epoch: 113 | MeanAbsoluteError: 0.0539340972900391 | Loss: 0.0041204620994484 | Epoch: 114 | 
MeanAbsoluteError: 0.0637192800641060 | Loss: 0.0065724830268524 | Epoch: 115 | MeanAbsoluteError: 0.0402858294546604 | Loss: 0.0023573138124238 | Epoch: 116 | 
MeanAbsoluteError: 0.0314157530665398 | Loss: 0.0017951420382955 | Epoch: 117 | MeanAbsoluteError: 0.0276656318455935 | Loss: 0.0013175439940264 | Epoch: 118 | 
MeanAbsoluteError: 0.0851664245128632 | Loss: 0.0089700542605267 | Epoch: 119 | MeanAbsoluteError: 0.0351515971124172 | Loss: 0.0016271283697838 | Epoch: 120 | 
MeanAbsoluteError: 0.0247977878898382 | Loss: 0.0009182052319654 | Epoch: 121 | MeanAbsoluteError: 0.0274488739669323 | Loss: 0.0015607886385764 | Epoch: 122 | 
MeanAbsoluteError: 0.0235399100929499 | Loss: 0.0013098884978367 | Epoch: 123 | MeanAbsoluteError: 0.0184919293969870 | Loss: 0.0006245385582308 | Epoch: 124 | 
MeanAbsoluteError: 0.0518441386520863 | Loss: 0.0032232807985005 | Epoch: 125 | MeanAbsoluteError: 0.0244523119181395 | Loss: 0.0009476635784197 | Epoch: 126 | 
MeanAbsoluteError: 0.0464971512556076 | Loss: 0.0034786808559707 | Epoch: 127 | MeanAbsoluteError: 0.0278015658259392 | Loss: 0.0013277271243099 | Epoch: 128 | 
MeanAbsoluteError: 0.0365378223359585 | Loss: 0.0024416067261392 | Epoch: 129 | MeanAbsoluteError: 0.0276989787817001 | Loss: 0.0014137154100284 | Epoch: 130 | 
MeanAbsoluteError: 0.0659212321043015 | Loss: 0.0057641606455526 | Epoch: 131 | MeanAbsoluteError: 0.0229704063385725 | Loss: 0.0011556179849252 | Epoch: 132 | 
MeanAbsoluteError: 0.0267138648778200 | Loss: 0.0011322076562255 | Epoch: 133 | MeanAbsoluteError: 0.0414249338209629 | Loss: 0.0022467267072688 | Epoch: 134 | 
MeanAbsoluteError: 0.0194982569664717 | Loss: 0.0008207166695054 | Epoch: 135 | MeanAbsoluteError: 0.0369211584329605 | Loss: 0.0024925308893077 | Epoch: 136 | 
MeanAbsoluteError: 0.0203929059207439 | Loss: 0.0008401474232624 | Epoch: 137 | MeanAbsoluteError: 0.0270500369369984 | Loss: 0.0012536924052536 | Epoch: 138 | 
MeanAbsoluteError: 0.0290005300194025 | Loss: 0.0020525477593765 | Epoch: 139 | MeanAbsoluteError: 0.0378109216690063 | Loss: 0.0022417347197636 | Epoch: 140 | 
MeanAbsoluteError: 0.0212643630802631 | Loss: 0.0009807098764353 | Epoch: 141 | MeanAbsoluteError: 0.0309840496629477 | Loss: 0.0018699676102887 | Epoch: 142 | 
MeanAbsoluteError: 0.0380935892462730 | Loss: 0.0030575540373460 | Epoch: 143 | MeanAbsoluteError: 0.0340284518897533 | Loss: 0.0018660727386864 | Epoch: 144 | 
MeanAbsoluteError: 0.0246555376797915 | Loss: 0.0012899119935285 | Epoch: 145 | MeanAbsoluteError: 0.0276781823486090 | Loss: 0.0016606970127144 | Epoch: 146 | 
MeanAbsoluteError: 0.0267183519899845 | Loss: 0.0010897133929225 | Epoch: 147 | MeanAbsoluteError: 0.0255724135786295 | Loss: 0.0014532874920405 | Epoch: 148 | 
MeanAbsoluteError: 0.0276903063058853 | Loss: 0.0013129490947064 | Epoch: 149 | MeanAbsoluteError: 0.0435062833130360 | Loss: 0.0034787699293632 | Epoch: 150 | 
MeanAbsoluteError: 0.0238710194826126 | Loss: 0.0012850386410719 | Epoch: 151 | MeanAbsoluteError: 0.0258780866861343 | Loss: 0.0017287841541334 | Epoch: 152 | 
MeanAbsoluteError: 0.0294004250317812 | Loss: 0.0022103867309992 | Epoch: 153 | MeanAbsoluteError: 0.0572487078607082 | Loss: 0.0041400556846593 | Epoch: 154 | 
MeanAbsoluteError: 0.0548454187810421 | Loss: 0.0041622592566105 | Epoch: 155 | MeanAbsoluteError: 0.0319565646350384 | Loss: 0.0013163556174662 | Early stopping at epoch 154
Fold: 10
Epoch: 1 | 
MeanAbsoluteError: 0.1298855543136597 | Loss: 0.0263818235924611 | Epoch: 2 | MeanAbsoluteError: 0.1006979197263718 | Loss: 0.0164990963844153 | Epoch: 3 | 
MeanAbsoluteError: 0.0947440266609192 | Loss: 0.0143637438662923 | Epoch: 4 | MeanAbsoluteError: 0.0845037847757339 | Loss: 0.0110044010485021 | Epoch: 5 | 
MeanAbsoluteError: 0.0692565664649010 | Loss: 0.0074513300787657 | Epoch: 6 | MeanAbsoluteError: 0.0825363472104073 | Loss: 0.0105282823698452 | Epoch: 7 | 
MeanAbsoluteError: 0.1221913397312164 | Loss: 0.0183285454717966 | Epoch: 8 | MeanAbsoluteError: 0.0906313732266426 | Loss: 0.0107881666805882 | Epoch: 9 | 
MeanAbsoluteError: 0.1449716538190842 | Loss: 0.0252413770470482 | Epoch: 10 | MeanAbsoluteError: 0.0650191977620125 | Loss: 0.0067279472445639 | Epoch: 11 | 
MeanAbsoluteError: 0.0473446361720562 | Loss: 0.0040090646944009 | Epoch: 12 | MeanAbsoluteError: 0.0387143865227699 | Loss: 0.0029206710325805 | Epoch: 13 | 
MeanAbsoluteError: 0.0866038575768471 | Loss: 0.0099503193408824 | Epoch: 14 | MeanAbsoluteError: 0.0368491634726524 | Loss: 0.0032107793376781 | Epoch: 15 | 
MeanAbsoluteError: 0.0804207250475883 | Loss: 0.0082785071661839 | Epoch: 16 | MeanAbsoluteError: 0.1123353689908981 | Loss: 0.0148329573611800 | Epoch: 17 | 
MeanAbsoluteError: 0.0837126076221466 | Loss: 0.0093902690479389 | Epoch: 18 | MeanAbsoluteError: 0.0488279387354851 | Loss: 0.0035847164332294 | Epoch: 19 | 
MeanAbsoluteError: 0.0722173899412155 | Loss: 0.0071606196713849 | Epoch: 20 | MeanAbsoluteError: 0.0719034373760223 | Loss: 0.0081924320771717 | Epoch: 21 | MeanAbsoluteError: 0.0372259654104710 | Loss: 0.0027907052393018 | 
Epoch: 22 | MeanAbsoluteError: 0.0371300242841244 | Loss: 0.0030595183891889 | Epoch: 23 | 
MeanAbsoluteError: 0.0658265277743340 | Loss: 0.0060779051317905 | Epoch: 24 | MeanAbsoluteError: 0.0453501604497433 | Loss: 0.0042699152836576 | Epoch: 25 | 
MeanAbsoluteError: 0.0313848294317722 | Loss: 0.0022687793254870 | Epoch: 26 | MeanAbsoluteError: 0.1155247911810875 | Loss: 0.0150866333681803 | Epoch: 27 | 
MeanAbsoluteError: 0.0325903594493866 | Loss: 0.0020944223909352 | Epoch: 28 | MeanAbsoluteError: 0.0390313304960728 | Loss: 0.0024280944680168 | Epoch: 29 | 
MeanAbsoluteError: 0.0982777997851372 | Loss: 0.0123194160226446 | Epoch: 30 | MeanAbsoluteError: 0.0956231653690338 | Loss: 0.0103951519928299 | Epoch: 31 | 
MeanAbsoluteError: 0.0377881303429604 | Loss: 0.0025416025891900 | Epoch: 32 | MeanAbsoluteError: 0.0561117269098759 | Loss: 0.0044860119143358 | Epoch: 33 | 
MeanAbsoluteError: 0.0579385906457901 | Loss: 0.0046820755188282 | Epoch: 34 | MeanAbsoluteError: 0.0396880395710468 | Loss: 0.0027096026997942 | Epoch: 35 | 
MeanAbsoluteError: 0.0394270606338978 | Loss: 0.0027102856547572 | Epoch: 36 | MeanAbsoluteError: 0.0410319194197655 | Loss: 0.0027786897911798 | Epoch: 37 | 
MeanAbsoluteError: 0.0363821312785149 | Loss: 0.0022981364074020 | Epoch: 38 | MeanAbsoluteError: 0.0548508353531361 | Loss: 0.0042668302865842 | Epoch: 39 | 
MeanAbsoluteError: 0.0532912127673626 | Loss: 0.0047393800296749 | Epoch: 40 | MeanAbsoluteError: 0.0364252813160419 | Loss: 0.0021469615659533 | Epoch: 41 | 
MeanAbsoluteError: 0.0214278642088175 | Loss: 0.0011383185371345 | Epoch: 42 | MeanAbsoluteError: 0.0272402409464121 | Loss: 0.0013241021280499 | Epoch: 43 | 
MeanAbsoluteError: 0.0313934646546841 | Loss: 0.0020190687814298 | Epoch: 44 | MeanAbsoluteError: 0.0607849061489105 | Loss: 0.0045544666667970 | Epoch: 45 | 
MeanAbsoluteError: 0.0743075385689735 | Loss: 0.0081483257862811 | Epoch: 46 | MeanAbsoluteError: 0.0319666974246502 | Loss: 0.0014114201006193 | Epoch: 47 | 
MeanAbsoluteError: 0.0981889143586159 | Loss: 0.0110198168370586 | Epoch: 48 | MeanAbsoluteError: 0.0778534114360809 | Loss: 0.0087452791810322 | Epoch: 49 | 
MeanAbsoluteError: 0.0811061263084412 | Loss: 0.0075183138251305 | Epoch: 50 | MeanAbsoluteError: 0.0445853359997272 | Loss: 0.0028506851790903 | Epoch: 51 | 
MeanAbsoluteError: 0.0375275202095509 | Loss: 0.0021379338084863 | Epoch: 52 | MeanAbsoluteError: 0.0451876670122147 | Loss: 0.0027235224395274 | Epoch: 53 | 
MeanAbsoluteError: 0.0990672484040260 | Loss: 0.0117675217871483 | Epoch: 54 | MeanAbsoluteError: 0.0380116030573845 | Loss: 0.0029481473902706 | Epoch: 55 | 
MeanAbsoluteError: 0.0561995692551136 | Loss: 0.0047397884728315 | Epoch: 56 | MeanAbsoluteError: 0.0228690821677446 | Loss: 0.0010424943421430 | Epoch: 57 | 
MeanAbsoluteError: 0.0282295607030392 | Loss: 0.0016251633194490 | Epoch: 58 | MeanAbsoluteError: 0.0772883147001266 | Loss: 0.0072104589153941 | Epoch: 59 | 
MeanAbsoluteError: 0.0829904749989510 | Loss: 0.0086207497291840 | Epoch: 60 | MeanAbsoluteError: 0.0436802767217159 | Loss: 0.0029007975334445 | Epoch: 61 | 
MeanAbsoluteError: 0.0556950345635414 | Loss: 0.0039507038533114 | Epoch: 62 | MeanAbsoluteError: 0.0502556860446930 | Loss: 0.0038230503873470 | Epoch: 63 | 
MeanAbsoluteError: 0.0315789058804512 | Loss: 0.0016308134744087 | Epoch: 64 | MeanAbsoluteError: 0.0458189137279987 | Loss: 0.0030114870840827 | Epoch: 65 | 
MeanAbsoluteError: 0.0536704771220684 | Loss: 0.0042195228429941 | Epoch: 66 | MeanAbsoluteError: 0.0405249930918217 | Loss: 0.0023841386069902 | Epoch: 67 | 
MeanAbsoluteError: 0.0705133751034737 | Loss: 0.0060252818064048 | Epoch: 68 | MeanAbsoluteError: 0.0440801009535789 | Loss: 0.0028524114302574 | Epoch: 69 | 
MeanAbsoluteError: 0.0287140551954508 | Loss: 0.0021043367951979 | Epoch: 70 | MeanAbsoluteError: 0.0570090860128403 | Loss: 0.0045036475997991 | Epoch: 71 | 
MeanAbsoluteError: 0.0285404343158007 | Loss: 0.0019902293480789 | Epoch: 72 | MeanAbsoluteError: 0.0296363979578018 | Loss: 0.0017921072083901 | Epoch: 73 | 
MeanAbsoluteError: 0.0591405294835567 | Loss: 0.0053762215941858 | Epoch: 74 | MeanAbsoluteError: 0.0351884216070175 | Loss: 0.0017670480077728 | Epoch: 75 | 
MeanAbsoluteError: 0.0273822695016861 | Loss: 0.0019253477624331 | Epoch: 76 | MeanAbsoluteError: 0.0598349869251251 | Loss: 0.0043782356123512 | Epoch: 77 | 
MeanAbsoluteError: 0.0327594466507435 | Loss: 0.0016105747065292 | Epoch: 78 | MeanAbsoluteError: 0.0295947287231684 | Loss: 0.0014898010457938 | Epoch: 79 | 
MeanAbsoluteError: 0.0355377048254013 | Loss: 0.0020530053432314 | Epoch: 80 | MeanAbsoluteError: 0.0313123911619186 | Loss: 0.0015581379680393 | Epoch: 81 | 
MeanAbsoluteError: 0.0298162456601858 | Loss: 0.0019593062147928 | Epoch: 82 | MeanAbsoluteError: 0.0249803122133017 | Loss: 0.0013179845140817 | Epoch: 83 | 
MeanAbsoluteError: 0.0273981206119061 | Loss: 0.0022060886918692 | Epoch: 84 | MeanAbsoluteError: 0.0194702968001366 | Loss: 0.0007577899808754 | Epoch: 85 | 
MeanAbsoluteError: 0.0415325723588467 | Loss: 0.0027466045710473 | Epoch: 86 | MeanAbsoluteError: 0.0358040556311607 | Loss: 0.0023915735118163 | Epoch: 87 | 
MeanAbsoluteError: 0.0498743727803230 | Loss: 0.0033780845920913 | Epoch: 88 | MeanAbsoluteError: 0.0675229430198669 | Loss: 0.0057847230480267 | Epoch: 89 | 
MeanAbsoluteError: 0.0505493879318237 | Loss: 0.0037510936829047 | Epoch: 90 | MeanAbsoluteError: 0.0232482813298702 | Loss: 0.0008837005992133 | Epoch: 91 | 
MeanAbsoluteError: 0.0594000481069088 | Loss: 0.0057154797250405 | Epoch: 92 | MeanAbsoluteError: 0.0519551932811737 | Loss: 0.0037155281841898 | Epoch: 93 | 
MeanAbsoluteError: 0.0266177486628294 | Loss: 0.0010481001092837 | Epoch: 94 | MeanAbsoluteError: 0.0462213568389416 | Loss: 0.0026863148041929 | Epoch: 95 | 
MeanAbsoluteError: 0.0721541568636894 | Loss: 0.0082577932626009 | Epoch: 96 | MeanAbsoluteError: 0.0287432316690683 | Loss: 0.0013269877459746 | Epoch: 97 | 
MeanAbsoluteError: 0.0319408662617207 | Loss: 0.0016206096266755 | Epoch: 98 | MeanAbsoluteError: 0.0474642030894756 | Loss: 0.0035635464950106 | Epoch: 99 | 
MeanAbsoluteError: 0.0378547757863998 | Loss: 0.0019473610714508 | Epoch: 100 | MeanAbsoluteError: 0.0209226962178946 | Loss: 0.0007051115121263 | Epoch: 101 | 
MeanAbsoluteError: 0.0233147051185369 | Loss: 0.0009550361383635 | Epoch: 102 | MeanAbsoluteError: 0.0242063216865063 | Loss: 0.0013649881886802 | Epoch: 103 | 
MeanAbsoluteError: 0.0690123811364174 | Loss: 0.0060489769272793 | Epoch: 104 | MeanAbsoluteError: 0.0415235869586468 | Loss: 0.0045246519596101 | Epoch: 105 | 
MeanAbsoluteError: 0.0497683100402355 | Loss: 0.0040739173463617 | Epoch: 106 | MeanAbsoluteError: 0.0534552782773972 | Loss: 0.0039743288563421 | Epoch: 107 | 
MeanAbsoluteError: 0.0403967760503292 | Loss: 0.0028004142939328 | Epoch: 108 | MeanAbsoluteError: 0.0324481874704361 | Loss: 0.0021324621338863 | Epoch: 109 | 
MeanAbsoluteError: 0.0341406017541885 | Loss: 0.0019116246481784 | Epoch: 110 | MeanAbsoluteError: 0.0325782932341099 | Loss: 0.0016893915778313 | Epoch: 111 | 
MeanAbsoluteError: 0.0351718701422215 | Loss: 0.0023971235070628 | Epoch: 112 | MeanAbsoluteError: 0.0227622631937265 | Loss: 0.0008714722688847 | Epoch: 113 | 
MeanAbsoluteError: 0.0333576686680317 | Loss: 0.0016479703167883 | Epoch: 114 | MeanAbsoluteError: 0.0247260164469481 | Loss: 0.0010437276796438 | Epoch: 115 | 
MeanAbsoluteError: 0.0325417406857014 | Loss: 0.0030681500211358 | Epoch: 116 | MeanAbsoluteError: 0.0280887968838215 | Loss: 0.0016879062213075 | Epoch: 117 | 
MeanAbsoluteError: 0.0319207087159157 | Loss: 0.0018371716007375 | Epoch: 118 | MeanAbsoluteError: 0.0374973267316818 | Loss: 0.0022781426221347 | Epoch: 119 | 
MeanAbsoluteError: 0.0367106497287750 | Loss: 0.0024588486188664 | Epoch: 120 | MeanAbsoluteError: 0.0185401961207390 | Loss: 0.0008175816922001 | Epoch: 121 | 
MeanAbsoluteError: 0.0657862722873688 | Loss: 0.0053892409822975 | Epoch: 122 | MeanAbsoluteError: 0.0446262173354626 | Loss: 0.0030999228609009 | Epoch: 123 | 
MeanAbsoluteError: 0.0246644727885723 | Loss: 0.0012081742841894 | Epoch: 124 | MeanAbsoluteError: 0.0369930528104305 | Loss: 0.0021203569217155 | Epoch: 125 | 
MeanAbsoluteError: 0.0386718511581421 | Loss: 0.0023610333804614 | Epoch: 126 | MeanAbsoluteError: 0.0537932552397251 | Loss: 0.0040968241205869 | Epoch: 127 | 
MeanAbsoluteError: 0.0514048673212528 | Loss: 0.0038026288026371 | Epoch: 128 | MeanAbsoluteError: 0.0530282296240330 | Loss: 0.0044881992059975 | Epoch: 129 | 
MeanAbsoluteError: 0.0554868355393410 | Loss: 0.0045269931075521 | Epoch: 130 | MeanAbsoluteError: 0.0439128912985325 | Loss: 0.0026564664529780 | Epoch: 131 | 
MeanAbsoluteError: 0.0612625405192375 | Loss: 0.0045806618335728 | Epoch: 132 | MeanAbsoluteError: 0.0534874349832535 | Loss: 0.0037240133119317 | Early stopping at epoch 131
metric_name = type(fun_control["metric_torch"]).__name__
print(f"loss: {df_eval}, Cross-validated {metric_name}: {df_metrics}")
loss: 0.0033835511800134554, Cross-validated MeanAbsoluteError: 0.04779773950576782

19.10.4 Detailed Hyperparameter Plots

filename = "./figures/" + experiment_name
spot_tuner.plot_important_hyperparameter_contour(filename=filename)
l1:  27.625846168352734
dropout_prob:  1.7781767444973497
patience:  100.0
sgd_momentum:  100.0

Contour plots.

19.10.5 Parallel Coordinates Plot

spot_tuner.parallel_plot()

Parallel coordinates plots

19.11 Summary and Outlook

This tutorial presents the hyperparameter tuning open source software spotPython for PyTorch. Some of the advantages of spotPython are:

  • Numerical and categorical hyperparameters.
  • Powerful surrogate models.
  • Flexible approach and easy to use.
  • Simple JSON files for the specification of the hyperparameters.
  • Extension of default and user specified network classes.
  • Noise handling techniques.
  • Online visualization of the hyperparameter tuning process with tensorboard.

Currently, only rudimentary parallel and distributed neural network training is possible, but these capabilities will be extended in the future. The next version of spotPython will also include a more detailed documentation and more examples.

Important

Important: This tutorial does not present a complete benchmarking study (Bartz-Beielstein et al. 2020). The results are only preliminary and highly dependent on the local configuration (hard- and software). Our goal is to provide a first impression of the performance of the hyperparameter tuning package spotPython. The results should be interpreted with care.