Unsupervised Spectral Unmixing with Autoencoders#
By Joshua C. Agar, Shuyu Qin
There are many times where you want to extract imporant features from high-dimensional data
In essence, the goal is to compress data to some lower latent space where you can extract information
Autoencoder#
Encoder - Neural network that deconstructs the data into the most important statistical components
Embedding Layer(s) - One or many layers were information is extracted
Decoder - Neural network that translates the latent space to original dimensionality.
Mathematical Objective#
Minimize the reconstruction loss based on some metric.
Mean squared error
Good at avoiding influence of anomalies
Mean absolute error
Good at capturing details within spectra
Optimizers#
Standard optimizers like ADAM tend to be sufficient
Can use more complex optimizers 2nd order, adhessian to optimize small models.
Practical Objective#
Create an autoencoder that has performant reconstruction
Create a low-dimensional and interpretable latent space
Reduce the dimensionality
Impose non-negativity contraints
Impose regularization
Impose sparsity
Impose constraints on the shape of the latent distribution
Impose soft-constraints that favor disentanglement
Create a latent trajectory that is suitable for generation
Imports Packages#
# installs the tutorial package
!pip install m3_learning --no-deps
!pip install -r tutorial_requirements.txt
Show code cell output
Requirement already satisfied: m3_learning in /home/xinqiao/anaconda3/envs/m3_test/lib/python3.10/site-packages (0.0.22)
ERROR: Could not open requirements file: [Errno 2] No such file or directory: 'tutorial_requirements.txt'
import numpy as np
from skimage import io
from sklearn.model_selection import train_test_split
import matplotlib.pyplot as plt
import inspect
from m3_learning.util.code import print_code
from m3_learning.viz.nn import embeddings, latent_generator
from m3_learning.nn.random import random_seed
from m3_learning.viz.style import set_style
from m3_learning.nn.time_series_nn.nn_util import Train, transform_nn, loss_function
from m3_learning.viz.layout import layout_fig, embedding_maps
from m3_learning.util.data_generators import generate_data
import copy
import torch
import torch.nn as nn
import torch.optim as optim
from torchsummary import summary
set_style("default")
random_seed(seed=42)
2023-11-10 16:32:51.375864: I tensorflow/tsl/cuda/cudart_stub.cc:28] Could not find cuda drivers on your machine, GPU will not be used.
2023-11-10 16:32:51.409196: E tensorflow/compiler/xla/stream_executor/cuda/cuda_dnn.cc:9342] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2023-11-10 16:32:51.409225: E tensorflow/compiler/xla/stream_executor/cuda/cuda_fft.cc:609] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2023-11-10 16:32:51.409259: E tensorflow/compiler/xla/stream_executor/cuda/cuda_blas.cc:1518] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2023-11-10 16:32:51.416969: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-11-10 16:32:52.147206: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
default set for seaborn
default set for matplotlib
Pytorch seed was set to 42
Numpy seed was set to 42
tensorflow seed was set to 42
Generating Data#
We want to generate a hyperspectral image
This can be done by taking the RGB values of an image and using them as parameters for a function
Loads and image of my dog Nala#
Painting by Irene Dogmatic
# Loads dog image
image = io.imread(
"https://github.com/jagar2/m3_learning/blob/main/m3_learning/Tutorials/Unsupervised_Learning_with_AEs/figs/nala.jpg?raw=true"
)
# Crops dog image
image = image[200:1900:20, 100:1500:20] / 255
Displays the image#
# Plots dog image
plt.imshow(image)
<matplotlib.image.AxesImage at 0x7f550a1e7ac0>
Generating some data based on the image#
Define a non-linear function#
def non_linear_fn(t, x, y, z):
tanh = nn.Tanh()
selu = nn.SELU()
sigmoid = nn.Sigmoid()
# returns a function from variables
return (
tanh(torch.tensor(20 * (t - 2 * (x - 0.5))))
+ selu(torch.tensor((t - 2 * (y - 0.5))))
+ sigmoid(torch.tensor(-20 * (t - (z - 0.5))))
)
print_code(generate_data)
24: def generate_data(values, function=default_nl_function, length=25, range_=[-1, 1]):
25: """function to generate data based on an arbitrary function
26:
27: Args:
28: values (array): Input values to use
29: function (obj, optional): Function to use for generation. Defaults to default_nl_function.
30: length (int, optional): length of the vector to generate. Defaults to 25.
31: range_ (list, optional): range of spectra where you generate data. Defaults to [-1, 1].
32:
33: Returns:
34: array: computed spectra
35: """
36: # build x vector
37: x = np.linspace(range_[0], range_[1], length)
38:
39: data = np.zeros((values.shape[0], length))
40:
41: for i in range(values.shape[0]):
42: data[i, :] = function(x, values[i, 0], values[i, 1], values[i, 2])
43:
44: return data
45:
# generates a hyperspectral image
dog_data = generate_data(image.reshape(-1, 3),
length=10, function=non_linear_fn)
# Conducts a test train split.
# because we are training an autoencoder x and y are the same
X_train, X_test, _, _ = train_test_split(
dog_data, dog_data, test_size=0.2, random_state=42
)
Plots the generated data#
fig, ax = layout_fig(6, mod=3, figsize=(10, 5))
ax = ax.ravel()
cmap = plt.cm.viridis
for i, ax in enumerate(ax):
# for the first three plots we plot the image
if i < 3:
img = np.zeros(image.shape)
img[:, :, i] = image[:, :, i]
ax.imshow(img)
else:
# for the last three plots we plot the hyperspectral image
values = np.zeros((5, 3))
# generates 5 linearly spaced values between 0 and 1
values[:, i - 3] = np.linspace(0, 1, 5)
# generates the spectra
y_data = generate_data(values, length=10)
for j in range(y_data.shape[0]):
# computes the colormap for each spectra based on the value
color = cmap((j + 1) / y_data.shape[0])
# plots the data
ax.plot(y_data[j], c=color)
Building a Simple Autoencoder#
Defines the encoder and the decoder#
# sets the number of latent dimensions for the autoencoder
latent_dim = 12
class Encoder(nn.Module):
"""Encoder class for the autoencoder"""
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Encoder, self).__init__()
self.dense_1 = nn.Linear(10, self.latent_dim)
def forward(self, x):
# single dense layer in the model
x = self.dense_1(x)
return x
class Decoder(nn.Module):
"""Decoder class for the autoencoder"""
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Decoder, self).__init__()
self.dense_1 = nn.Linear(self.latent_dim, 10)
def forward(self, x):
# single dense layer in the decoder
x = self.dense_1(x)
return x
Builds the autoencoder#
class Autoencoder(nn.Module):
"""
Autoencoder class that combines the encoder and decoder
"""
def __init__(self, encoder, decoder):
super().__init__()
self.encoder = encoder
self.decoder = decoder
def forward(self, x):
# encode
embedding = self.encoder(x)
# decode
predicted = self.decoder(embedding)
return predicted
Instantiates the model#
import cpuinfo
cpudata = cpuinfo.get_cpu_info()["brand_raw"]
cpuname = cpudata.split(" ")[1]
# choose a device based on your system
if cpuname == "M1":
device = "mps"
elif torch.cuda.device_count():
device = "cuda"
else:
device = "cpu"
print(f"You are running on a {device}")
# builds the encode, decoder, and autoencoder
encoder = Encoder().to(device)
decoder = Decoder().to(device)
model = Autoencoder(encoder, decoder).to(device)
# optimizer
optimizer = optim.Adam(model.parameters(), lr=3e-4)
You are running on a cuda
# prints the model structure
try:
summary(model, ((X_train.shape[1:])))
except:
model_cpu = copy.deepcopy(model).to("cpu")
summary(model_cpu, ((X_train.shape[1:])))
----------------------------------------------------------------
Layer (type) Output Shape Param #
================================================================
Linear-1 [-1, 12] 132
Encoder-2 [-1, 12] 0
Linear-3 [-1, 10] 130
Decoder-4 [-1, 10] 0
================================================================
Total params: 262
Trainable params: 262
Non-trainable params: 0
----------------------------------------------------------------
Input size (MB): 0.00
Forward/backward pass size (MB): 0.00
Params size (MB): 0.00
Estimated Total Size (MB): 0.00
----------------------------------------------------------------
Encoder with 12 latent dimensions
Decoder with with size 10 –> same as orignal spectral length
Autoencoder considers time by saying each timestep is its own fully-uncorrelated sample
Builds the dataloader#
# builds a dataloader
train_iterator = torch.utils.data.DataLoader(
X_train, batch_size=256, shuffle=True)
Trains the model#
print_code(Train)
201: def Train(
202: model,
203: encoder,
204: decoder,
205: train_iterator,
206: optimizer,
207: epochs,
208: coef=0,
209: coef_1=0,
210: ln_parm=1,
211: beta=None,
212: mse=True,
213: device="cuda",
214: save_weight = False,
215: ):
216: """Function that trains the model
217:
218: Args:
219: model (Pytorch model): autoencoder model
220: encoder (PyTorch model): encoder of the mode
221: decoder (PyTorch model): decoder of the model
222: train_iterator (iter): iterator used from straining
223: optimizer (obj): optimization methods used
224: epochs (int): number of epochs
225: coef (int, optional): used to set the lambda value of the regularization. Defaults to 0.
226: coef1 (int, optional): not implemented. Defaults to 0.
227: ln_parm (int, optional): norm value. Defaults to 1.
228: beta (float, optional): beta for variational autoencoder. Defaults to None.
229: mse (bool, optional): selects to use the MSE loss. Defaults to True.
230: device (str, optional): selects the device to use. Defaults to "cuda".
231:
232: """
233:
234: clear_output()
235:
236:
237: N_EPOCHS = epochs
238: best_train_loss = float("inf")
239:
240: for epoch in range(N_EPOCHS):
241:
242: train = loss_function(
243: model,
244: encoder,
245: decoder,
246: train_iterator,
247: optimizer,
248: coef,
249: coef_1,
250: ln_parm,
251: beta,
252: mse,
253: device,
254: )
255:
256: train_loss = train
257: train_loss /= len(train_iterator)
258: print(f"Epoch {epoch}, Train Loss: {train_loss:.4f}")
259: print(".............................")
260:
261: if best_train_loss > train_loss:
262: best_train_loss = train_loss
263:
264: checkpoint = {
265: "net": model.state_dict(),
266: "optimizer": optimizer.state_dict(),
267: "epoch": epoch,
268: "encoder": encoder.state_dict(),
269: "decoder": decoder.state_dict(),
270: }
271: if save_weight:
272: if epoch >= 0:
273: torch.save(
274: checkpoint, f"./test__Train Loss:{train_loss:.4f}-{epoch}.pkl"
275: )
276:
# fixes the seed
random_seed(seed=42)
# trains the model
Train(model, encoder, decoder, train_iterator, optimizer, 500, device=device)
Show code cell output
0%| | 0/19 [00:00<?, ?it/s]
5%|▌ | 1/19 [00:00<00:02, 8.34it/s]
100%|██████████| 19/19 [00:00<00:00, 125.09it/s]
Epoch 0, Train Loss: 2.0557
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 325.88it/s]
Epoch 1, Train Loss: 1.8709
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 286.00it/s]
Epoch 2, Train Loss: 1.7014
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 394.22it/s]
Epoch 3, Train Loss: 1.5465
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 262.36it/s]
Epoch 4, Train Loss: 1.3983
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.85it/s]
Epoch 5, Train Loss: 1.2586
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.75it/s]
Epoch 6, Train Loss: 1.1299
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.74it/s]
Epoch 7, Train Loss: 1.0058
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.78it/s]
Epoch 8, Train Loss: 0.8919
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 346.51it/s]
Epoch 9, Train Loss: 0.7870
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.59it/s]
Epoch 10, Train Loss: 0.6910
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 467.33it/s]
Epoch 11, Train Loss: 0.6044
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 514.00it/s]
Epoch 12, Train Loss: 0.5278
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 399.47it/s]
Epoch 13, Train Loss: 0.4611
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 246.81it/s]
Epoch 14, Train Loss: 0.4038
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 293.58it/s]
Epoch 15, Train Loss: 0.3553
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.92it/s]
Epoch 16, Train Loss: 0.3155
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 518.25it/s]
Epoch 17, Train Loss: 0.2828
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 607.25it/s]
Epoch 18, Train Loss: 0.2565
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 603.21it/s]
Epoch 19, Train Loss: 0.2355
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 607.69it/s]
Epoch 20, Train Loss: 0.2191
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 475.86it/s]
Epoch 21, Train Loss: 0.2055
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 481.17it/s]
Epoch 22, Train Loss: 0.1945
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 439.22it/s]
Epoch 23, Train Loss: 0.1857
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 586.55it/s]
Epoch 24, Train Loss: 0.1780
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 596.47it/s]
Epoch 25, Train Loss: 0.1714
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 602.06it/s]
Epoch 26, Train Loss: 0.1664
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.43it/s]
Epoch 27, Train Loss: 0.1614
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 576.05it/s]
Epoch 28, Train Loss: 0.1573
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 443.13it/s]
Epoch 29, Train Loss: 0.1535
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 505.96it/s]
Epoch 30, Train Loss: 0.1501
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 573.12it/s]
Epoch 31, Train Loss: 0.1467
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 432.56it/s]
Epoch 32, Train Loss: 0.1440
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 428.48it/s]
Epoch 33, Train Loss: 0.1412
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 567.99it/s]
Epoch 34, Train Loss: 0.1385
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 542.91it/s]
Epoch 35, Train Loss: 0.1361
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 338.21it/s]
Epoch 36, Train Loss: 0.1338
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 453.03it/s]
Epoch 37, Train Loss: 0.1314
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 347.38it/s]
Epoch 38, Train Loss: 0.1291
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 374.63it/s]
Epoch 39, Train Loss: 0.1268
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 417.42it/s]
Epoch 40, Train Loss: 0.1245
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 581.46it/s]
Epoch 41, Train Loss: 0.1225
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 601.95it/s]
Epoch 42, Train Loss: 0.1204
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 576.02it/s]
Epoch 43, Train Loss: 0.1181
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.36it/s]
Epoch 44, Train Loss: 0.1161
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 519.86it/s]
Epoch 45, Train Loss: 0.1140
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 319.51it/s]
Epoch 46, Train Loss: 0.1121
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 532.49it/s]
Epoch 47, Train Loss: 0.1099
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 588.25it/s]
Epoch 48, Train Loss: 0.1081
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 516.04it/s]
Epoch 49, Train Loss: 0.1062
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 429.32it/s]
Epoch 50, Train Loss: 0.1044
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 469.82it/s]
Epoch 51, Train Loss: 0.1024
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 601.20it/s]
Epoch 52, Train Loss: 0.1005
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 532.33it/s]
Epoch 53, Train Loss: 0.0986
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 359.65it/s]
Epoch 54, Train Loss: 0.0969
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 510.69it/s]
Epoch 55, Train Loss: 0.0949
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 622.76it/s]
Epoch 56, Train Loss: 0.0933
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 525.86it/s]
Epoch 57, Train Loss: 0.0914
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 613.46it/s]
Epoch 58, Train Loss: 0.0897
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 619.63it/s]
Epoch 59, Train Loss: 0.0880
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 540.63it/s]
Epoch 60, Train Loss: 0.0863
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 563.93it/s]
Epoch 61, Train Loss: 0.0847
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 596.96it/s]
Epoch 62, Train Loss: 0.0831
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 587.83it/s]
Epoch 63, Train Loss: 0.0816
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 611.90it/s]
Epoch 64, Train Loss: 0.0801
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 585.74it/s]
Epoch 65, Train Loss: 0.0784
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 569.26it/s]
Epoch 66, Train Loss: 0.0771
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 573.33it/s]
Epoch 67, Train Loss: 0.0755
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 583.84it/s]
Epoch 68, Train Loss: 0.0743
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 461.95it/s]
Epoch 69, Train Loss: 0.0727
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 537.72it/s]
Epoch 70, Train Loss: 0.0713
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 461.61it/s]
Epoch 71, Train Loss: 0.0701
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 601.27it/s]
Epoch 72, Train Loss: 0.0689
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 357.84it/s]
Epoch 73, Train Loss: 0.0676
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 383.21it/s]
Epoch 74, Train Loss: 0.0664
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 556.28it/s]
Epoch 75, Train Loss: 0.0651
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 609.05it/s]
Epoch 76, Train Loss: 0.0639
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 560.91it/s]
Epoch 77, Train Loss: 0.0628
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 613.57it/s]
Epoch 78, Train Loss: 0.0618
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 587.62it/s]
Epoch 79, Train Loss: 0.0607
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 553.55it/s]
Epoch 80, Train Loss: 0.0597
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 541.23it/s]
Epoch 81, Train Loss: 0.0586
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 349.18it/s]
Epoch 82, Train Loss: 0.0577
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 387.54it/s]
Epoch 83, Train Loss: 0.0568
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 224.42it/s]
Epoch 84, Train Loss: 0.0558
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 293.30it/s]
Epoch 85, Train Loss: 0.0549
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 301.22it/s]
Epoch 86, Train Loss: 0.0539
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 364.33it/s]
Epoch 87, Train Loss: 0.0531
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 334.50it/s]
Epoch 88, Train Loss: 0.0524
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 386.56it/s]
Epoch 89, Train Loss: 0.0515
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 541.12it/s]
Epoch 90, Train Loss: 0.0507
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.16it/s]
Epoch 91, Train Loss: 0.0500
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.49it/s]
Epoch 92, Train Loss: 0.0492
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.96it/s]
Epoch 93, Train Loss: 0.0484
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 432.68it/s]
Epoch 94, Train Loss: 0.0477
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 399.88it/s]
Epoch 95, Train Loss: 0.0470
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 337.14it/s]
Epoch 96, Train Loss: 0.0463
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 497.64it/s]
Epoch 97, Train Loss: 0.0457
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 321.53it/s]
Epoch 98, Train Loss: 0.0451
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 475.89it/s]
Epoch 99, Train Loss: 0.0445
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 547.94it/s]
Epoch 100, Train Loss: 0.0437
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.39it/s]
Epoch 101, Train Loss: 0.0431
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 229.71it/s]
Epoch 102, Train Loss: 0.0425
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.14it/s]
Epoch 103, Train Loss: 0.0420
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 473.43it/s]
Epoch 104, Train Loss: 0.0415
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 418.83it/s]
Epoch 105, Train Loss: 0.0409
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 497.03it/s]
Epoch 106, Train Loss: 0.0403
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 455.99it/s]
Epoch 107, Train Loss: 0.0397
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 376.99it/s]
Epoch 108, Train Loss: 0.0392
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 576.49it/s]
Epoch 109, Train Loss: 0.0388
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 357.75it/s]
Epoch 110, Train Loss: 0.0382
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 458.25it/s]
Epoch 111, Train Loss: 0.0378
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 388.75it/s]
Epoch 112, Train Loss: 0.0373
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 249.25it/s]
Epoch 113, Train Loss: 0.0369
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 287.63it/s]
Epoch 114, Train Loss: 0.0365
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 322.15it/s]
Epoch 115, Train Loss: 0.0359
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 432.07it/s]
Epoch 116, Train Loss: 0.0354
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.47it/s]
Epoch 117, Train Loss: 0.0350
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 377.84it/s]
Epoch 118, Train Loss: 0.0346
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 408.77it/s]
Epoch 119, Train Loss: 0.0341
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 441.06it/s]
Epoch 120, Train Loss: 0.0338
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 419.99it/s]
Epoch 121, Train Loss: 0.0333
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.11it/s]
Epoch 122, Train Loss: 0.0330
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 311.78it/s]
Epoch 123, Train Loss: 0.0326
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.03it/s]
Epoch 124, Train Loss: 0.0321
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 299.78it/s]
Epoch 125, Train Loss: 0.0318
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.48it/s]
Epoch 126, Train Loss: 0.0314
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 358.87it/s]
Epoch 127, Train Loss: 0.0311
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 499.88it/s]
Epoch 128, Train Loss: 0.0307
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.80it/s]
Epoch 129, Train Loss: 0.0304
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 249.78it/s]
Epoch 130, Train Loss: 0.0300
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 344.49it/s]
Epoch 131, Train Loss: 0.0297
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 426.28it/s]
Epoch 132, Train Loss: 0.0294
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 445.71it/s]
Epoch 133, Train Loss: 0.0290
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.87it/s]
Epoch 134, Train Loss: 0.0287
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 364.47it/s]
Epoch 135, Train Loss: 0.0283
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 344.62it/s]
Epoch 136, Train Loss: 0.0280
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.29it/s]
Epoch 137, Train Loss: 0.0278
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 350.19it/s]
Epoch 138, Train Loss: 0.0274
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 373.29it/s]
Epoch 139, Train Loss: 0.0271
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 372.94it/s]
Epoch 140, Train Loss: 0.0268
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.16it/s]
Epoch 141, Train Loss: 0.0266
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 394.46it/s]
Epoch 142, Train Loss: 0.0262
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 335.64it/s]
Epoch 143, Train Loss: 0.0259
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 294.92it/s]
Epoch 144, Train Loss: 0.0257
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.44it/s]
Epoch 145, Train Loss: 0.0254
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 311.63it/s]
Epoch 146, Train Loss: 0.0252
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 295.80it/s]
Epoch 147, Train Loss: 0.0250
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 331.35it/s]
Epoch 148, Train Loss: 0.0246
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 323.36it/s]
Epoch 149, Train Loss: 0.0245
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 394.71it/s]
Epoch 150, Train Loss: 0.0242
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 327.57it/s]
Epoch 151, Train Loss: 0.0239
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.10it/s]
Epoch 152, Train Loss: 0.0237
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 341.00it/s]
Epoch 153, Train Loss: 0.0234
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 571.26it/s]
Epoch 154, Train Loss: 0.0232
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 587.44it/s]
Epoch 155, Train Loss: 0.0230
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 583.37it/s]
Epoch 156, Train Loss: 0.0227
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 578.24it/s]
Epoch 157, Train Loss: 0.0225
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 445.72it/s]
Epoch 158, Train Loss: 0.0224
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 288.02it/s]
Epoch 159, Train Loss: 0.0220
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.27it/s]
Epoch 160, Train Loss: 0.0218
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 570.21it/s]
Epoch 161, Train Loss: 0.0217
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 573.32it/s]
Epoch 162, Train Loss: 0.0215
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 583.19it/s]
Epoch 163, Train Loss: 0.0212
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 316.44it/s]
Epoch 164, Train Loss: 0.0211
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 513.28it/s]
Epoch 165, Train Loss: 0.0208
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 588.99it/s]
Epoch 166, Train Loss: 0.0207
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 571.43it/s]
Epoch 167, Train Loss: 0.0204
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 561.82it/s]
Epoch 168, Train Loss: 0.0202
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 351.47it/s]
Epoch 169, Train Loss: 0.0201
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 357.95it/s]
Epoch 170, Train Loss: 0.0199
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 579.44it/s]
Epoch 171, Train Loss: 0.0197
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 519.87it/s]
Epoch 172, Train Loss: 0.0195
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 311.38it/s]
Epoch 173, Train Loss: 0.0193
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.77it/s]
Epoch 174, Train Loss: 0.0192
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.82it/s]
Epoch 175, Train Loss: 0.0190
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 384.62it/s]
Epoch 176, Train Loss: 0.0187
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 372.57it/s]
Epoch 177, Train Loss: 0.0187
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 288.06it/s]
Epoch 178, Train Loss: 0.0185
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 290.90it/s]
Epoch 179, Train Loss: 0.0182
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 383.30it/s]
Epoch 180, Train Loss: 0.0181
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.92it/s]
Epoch 181, Train Loss: 0.0179
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 283.36it/s]
Epoch 182, Train Loss: 0.0178
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 356.27it/s]
Epoch 183, Train Loss: 0.0176
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 387.15it/s]
Epoch 184, Train Loss: 0.0174
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 335.28it/s]
Epoch 185, Train Loss: 0.0173
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 301.89it/s]
Epoch 186, Train Loss: 0.0171
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 310.17it/s]
Epoch 187, Train Loss: 0.0169
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.61it/s]
Epoch 188, Train Loss: 0.0168
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.34it/s]
Epoch 189, Train Loss: 0.0166
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 468.17it/s]
Epoch 190, Train Loss: 0.0165
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 380.12it/s]
Epoch 191, Train Loss: 0.0164
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 333.67it/s]
Epoch 192, Train Loss: 0.0162
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 495.71it/s]
Epoch 193, Train Loss: 0.0161
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 345.71it/s]
Epoch 194, Train Loss: 0.0159
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.60it/s]
Epoch 195, Train Loss: 0.0158
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 380.58it/s]
Epoch 196, Train Loss: 0.0156
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 298.73it/s]
Epoch 197, Train Loss: 0.0155
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 354.66it/s]
Epoch 198, Train Loss: 0.0153
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 287.83it/s]
Epoch 199, Train Loss: 0.0152
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 583.76it/s]
Epoch 200, Train Loss: 0.0150
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 405.62it/s]
Epoch 201, Train Loss: 0.0148
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 362.21it/s]
Epoch 202, Train Loss: 0.0147
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 361.70it/s]
Epoch 203, Train Loss: 0.0145
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 593.87it/s]
Epoch 204, Train Loss: 0.0144
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 387.88it/s]
Epoch 205, Train Loss: 0.0143
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 292.11it/s]
Epoch 206, Train Loss: 0.0141
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 340.33it/s]
Epoch 207, Train Loss: 0.0139
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 328.95it/s]
Epoch 208, Train Loss: 0.0138
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 346.33it/s]
Epoch 209, Train Loss: 0.0136
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.31it/s]
Epoch 210, Train Loss: 0.0135
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 343.00it/s]
Epoch 211, Train Loss: 0.0134
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.42it/s]
Epoch 212, Train Loss: 0.0133
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 352.54it/s]
Epoch 213, Train Loss: 0.0131
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 434.07it/s]
Epoch 214, Train Loss: 0.0129
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 429.59it/s]
Epoch 215, Train Loss: 0.0128
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 481.44it/s]
Epoch 216, Train Loss: 0.0127
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 356.79it/s]
Epoch 217, Train Loss: 0.0125
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 432.75it/s]
Epoch 218, Train Loss: 0.0123
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 293.70it/s]
Epoch 219, Train Loss: 0.0122
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 382.70it/s]
Epoch 220, Train Loss: 0.0120
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.80it/s]
Epoch 221, Train Loss: 0.0119
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 248.62it/s]
Epoch 222, Train Loss: 0.0118
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 228.52it/s]
Epoch 223, Train Loss: 0.0116
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 406.17it/s]
Epoch 224, Train Loss: 0.0115
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 447.16it/s]
Epoch 225, Train Loss: 0.0114
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 465.79it/s]
Epoch 226, Train Loss: 0.0112
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 330.80it/s]
Epoch 227, Train Loss: 0.0110
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.15it/s]
Epoch 228, Train Loss: 0.0109
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.89it/s]
Epoch 229, Train Loss: 0.0108
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.90it/s]
Epoch 230, Train Loss: 0.0106
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 404.10it/s]
Epoch 231, Train Loss: 0.0105
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.19it/s]
Epoch 232, Train Loss: 0.0104
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 543.06it/s]
Epoch 233, Train Loss: 0.0102
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 578.16it/s]
Epoch 234, Train Loss: 0.0101
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 450.12it/s]
Epoch 235, Train Loss: 0.0099
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 601.34it/s]
Epoch 236, Train Loss: 0.0098
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 561.52it/s]
Epoch 237, Train Loss: 0.0096
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 607.88it/s]
Epoch 238, Train Loss: 0.0096
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 568.46it/s]
Epoch 239, Train Loss: 0.0094
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 339.30it/s]
Epoch 240, Train Loss: 0.0093
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.12it/s]
Epoch 241, Train Loss: 0.0092
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 330.09it/s]
Epoch 242, Train Loss: 0.0090
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 330.27it/s]
Epoch 243, Train Loss: 0.0088
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 319.13it/s]
Epoch 244, Train Loss: 0.0087
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 301.82it/s]
Epoch 245, Train Loss: 0.0086
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.34it/s]
Epoch 246, Train Loss: 0.0084
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 313.10it/s]
Epoch 247, Train Loss: 0.0083
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.07it/s]
Epoch 248, Train Loss: 0.0082
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.78it/s]
Epoch 249, Train Loss: 0.0080
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.66it/s]
Epoch 250, Train Loss: 0.0079
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.41it/s]
Epoch 251, Train Loss: 0.0078
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 255.27it/s]
Epoch 252, Train Loss: 0.0077
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 391.43it/s]
Epoch 253, Train Loss: 0.0075
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 467.01it/s]
Epoch 254, Train Loss: 0.0074
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.26it/s]
Epoch 255, Train Loss: 0.0073
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.44it/s]
Epoch 256, Train Loss: 0.0071
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.34it/s]
Epoch 257, Train Loss: 0.0070
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 464.59it/s]
Epoch 258, Train Loss: 0.0069
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 311.96it/s]
Epoch 259, Train Loss: 0.0067
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 327.30it/s]
Epoch 260, Train Loss: 0.0066
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 549.77it/s]
Epoch 261, Train Loss: 0.0065
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 573.93it/s]
Epoch 262, Train Loss: 0.0064
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 612.49it/s]
Epoch 263, Train Loss: 0.0062
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 593.49it/s]
Epoch 264, Train Loss: 0.0061
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 593.40it/s]
Epoch 265, Train Loss: 0.0060
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 600.48it/s]
Epoch 266, Train Loss: 0.0059
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.53it/s]
Epoch 267, Train Loss: 0.0057
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 586.06it/s]
Epoch 268, Train Loss: 0.0056
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 601.46it/s]
Epoch 269, Train Loss: 0.0055
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 608.22it/s]
Epoch 270, Train Loss: 0.0054
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 614.66it/s]
Epoch 271, Train Loss: 0.0052
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 534.37it/s]
Epoch 272, Train Loss: 0.0052
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 351.62it/s]
Epoch 273, Train Loss: 0.0050
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.70it/s]
Epoch 274, Train Loss: 0.0049
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 228.44it/s]
Epoch 275, Train Loss: 0.0048
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 332.33it/s]
Epoch 276, Train Loss: 0.0047
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 440.18it/s]
Epoch 277, Train Loss: 0.0046
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.51it/s]
Epoch 278, Train Loss: 0.0045
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.38it/s]
Epoch 279, Train Loss: 0.0043
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 248.30it/s]
Epoch 280, Train Loss: 0.0042
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.76it/s]
Epoch 281, Train Loss: 0.0041
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.89it/s]
Epoch 282, Train Loss: 0.0040
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.45it/s]
Epoch 283, Train Loss: 0.0039
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 224.80it/s]
Epoch 284, Train Loss: 0.0038
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.42it/s]
Epoch 285, Train Loss: 0.0037
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.28it/s]
Epoch 286, Train Loss: 0.0036
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 297.59it/s]
Epoch 287, Train Loss: 0.0035
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 431.81it/s]
Epoch 288, Train Loss: 0.0034
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 489.82it/s]
Epoch 289, Train Loss: 0.0033
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 433.02it/s]
Epoch 290, Train Loss: 0.0032
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 372.08it/s]
Epoch 291, Train Loss: 0.0031
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 249.49it/s]
Epoch 292, Train Loss: 0.0030
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 405.51it/s]
Epoch 293, Train Loss: 0.0029
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 524.44it/s]
Epoch 294, Train Loss: 0.0028
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 499.37it/s]
Epoch 295, Train Loss: 0.0027
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 355.93it/s]
Epoch 296, Train Loss: 0.0026
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.39it/s]
Epoch 297, Train Loss: 0.0025
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.20it/s]
Epoch 298, Train Loss: 0.0024
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.91it/s]
Epoch 299, Train Loss: 0.0023
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 333.95it/s]
Epoch 300, Train Loss: 0.0023
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 442.29it/s]
Epoch 301, Train Loss: 0.0022
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 488.95it/s]
Epoch 302, Train Loss: 0.0021
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 503.30it/s]
Epoch 303, Train Loss: 0.0020
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 456.21it/s]
Epoch 304, Train Loss: 0.0019
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 256.69it/s]
Epoch 305, Train Loss: 0.0019
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.66it/s]
Epoch 306, Train Loss: 0.0018
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.18it/s]
Epoch 307, Train Loss: 0.0017
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.78it/s]
Epoch 308, Train Loss: 0.0016
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 255.05it/s]
Epoch 309, Train Loss: 0.0016
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 379.19it/s]
Epoch 310, Train Loss: 0.0015
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 547.77it/s]
Epoch 311, Train Loss: 0.0014
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 575.72it/s]
Epoch 312, Train Loss: 0.0014
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 464.73it/s]
Epoch 313, Train Loss: 0.0013
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 359.17it/s]
Epoch 314, Train Loss: 0.0013
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.54it/s]
Epoch 315, Train Loss: 0.0012
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 401.45it/s]
Epoch 316, Train Loss: 0.0011
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 297.55it/s]
Epoch 317, Train Loss: 0.0011
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.75it/s]
Epoch 318, Train Loss: 0.0010
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.21it/s]
Epoch 319, Train Loss: 0.0010
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.94it/s]
Epoch 320, Train Loss: 0.0009
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.55it/s]
Epoch 321, Train Loss: 0.0009
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 344.24it/s]
Epoch 322, Train Loss: 0.0009
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 531.61it/s]
Epoch 323, Train Loss: 0.0008
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 560.53it/s]
Epoch 324, Train Loss: 0.0008
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 305.68it/s]
Epoch 325, Train Loss: 0.0007
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 359.57it/s]
Epoch 326, Train Loss: 0.0007
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 380.82it/s]
Epoch 327, Train Loss: 0.0007
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 436.70it/s]
Epoch 328, Train Loss: 0.0006
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 484.29it/s]
Epoch 329, Train Loss: 0.0006
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 489.87it/s]
Epoch 330, Train Loss: 0.0006
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 491.80it/s]
Epoch 331, Train Loss: 0.0005
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 496.97it/s]
Epoch 332, Train Loss: 0.0005
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 457.50it/s]
Epoch 333, Train Loss: 0.0005
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 363.98it/s]
Epoch 334, Train Loss: 0.0004
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 495.13it/s]
Epoch 335, Train Loss: 0.0004
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 522.93it/s]
Epoch 336, Train Loss: 0.0004
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 508.84it/s]
Epoch 337, Train Loss: 0.0004
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 521.28it/s]
Epoch 338, Train Loss: 0.0004
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 360.96it/s]
Epoch 339, Train Loss: 0.0003
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 422.34it/s]
Epoch 340, Train Loss: 0.0003
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 508.55it/s]
Epoch 341, Train Loss: 0.0003
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 500.22it/s]
Epoch 342, Train Loss: 0.0003
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 303.95it/s]
Epoch 343, Train Loss: 0.0003
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 503.99it/s]
Epoch 344, Train Loss: 0.0003
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 494.79it/s]
Epoch 345, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 295.88it/s]
Epoch 346, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 340.32it/s]
Epoch 347, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 450.49it/s]
Epoch 348, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 348.32it/s]
Epoch 349, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.41it/s]
Epoch 350, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 296.17it/s]
Epoch 351, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 447.63it/s]
Epoch 352, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.45it/s]
Epoch 353, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.61it/s]
Epoch 354, Train Loss: 0.0002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.10it/s]
Epoch 355, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.73it/s]
Epoch 356, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 249.75it/s]
Epoch 357, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 306.65it/s]
Epoch 358, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 349.37it/s]
Epoch 359, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 465.37it/s]
Epoch 360, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 489.44it/s]
Epoch 361, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 344.70it/s]
Epoch 362, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 359.03it/s]
Epoch 363, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 305.07it/s]
Epoch 364, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.44it/s]
Epoch 365, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 300.89it/s]
Epoch 366, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 294.90it/s]
Epoch 367, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 312.79it/s]
Epoch 368, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 338.18it/s]
Epoch 369, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.45it/s]
Epoch 370, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 226.02it/s]
Epoch 371, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.87it/s]
Epoch 372, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 315.83it/s]
Epoch 373, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 296.76it/s]
Epoch 374, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.63it/s]
Epoch 375, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.69it/s]
Epoch 376, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.47it/s]
Epoch 377, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.88it/s]
Epoch 378, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 411.24it/s]
Epoch 379, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 299.26it/s]
Epoch 380, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 409.92it/s]
Epoch 381, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 307.47it/s]
Epoch 382, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 350.42it/s]
Epoch 383, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 224.26it/s]
Epoch 384, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.48it/s]
Epoch 385, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 504.11it/s]
Epoch 386, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.62it/s]
Epoch 387, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 346.71it/s]
Epoch 388, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 334.22it/s]
Epoch 389, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.99it/s]
Epoch 390, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 344.80it/s]
Epoch 391, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 332.29it/s]
Epoch 392, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.18it/s]
Epoch 393, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 314.56it/s]
Epoch 394, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 486.41it/s]
Epoch 395, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 579.51it/s]
Epoch 396, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 616.24it/s]
Epoch 397, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 613.57it/s]
Epoch 398, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 423.42it/s]
Epoch 399, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 561.00it/s]
Epoch 400, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 624.19it/s]
Epoch 401, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 614.51it/s]
Epoch 402, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.66it/s]
Epoch 403, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 420.34it/s]
Epoch 404, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 321.21it/s]
Epoch 405, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 485.35it/s]
Epoch 406, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 608.12it/s]
Epoch 407, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 618.70it/s]
Epoch 408, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 624.54it/s]
Epoch 409, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 614.60it/s]
Epoch 410, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 614.91it/s]
Epoch 411, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 485.31it/s]
Epoch 412, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 355.68it/s]
Epoch 413, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 373.21it/s]
Epoch 414, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 256.68it/s]
Epoch 415, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.23it/s]
Epoch 416, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.12it/s]
Epoch 417, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 299.45it/s]
Epoch 418, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 445.99it/s]
Epoch 419, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 475.23it/s]
Epoch 420, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 501.54it/s]
Epoch 421, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 502.82it/s]
Epoch 422, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 504.16it/s]
Epoch 423, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 551.53it/s]
Epoch 424, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 624.54it/s]
Epoch 425, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 617.12it/s]
Epoch 426, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 609.44it/s]
Epoch 427, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 609.59it/s]
Epoch 428, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 612.86it/s]
Epoch 429, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 621.35it/s]
Epoch 430, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 628.61it/s]
Epoch 431, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 531.62it/s]
Epoch 432, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 612.43it/s]
Epoch 433, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 613.85it/s]
Epoch 434, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 613.28it/s]
Epoch 435, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.57it/s]
Epoch 436, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.99it/s]
Epoch 437, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 423.19it/s]
Epoch 438, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 572.79it/s]
Epoch 439, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.66it/s]
Epoch 440, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 600.84it/s]
Epoch 441, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 626.94it/s]
Epoch 442, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 620.72it/s]
Epoch 443, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 611.10it/s]
Epoch 444, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 630.29it/s]
Epoch 445, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 602.86it/s]
Epoch 446, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 621.04it/s]
Epoch 447, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 598.32it/s]
Epoch 448, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 623.31it/s]
Epoch 449, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 623.34it/s]
Epoch 450, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 614.14it/s]
Epoch 451, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 621.33it/s]
Epoch 452, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 630.99it/s]
Epoch 453, Train Loss: 0.0001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 619.69it/s]
Epoch 454, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 621.31it/s]
Epoch 455, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 619.96it/s]
Epoch 456, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 606.13it/s]
Epoch 457, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 552.68it/s]
Epoch 458, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 509.58it/s]
Epoch 459, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 501.61it/s]
Epoch 460, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 519.30it/s]
Epoch 461, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 517.33it/s]
Epoch 462, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 502.21it/s]
Epoch 463, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 514.80it/s]
Epoch 464, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 517.16it/s]
Epoch 465, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 514.61it/s]
Epoch 466, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 448.11it/s]
Epoch 467, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 345.57it/s]
Epoch 468, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 485.77it/s]
Epoch 469, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 471.98it/s]
Epoch 470, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 318.04it/s]
Epoch 471, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 332.75it/s]
Epoch 472, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.93it/s]
Epoch 473, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 316.42it/s]
Epoch 474, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 313.71it/s]
Epoch 475, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 338.68it/s]
Epoch 476, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.90it/s]
Epoch 477, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 347.34it/s]
Epoch 478, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 473.38it/s]
Epoch 479, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 496.54it/s]
Epoch 480, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 456.21it/s]
Epoch 481, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 412.30it/s]
Epoch 482, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 501.20it/s]
Epoch 483, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 498.72it/s]
Epoch 484, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 248.18it/s]
Epoch 485, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 351.53it/s]
Epoch 486, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 480.13it/s]
Epoch 487, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 334.96it/s]
Epoch 488, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 349.61it/s]
Epoch 489, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 333.73it/s]
Epoch 490, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 424.39it/s]
Epoch 491, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 285.30it/s]
Epoch 492, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 250.73it/s]
Epoch 493, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.08it/s]
Epoch 494, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 389.07it/s]
Epoch 495, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 469.10it/s]
Epoch 496, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 439.58it/s]
Epoch 497, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 510.44it/s]
Epoch 498, Train Loss: 0.0000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 550.13it/s]
Epoch 499, Train Loss: 0.0000
.............................
Evaluates the model after training#
print_code(transform_nn)
278: def transform_nn(data, encoder, decoder, device = 'cuda'):
279: """Extracts the inference from the autoencoder
280:
281: Args:
282: data (array, float): input data
283: encoder (PyTorch model): encoder block
284: decoder (PyTorch model): decoder block
285: device (str, optional): selects the device to use. Defaults to "cuda".
286:
287: Returns:
288: array, float: encoder results, decoder results
289: """
290: try:
291: encoded_spectra = encoder(
292: torch.tensor(np.atleast_3d(data), dtype=torch.float32).to(device)
293: )
294: except:
295: pass
296:
297: try:
298: encoded_spectra = encoder(torch.tensor(data, dtype=torch.float32).to(device))
299: except:
300: pass
301:
302: decoded_spectra = decoder(encoded_spectra)
303:
304: encoded_spectra = encoded_spectra.to("cpu")
305: encoded_spectra = encoded_spectra.detach().numpy()
306: decoded_spectra = decoded_spectra.to("cpu")
307: decoded_spectra = decoded_spectra.detach().numpy()
308: return encoded_spectra, decoded_spectra
309:
# evaluates the model
encode, decode = transform_nn(dog_data, encoder, decoder, device=device)
# computes the embeddings
embeddings(encode, shape_=image.shape[0:2], figsize=(15, 5), clim=(-2, 2))
This is clearly an overcomplete example since we are learning 10 timesteps with 12 latent variables
We know that we only have 3 intrinsic latent variables
Model with 3 latent variables#
Instantiates the model (3 latent variables)#
# rebuilds the model with 3 latent dimensions
encoder = Encoder(latent_dim=3).to(device)
decoder = Decoder(latent_dim=3).to(device)
model = Autoencoder(encoder, decoder).to(device)
# optimizer
optimizer = optim.Adam(model.parameters(), lr=3e-4)
# prints the summary of the model
summary(model, ((X_train.shape[1:])))
----------------------------------------------------------------
Layer (type) Output Shape Param #
================================================================
Linear-1 [-1, 3] 33
Encoder-2 [-1, 3] 0
Linear-3 [-1, 10] 40
Decoder-4 [-1, 10] 0
================================================================
Total params: 73
Trainable params: 73
Non-trainable params: 0
----------------------------------------------------------------
Input size (MB): 0.00
Forward/backward pass size (MB): 0.00
Params size (MB): 0.00
Estimated Total Size (MB): 0.00
----------------------------------------------------------------
Encoder with 3 latent dimensions
Decoder with with size 10 –> same as orignal spectral length
Autoencoder considers time by saying each timestep is its own fully-uncorrelated sample
train_iterator = torch.utils.data.DataLoader(
X_train, batch_size=256, shuffle=True)
Trains the model#
random_seed(seed=42)
Train(model, encoder, decoder, train_iterator, optimizer, 500, device=device)
Show code cell output
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 315.62it/s]
Epoch 0, Train Loss: 2.3594
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 352.67it/s]
Epoch 1, Train Loss: 2.3181
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 561.37it/s]
Epoch 2, Train Loss: 2.2805
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 588.41it/s]
Epoch 3, Train Loss: 2.2494
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 443.99it/s]
Epoch 4, Train Loss: 2.2163
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 503.88it/s]
Epoch 5, Train Loss: 2.1850
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.26it/s]
Epoch 6, Train Loss: 2.1561
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 468.35it/s]
Epoch 7, Train Loss: 2.1224
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 524.55it/s]
Epoch 8, Train Loss: 2.0912
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.20it/s]
Epoch 9, Train Loss: 2.0593
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.98it/s]
Epoch 10, Train Loss: 2.0236
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 285.07it/s]
Epoch 11, Train Loss: 1.9853
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 296.41it/s]
Epoch 12, Train Loss: 1.9495
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.99it/s]
Epoch 13, Train Loss: 1.9113
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 356.03it/s]
Epoch 14, Train Loss: 1.8703
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 467.95it/s]
Epoch 15, Train Loss: 1.8264
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 463.46it/s]
Epoch 16, Train Loss: 1.7808
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.02it/s]
Epoch 17, Train Loss: 1.7369
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.45it/s]
Epoch 18, Train Loss: 1.6876
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 342.75it/s]
Epoch 19, Train Loss: 1.6333
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 291.00it/s]
Epoch 20, Train Loss: 1.5798
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 314.05it/s]
Epoch 21, Train Loss: 1.5261
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 466.46it/s]
Epoch 22, Train Loss: 1.4660
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.52it/s]
Epoch 23, Train Loss: 1.4064
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 407.97it/s]
Epoch 24, Train Loss: 1.3457
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 262.31it/s]
Epoch 25, Train Loss: 1.2864
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 288.20it/s]
Epoch 26, Train Loss: 1.2266
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.62it/s]
Epoch 27, Train Loss: 1.1685
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 420.39it/s]
Epoch 28, Train Loss: 1.1097
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 287.42it/s]
Epoch 29, Train Loss: 1.0524
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 319.35it/s]
Epoch 30, Train Loss: 0.9975
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 316.94it/s]
Epoch 31, Train Loss: 0.9439
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 528.39it/s]
Epoch 32, Train Loss: 0.8917
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 300.73it/s]
Epoch 33, Train Loss: 0.8427
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.97it/s]
Epoch 34, Train Loss: 0.7950
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 475.46it/s]
Epoch 35, Train Loss: 0.7502
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 537.08it/s]
Epoch 36, Train Loss: 0.7077
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 564.48it/s]
Epoch 37, Train Loss: 0.6668
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 609.28it/s]
Epoch 38, Train Loss: 0.6293
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 621.43it/s]
Epoch 39, Train Loss: 0.5935
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 566.30it/s]
Epoch 40, Train Loss: 0.5598
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 599.78it/s]
Epoch 41, Train Loss: 0.5290
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 551.59it/s]
Epoch 42, Train Loss: 0.5001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 563.38it/s]
Epoch 43, Train Loss: 0.4723
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 593.27it/s]
Epoch 44, Train Loss: 0.4470
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 409.27it/s]
Epoch 45, Train Loss: 0.4242
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.36it/s]
Epoch 46, Train Loss: 0.4030
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.97it/s]
Epoch 47, Train Loss: 0.3825
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 294.38it/s]
Epoch 48, Train Loss: 0.3655
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 327.40it/s]
Epoch 49, Train Loss: 0.3486
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 516.16it/s]
Epoch 50, Train Loss: 0.3335
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 543.43it/s]
Epoch 51, Train Loss: 0.3193
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 596.58it/s]
Epoch 52, Train Loss: 0.3065
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 589.81it/s]
Epoch 53, Train Loss: 0.2943
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 619.88it/s]
Epoch 54, Train Loss: 0.2836
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 576.93it/s]
Epoch 55, Train Loss: 0.2732
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 610.47it/s]
Epoch 56, Train Loss: 0.2647
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 617.64it/s]
Epoch 57, Train Loss: 0.2565
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 562.53it/s]
Epoch 58, Train Loss: 0.2486
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 582.55it/s]
Epoch 59, Train Loss: 0.2418
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 579.62it/s]
Epoch 60, Train Loss: 0.2354
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 337.41it/s]
Epoch 61, Train Loss: 0.2295
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 392.85it/s]
Epoch 62, Train Loss: 0.2243
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 381.50it/s]
Epoch 63, Train Loss: 0.2194
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 516.63it/s]
Epoch 64, Train Loss: 0.2149
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 599.06it/s]
Epoch 65, Train Loss: 0.2106
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 562.70it/s]
Epoch 66, Train Loss: 0.2071
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 596.36it/s]
Epoch 67, Train Loss: 0.2032
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 569.34it/s]
Epoch 68, Train Loss: 0.2003
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 602.09it/s]
Epoch 69, Train Loss: 0.1968
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 594.66it/s]
Epoch 70, Train Loss: 0.1943
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 608.53it/s]
Epoch 71, Train Loss: 0.1916
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 592.86it/s]
Epoch 72, Train Loss: 0.1892
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 608.24it/s]
Epoch 73, Train Loss: 0.1871
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 582.67it/s]
Epoch 74, Train Loss: 0.1847
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 605.46it/s]
Epoch 75, Train Loss: 0.1827
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 530.66it/s]
Epoch 76, Train Loss: 0.1810
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 579.95it/s]
Epoch 77, Train Loss: 0.1790
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 513.34it/s]
Epoch 78, Train Loss: 0.1775
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 587.20it/s]
Epoch 79, Train Loss: 0.1761
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 583.75it/s]
Epoch 80, Train Loss: 0.1748
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 607.24it/s]
Epoch 81, Train Loss: 0.1733
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 571.71it/s]
Epoch 82, Train Loss: 0.1723
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 599.81it/s]
Epoch 83, Train Loss: 0.1712
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 598.75it/s]
Epoch 84, Train Loss: 0.1699
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 609.86it/s]
Epoch 85, Train Loss: 0.1690
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.92it/s]
Epoch 86, Train Loss: 0.1679
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 288.29it/s]
Epoch 87, Train Loss: 0.1672
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 394.20it/s]
Epoch 88, Train Loss: 0.1664
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 431.19it/s]
Epoch 89, Train Loss: 0.1657
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 375.71it/s]
Epoch 90, Train Loss: 0.1649
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 490.77it/s]
Epoch 91, Train Loss: 0.1641
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 483.36it/s]
Epoch 92, Train Loss: 0.1634
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 446.28it/s]
Epoch 93, Train Loss: 0.1628
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.17it/s]
Epoch 94, Train Loss: 0.1623
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 219.42it/s]
Epoch 95, Train Loss: 0.1619
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.27it/s]
Epoch 96, Train Loss: 0.1612
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 327.52it/s]
Epoch 97, Train Loss: 0.1608
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 334.42it/s]
Epoch 98, Train Loss: 0.1604
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 356.87it/s]
Epoch 99, Train Loss: 0.1599
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 492.28it/s]
Epoch 100, Train Loss: 0.1595
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 468.44it/s]
Epoch 101, Train Loss: 0.1592
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 465.46it/s]
Epoch 102, Train Loss: 0.1587
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 507.75it/s]
Epoch 103, Train Loss: 0.1585
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 569.09it/s]
Epoch 104, Train Loss: 0.1581
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 350.58it/s]
Epoch 105, Train Loss: 0.1578
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 409.35it/s]
Epoch 106, Train Loss: 0.1574
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 584.78it/s]
Epoch 107, Train Loss: 0.1570
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 599.62it/s]
Epoch 108, Train Loss: 0.1569
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 574.17it/s]
Epoch 109, Train Loss: 0.1566
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 558.91it/s]
Epoch 110, Train Loss: 0.1563
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 607.17it/s]
Epoch 111, Train Loss: 0.1561
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 531.11it/s]
Epoch 112, Train Loss: 0.1559
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 435.14it/s]
Epoch 113, Train Loss: 0.1558
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 484.49it/s]
Epoch 114, Train Loss: 0.1554
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 588.87it/s]
Epoch 115, Train Loss: 0.1551
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 367.88it/s]
Epoch 116, Train Loss: 0.1547
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 346.14it/s]
Epoch 117, Train Loss: 0.1545
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 301.84it/s]
Epoch 118, Train Loss: 0.1544
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 519.27it/s]
Epoch 119, Train Loss: 0.1540
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 600.85it/s]
Epoch 120, Train Loss: 0.1540
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 615.62it/s]
Epoch 121, Train Loss: 0.1537
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 602.53it/s]
Epoch 122, Train Loss: 0.1535
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 619.45it/s]
Epoch 123, Train Loss: 0.1534
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 557.68it/s]
Epoch 124, Train Loss: 0.1530
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 602.37it/s]
Epoch 125, Train Loss: 0.1527
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 574.60it/s]
Epoch 126, Train Loss: 0.1527
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 601.46it/s]
Epoch 127, Train Loss: 0.1524
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 497.01it/s]
Epoch 128, Train Loss: 0.1520
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 250.61it/s]
Epoch 129, Train Loss: 0.1518
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 398.09it/s]
Epoch 130, Train Loss: 0.1518
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 458.80it/s]
Epoch 131, Train Loss: 0.1514
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 493.81it/s]
Epoch 132, Train Loss: 0.1514
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 497.39it/s]
Epoch 133, Train Loss: 0.1510
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 550.65it/s]
Epoch 134, Train Loss: 0.1509
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 587.41it/s]
Epoch 135, Train Loss: 0.1506
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 597.66it/s]
Epoch 136, Train Loss: 0.1505
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 595.46it/s]
Epoch 137, Train Loss: 0.1501
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 606.55it/s]
Epoch 138, Train Loss: 0.1499
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 599.07it/s]
Epoch 139, Train Loss: 0.1496
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 591.98it/s]
Epoch 140, Train Loss: 0.1493
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 576.46it/s]
Epoch 141, Train Loss: 0.1493
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 601.66it/s]
Epoch 142, Train Loss: 0.1490
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.69it/s]
Epoch 143, Train Loss: 0.1486
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.32it/s]
Epoch 144, Train Loss: 0.1485
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 415.81it/s]
Epoch 145, Train Loss: 0.1483
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.46it/s]
Epoch 146, Train Loss: 0.1479
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 416.15it/s]
Epoch 147, Train Loss: 0.1478
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 327.83it/s]
Epoch 148, Train Loss: 0.1474
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.89it/s]
Epoch 149, Train Loss: 0.1474
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.62it/s]
Epoch 150, Train Loss: 0.1470
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 402.82it/s]
Epoch 151, Train Loss: 0.1469
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 441.70it/s]
Epoch 152, Train Loss: 0.1466
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.69it/s]
Epoch 153, Train Loss: 0.1463
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.45it/s]
Epoch 154, Train Loss: 0.1461
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.78it/s]
Epoch 155, Train Loss: 0.1458
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.06it/s]
Epoch 156, Train Loss: 0.1456
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 291.19it/s]
Epoch 157, Train Loss: 0.1452
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 315.30it/s]
Epoch 158, Train Loss: 0.1451
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.41it/s]
Epoch 159, Train Loss: 0.1447
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.06it/s]
Epoch 160, Train Loss: 0.1445
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 316.12it/s]
Epoch 161, Train Loss: 0.1441
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 334.05it/s]
Epoch 162, Train Loss: 0.1440
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 452.30it/s]
Epoch 163, Train Loss: 0.1438
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 490.75it/s]
Epoch 164, Train Loss: 0.1434
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 293.86it/s]
Epoch 165, Train Loss: 0.1431
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.84it/s]
Epoch 166, Train Loss: 0.1429
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 302.36it/s]
Epoch 167, Train Loss: 0.1426
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 472.64it/s]
Epoch 168, Train Loss: 0.1425
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.55it/s]
Epoch 169, Train Loss: 0.1422
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.29it/s]
Epoch 170, Train Loss: 0.1420
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.51it/s]
Epoch 171, Train Loss: 0.1414
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.07it/s]
Epoch 172, Train Loss: 0.1412
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 220.78it/s]
Epoch 173, Train Loss: 0.1411
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.36it/s]
Epoch 174, Train Loss: 0.1407
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 289.45it/s]
Epoch 175, Train Loss: 0.1407
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.46it/s]
Epoch 176, Train Loss: 0.1399
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 345.93it/s]
Epoch 177, Train Loss: 0.1402
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 539.37it/s]
Epoch 178, Train Loss: 0.1397
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 381.17it/s]
Epoch 179, Train Loss: 0.1395
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.45it/s]
Epoch 180, Train Loss: 0.1391
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 322.53it/s]
Epoch 181, Train Loss: 0.1387
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.01it/s]
Epoch 182, Train Loss: 0.1385
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 289.95it/s]
Epoch 183, Train Loss: 0.1382
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 310.94it/s]
Epoch 184, Train Loss: 0.1378
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.34it/s]
Epoch 185, Train Loss: 0.1378
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.17it/s]
Epoch 186, Train Loss: 0.1371
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 288.75it/s]
Epoch 187, Train Loss: 0.1370
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.55it/s]
Epoch 188, Train Loss: 0.1367
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 303.15it/s]
Epoch 189, Train Loss: 0.1365
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.55it/s]
Epoch 190, Train Loss: 0.1363
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.70it/s]
Epoch 191, Train Loss: 0.1361
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.03it/s]
Epoch 192, Train Loss: 0.1356
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 318.66it/s]
Epoch 193, Train Loss: 0.1355
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 457.09it/s]
Epoch 194, Train Loss: 0.1350
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 410.21it/s]
Epoch 195, Train Loss: 0.1349
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 467.15it/s]
Epoch 196, Train Loss: 0.1343
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.36it/s]
Epoch 197, Train Loss: 0.1342
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.05it/s]
Epoch 198, Train Loss: 0.1338
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.41it/s]
Epoch 199, Train Loss: 0.1336
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.36it/s]
Epoch 200, Train Loss: 0.1333
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.55it/s]
Epoch 201, Train Loss: 0.1328
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.10it/s]
Epoch 202, Train Loss: 0.1326
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 229.45it/s]
Epoch 203, Train Loss: 0.1325
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 248.61it/s]
Epoch 204, Train Loss: 0.1321
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 320.15it/s]
Epoch 205, Train Loss: 0.1320
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 429.66it/s]
Epoch 206, Train Loss: 0.1314
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 438.21it/s]
Epoch 207, Train Loss: 0.1311
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 306.36it/s]
Epoch 208, Train Loss: 0.1309
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 295.14it/s]
Epoch 209, Train Loss: 0.1304
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 457.76it/s]
Epoch 210, Train Loss: 0.1303
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 481.40it/s]
Epoch 211, Train Loss: 0.1302
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 426.32it/s]
Epoch 212, Train Loss: 0.1298
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 494.70it/s]
Epoch 213, Train Loss: 0.1294
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 494.52it/s]
Epoch 214, Train Loss: 0.1292
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 324.82it/s]
Epoch 215, Train Loss: 0.1287
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 262.91it/s]
Epoch 216, Train Loss: 0.1285
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 368.78it/s]
Epoch 217, Train Loss: 0.1282
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.75it/s]
Epoch 218, Train Loss: 0.1280
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 545.81it/s]
Epoch 219, Train Loss: 0.1277
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.94it/s]
Epoch 220, Train Loss: 0.1274
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 363.37it/s]
Epoch 221, Train Loss: 0.1271
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 524.46it/s]
Epoch 222, Train Loss: 0.1268
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 577.35it/s]
Epoch 223, Train Loss: 0.1266
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 557.84it/s]
Epoch 224, Train Loss: 0.1264
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 525.48it/s]
Epoch 225, Train Loss: 0.1260
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.16it/s]
Epoch 226, Train Loss: 0.1255
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 360.24it/s]
Epoch 227, Train Loss: 0.1253
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 547.27it/s]
Epoch 228, Train Loss: 0.1250
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 351.22it/s]
Epoch 229, Train Loss: 0.1250
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 287.52it/s]
Epoch 230, Train Loss: 0.1244
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 502.24it/s]
Epoch 231, Train Loss: 0.1242
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 397.92it/s]
Epoch 232, Train Loss: 0.1238
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 352.00it/s]
Epoch 233, Train Loss: 0.1237
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 578.35it/s]
Epoch 234, Train Loss: 0.1233
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 608.91it/s]
Epoch 235, Train Loss: 0.1228
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 607.41it/s]
Epoch 236, Train Loss: 0.1228
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 618.47it/s]
Epoch 237, Train Loss: 0.1223
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 363.39it/s]
Epoch 238, Train Loss: 0.1220
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 491.28it/s]
Epoch 239, Train Loss: 0.1219
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 377.58it/s]
Epoch 240, Train Loss: 0.1217
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 596.00it/s]
Epoch 241, Train Loss: 0.1215
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 582.32it/s]
Epoch 242, Train Loss: 0.1210
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 573.61it/s]
Epoch 243, Train Loss: 0.1206
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 301.67it/s]
Epoch 244, Train Loss: 0.1204
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.67it/s]
Epoch 245, Train Loss: 0.1203
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 358.21it/s]
Epoch 246, Train Loss: 0.1198
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.37it/s]
Epoch 247, Train Loss: 0.1195
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 293.56it/s]
Epoch 248, Train Loss: 0.1193
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 457.11it/s]
Epoch 249, Train Loss: 0.1189
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 322.51it/s]
Epoch 250, Train Loss: 0.1188
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 337.33it/s]
Epoch 251, Train Loss: 0.1184
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.20it/s]
Epoch 252, Train Loss: 0.1184
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 286.15it/s]
Epoch 253, Train Loss: 0.1180
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 356.34it/s]
Epoch 254, Train Loss: 0.1177
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.69it/s]
Epoch 255, Train Loss: 0.1174
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 232.66it/s]
Epoch 256, Train Loss: 0.1170
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.63it/s]
Epoch 257, Train Loss: 0.1169
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 320.81it/s]
Epoch 258, Train Loss: 0.1166
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 298.19it/s]
Epoch 259, Train Loss: 0.1162
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 456.48it/s]
Epoch 260, Train Loss: 0.1161
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 478.53it/s]
Epoch 261, Train Loss: 0.1159
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 475.32it/s]
Epoch 262, Train Loss: 0.1156
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 503.87it/s]
Epoch 263, Train Loss: 0.1152
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 301.17it/s]
Epoch 264, Train Loss: 0.1150
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 330.38it/s]
Epoch 265, Train Loss: 0.1147
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 399.37it/s]
Epoch 266, Train Loss: 0.1145
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 286.70it/s]
Epoch 267, Train Loss: 0.1143
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.50it/s]
Epoch 268, Train Loss: 0.1140
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 430.92it/s]
Epoch 269, Train Loss: 0.1137
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 382.24it/s]
Epoch 270, Train Loss: 0.1135
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 372.91it/s]
Epoch 271, Train Loss: 0.1132
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 499.14it/s]
Epoch 272, Train Loss: 0.1132
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 604.54it/s]
Epoch 273, Train Loss: 0.1127
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 465.67it/s]
Epoch 274, Train Loss: 0.1126
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 302.36it/s]
Epoch 275, Train Loss: 0.1125
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 218.74it/s]
Epoch 276, Train Loss: 0.1122
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 288.37it/s]
Epoch 277, Train Loss: 0.1119
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 304.20it/s]
Epoch 278, Train Loss: 0.1117
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 401.14it/s]
Epoch 279, Train Loss: 0.1113
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 341.91it/s]
Epoch 280, Train Loss: 0.1113
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 304.46it/s]
Epoch 281, Train Loss: 0.1110
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 438.30it/s]
Epoch 282, Train Loss: 0.1109
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 458.71it/s]
Epoch 283, Train Loss: 0.1106
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 577.61it/s]
Epoch 284, Train Loss: 0.1104
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 572.61it/s]
Epoch 285, Train Loss: 0.1100
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 605.14it/s]
Epoch 286, Train Loss: 0.1097
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 602.74it/s]
Epoch 287, Train Loss: 0.1094
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 314.25it/s]
Epoch 288, Train Loss: 0.1096
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.54it/s]
Epoch 289, Train Loss: 0.1092
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 290.22it/s]
Epoch 290, Train Loss: 0.1091
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 339.01it/s]
Epoch 291, Train Loss: 0.1089
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.27it/s]
Epoch 292, Train Loss: 0.1084
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.42it/s]
Epoch 293, Train Loss: 0.1084
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.47it/s]
Epoch 294, Train Loss: 0.1083
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.83it/s]
Epoch 295, Train Loss: 0.1081
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 317.08it/s]
Epoch 296, Train Loss: 0.1079
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 418.90it/s]
Epoch 297, Train Loss: 0.1076
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.10it/s]
Epoch 298, Train Loss: 0.1073
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.89it/s]
Epoch 299, Train Loss: 0.1072
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 223.12it/s]
Epoch 300, Train Loss: 0.1068
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.57it/s]
Epoch 301, Train Loss: 0.1068
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 413.68it/s]
Epoch 302, Train Loss: 0.1068
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 464.04it/s]
Epoch 303, Train Loss: 0.1066
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 299.68it/s]
Epoch 304, Train Loss: 0.1063
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.72it/s]
Epoch 305, Train Loss: 0.1062
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.23it/s]
Epoch 306, Train Loss: 0.1058
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 327.44it/s]
Epoch 307, Train Loss: 0.1058
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 461.22it/s]
Epoch 308, Train Loss: 0.1060
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 367.41it/s]
Epoch 309, Train Loss: 0.1054
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 589.12it/s]
Epoch 310, Train Loss: 0.1054
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 598.69it/s]
Epoch 311, Train Loss: 0.1052
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 542.00it/s]
Epoch 312, Train Loss: 0.1052
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 402.38it/s]
Epoch 313, Train Loss: 0.1050
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 315.18it/s]
Epoch 314, Train Loss: 0.1048
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 291.74it/s]
Epoch 315, Train Loss: 0.1045
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 433.36it/s]
Epoch 316, Train Loss: 0.1043
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 501.87it/s]
Epoch 317, Train Loss: 0.1042
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 288.68it/s]
Epoch 318, Train Loss: 0.1040
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 466.20it/s]
Epoch 319, Train Loss: 0.1040
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 313.65it/s]
Epoch 320, Train Loss: 0.1040
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 499.99it/s]
Epoch 321, Train Loss: 0.1037
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 591.74it/s]
Epoch 322, Train Loss: 0.1037
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 293.38it/s]
Epoch 323, Train Loss: 0.1035
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.79it/s]
Epoch 324, Train Loss: 0.1033
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 321.21it/s]
Epoch 325, Train Loss: 0.1033
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 311.48it/s]
Epoch 326, Train Loss: 0.1029
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 524.35it/s]
Epoch 327, Train Loss: 0.1027
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 463.67it/s]
Epoch 328, Train Loss: 0.1028
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 461.29it/s]
Epoch 329, Train Loss: 0.1027
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 501.43it/s]
Epoch 330, Train Loss: 0.1027
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 501.46it/s]
Epoch 331, Train Loss: 0.1022
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 505.58it/s]
Epoch 332, Train Loss: 0.1023
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 436.27it/s]
Epoch 333, Train Loss: 0.1022
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 578.95it/s]
Epoch 334, Train Loss: 0.1020
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 578.62it/s]
Epoch 335, Train Loss: 0.1018
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 424.11it/s]
Epoch 336, Train Loss: 0.1019
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 310.14it/s]
Epoch 337, Train Loss: 0.1017
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 392.04it/s]
Epoch 338, Train Loss: 0.1017
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 291.13it/s]
Epoch 339, Train Loss: 0.1014
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.99it/s]
Epoch 340, Train Loss: 0.1011
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.39it/s]
Epoch 341, Train Loss: 0.1010
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 253.06it/s]
Epoch 342, Train Loss: 0.1010
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 372.92it/s]
Epoch 343, Train Loss: 0.1010
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 500.60it/s]
Epoch 344, Train Loss: 0.1008
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 488.32it/s]
Epoch 345, Train Loss: 0.1007
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 498.09it/s]
Epoch 346, Train Loss: 0.1006
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 476.81it/s]
Epoch 347, Train Loss: 0.1004
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 551.47it/s]
Epoch 348, Train Loss: 0.1002
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 606.60it/s]
Epoch 349, Train Loss: 0.1000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 436.18it/s]
Epoch 350, Train Loss: 0.1001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 512.41it/s]
Epoch 351, Train Loss: 0.1000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 477.15it/s]
Epoch 352, Train Loss: 0.0998
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 368.32it/s]
Epoch 353, Train Loss: 0.0997
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 546.04it/s]
Epoch 354, Train Loss: 0.0998
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 597.34it/s]
Epoch 355, Train Loss: 0.0995
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 591.39it/s]
Epoch 356, Train Loss: 0.0992
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.02it/s]
Epoch 357, Train Loss: 0.0991
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.41it/s]
Epoch 358, Train Loss: 0.0992
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.79it/s]
Epoch 359, Train Loss: 0.0989
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 312.34it/s]
Epoch 360, Train Loss: 0.0986
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 422.44it/s]
Epoch 361, Train Loss: 0.0988
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 458.20it/s]
Epoch 362, Train Loss: 0.0987
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 488.50it/s]
Epoch 363, Train Loss: 0.0987
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 297.15it/s]
Epoch 364, Train Loss: 0.0985
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 310.68it/s]
Epoch 365, Train Loss: 0.0983
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.22it/s]
Epoch 366, Train Loss: 0.0982
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.27it/s]
Epoch 367, Train Loss: 0.0980
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 305.02it/s]
Epoch 368, Train Loss: 0.0980
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.06it/s]
Epoch 369, Train Loss: 0.0979
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 294.51it/s]
Epoch 370, Train Loss: 0.0975
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 444.27it/s]
Epoch 371, Train Loss: 0.0977
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.69it/s]
Epoch 372, Train Loss: 0.0974
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 386.99it/s]
Epoch 373, Train Loss: 0.0974
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 256.71it/s]
Epoch 374, Train Loss: 0.0973
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 222.86it/s]
Epoch 375, Train Loss: 0.0971
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.48it/s]
Epoch 376, Train Loss: 0.0971
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 436.68it/s]
Epoch 377, Train Loss: 0.0969
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 249.11it/s]
Epoch 378, Train Loss: 0.0966
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 336.06it/s]
Epoch 379, Train Loss: 0.0966
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 447.62it/s]
Epoch 380, Train Loss: 0.0966
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 372.24it/s]
Epoch 381, Train Loss: 0.0963
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 390.92it/s]
Epoch 382, Train Loss: 0.0961
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 345.21it/s]
Epoch 383, Train Loss: 0.0962
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 408.44it/s]
Epoch 384, Train Loss: 0.0960
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 314.46it/s]
Epoch 385, Train Loss: 0.0959
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 347.13it/s]
Epoch 386, Train Loss: 0.0958
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 371.37it/s]
Epoch 387, Train Loss: 0.0956
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 329.85it/s]
Epoch 388, Train Loss: 0.0955
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 479.60it/s]
Epoch 389, Train Loss: 0.0954
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 514.57it/s]
Epoch 390, Train Loss: 0.0953
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 519.17it/s]
Epoch 391, Train Loss: 0.0951
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 512.88it/s]
Epoch 392, Train Loss: 0.0949
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 325.51it/s]
Epoch 393, Train Loss: 0.0948
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 482.64it/s]
Epoch 394, Train Loss: 0.0946
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.99it/s]
Epoch 395, Train Loss: 0.0944
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.71it/s]
Epoch 396, Train Loss: 0.0943
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 301.29it/s]
Epoch 397, Train Loss: 0.0943
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 467.91it/s]
Epoch 398, Train Loss: 0.0941
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 356.58it/s]
Epoch 399, Train Loss: 0.0941
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.21it/s]
Epoch 400, Train Loss: 0.0939
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 400.17it/s]
Epoch 401, Train Loss: 0.0937
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.04it/s]
Epoch 402, Train Loss: 0.0935
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 306.99it/s]
Epoch 403, Train Loss: 0.0934
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 441.36it/s]
Epoch 404, Train Loss: 0.0934
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 317.42it/s]
Epoch 405, Train Loss: 0.0931
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 292.14it/s]
Epoch 406, Train Loss: 0.0930
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.74it/s]
Epoch 407, Train Loss: 0.0929
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 418.72it/s]
Epoch 408, Train Loss: 0.0926
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 307.80it/s]
Epoch 409, Train Loss: 0.0925
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.93it/s]
Epoch 410, Train Loss: 0.0926
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 437.15it/s]
Epoch 411, Train Loss: 0.0925
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 458.04it/s]
Epoch 412, Train Loss: 0.0922
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 493.81it/s]
Epoch 413, Train Loss: 0.0922
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 530.13it/s]
Epoch 414, Train Loss: 0.0918
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 510.90it/s]
Epoch 415, Train Loss: 0.0918
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 502.91it/s]
Epoch 416, Train Loss: 0.0914
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 506.11it/s]
Epoch 417, Train Loss: 0.0914
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 507.41it/s]
Epoch 418, Train Loss: 0.0916
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 492.06it/s]
Epoch 419, Train Loss: 0.0913
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 516.39it/s]
Epoch 420, Train Loss: 0.0911
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 513.10it/s]
Epoch 421, Train Loss: 0.0908
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 371.80it/s]
Epoch 422, Train Loss: 0.0908
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 399.22it/s]
Epoch 423, Train Loss: 0.0904
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 474.37it/s]
Epoch 424, Train Loss: 0.0904
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 438.17it/s]
Epoch 425, Train Loss: 0.0904
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 499.86it/s]
Epoch 426, Train Loss: 0.0903
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 507.16it/s]
Epoch 427, Train Loss: 0.0901
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 524.54it/s]
Epoch 428, Train Loss: 0.0900
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 505.58it/s]
Epoch 429, Train Loss: 0.0899
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 352.21it/s]
Epoch 430, Train Loss: 0.0896
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.46it/s]
Epoch 431, Train Loss: 0.0896
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 517.23it/s]
Epoch 432, Train Loss: 0.0894
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 553.06it/s]
Epoch 433, Train Loss: 0.0894
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 600.28it/s]
Epoch 434, Train Loss: 0.0892
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 579.72it/s]
Epoch 435, Train Loss: 0.0889
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 595.31it/s]
Epoch 436, Train Loss: 0.0888
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 582.21it/s]
Epoch 437, Train Loss: 0.0887
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 593.54it/s]
Epoch 438, Train Loss: 0.0885
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 416.25it/s]
Epoch 439, Train Loss: 0.0884
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 461.62it/s]
Epoch 440, Train Loss: 0.0883
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 591.85it/s]
Epoch 441, Train Loss: 0.0882
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.40it/s]
Epoch 442, Train Loss: 0.0878
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 597.24it/s]
Epoch 443, Train Loss: 0.0878
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 581.22it/s]
Epoch 444, Train Loss: 0.0876
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 290.67it/s]
Epoch 445, Train Loss: 0.0875
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.64it/s]
Epoch 446, Train Loss: 0.0872
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 500.20it/s]
Epoch 447, Train Loss: 0.0872
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 474.90it/s]
Epoch 448, Train Loss: 0.0870
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 326.98it/s]
Epoch 449, Train Loss: 0.0870
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 583.19it/s]
Epoch 450, Train Loss: 0.0868
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 596.31it/s]
Epoch 451, Train Loss: 0.0867
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 585.07it/s]
Epoch 452, Train Loss: 0.0867
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 593.00it/s]
Epoch 453, Train Loss: 0.0864
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 588.44it/s]
Epoch 454, Train Loss: 0.0863
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 345.48it/s]
Epoch 455, Train Loss: 0.0860
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 262.62it/s]
Epoch 456, Train Loss: 0.0858
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 296.13it/s]
Epoch 457, Train Loss: 0.0857
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 430.54it/s]
Epoch 458, Train Loss: 0.0857
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.53it/s]
Epoch 459, Train Loss: 0.0856
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.69it/s]
Epoch 460, Train Loss: 0.0854
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.61it/s]
Epoch 461, Train Loss: 0.0852
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 381.28it/s]
Epoch 462, Train Loss: 0.0850
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 443.04it/s]
Epoch 463, Train Loss: 0.0849
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 348.17it/s]
Epoch 464, Train Loss: 0.0849
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 394.20it/s]
Epoch 465, Train Loss: 0.0847
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 562.26it/s]
Epoch 466, Train Loss: 0.0845
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 560.04it/s]
Epoch 467, Train Loss: 0.0843
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 298.81it/s]
Epoch 468, Train Loss: 0.0843
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 316.59it/s]
Epoch 469, Train Loss: 0.0841
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 367.35it/s]
Epoch 470, Train Loss: 0.0840
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 335.81it/s]
Epoch 471, Train Loss: 0.0839
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 299.46it/s]
Epoch 472, Train Loss: 0.0837
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 443.19it/s]
Epoch 473, Train Loss: 0.0837
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.70it/s]
Epoch 474, Train Loss: 0.0833
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.24it/s]
Epoch 475, Train Loss: 0.0834
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 296.61it/s]
Epoch 476, Train Loss: 0.0831
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 360.49it/s]
Epoch 477, Train Loss: 0.0830
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 425.32it/s]
Epoch 478, Train Loss: 0.0830
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 413.51it/s]
Epoch 479, Train Loss: 0.0827
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 496.31it/s]
Epoch 480, Train Loss: 0.0826
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 293.62it/s]
Epoch 481, Train Loss: 0.0824
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.15it/s]
Epoch 482, Train Loss: 0.0824
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.21it/s]
Epoch 483, Train Loss: 0.0824
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 405.24it/s]
Epoch 484, Train Loss: 0.0822
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 424.64it/s]
Epoch 485, Train Loss: 0.0819
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 528.72it/s]
Epoch 486, Train Loss: 0.0818
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 576.92it/s]
Epoch 487, Train Loss: 0.0819
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 594.91it/s]
Epoch 488, Train Loss: 0.0817
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 606.91it/s]
Epoch 489, Train Loss: 0.0815
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 478.53it/s]
Epoch 490, Train Loss: 0.0813
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 552.04it/s]
Epoch 491, Train Loss: 0.0813
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 599.67it/s]
Epoch 492, Train Loss: 0.0813
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 611.43it/s]
Epoch 493, Train Loss: 0.0811
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 598.66it/s]
Epoch 494, Train Loss: 0.0809
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 581.81it/s]
Epoch 495, Train Loss: 0.0806
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 590.60it/s]
Epoch 496, Train Loss: 0.0806
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 610.62it/s]
Epoch 497, Train Loss: 0.0806
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 612.05it/s]
Epoch 498, Train Loss: 0.0804
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 621.82it/s]
Epoch 499, Train Loss: 0.0803
.............................
encode, decode = transform_nn(dog_data, encoder, decoder, device=device)
embeddings(encode, shape_=image.shape[0:2], figsize=(10, 5))
This is clearly an overcomplete example since we are learning 10 timesteps with 12 latent variables
Generator#
Now we want to see how the spectra changes as we traverse the latent space
latent_generator(decoder, encode, image, 5, 10, device=device,
figsize=(10, 5), divider_=False)
Recurrent Neural Network Autoencoders#
The above example did not consider the temporal information in the data.
This can be improved by using a recurrent neural network that processes each time step sequentially.
To add an understanding about the short and long term information in the data you can add memory and forget logic as a learnable parameter.
Builds the model#
latent_dim = 12
# encoder with LSTM
class Encoder(nn.Module):
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Encoder, self).__init__()
self.lstm = nn.LSTM(1, 12, batch_first=True, bidirectional=True)
self.embedding = nn.Linear(24, self.latent_dim)
self.relu = nn.ReLU()
def forward(self, x):
x, (_, __) = self.lstm(x)
x = x[:, -1, :]
x = self.embedding(x)
return x
class Decoder(nn.Module):
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Decoder, self).__init__()
self.lstm = nn.LSTM(self.latent_dim, 12,
batch_first=True, bidirectional=True)
self.tdd = nn.Conv1d(24, 1, 1)
def forward(self, x):
x = x[:, :, None]
x = x.transpose(1, 2)
x = x.repeat([1, 10, 1])
x, (_, __) = self.lstm(x)
x = x.transpose(1, 2)
x = self.tdd(x)
x = x.transpose(1, 2)
return x
encoder = Encoder().to(device)
decoder = Decoder().to(device)
model = Autoencoder(encoder, decoder).to(device)
# optimizer
optimizer = optim.Adam(model.parameters(), lr=3e-5)
Dataloader#
train_iterator = torch.utils.data.DataLoader(
np.atleast_3d(X_train), batch_size=256, shuffle=False
)
Training#
random_seed(seed=42)
Train(model, encoder, decoder, train_iterator, optimizer, 500, device=device)
Show code cell output
0%| | 0/19 [00:00<?, ?it/s]
5%|▌ | 1/19 [00:00<00:03, 5.48it/s]
68%|██████▊ | 13/19 [00:00<00:00, 55.35it/s]
100%|██████████| 19/19 [00:00<00:00, 55.41it/s]
Epoch 0, Train Loss: 2.2412
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.67it/s]
100%|██████████| 19/19 [00:00<00:00, 115.49it/s]
Epoch 1, Train Loss: 2.2313
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.15it/s]
100%|██████████| 19/19 [00:00<00:00, 104.63it/s]
Epoch 2, Train Loss: 2.2214
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.36it/s]
100%|██████████| 19/19 [00:00<00:00, 127.28it/s]
Epoch 3, Train Loss: 2.2117
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.38it/s]
Epoch 4, Train Loss: 2.2020
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 223.41it/s]
Epoch 5, Train Loss: 2.1923
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.37it/s]
100%|██████████| 19/19 [00:00<00:00, 128.76it/s]
Epoch 6, Train Loss: 2.1826
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 246.36it/s]
Epoch 7, Train Loss: 2.1729
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.11it/s]
Epoch 8, Train Loss: 2.1631
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.97it/s]
Epoch 9, Train Loss: 2.1533
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.41it/s]
Epoch 10, Train Loss: 2.1433
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.93it/s]
Epoch 11, Train Loss: 2.1333
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.43it/s]
Epoch 12, Train Loss: 2.1230
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.02it/s]
Epoch 13, Train Loss: 2.1126
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.68it/s]
Epoch 14, Train Loss: 2.1019
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.72it/s]
Epoch 15, Train Loss: 2.0911
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.20it/s]
Epoch 16, Train Loss: 2.0799
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.05it/s]
Epoch 17, Train Loss: 2.0686
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.60it/s]
100%|██████████| 19/19 [00:00<00:00, 120.01it/s]
Epoch 18, Train Loss: 2.0569
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.28it/s]
100%|██████████| 19/19 [00:00<00:00, 103.41it/s]
Epoch 19, Train Loss: 2.0449
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.19it/s]
100%|██████████| 19/19 [00:00<00:00, 96.12it/s]
Epoch 20, Train Loss: 2.0326
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.21it/s]
100%|██████████| 19/19 [00:00<00:00, 114.12it/s]
Epoch 21, Train Loss: 2.0200
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.81it/s]
100%|██████████| 19/19 [00:00<00:00, 91.44it/s]
100%|██████████| 19/19 [00:00<00:00, 90.21it/s]
Epoch 22, Train Loss: 2.0070
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.76it/s]
100%|██████████| 19/19 [00:00<00:00, 89.22it/s]
100%|██████████| 19/19 [00:00<00:00, 87.61it/s]
Epoch 23, Train Loss: 1.9937
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.40it/s]
100%|██████████| 19/19 [00:00<00:00, 93.98it/s]
Epoch 24, Train Loss: 1.9799
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.35it/s]
100%|██████████| 19/19 [00:00<00:00, 92.12it/s]
100%|██████████| 19/19 [00:00<00:00, 90.90it/s]
Epoch 25, Train Loss: 1.9658
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.44it/s]
100%|██████████| 19/19 [00:00<00:00, 139.32it/s]
Epoch 26, Train Loss: 1.9512
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.45it/s]
100%|██████████| 19/19 [00:00<00:00, 101.07it/s]
Epoch 27, Train Loss: 1.9362
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.97it/s]
100%|██████████| 19/19 [00:00<00:00, 93.05it/s]
100%|██████████| 19/19 [00:00<00:00, 91.57it/s]
Epoch 28, Train Loss: 1.9208
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.29it/s]
100%|██████████| 19/19 [00:00<00:00, 97.64it/s]
Epoch 29, Train Loss: 1.9050
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.86it/s]
100%|██████████| 19/19 [00:00<00:00, 89.18it/s]
100%|██████████| 19/19 [00:00<00:00, 88.00it/s]
Epoch 30, Train Loss: 1.8887
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.88it/s]
100%|██████████| 19/19 [00:00<00:00, 100.32it/s]
Epoch 31, Train Loss: 1.8719
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.41it/s]
100%|██████████| 19/19 [00:00<00:00, 96.05it/s]
Epoch 32, Train Loss: 1.8548
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.11it/s]
100%|██████████| 19/19 [00:00<00:00, 99.81it/s]
Epoch 33, Train Loss: 1.8372
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.50it/s]
100%|██████████| 19/19 [00:00<00:00, 134.45it/s]
Epoch 34, Train Loss: 1.8192
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.13it/s]
100%|██████████| 19/19 [00:00<00:00, 116.20it/s]
Epoch 35, Train Loss: 1.8008
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.46it/s]
100%|██████████| 19/19 [00:00<00:00, 110.25it/s]
Epoch 36, Train Loss: 1.7821
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 177.27it/s]
100%|██████████| 19/19 [00:00<00:00, 178.46it/s]
Epoch 37, Train Loss: 1.7630
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 246.29it/s]
Epoch 38, Train Loss: 1.7436
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.37it/s]
100%|██████████| 19/19 [00:00<00:00, 127.38it/s]
Epoch 39, Train Loss: 1.7240
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.23it/s]
100%|██████████| 19/19 [00:00<00:00, 94.97it/s]
100%|██████████| 19/19 [00:00<00:00, 93.38it/s]
Epoch 40, Train Loss: 1.7042
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.26it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.87it/s]
100%|██████████| 19/19 [00:00<00:00, 87.02it/s]
Epoch 41, Train Loss: 1.6842
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 150.35it/s]
100%|██████████| 19/19 [00:00<00:00, 135.15it/s]
Epoch 42, Train Loss: 1.6642
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 120.52it/s]
100%|██████████| 19/19 [00:00<00:00, 116.62it/s]
Epoch 43, Train Loss: 1.6441
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.12it/s]
100%|██████████| 19/19 [00:00<00:00, 107.69it/s]
Epoch 44, Train Loss: 1.6241
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.13it/s]
100%|██████████| 19/19 [00:00<00:00, 97.84it/s]
Epoch 45, Train Loss: 1.6042
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 221.52it/s]
Epoch 46, Train Loss: 1.5846
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.32it/s]
Epoch 47, Train Loss: 1.5652
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.08it/s]
100%|██████████| 19/19 [00:00<00:00, 106.68it/s]
Epoch 48, Train Loss: 1.5462
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 127.41it/s]
100%|██████████| 19/19 [00:00<00:00, 139.51it/s]
Epoch 49, Train Loss: 1.5276
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 166.45it/s]
100%|██████████| 19/19 [00:00<00:00, 156.61it/s]
Epoch 50, Train Loss: 1.5093
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.10it/s]
100%|██████████| 19/19 [00:00<00:00, 97.93it/s]
Epoch 51, Train Loss: 1.4916
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 185.55it/s]
100%|██████████| 19/19 [00:00<00:00, 184.06it/s]
Epoch 52, Train Loss: 1.4743
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.69it/s]
Epoch 53, Train Loss: 1.4574
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 137.39it/s]
100%|██████████| 19/19 [00:00<00:00, 151.20it/s]
Epoch 54, Train Loss: 1.4410
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.95it/s]
Epoch 55, Train Loss: 1.4251
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 262.08it/s]
Epoch 56, Train Loss: 1.4096
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.65it/s]
Epoch 57, Train Loss: 1.3944
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.44it/s]
Epoch 58, Train Loss: 1.3796
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.16it/s]
Epoch 59, Train Loss: 1.3650
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.01it/s]
Epoch 60, Train Loss: 1.3507
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.15it/s]
Epoch 61, Train Loss: 1.3366
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 179.92it/s]
100%|██████████| 19/19 [00:00<00:00, 171.05it/s]
Epoch 62, Train Loss: 1.3226
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 157.41it/s]
100%|██████████| 19/19 [00:00<00:00, 164.65it/s]
Epoch 63, Train Loss: 1.3087
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.42it/s]
Epoch 64, Train Loss: 1.2948
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.10it/s]
Epoch 65, Train Loss: 1.2810
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.07it/s]
Epoch 66, Train Loss: 1.2672
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.68it/s]
Epoch 67, Train Loss: 1.2534
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.96it/s]
100%|██████████| 19/19 [00:00<00:00, 121.92it/s]
Epoch 68, Train Loss: 1.2395
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.59it/s]
100%|██████████| 19/19 [00:00<00:00, 127.49it/s]
Epoch 69, Train Loss: 1.2255
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 256.93it/s]
Epoch 70, Train Loss: 1.2115
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.00it/s]
Epoch 71, Train Loss: 1.1974
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.99it/s]
Epoch 72, Train Loss: 1.1832
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.54it/s]
Epoch 73, Train Loss: 1.1689
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.97it/s]
Epoch 74, Train Loss: 1.1546
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.98it/s]
Epoch 75, Train Loss: 1.1401
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 156.79it/s]
100%|██████████| 19/19 [00:00<00:00, 165.86it/s]
Epoch 76, Train Loss: 1.1256
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.39it/s]
Epoch 77, Train Loss: 1.1109
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.63it/s]
Epoch 78, Train Loss: 1.0962
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.38it/s]
Epoch 79, Train Loss: 1.0814
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.79it/s]
Epoch 80, Train Loss: 1.0666
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.33it/s]
Epoch 81, Train Loss: 1.0516
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 223.71it/s]
Epoch 82, Train Loss: 1.0367
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 150.95it/s]
100%|██████████| 19/19 [00:00<00:00, 145.42it/s]
Epoch 83, Train Loss: 1.0217
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 219.26it/s]
Epoch 84, Train Loss: 1.0067
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.29it/s]
Epoch 85, Train Loss: 0.9916
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.77it/s]
Epoch 86, Train Loss: 0.9766
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.35it/s]
Epoch 87, Train Loss: 0.9615
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.74it/s]
Epoch 88, Train Loss: 0.9465
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.54it/s]
Epoch 89, Train Loss: 0.9314
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.79it/s]
100%|██████████| 19/19 [00:00<00:00, 126.09it/s]
Epoch 90, Train Loss: 0.9164
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 255.78it/s]
Epoch 91, Train Loss: 0.9015
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.68it/s]
Epoch 92, Train Loss: 0.8866
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.90it/s]
Epoch 93, Train Loss: 0.8717
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.51it/s]
Epoch 94, Train Loss: 0.8569
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 158.00it/s]
100%|██████████| 19/19 [00:00<00:00, 166.91it/s]
Epoch 95, Train Loss: 0.8422
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.24it/s]
Epoch 96, Train Loss: 0.8275
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.85it/s]
Epoch 97, Train Loss: 0.8129
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.19it/s]
Epoch 98, Train Loss: 0.7984
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.90it/s]
Epoch 99, Train Loss: 0.7840
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.67it/s]
100%|██████████| 19/19 [00:00<00:00, 105.89it/s]
Epoch 100, Train Loss: 0.7697
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.80it/s]
100%|██████████| 19/19 [00:00<00:00, 107.51it/s]
Epoch 101, Train Loss: 0.7555
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.84it/s]
100%|██████████| 19/19 [00:00<00:00, 95.39it/s]
Epoch 102, Train Loss: 0.7414
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.54it/s]
100%|██████████| 19/19 [00:00<00:00, 91.93it/s]
Epoch 103, Train Loss: 0.7274
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.51it/s]
100%|██████████| 19/19 [00:00<00:00, 112.89it/s]
Epoch 104, Train Loss: 0.7135
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.50it/s]
Epoch 105, Train Loss: 0.6997
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.25it/s]
Epoch 106, Train Loss: 0.6861
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.28it/s]
Epoch 107, Train Loss: 0.6726
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.40it/s]
Epoch 108, Train Loss: 0.6592
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.27it/s]
Epoch 109, Train Loss: 0.6459
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.23it/s]
Epoch 110, Train Loss: 0.6328
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.41it/s]
Epoch 111, Train Loss: 0.6199
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.24it/s]
Epoch 112, Train Loss: 0.6070
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.29it/s]
Epoch 113, Train Loss: 0.5944
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.28it/s]
Epoch 114, Train Loss: 0.5818
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.79it/s]
100%|██████████| 19/19 [00:00<00:00, 106.72it/s]
Epoch 115, Train Loss: 0.5695
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 145.23it/s]
100%|██████████| 19/19 [00:00<00:00, 157.52it/s]
Epoch 116, Train Loss: 0.5573
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.47it/s]
Epoch 117, Train Loss: 0.5453
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.18it/s]
100%|██████████| 19/19 [00:00<00:00, 110.74it/s]
Epoch 118, Train Loss: 0.5334
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 196.53it/s]
Epoch 119, Train Loss: 0.5218
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 168.48it/s]
100%|██████████| 19/19 [00:00<00:00, 172.54it/s]
Epoch 120, Train Loss: 0.5104
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.96it/s]
Epoch 121, Train Loss: 0.4991
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.29it/s]
Epoch 122, Train Loss: 0.4881
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.89it/s]
Epoch 123, Train Loss: 0.4774
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.87it/s]
Epoch 124, Train Loss: 0.4668
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.87it/s]
Epoch 125, Train Loss: 0.4566
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.43it/s]
Epoch 126, Train Loss: 0.4466
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.55it/s]
Epoch 127, Train Loss: 0.4369
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.27it/s]
Epoch 128, Train Loss: 0.4274
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.35it/s]
Epoch 129, Train Loss: 0.4183
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.77it/s]
Epoch 130, Train Loss: 0.4094
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.43it/s]
Epoch 131, Train Loss: 0.4008
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.65it/s]
Epoch 132, Train Loss: 0.3925
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.12it/s]
Epoch 133, Train Loss: 0.3845
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.86it/s]
Epoch 134, Train Loss: 0.3767
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.60it/s]
Epoch 135, Train Loss: 0.3692
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.47it/s]
Epoch 136, Train Loss: 0.3620
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.52it/s]
Epoch 137, Train Loss: 0.3550
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.40it/s]
Epoch 138, Train Loss: 0.3482
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.62it/s]
Epoch 139, Train Loss: 0.3417
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.13it/s]
Epoch 140, Train Loss: 0.3354
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.10it/s]
Epoch 141, Train Loss: 0.3294
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.37it/s]
Epoch 142, Train Loss: 0.3235
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.31it/s]
Epoch 143, Train Loss: 0.3179
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.39it/s]
Epoch 144, Train Loss: 0.3124
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.79it/s]
Epoch 145, Train Loss: 0.3072
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.63it/s]
Epoch 146, Train Loss: 0.3021
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.02it/s]
Epoch 147, Train Loss: 0.2973
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.98it/s]
Epoch 148, Train Loss: 0.2926
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.07it/s]
Epoch 149, Train Loss: 0.2880
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.64it/s]
Epoch 150, Train Loss: 0.2837
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.60it/s]
Epoch 151, Train Loss: 0.2795
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.59it/s]
Epoch 152, Train Loss: 0.2754
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.52it/s]
Epoch 153, Train Loss: 0.2716
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.37it/s]
Epoch 154, Train Loss: 0.2678
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.54it/s]
Epoch 155, Train Loss: 0.2642
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.30it/s]
Epoch 156, Train Loss: 0.2607
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.37it/s]
Epoch 157, Train Loss: 0.2574
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.06it/s]
Epoch 158, Train Loss: 0.2542
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 129.72it/s]
100%|██████████| 19/19 [00:00<00:00, 123.26it/s]
Epoch 159, Train Loss: 0.2511
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.22it/s]
100%|██████████| 19/19 [00:00<00:00, 110.93it/s]
Epoch 160, Train Loss: 0.2481
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.74it/s]
100%|██████████| 19/19 [00:00<00:00, 93.92it/s]
100%|██████████| 19/19 [00:00<00:00, 92.31it/s]
Epoch 161, Train Loss: 0.2453
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.37it/s]
100%|██████████| 19/19 [00:00<00:00, 159.71it/s]
Epoch 162, Train Loss: 0.2425
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.71it/s]
Epoch 163, Train Loss: 0.2399
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.95it/s]
Epoch 164, Train Loss: 0.2374
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.75it/s]
Epoch 165, Train Loss: 0.2349
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.27it/s]
Epoch 166, Train Loss: 0.2326
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.60it/s]
Epoch 167, Train Loss: 0.2303
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.04it/s]
Epoch 168, Train Loss: 0.2281
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.62it/s]
Epoch 169, Train Loss: 0.2261
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.98it/s]
100%|██████████| 19/19 [00:00<00:00, 108.99it/s]
Epoch 170, Train Loss: 0.2241
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.00it/s]
100%|██████████| 19/19 [00:00<00:00, 113.68it/s]
Epoch 171, Train Loss: 0.2221
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.83it/s]
100%|██████████| 19/19 [00:00<00:00, 113.97it/s]
Epoch 172, Train Loss: 0.2203
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 121.05it/s]
100%|██████████| 19/19 [00:00<00:00, 118.35it/s]
Epoch 173, Train Loss: 0.2185
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.93it/s]
100%|██████████| 19/19 [00:00<00:00, 114.77it/s]
Epoch 174, Train Loss: 0.2167
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.65it/s]
100%|██████████| 19/19 [00:00<00:00, 102.81it/s]
Epoch 175, Train Loss: 0.2151
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.89it/s]
100%|██████████| 19/19 [00:00<00:00, 113.45it/s]
Epoch 176, Train Loss: 0.2135
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.32it/s]
100%|██████████| 19/19 [00:00<00:00, 100.81it/s]
Epoch 177, Train Loss: 0.2119
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.96it/s]
100%|██████████| 19/19 [00:00<00:00, 110.11it/s]
Epoch 178, Train Loss: 0.2104
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.39it/s]
100%|██████████| 19/19 [00:00<00:00, 94.85it/s]
Epoch 179, Train Loss: 0.2090
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.13it/s]
100%|██████████| 19/19 [00:00<00:00, 102.19it/s]
Epoch 180, Train Loss: 0.2076
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.88it/s]
100%|██████████| 19/19 [00:00<00:00, 99.93it/s]
Epoch 181, Train Loss: 0.2062
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.39it/s]
100%|██████████| 19/19 [00:00<00:00, 102.30it/s]
Epoch 182, Train Loss: 0.2049
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.16it/s]
100%|██████████| 19/19 [00:00<00:00, 121.92it/s]
Epoch 183, Train Loss: 0.2036
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 255.62it/s]
Epoch 184, Train Loss: 0.2024
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.75it/s]
Epoch 185, Train Loss: 0.2012
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 137.78it/s]
100%|██████████| 19/19 [00:00<00:00, 130.62it/s]
Epoch 186, Train Loss: 0.2000
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.09it/s]
100%|██████████| 19/19 [00:00<00:00, 117.88it/s]
Epoch 187, Train Loss: 0.1989
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 179.31it/s]
100%|██████████| 19/19 [00:00<00:00, 169.14it/s]
Epoch 188, Train Loss: 0.1977
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 146.51it/s]
100%|██████████| 19/19 [00:00<00:00, 158.66it/s]
Epoch 189, Train Loss: 0.1967
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.03it/s]
100%|██████████| 19/19 [00:00<00:00, 119.49it/s]
Epoch 190, Train Loss: 0.1956
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 253.42it/s]
Epoch 191, Train Loss: 0.1945
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.80it/s]
Epoch 192, Train Loss: 0.1935
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.34it/s]
Epoch 193, Train Loss: 0.1925
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 289.08it/s]
Epoch 194, Train Loss: 0.1915
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.16it/s]
Epoch 195, Train Loss: 0.1906
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.70it/s]
100%|██████████| 19/19 [00:00<00:00, 121.29it/s]
Epoch 196, Train Loss: 0.1897
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.44it/s]
100%|██████████| 19/19 [00:00<00:00, 120.99it/s]
Epoch 197, Train Loss: 0.1888
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.66it/s]
100%|██████████| 19/19 [00:00<00:00, 111.74it/s]
Epoch 198, Train Loss: 0.1879
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.01it/s]
Epoch 199, Train Loss: 0.1871
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.86it/s]
Epoch 200, Train Loss: 0.1862
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.74it/s]
Epoch 201, Train Loss: 0.1854
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 135.49it/s]
100%|██████████| 19/19 [00:00<00:00, 129.16it/s]
Epoch 202, Train Loss: 0.1847
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.68it/s]
100%|██████████| 19/19 [00:00<00:00, 112.88it/s]
Epoch 203, Train Loss: 0.1839
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.35it/s]
Epoch 204, Train Loss: 0.1832
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 184.50it/s]
100%|██████████| 19/19 [00:00<00:00, 182.78it/s]
Epoch 205, Train Loss: 0.1825
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.90it/s]
100%|██████████| 19/19 [00:00<00:00, 99.78it/s]
Epoch 206, Train Loss: 0.1818
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.54it/s]
100%|██████████| 19/19 [00:00<00:00, 104.05it/s]
Epoch 207, Train Loss: 0.1812
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 100.86it/s]
100%|██████████| 19/19 [00:00<00:00, 95.61it/s]
Epoch 208, Train Loss: 0.1805
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.04it/s]
100%|██████████| 19/19 [00:00<00:00, 90.92it/s]
Epoch 209, Train Loss: 0.1799
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.09it/s]
100%|██████████| 19/19 [00:00<00:00, 92.35it/s]
Epoch 210, Train Loss: 0.1793
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.76it/s]
100%|██████████| 19/19 [00:00<00:00, 91.75it/s]
100%|██████████| 19/19 [00:00<00:00, 90.69it/s]
Epoch 211, Train Loss: 0.1787
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.34it/s]
100%|██████████| 19/19 [00:00<00:00, 97.77it/s]
Epoch 212, Train Loss: 0.1781
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.90it/s]
Epoch 213, Train Loss: 0.1776
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 136.48it/s]
100%|██████████| 19/19 [00:00<00:00, 128.95it/s]
Epoch 214, Train Loss: 0.1771
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 127.69it/s]
100%|██████████| 19/19 [00:00<00:00, 149.65it/s]
Epoch 215, Train Loss: 0.1765
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.91it/s]
Epoch 216, Train Loss: 0.1760
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.54it/s]
Epoch 217, Train Loss: 0.1755
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.74it/s]
Epoch 218, Train Loss: 0.1750
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.85it/s]
Epoch 219, Train Loss: 0.1746
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.56it/s]
Epoch 220, Train Loss: 0.1741
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.46it/s]
Epoch 221, Train Loss: 0.1736
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.92it/s]
Epoch 222, Train Loss: 0.1732
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.88it/s]
Epoch 223, Train Loss: 0.1728
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.10it/s]
Epoch 224, Train Loss: 0.1723
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.40it/s]
Epoch 225, Train Loss: 0.1719
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.77it/s]
Epoch 226, Train Loss: 0.1715
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.23it/s]
Epoch 227, Train Loss: 0.1711
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.39it/s]
100%|██████████| 19/19 [00:00<00:00, 107.12it/s]
Epoch 228, Train Loss: 0.1707
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 183.98it/s]
100%|██████████| 19/19 [00:00<00:00, 182.02it/s]
Epoch 229, Train Loss: 0.1704
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.86it/s]
100%|██████████| 19/19 [00:00<00:00, 126.23it/s]
Epoch 230, Train Loss: 0.1700
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.44it/s]
Epoch 231, Train Loss: 0.1696
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.10it/s]
Epoch 232, Train Loss: 0.1692
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.68it/s]
Epoch 233, Train Loss: 0.1689
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 126.49it/s]
100%|██████████| 19/19 [00:00<00:00, 116.36it/s]
Epoch 234, Train Loss: 0.1685
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.56it/s]
100%|██████████| 19/19 [00:00<00:00, 99.80it/s]
Epoch 235, Train Loss: 0.1682
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.54it/s]
100%|██████████| 19/19 [00:00<00:00, 101.79it/s]
Epoch 236, Train Loss: 0.1678
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.98it/s]
100%|██████████| 19/19 [00:00<00:00, 92.25it/s]
Epoch 237, Train Loss: 0.1675
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.75it/s]
100%|██████████| 19/19 [00:00<00:00, 97.56it/s]
Epoch 238, Train Loss: 0.1672
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.75it/s]
100%|██████████| 19/19 [00:00<00:00, 100.07it/s]
Epoch 239, Train Loss: 0.1668
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.23it/s]
100%|██████████| 19/19 [00:00<00:00, 96.41it/s]
Epoch 240, Train Loss: 0.1665
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.82it/s]
100%|██████████| 19/19 [00:00<00:00, 129.62it/s]
Epoch 241, Train Loss: 0.1662
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.73it/s]
100%|██████████| 19/19 [00:00<00:00, 88.83it/s]
100%|██████████| 19/19 [00:00<00:00, 87.39it/s]
Epoch 242, Train Loss: 0.1659
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.58it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.79it/s]
100%|██████████| 19/19 [00:00<00:00, 85.51it/s]
Epoch 243, Train Loss: 0.1655
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.17it/s]
100%|██████████| 19/19 [00:00<00:00, 98.26it/s]
Epoch 244, Train Loss: 0.1652
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.11it/s]
100%|██████████| 19/19 [00:00<00:00, 104.25it/s]
Epoch 245, Train Loss: 0.1649
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.84it/s]
100%|██████████| 19/19 [00:00<00:00, 100.42it/s]
Epoch 246, Train Loss: 0.1646
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.97it/s]
100%|██████████| 19/19 [00:00<00:00, 89.22it/s]
100%|██████████| 19/19 [00:00<00:00, 87.80it/s]
Epoch 247, Train Loss: 0.1643
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.96it/s]
100%|██████████| 19/19 [00:00<00:00, 98.62it/s]
Epoch 248, Train Loss: 0.1640
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.61it/s]
100%|██████████| 19/19 [00:00<00:00, 100.01it/s]
Epoch 249, Train Loss: 0.1637
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.68it/s]
100%|██████████| 19/19 [00:00<00:00, 95.46it/s]
Epoch 250, Train Loss: 0.1634
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.08it/s]
100%|██████████| 19/19 [00:00<00:00, 91.21it/s]
Epoch 251, Train Loss: 0.1631
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.93it/s]
100%|██████████| 19/19 [00:00<00:00, 103.12it/s]
Epoch 252, Train Loss: 0.1628
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.41it/s]
100%|██████████| 19/19 [00:00<00:00, 142.20it/s]
Epoch 253, Train Loss: 0.1625
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.73it/s]
Epoch 254, Train Loss: 0.1622
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.76it/s]
Epoch 255, Train Loss: 0.1619
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.67it/s]
Epoch 256, Train Loss: 0.1616
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.06it/s]
Epoch 257, Train Loss: 0.1614
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.88it/s]
100%|██████████| 19/19 [00:00<00:00, 115.39it/s]
Epoch 258, Train Loss: 0.1611
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.60it/s]
100%|██████████| 19/19 [00:00<00:00, 100.29it/s]
Epoch 259, Train Loss: 0.1608
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.37it/s]
100%|██████████| 19/19 [00:00<00:00, 89.17it/s]
Epoch 260, Train Loss: 0.1605
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.58it/s]
100%|██████████| 19/19 [00:00<00:00, 102.86it/s]
Epoch 261, Train Loss: 0.1602
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 130.20it/s]
100%|██████████| 19/19 [00:00<00:00, 128.85it/s]
Epoch 262, Train Loss: 0.1599
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.65it/s]
Epoch 263, Train Loss: 0.1597
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 130.19it/s]
100%|██████████| 19/19 [00:00<00:00, 115.91it/s]
Epoch 264, Train Loss: 0.1594
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.28it/s]
100%|██████████| 19/19 [00:00<00:00, 104.67it/s]
Epoch 265, Train Loss: 0.1591
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.89it/s]
Epoch 266, Train Loss: 0.1588
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.89it/s]
Epoch 267, Train Loss: 0.1585
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.55it/s]
100%|██████████| 19/19 [00:00<00:00, 101.93it/s]
Epoch 268, Train Loss: 0.1583
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.81it/s]
100%|██████████| 19/19 [00:00<00:00, 132.42it/s]
Epoch 269, Train Loss: 0.1580
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 251.05it/s]
Epoch 270, Train Loss: 0.1577
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.17it/s]
Epoch 271, Train Loss: 0.1574
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.24it/s]
Epoch 272, Train Loss: 0.1571
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.42it/s]
Epoch 273, Train Loss: 0.1569
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.49it/s]
Epoch 274, Train Loss: 0.1566
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.81it/s]
100%|██████████| 19/19 [00:00<00:00, 112.55it/s]
Epoch 275, Train Loss: 0.1563
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.61it/s]
Epoch 276, Train Loss: 0.1560
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.12it/s]
Epoch 277, Train Loss: 0.1558
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.06it/s]
Epoch 278, Train Loss: 0.1555
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.90it/s]
Epoch 279, Train Loss: 0.1552
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.10it/s]
Epoch 280, Train Loss: 0.1549
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.43it/s]
Epoch 281, Train Loss: 0.1547
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.12it/s]
Epoch 282, Train Loss: 0.1544
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.95it/s]
Epoch 283, Train Loss: 0.1541
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.71it/s]
Epoch 284, Train Loss: 0.1538
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.74it/s]
Epoch 285, Train Loss: 0.1536
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.47it/s]
Epoch 286, Train Loss: 0.1533
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.64it/s]
Epoch 287, Train Loss: 0.1530
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.35it/s]
100%|██████████| 19/19 [00:00<00:00, 106.22it/s]
Epoch 288, Train Loss: 0.1528
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 146.52it/s]
100%|██████████| 19/19 [00:00<00:00, 152.62it/s]
Epoch 289, Train Loss: 0.1525
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.22it/s]
Epoch 290, Train Loss: 0.1522
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.32it/s]
100%|██████████| 19/19 [00:00<00:00, 127.27it/s]
Epoch 291, Train Loss: 0.1520
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.20it/s]
100%|██████████| 19/19 [00:00<00:00, 115.46it/s]
Epoch 292, Train Loss: 0.1517
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.97it/s]
Epoch 293, Train Loss: 0.1514
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.58it/s]
Epoch 294, Train Loss: 0.1511
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.93it/s]
Epoch 295, Train Loss: 0.1509
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.73it/s]
Epoch 296, Train Loss: 0.1506
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.55it/s]
Epoch 297, Train Loss: 0.1503
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.11it/s]
Epoch 298, Train Loss: 0.1501
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.45it/s]
Epoch 299, Train Loss: 0.1498
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.91it/s]
100%|██████████| 19/19 [00:00<00:00, 137.72it/s]
Epoch 300, Train Loss: 0.1496
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 194.26it/s]
Epoch 301, Train Loss: 0.1493
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.81it/s]
Epoch 302, Train Loss: 0.1490
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.01it/s]
Epoch 303, Train Loss: 0.1488
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.45it/s]
Epoch 304, Train Loss: 0.1485
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.25it/s]
Epoch 305, Train Loss: 0.1483
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.76it/s]
Epoch 306, Train Loss: 0.1480
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.97it/s]
Epoch 307, Train Loss: 0.1477
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.36it/s]
Epoch 308, Train Loss: 0.1475
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.91it/s]
100%|██████████| 19/19 [00:00<00:00, 116.84it/s]
Epoch 309, Train Loss: 0.1472
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.73it/s]
100%|██████████| 19/19 [00:00<00:00, 131.16it/s]
Epoch 310, Train Loss: 0.1470
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 256.83it/s]
Epoch 311, Train Loss: 0.1467
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.36it/s]
Epoch 312, Train Loss: 0.1465
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.08it/s]
Epoch 313, Train Loss: 0.1462
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.83it/s]
Epoch 314, Train Loss: 0.1460
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.60it/s]
Epoch 315, Train Loss: 0.1457
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.89it/s]
Epoch 316, Train Loss: 0.1455
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.34it/s]
Epoch 317, Train Loss: 0.1452
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.86it/s]
Epoch 318, Train Loss: 0.1450
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.34it/s]
Epoch 319, Train Loss: 0.1447
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.81it/s]
Epoch 320, Train Loss: 0.1445
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 251.98it/s]
Epoch 321, Train Loss: 0.1442
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.58it/s]
Epoch 322, Train Loss: 0.1440
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.04it/s]
Epoch 323, Train Loss: 0.1438
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.76it/s]
Epoch 324, Train Loss: 0.1435
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.96it/s]
Epoch 325, Train Loss: 0.1433
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 192.10it/s]
Epoch 326, Train Loss: 0.1430
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.98it/s]
100%|██████████| 19/19 [00:00<00:00, 106.18it/s]
Epoch 327, Train Loss: 0.1428
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.98it/s]
100%|██████████| 19/19 [00:00<00:00, 100.78it/s]
Epoch 328, Train Loss: 0.1426
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 228.12it/s]
Epoch 329, Train Loss: 0.1423
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.45it/s]
Epoch 330, Train Loss: 0.1421
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.19it/s]
100%|██████████| 19/19 [00:00<00:00, 112.22it/s]
Epoch 331, Train Loss: 0.1419
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.28it/s]
100%|██████████| 19/19 [00:00<00:00, 108.08it/s]
Epoch 332, Train Loss: 0.1416
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.19it/s]
100%|██████████| 19/19 [00:00<00:00, 109.69it/s]
Epoch 333, Train Loss: 0.1414
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.17it/s]
Epoch 334, Train Loss: 0.1412
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.41it/s]
Epoch 335, Train Loss: 0.1409
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 255.96it/s]
Epoch 336, Train Loss: 0.1407
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.24it/s]
Epoch 337, Train Loss: 0.1405
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.05it/s]
Epoch 338, Train Loss: 0.1403
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.66it/s]
100%|██████████| 19/19 [00:00<00:00, 120.86it/s]
Epoch 339, Train Loss: 0.1400
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.18it/s]
100%|██████████| 19/19 [00:00<00:00, 113.69it/s]
Epoch 340, Train Loss: 0.1398
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 220.88it/s]
Epoch 341, Train Loss: 0.1396
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 181.15it/s]
100%|██████████| 19/19 [00:00<00:00, 178.45it/s]
Epoch 342, Train Loss: 0.1394
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.46it/s]
100%|██████████| 19/19 [00:00<00:00, 116.72it/s]
Epoch 343, Train Loss: 0.1392
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 108.87it/s]
100%|██████████| 19/19 [00:00<00:00, 130.11it/s]
Epoch 344, Train Loss: 0.1389
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 201.00it/s]
Epoch 345, Train Loss: 0.1387
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.12it/s]
Epoch 346, Train Loss: 0.1385
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 160.46it/s]
100%|██████████| 19/19 [00:00<00:00, 150.86it/s]
Epoch 347, Train Loss: 0.1383
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.26it/s]
100%|██████████| 19/19 [00:00<00:00, 113.90it/s]
Epoch 348, Train Loss: 0.1381
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.27it/s]
100%|██████████| 19/19 [00:00<00:00, 112.08it/s]
Epoch 349, Train Loss: 0.1379
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.02it/s]
Epoch 350, Train Loss: 0.1377
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.57it/s]
Epoch 351, Train Loss: 0.1375
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 120.95it/s]
100%|██████████| 19/19 [00:00<00:00, 117.20it/s]
Epoch 352, Train Loss: 0.1372
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.20it/s]
100%|██████████| 19/19 [00:00<00:00, 95.20it/s]
Epoch 353, Train Loss: 0.1370
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.43it/s]
100%|██████████| 19/19 [00:00<00:00, 95.35it/s]
Epoch 354, Train Loss: 0.1368
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.00it/s]
100%|██████████| 19/19 [00:00<00:00, 98.49it/s]
Epoch 355, Train Loss: 0.1366
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 100.85it/s]
100%|██████████| 19/19 [00:00<00:00, 96.09it/s]
Epoch 356, Train Loss: 0.1364
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.21it/s]
100%|██████████| 19/19 [00:00<00:00, 100.06it/s]
Epoch 357, Train Loss: 0.1362
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.05it/s]
100%|██████████| 19/19 [00:00<00:00, 99.28it/s]
Epoch 358, Train Loss: 0.1360
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.53it/s]
100%|██████████| 19/19 [00:00<00:00, 100.58it/s]
Epoch 359, Train Loss: 0.1358
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.46it/s]
100%|██████████| 19/19 [00:00<00:00, 160.34it/s]
Epoch 360, Train Loss: 0.1356
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 131.43it/s]
100%|██████████| 19/19 [00:00<00:00, 126.63it/s]
Epoch 361, Train Loss: 0.1354
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.72it/s]
100%|██████████| 19/19 [00:00<00:00, 102.42it/s]
Epoch 362, Train Loss: 0.1353
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.00it/s]
100%|██████████| 19/19 [00:00<00:00, 114.06it/s]
Epoch 363, Train Loss: 0.1351
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.16it/s]
Epoch 364, Train Loss: 0.1349
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.60it/s]
Epoch 365, Train Loss: 0.1347
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.43it/s]
Epoch 366, Train Loss: 0.1345
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.82it/s]
Epoch 367, Train Loss: 0.1343
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.20it/s]
Epoch 368, Train Loss: 0.1341
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.49it/s]
Epoch 369, Train Loss: 0.1339
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 140.09it/s]
100%|██████████| 19/19 [00:00<00:00, 138.44it/s]
Epoch 370, Train Loss: 0.1338
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.25it/s]
Epoch 371, Train Loss: 0.1336
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.25it/s]
Epoch 372, Train Loss: 0.1334
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.37it/s]
Epoch 373, Train Loss: 0.1332
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.94it/s]
Epoch 374, Train Loss: 0.1331
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.27it/s]
Epoch 375, Train Loss: 0.1329
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.52it/s]
Epoch 376, Train Loss: 0.1327
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 188.86it/s]
100%|██████████| 19/19 [00:00<00:00, 187.12it/s]
Epoch 377, Train Loss: 0.1325
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 154.46it/s]
100%|██████████| 19/19 [00:00<00:00, 151.88it/s]
Epoch 378, Train Loss: 0.1324
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 128.98it/s]
100%|██████████| 19/19 [00:00<00:00, 134.86it/s]
Epoch 379, Train Loss: 0.1322
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.25it/s]
100%|██████████| 19/19 [00:00<00:00, 101.05it/s]
Epoch 380, Train Loss: 0.1320
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.96it/s]
100%|██████████| 19/19 [00:00<00:00, 115.99it/s]
Epoch 381, Train Loss: 0.1319
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.58it/s]
Epoch 382, Train Loss: 0.1317
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.67it/s]
Epoch 383, Train Loss: 0.1315
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.87it/s]
100%|██████████| 19/19 [00:00<00:00, 155.58it/s]
Epoch 384, Train Loss: 0.1314
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.99it/s]
Epoch 385, Train Loss: 0.1312
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.68it/s]
Epoch 386, Train Loss: 0.1310
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.27it/s]
Epoch 387, Train Loss: 0.1309
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 120.85it/s]
100%|██████████| 19/19 [00:00<00:00, 122.49it/s]
Epoch 388, Train Loss: 0.1307
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.75it/s]
100%|██████████| 19/19 [00:00<00:00, 106.57it/s]
Epoch 389, Train Loss: 0.1306
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.57it/s]
100%|██████████| 19/19 [00:00<00:00, 101.46it/s]
Epoch 390, Train Loss: 0.1304
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 134.84it/s]
100%|██████████| 19/19 [00:00<00:00, 119.86it/s]
Epoch 391, Train Loss: 0.1303
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.08it/s]
100%|██████████| 19/19 [00:00<00:00, 93.40it/s]
Epoch 392, Train Loss: 0.1301
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.41it/s]
100%|██████████| 19/19 [00:00<00:00, 98.00it/s]
Epoch 393, Train Loss: 0.1299
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.33it/s]
100%|██████████| 19/19 [00:00<00:00, 93.35it/s]
Epoch 394, Train Loss: 0.1298
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.31it/s]
100%|██████████| 19/19 [00:00<00:00, 119.05it/s]
Epoch 395, Train Loss: 0.1296
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.49it/s]
Epoch 396, Train Loss: 0.1295
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.93it/s]
Epoch 397, Train Loss: 0.1293
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.82it/s]
Epoch 398, Train Loss: 0.1292
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.82it/s]
100%|██████████| 19/19 [00:00<00:00, 129.80it/s]
Epoch 399, Train Loss: 0.1290
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.85it/s]
100%|██████████| 19/19 [00:00<00:00, 110.62it/s]
Epoch 400, Train Loss: 0.1289
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.98it/s]
100%|██████████| 19/19 [00:00<00:00, 122.22it/s]
Epoch 401, Train Loss: 0.1288
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.84it/s]
100%|██████████| 19/19 [00:00<00:00, 106.37it/s]
Epoch 402, Train Loss: 0.1286
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.62it/s]
Epoch 403, Train Loss: 0.1285
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 253.47it/s]
Epoch 404, Train Loss: 0.1283
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.12it/s]
Epoch 405, Train Loss: 0.1282
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 286.86it/s]
Epoch 406, Train Loss: 0.1280
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 196.26it/s]
Epoch 407, Train Loss: 0.1279
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.22it/s]
Epoch 408, Train Loss: 0.1277
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 151.71it/s]
100%|██████████| 19/19 [00:00<00:00, 142.10it/s]
Epoch 409, Train Loss: 0.1276
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.14it/s]
100%|██████████| 19/19 [00:00<00:00, 95.64it/s]
Epoch 410, Train Loss: 0.1275
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.90it/s]
95%|█████████▍| 18/19 [00:00<00:00, 87.81it/s]
100%|██████████| 19/19 [00:00<00:00, 86.58it/s]
Epoch 411, Train Loss: 0.1273
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.59it/s]
100%|██████████| 19/19 [00:00<00:00, 101.58it/s]
Epoch 412, Train Loss: 0.1272
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.17it/s]
100%|██████████| 19/19 [00:00<00:00, 104.74it/s]
Epoch 413, Train Loss: 0.1270
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.56it/s]
100%|██████████| 19/19 [00:00<00:00, 96.45it/s]
Epoch 414, Train Loss: 0.1269
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.96it/s]
100%|██████████| 19/19 [00:00<00:00, 111.85it/s]
Epoch 415, Train Loss: 0.1268
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.67it/s]
100%|██████████| 19/19 [00:00<00:00, 111.82it/s]
Epoch 416, Train Loss: 0.1266
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.92it/s]
100%|██████████| 19/19 [00:00<00:00, 94.42it/s]
Epoch 417, Train Loss: 0.1265
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.94it/s]
100%|██████████| 19/19 [00:00<00:00, 96.89it/s]
Epoch 418, Train Loss: 0.1264
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.06it/s]
100%|██████████| 19/19 [00:00<00:00, 90.56it/s]
Epoch 419, Train Loss: 0.1262
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.34it/s]
100%|██████████| 19/19 [00:00<00:00, 90.07it/s]
Epoch 420, Train Loss: 0.1261
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 89.67it/s]
100%|██████████| 19/19 [00:00<00:00, 90.84it/s]
Epoch 421, Train Loss: 0.1260
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.35it/s]
100%|██████████| 19/19 [00:00<00:00, 90.64it/s]
Epoch 422, Train Loss: 0.1258
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.41it/s]
100%|██████████| 19/19 [00:00<00:00, 104.95it/s]
Epoch 423, Train Loss: 0.1257
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 110.39it/s]
100%|██████████| 19/19 [00:00<00:00, 121.34it/s]
Epoch 424, Train Loss: 0.1256
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.50it/s]
Epoch 425, Train Loss: 0.1254
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.68it/s]
Epoch 426, Train Loss: 0.1253
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.90it/s]
Epoch 427, Train Loss: 0.1251
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.87it/s]
Epoch 428, Train Loss: 0.1250
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.02it/s]
Epoch 429, Train Loss: 0.1249
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.01it/s]
Epoch 430, Train Loss: 0.1248
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.08it/s]
Epoch 431, Train Loss: 0.1246
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.23it/s]
Epoch 432, Train Loss: 0.1245
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.09it/s]
Epoch 433, Train Loss: 0.1244
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.35it/s]
Epoch 434, Train Loss: 0.1242
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.85it/s]
Epoch 435, Train Loss: 0.1241
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.35it/s]
Epoch 436, Train Loss: 0.1240
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.95it/s]
Epoch 437, Train Loss: 0.1238
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.37it/s]
Epoch 438, Train Loss: 0.1237
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 177.61it/s]
100%|██████████| 19/19 [00:00<00:00, 175.46it/s]
Epoch 439, Train Loss: 0.1236
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.62it/s]
100%|██████████| 19/19 [00:00<00:00, 112.10it/s]
Epoch 440, Train Loss: 0.1234
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.09it/s]
100%|██████████| 19/19 [00:00<00:00, 115.55it/s]
Epoch 441, Train Loss: 0.1233
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 145.78it/s]
100%|██████████| 19/19 [00:00<00:00, 158.81it/s]
Epoch 442, Train Loss: 0.1232
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.05it/s]
Epoch 443, Train Loss: 0.1231
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.65it/s]
Epoch 444, Train Loss: 0.1229
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.59it/s]
Epoch 445, Train Loss: 0.1228
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.02it/s]
Epoch 446, Train Loss: 0.1227
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 283.68it/s]
Epoch 447, Train Loss: 0.1225
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.90it/s]
100%|██████████| 19/19 [00:00<00:00, 102.45it/s]
Epoch 448, Train Loss: 0.1224
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.65it/s]
100%|██████████| 19/19 [00:00<00:00, 104.85it/s]
Epoch 449, Train Loss: 0.1223
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.28it/s]
100%|██████████| 19/19 [00:00<00:00, 95.75it/s]
Epoch 450, Train Loss: 0.1222
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.71it/s]
100%|██████████| 19/19 [00:00<00:00, 95.96it/s]
Epoch 451, Train Loss: 0.1220
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.68it/s]
100%|██████████| 19/19 [00:00<00:00, 108.47it/s]
Epoch 452, Train Loss: 0.1219
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.17it/s]
100%|██████████| 19/19 [00:00<00:00, 102.88it/s]
Epoch 453, Train Loss: 0.1218
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.30it/s]
100%|██████████| 19/19 [00:00<00:00, 96.04it/s]
Epoch 454, Train Loss: 0.1216
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.55it/s]
100%|██████████| 19/19 [00:00<00:00, 122.31it/s]
Epoch 455, Train Loss: 0.1215
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.80it/s]
100%|██████████| 19/19 [00:00<00:00, 108.41it/s]
Epoch 456, Train Loss: 0.1214
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.33it/s]
100%|██████████| 19/19 [00:00<00:00, 95.44it/s]
Epoch 457, Train Loss: 0.1213
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.28it/s]
100%|██████████| 19/19 [00:00<00:00, 113.07it/s]
Epoch 458, Train Loss: 0.1211
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.00it/s]
100%|██████████| 19/19 [00:00<00:00, 95.81it/s]
Epoch 459, Train Loss: 0.1210
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.87it/s]
100%|██████████| 19/19 [00:00<00:00, 92.46it/s]
100%|██████████| 19/19 [00:00<00:00, 91.04it/s]
Epoch 460, Train Loss: 0.1209
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.26it/s]
100%|██████████| 19/19 [00:00<00:00, 104.54it/s]
Epoch 461, Train Loss: 0.1208
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.91it/s]
100%|██████████| 19/19 [00:00<00:00, 140.69it/s]
Epoch 462, Train Loss: 0.1206
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.81it/s]
100%|██████████| 19/19 [00:00<00:00, 127.72it/s]
Epoch 463, Train Loss: 0.1205
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 195.07it/s]
Epoch 464, Train Loss: 0.1204
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.49it/s]
100%|██████████| 19/19 [00:00<00:00, 116.60it/s]
Epoch 465, Train Loss: 0.1202
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.86it/s]
100%|██████████| 19/19 [00:00<00:00, 98.48it/s]
Epoch 466, Train Loss: 0.1201
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.57it/s]
100%|██████████| 19/19 [00:00<00:00, 114.71it/s]
Epoch 467, Train Loss: 0.1200
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.73it/s]
Epoch 468, Train Loss: 0.1199
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.68it/s]
Epoch 469, Train Loss: 0.1197
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.25it/s]
Epoch 470, Train Loss: 0.1196
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.21it/s]
Epoch 471, Train Loss: 0.1195
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.67it/s]
Epoch 472, Train Loss: 0.1194
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.10it/s]
Epoch 473, Train Loss: 0.1192
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.62it/s]
Epoch 474, Train Loss: 0.1191
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.58it/s]
Epoch 475, Train Loss: 0.1190
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.75it/s]
Epoch 476, Train Loss: 0.1188
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.00it/s]
Epoch 477, Train Loss: 0.1187
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.84it/s]
Epoch 478, Train Loss: 0.1186
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.21it/s]
Epoch 479, Train Loss: 0.1185
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.11it/s]
Epoch 480, Train Loss: 0.1183
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.26it/s]
Epoch 481, Train Loss: 0.1182
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.74it/s]
Epoch 482, Train Loss: 0.1181
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.56it/s]
Epoch 483, Train Loss: 0.1180
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.27it/s]
Epoch 484, Train Loss: 0.1178
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.37it/s]
Epoch 485, Train Loss: 0.1177
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.69it/s]
Epoch 486, Train Loss: 0.1176
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.95it/s]
Epoch 487, Train Loss: 0.1174
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.11it/s]
Epoch 488, Train Loss: 0.1173
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.06it/s]
Epoch 489, Train Loss: 0.1172
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.35it/s]
Epoch 490, Train Loss: 0.1171
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.82it/s]
Epoch 491, Train Loss: 0.1169
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.94it/s]
Epoch 492, Train Loss: 0.1168
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.04it/s]
Epoch 493, Train Loss: 0.1167
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.23it/s]
Epoch 494, Train Loss: 0.1166
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.62it/s]
Epoch 495, Train Loss: 0.1164
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.08it/s]
Epoch 496, Train Loss: 0.1163
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.03it/s]
Epoch 497, Train Loss: 0.1162
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 166.64it/s]
100%|██████████| 19/19 [00:00<00:00, 161.68it/s]
Epoch 498, Train Loss: 0.1160
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.23it/s]
100%|██████████| 19/19 [00:00<00:00, 111.43it/s]
Epoch 499, Train Loss: 0.1159
.............................
Validation#
encode, decode = transform_nn(dog_data, encoder, decoder, device=device)
/home/xinqiao/anaconda3/envs/m3_test/lib/python3.10/site-packages/torch/nn/modules/rnn.py:879: UserWarning: RNN module weights are not part of single contiguous chunk of memory. This means they need to be compacted at every call, possibly greatly increasing memory usage. To compact weights again call flatten_parameters(). (Triggered internally at ../aten/src/ATen/native/cudnn/RNN.cpp:982.)
result = _VF.lstm(input, hx, self._flat_weights, self.bias, self.num_layers,
embeddings(encode, shape_=image.shape[0:2], figsize=(15, 5))
This does not really mean too much because the latent variables are all competing with one another
LSTM Autoencoder with 3 Latent Variables#
encoder = Encoder(latent_dim=3).to(device)
decoder = Decoder(latent_dim=3).to(device)
model = Autoencoder(encoder, decoder).to(device)
# optimizer
optimizer = optim.Adam(model.parameters(), lr=3e-5)
model
Autoencoder(
(encoder): Encoder(
(lstm): LSTM(1, 12, batch_first=True, bidirectional=True)
(embedding): Linear(in_features=24, out_features=3, bias=True)
(relu): ReLU()
)
(decoder): Decoder(
(lstm): LSTM(3, 12, batch_first=True, bidirectional=True)
(tdd): Conv1d(24, 1, kernel_size=(1,), stride=(1,))
)
)
Dataloader#
train_iterator = torch.utils.data.DataLoader(
np.atleast_3d(X_train), batch_size=256, shuffle=False
)
Training#
random_seed(seed=42)
Train(model, encoder, decoder, train_iterator, optimizer, 500, device=device)
Show code cell output
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.47it/s]
100%|██████████| 19/19 [00:00<00:00, 188.10it/s]
Epoch 0, Train Loss: 2.0366
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.93it/s]
Epoch 1, Train Loss: 2.0331
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.09it/s]
Epoch 2, Train Loss: 2.0296
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.97it/s]
Epoch 3, Train Loss: 2.0262
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.22it/s]
Epoch 4, Train Loss: 2.0227
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.24it/s]
100%|██████████| 19/19 [00:00<00:00, 114.99it/s]
Epoch 5, Train Loss: 2.0193
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 202.75it/s]
Epoch 6, Train Loss: 2.0158
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.06it/s]
100%|██████████| 19/19 [00:00<00:00, 103.89it/s]
Epoch 7, Train Loss: 2.0124
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.36it/s]
100%|██████████| 19/19 [00:00<00:00, 112.52it/s]
Epoch 8, Train Loss: 2.0089
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.47it/s]
Epoch 9, Train Loss: 2.0054
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.03it/s]
Epoch 10, Train Loss: 2.0019
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.22it/s]
Epoch 11, Train Loss: 1.9984
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.94it/s]
Epoch 12, Train Loss: 1.9948
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.98it/s]
Epoch 13, Train Loss: 1.9912
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.02it/s]
Epoch 14, Train Loss: 1.9876
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 283.76it/s]
Epoch 15, Train Loss: 1.9839
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 120.03it/s]
100%|██████████| 19/19 [00:00<00:00, 117.31it/s]
Epoch 16, Train Loss: 1.9801
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 148.93it/s]
100%|██████████| 19/19 [00:00<00:00, 161.36it/s]
Epoch 17, Train Loss: 1.9763
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.18it/s]
Epoch 18, Train Loss: 1.9725
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.74it/s]
Epoch 19, Train Loss: 1.9685
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.74it/s]
Epoch 20, Train Loss: 1.9645
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.61it/s]
Epoch 21, Train Loss: 1.9604
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.90it/s]
100%|██████████| 19/19 [00:00<00:00, 139.24it/s]
Epoch 22, Train Loss: 1.9562
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.78it/s]
100%|██████████| 19/19 [00:00<00:00, 109.78it/s]
Epoch 23, Train Loss: 1.9519
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.24it/s]
100%|██████████| 19/19 [00:00<00:00, 92.20it/s]
100%|██████████| 19/19 [00:00<00:00, 90.93it/s]
Epoch 24, Train Loss: 1.9476
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 194.59it/s]
Epoch 25, Train Loss: 1.9431
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.44it/s]
Epoch 26, Train Loss: 1.9384
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.37it/s]
Epoch 27, Train Loss: 1.9337
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.13it/s]
Epoch 28, Train Loss: 1.9288
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 134.57it/s]
100%|██████████| 19/19 [00:00<00:00, 127.60it/s]
Epoch 29, Train Loss: 1.9238
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 140.39it/s]
100%|██████████| 19/19 [00:00<00:00, 139.15it/s]
Epoch 30, Train Loss: 1.9186
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.56it/s]
100%|██████████| 19/19 [00:00<00:00, 110.31it/s]
Epoch 31, Train Loss: 1.9133
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.35it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.41it/s]
100%|██████████| 19/19 [00:00<00:00, 84.40it/s]
Epoch 32, Train Loss: 1.9077
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 195.20it/s]
Epoch 33, Train Loss: 1.9021
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.84it/s]
Epoch 34, Train Loss: 1.8962
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.20it/s]
Epoch 35, Train Loss: 1.8901
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 136.48it/s]
100%|██████████| 19/19 [00:00<00:00, 130.00it/s]
Epoch 36, Train Loss: 1.8838
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.01it/s]
100%|██████████| 19/19 [00:00<00:00, 109.51it/s]
Epoch 37, Train Loss: 1.8773
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.56it/s]
100%|██████████| 19/19 [00:00<00:00, 122.88it/s]
Epoch 38, Train Loss: 1.8705
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 253.57it/s]
Epoch 39, Train Loss: 1.8635
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.72it/s]
100%|██████████| 19/19 [00:00<00:00, 116.33it/s]
Epoch 40, Train Loss: 1.8563
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.35it/s]
100%|██████████| 19/19 [00:00<00:00, 90.27it/s]
Epoch 41, Train Loss: 1.8487
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.45it/s]
100%|██████████| 19/19 [00:00<00:00, 118.98it/s]
Epoch 42, Train Loss: 1.8409
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.44it/s]
Epoch 43, Train Loss: 1.8328
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.38it/s]
100%|██████████| 19/19 [00:00<00:00, 110.35it/s]
Epoch 44, Train Loss: 1.8244
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.35it/s]
100%|██████████| 19/19 [00:00<00:00, 103.78it/s]
Epoch 45, Train Loss: 1.8156
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.40it/s]
100%|██████████| 19/19 [00:00<00:00, 88.33it/s]
Epoch 46, Train Loss: 1.8065
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.91it/s]
100%|██████████| 19/19 [00:00<00:00, 92.42it/s]
100%|██████████| 19/19 [00:00<00:00, 90.53it/s]
Epoch 47, Train Loss: 1.7971
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.19it/s]
100%|██████████| 19/19 [00:00<00:00, 98.53it/s]
Epoch 48, Train Loss: 1.7872
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.56it/s]
100%|██████████| 19/19 [00:00<00:00, 99.69it/s]
Epoch 49, Train Loss: 1.7770
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 100.30it/s]
100%|██████████| 19/19 [00:00<00:00, 95.21it/s]
Epoch 50, Train Loss: 1.7664
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.41it/s]
100%|██████████| 19/19 [00:00<00:00, 115.17it/s]
Epoch 51, Train Loss: 1.7553
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.15it/s]
100%|██████████| 19/19 [00:00<00:00, 89.56it/s]
Epoch 52, Train Loss: 1.7437
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.15it/s]
100%|██████████| 19/19 [00:00<00:00, 110.18it/s]
Epoch 53, Train Loss: 1.7317
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.57it/s]
100%|██████████| 19/19 [00:00<00:00, 91.31it/s]
Epoch 54, Train Loss: 1.7192
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.85it/s]
100%|██████████| 19/19 [00:00<00:00, 108.34it/s]
Epoch 55, Train Loss: 1.7062
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.31it/s]
100%|██████████| 19/19 [00:00<00:00, 101.18it/s]
Epoch 56, Train Loss: 1.6927
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.67it/s]
100%|██████████| 19/19 [00:00<00:00, 140.13it/s]
Epoch 57, Train Loss: 1.6786
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 132.22it/s]
100%|██████████| 19/19 [00:00<00:00, 126.13it/s]
Epoch 58, Train Loss: 1.6640
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.13it/s]
100%|██████████| 19/19 [00:00<00:00, 103.89it/s]
Epoch 59, Train Loss: 1.6488
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.51it/s]
100%|██████████| 19/19 [00:00<00:00, 94.67it/s]
Epoch 60, Train Loss: 1.6331
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.97it/s]
100%|██████████| 19/19 [00:00<00:00, 98.33it/s]
Epoch 61, Train Loss: 1.6169
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.78it/s]
100%|██████████| 19/19 [00:00<00:00, 92.08it/s]
100%|██████████| 19/19 [00:00<00:00, 90.78it/s]
Epoch 62, Train Loss: 1.6002
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.56it/s]
100%|██████████| 19/19 [00:00<00:00, 116.11it/s]
Epoch 63, Train Loss: 1.5830
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.18it/s]
100%|██████████| 19/19 [00:00<00:00, 92.61it/s]
Epoch 64, Train Loss: 1.5653
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.59it/s]
100%|██████████| 19/19 [00:00<00:00, 117.01it/s]
Epoch 65, Train Loss: 1.5472
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 250.78it/s]
Epoch 66, Train Loss: 1.5287
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.15it/s]
Epoch 67, Train Loss: 1.5099
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.64it/s]
Epoch 68, Train Loss: 1.4908
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.18it/s]
Epoch 69, Train Loss: 1.4715
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.96it/s]
Epoch 70, Train Loss: 1.4519
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.87it/s]
Epoch 71, Train Loss: 1.4322
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.00it/s]
Epoch 72, Train Loss: 1.4124
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.11it/s]
Epoch 73, Train Loss: 1.3925
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.70it/s]
100%|██████████| 19/19 [00:00<00:00, 118.57it/s]
Epoch 74, Train Loss: 1.3726
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 184.58it/s]
100%|██████████| 19/19 [00:00<00:00, 181.86it/s]
Epoch 75, Train Loss: 1.3526
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.20it/s]
100%|██████████| 19/19 [00:00<00:00, 107.73it/s]
Epoch 76, Train Loss: 1.3327
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.22it/s]
100%|██████████| 19/19 [00:00<00:00, 124.90it/s]
Epoch 77, Train Loss: 1.3128
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.57it/s]
Epoch 78, Train Loss: 1.2929
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.28it/s]
Epoch 79, Train Loss: 1.2731
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 255.49it/s]
Epoch 80, Train Loss: 1.2534
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.16it/s]
Epoch 81, Train Loss: 1.2337
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.25it/s]
Epoch 82, Train Loss: 1.2141
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.96it/s]
Epoch 83, Train Loss: 1.1946
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 191.63it/s]
Epoch 84, Train Loss: 1.1752
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 136.51it/s]
100%|██████████| 19/19 [00:00<00:00, 131.34it/s]
Epoch 85, Train Loss: 1.1558
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.27it/s]
Epoch 86, Train Loss: 1.1365
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.74it/s]
Epoch 87, Train Loss: 1.1172
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 132.24it/s]
100%|██████████| 19/19 [00:00<00:00, 121.53it/s]
Epoch 88, Train Loss: 1.0979
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.80it/s]
100%|██████████| 19/19 [00:00<00:00, 99.84it/s]
Epoch 89, Train Loss: 1.0786
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.23it/s]
100%|██████████| 19/19 [00:00<00:00, 119.89it/s]
Epoch 90, Train Loss: 1.0593
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 168.71it/s]
100%|██████████| 19/19 [00:00<00:00, 154.39it/s]
Epoch 91, Train Loss: 1.0400
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 134.65it/s]
100%|██████████| 19/19 [00:00<00:00, 123.35it/s]
Epoch 92, Train Loss: 1.0206
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.72it/s]
100%|██████████| 19/19 [00:00<00:00, 94.92it/s]
Epoch 93, Train Loss: 1.0010
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.14it/s]
100%|██████████| 19/19 [00:00<00:00, 105.10it/s]
Epoch 94, Train Loss: 0.9814
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.75it/s]
100%|██████████| 19/19 [00:00<00:00, 109.90it/s]
Epoch 95, Train Loss: 0.9616
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.88it/s]
100%|██████████| 19/19 [00:00<00:00, 116.92it/s]
Epoch 96, Train Loss: 0.9417
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.06it/s]
100%|██████████| 19/19 [00:00<00:00, 110.07it/s]
Epoch 97, Train Loss: 0.9216
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.82it/s]
100%|██████████| 19/19 [00:00<00:00, 104.19it/s]
Epoch 98, Train Loss: 0.9012
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.91it/s]
100%|██████████| 19/19 [00:00<00:00, 100.30it/s]
Epoch 99, Train Loss: 0.8807
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.31it/s]
100%|██████████| 19/19 [00:00<00:00, 92.53it/s]
Epoch 100, Train Loss: 0.8600
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.10it/s]
100%|██████████| 19/19 [00:00<00:00, 122.96it/s]
Epoch 101, Train Loss: 0.8391
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.63it/s]
100%|██████████| 19/19 [00:00<00:00, 117.05it/s]
Epoch 102, Train Loss: 0.8181
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.54it/s]
100%|██████████| 19/19 [00:00<00:00, 94.22it/s]
Epoch 103, Train Loss: 0.7968
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.60it/s]
100%|██████████| 19/19 [00:00<00:00, 115.16it/s]
Epoch 104, Train Loss: 0.7754
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.85it/s]
Epoch 105, Train Loss: 0.7539
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.91it/s]
Epoch 106, Train Loss: 0.7324
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.46it/s]
100%|██████████| 19/19 [00:00<00:00, 107.90it/s]
Epoch 107, Train Loss: 0.7108
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.04it/s]
100%|██████████| 19/19 [00:00<00:00, 90.92it/s]
100%|██████████| 19/19 [00:00<00:00, 89.09it/s]
Epoch 108, Train Loss: 0.6893
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.46it/s]
100%|██████████| 19/19 [00:00<00:00, 113.74it/s]
Epoch 109, Train Loss: 0.6680
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.05it/s]
100%|██████████| 19/19 [00:00<00:00, 104.64it/s]
Epoch 110, Train Loss: 0.6468
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.82it/s]
100%|██████████| 19/19 [00:00<00:00, 99.34it/s]
Epoch 111, Train Loss: 0.6259
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.84it/s]
100%|██████████| 19/19 [00:00<00:00, 90.03it/s]
100%|██████████| 19/19 [00:00<00:00, 88.96it/s]
Epoch 112, Train Loss: 0.6053
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.92it/s]
100%|██████████| 19/19 [00:00<00:00, 93.03it/s]
Epoch 113, Train Loss: 0.5852
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.79it/s]
100%|██████████| 19/19 [00:00<00:00, 94.12it/s]
100%|██████████| 19/19 [00:00<00:00, 92.61it/s]
Epoch 114, Train Loss: 0.5657
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 168.51it/s]
100%|██████████| 19/19 [00:00<00:00, 171.93it/s]
Epoch 115, Train Loss: 0.5467
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.96it/s]
Epoch 116, Train Loss: 0.5284
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.31it/s]
Epoch 117, Train Loss: 0.5108
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.23it/s]
100%|██████████| 19/19 [00:00<00:00, 113.26it/s]
Epoch 118, Train Loss: 0.4939
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.28it/s]
100%|██████████| 19/19 [00:00<00:00, 107.13it/s]
Epoch 119, Train Loss: 0.4779
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.58it/s]
100%|██████████| 19/19 [00:00<00:00, 95.97it/s]
Epoch 120, Train Loss: 0.4626
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.88it/s]
100%|██████████| 19/19 [00:00<00:00, 135.56it/s]
Epoch 121, Train Loss: 0.4482
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.92it/s]
Epoch 122, Train Loss: 0.4346
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 286.57it/s]
Epoch 123, Train Loss: 0.4218
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.19it/s]
Epoch 124, Train Loss: 0.4097
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 283.89it/s]
Epoch 125, Train Loss: 0.3984
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 285.52it/s]
Epoch 126, Train Loss: 0.3878
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.47it/s]
Epoch 127, Train Loss: 0.3778
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.23it/s]
100%|██████████| 19/19 [00:00<00:00, 122.90it/s]
Epoch 128, Train Loss: 0.3685
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 131.44it/s]
100%|██████████| 19/19 [00:00<00:00, 126.25it/s]
Epoch 129, Train Loss: 0.3597
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.36it/s]
100%|██████████| 19/19 [00:00<00:00, 117.65it/s]
Epoch 130, Train Loss: 0.3515
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.44it/s]
Epoch 131, Train Loss: 0.3438
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 129.60it/s]
100%|██████████| 19/19 [00:00<00:00, 124.16it/s]
Epoch 132, Train Loss: 0.3365
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.02it/s]
100%|██████████| 19/19 [00:00<00:00, 112.50it/s]
Epoch 133, Train Loss: 0.3297
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 165.57it/s]
100%|██████████| 19/19 [00:00<00:00, 161.74it/s]
Epoch 134, Train Loss: 0.3232
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.96it/s]
Epoch 135, Train Loss: 0.3171
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.08it/s]
Epoch 136, Train Loss: 0.3114
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.92it/s]
100%|██████████| 19/19 [00:00<00:00, 137.34it/s]
Epoch 137, Train Loss: 0.3060
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 126.68it/s]
100%|██████████| 19/19 [00:00<00:00, 119.42it/s]
Epoch 138, Train Loss: 0.3009
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.50it/s]
100%|██████████| 19/19 [00:00<00:00, 107.03it/s]
Epoch 139, Train Loss: 0.2961
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.22it/s]
100%|██████████| 19/19 [00:00<00:00, 128.00it/s]
Epoch 140, Train Loss: 0.2915
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.57it/s]
Epoch 141, Train Loss: 0.2872
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.11it/s]
Epoch 142, Train Loss: 0.2831
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 141.33it/s]
100%|██████████| 19/19 [00:00<00:00, 133.44it/s]
Epoch 143, Train Loss: 0.2792
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 221.74it/s]
Epoch 144, Train Loss: 0.2756
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.29it/s]
Epoch 145, Train Loss: 0.2721
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.05it/s]
Epoch 146, Train Loss: 0.2688
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.10it/s]
Epoch 147, Train Loss: 0.2657
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.03it/s]
Epoch 148, Train Loss: 0.2628
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.17it/s]
Epoch 149, Train Loss: 0.2600
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.56it/s]
Epoch 150, Train Loss: 0.2574
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.59it/s]
Epoch 151, Train Loss: 0.2549
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.97it/s]
Epoch 152, Train Loss: 0.2525
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 202.07it/s]
Epoch 153, Train Loss: 0.2502
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.90it/s]
Epoch 154, Train Loss: 0.2481
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.92it/s]
Epoch 155, Train Loss: 0.2461
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.77it/s]
Epoch 156, Train Loss: 0.2441
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 168.93it/s]
100%|██████████| 19/19 [00:00<00:00, 168.69it/s]
Epoch 157, Train Loss: 0.2423
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.78it/s]
Epoch 158, Train Loss: 0.2405
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.76it/s]
Epoch 159, Train Loss: 0.2389
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 232.04it/s]
Epoch 160, Train Loss: 0.2373
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.52it/s]
100%|██████████| 19/19 [00:00<00:00, 120.26it/s]
Epoch 161, Train Loss: 0.2358
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.15it/s]
100%|██████████| 19/19 [00:00<00:00, 97.33it/s]
Epoch 162, Train Loss: 0.2343
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.40it/s]
100%|██████████| 19/19 [00:00<00:00, 101.07it/s]
Epoch 163, Train Loss: 0.2329
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.87it/s]
100%|██████████| 19/19 [00:00<00:00, 100.97it/s]
Epoch 164, Train Loss: 0.2316
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.34it/s]
100%|██████████| 19/19 [00:00<00:00, 99.72it/s]
Epoch 165, Train Loss: 0.2303
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.24it/s]
100%|██████████| 19/19 [00:00<00:00, 102.67it/s]
Epoch 166, Train Loss: 0.2291
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 135.42it/s]
100%|██████████| 19/19 [00:00<00:00, 131.41it/s]
Epoch 167, Train Loss: 0.2280
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.22it/s]
100%|██████████| 19/19 [00:00<00:00, 131.53it/s]
Epoch 168, Train Loss: 0.2269
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 167.51it/s]
100%|██████████| 19/19 [00:00<00:00, 163.93it/s]
Epoch 169, Train Loss: 0.2258
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 144.77it/s]
100%|██████████| 19/19 [00:00<00:00, 158.04it/s]
Epoch 170, Train Loss: 0.2248
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.16it/s]
Epoch 171, Train Loss: 0.2238
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.85it/s]
Epoch 172, Train Loss: 0.2228
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.90it/s]
Epoch 173, Train Loss: 0.2219
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.64it/s]
Epoch 174, Train Loss: 0.2210
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.88it/s]
Epoch 175, Train Loss: 0.2201
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.66it/s]
Epoch 176, Train Loss: 0.2193
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 267.53it/s]
Epoch 177, Train Loss: 0.2185
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 284.93it/s]
Epoch 178, Train Loss: 0.2177
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.40it/s]
Epoch 179, Train Loss: 0.2169
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.95it/s]
Epoch 180, Train Loss: 0.2162
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.62it/s]
Epoch 181, Train Loss: 0.2155
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.18it/s]
Epoch 182, Train Loss: 0.2147
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.03it/s]
Epoch 183, Train Loss: 0.2140
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.62it/s]
Epoch 184, Train Loss: 0.2134
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.10it/s]
Epoch 185, Train Loss: 0.2127
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.46it/s]
Epoch 186, Train Loss: 0.2120
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 282.80it/s]
Epoch 187, Train Loss: 0.2114
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.85it/s]
Epoch 188, Train Loss: 0.2108
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.06it/s]
Epoch 189, Train Loss: 0.2101
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 121.97it/s]
100%|██████████| 19/19 [00:00<00:00, 122.85it/s]
Epoch 190, Train Loss: 0.2095
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 177.83it/s]
100%|██████████| 19/19 [00:00<00:00, 172.74it/s]
Epoch 191, Train Loss: 0.2089
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.01it/s]
100%|██████████| 19/19 [00:00<00:00, 100.76it/s]
Epoch 192, Train Loss: 0.2083
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 126.49it/s]
100%|██████████| 19/19 [00:00<00:00, 119.73it/s]
Epoch 193, Train Loss: 0.2078
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.69it/s]
100%|██████████| 19/19 [00:00<00:00, 91.96it/s]
Epoch 194, Train Loss: 0.2072
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.98it/s]
100%|██████████| 19/19 [00:00<00:00, 97.48it/s]
Epoch 195, Train Loss: 0.2066
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.33it/s]
100%|██████████| 19/19 [00:00<00:00, 92.69it/s]
Epoch 196, Train Loss: 0.2061
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.15it/s]
100%|██████████| 19/19 [00:00<00:00, 94.60it/s]
Epoch 197, Train Loss: 0.2055
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.27it/s]
100%|██████████| 19/19 [00:00<00:00, 96.19it/s]
Epoch 198, Train Loss: 0.2049
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.54it/s]
100%|██████████| 19/19 [00:00<00:00, 93.87it/s]
Epoch 199, Train Loss: 0.2044
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.60it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.12it/s]
100%|██████████| 19/19 [00:00<00:00, 86.65it/s]
Epoch 200, Train Loss: 0.2039
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.37it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.89it/s]
100%|██████████| 19/19 [00:00<00:00, 83.50it/s]
Epoch 201, Train Loss: 0.2033
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.63it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.27it/s]
100%|██████████| 19/19 [00:00<00:00, 85.22it/s]
Epoch 202, Train Loss: 0.2028
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.58it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.92it/s]
100%|██████████| 19/19 [00:00<00:00, 82.54it/s]
Epoch 203, Train Loss: 0.2023
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.15it/s]
100%|██████████| 19/19 [00:00<00:00, 100.05it/s]
Epoch 204, Train Loss: 0.2018
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.45it/s]
100%|██████████| 19/19 [00:00<00:00, 103.08it/s]
Epoch 205, Train Loss: 0.2013
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.44it/s]
100%|██████████| 19/19 [00:00<00:00, 95.44it/s]
Epoch 206, Train Loss: 0.2008
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.16it/s]
100%|██████████| 19/19 [00:00<00:00, 150.72it/s]
Epoch 207, Train Loss: 0.2002
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.25it/s]
100%|██████████| 19/19 [00:00<00:00, 110.25it/s]
Epoch 208, Train Loss: 0.1998
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.86it/s]
100%|██████████| 19/19 [00:00<00:00, 119.70it/s]
Epoch 209, Train Loss: 0.1993
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.20it/s]
Epoch 210, Train Loss: 0.1988
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 253.78it/s]
Epoch 211, Train Loss: 0.1983
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 128.59it/s]
100%|██████████| 19/19 [00:00<00:00, 124.71it/s]
Epoch 212, Train Loss: 0.1978
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.11it/s]
100%|██████████| 19/19 [00:00<00:00, 126.26it/s]
Epoch 213, Train Loss: 0.1973
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 140.62it/s]
100%|██████████| 19/19 [00:00<00:00, 140.01it/s]
Epoch 214, Train Loss: 0.1968
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 223.76it/s]
Epoch 215, Train Loss: 0.1964
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 223.00it/s]
Epoch 216, Train Loss: 0.1959
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 169.54it/s]
100%|██████████| 19/19 [00:00<00:00, 174.68it/s]
Epoch 217, Train Loss: 0.1955
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 123.73it/s]
100%|██████████| 19/19 [00:00<00:00, 115.57it/s]
Epoch 218, Train Loss: 0.1950
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.27it/s]
100%|██████████| 19/19 [00:00<00:00, 95.35it/s]
100%|██████████| 19/19 [00:00<00:00, 93.63it/s]
Epoch 219, Train Loss: 0.1945
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.36it/s]
100%|██████████| 19/19 [00:00<00:00, 106.51it/s]
Epoch 220, Train Loss: 0.1941
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.05it/s]
100%|██████████| 19/19 [00:00<00:00, 118.12it/s]
Epoch 221, Train Loss: 0.1936
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.87it/s]
100%|██████████| 19/19 [00:00<00:00, 188.10it/s]
Epoch 222, Train Loss: 0.1932
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 251.38it/s]
Epoch 223, Train Loss: 0.1928
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.18it/s]
100%|██████████| 19/19 [00:00<00:00, 99.32it/s]
Epoch 224, Train Loss: 0.1923
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.55it/s]
100%|██████████| 19/19 [00:00<00:00, 96.46it/s]
Epoch 225, Train Loss: 0.1919
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.15it/s]
100%|██████████| 19/19 [00:00<00:00, 112.55it/s]
Epoch 226, Train Loss: 0.1915
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.86it/s]
100%|██████████| 19/19 [00:00<00:00, 94.41it/s]
Epoch 227, Train Loss: 0.1910
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.04it/s]
95%|█████████▍| 18/19 [00:00<00:00, 88.51it/s]
100%|██████████| 19/19 [00:00<00:00, 87.86it/s]
Epoch 228, Train Loss: 0.1906
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.67it/s]
Epoch 229, Train Loss: 0.1902
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.05it/s]
Epoch 230, Train Loss: 0.1898
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.48it/s]
Epoch 231, Train Loss: 0.1894
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.10it/s]
Epoch 232, Train Loss: 0.1889
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.19it/s]
Epoch 233, Train Loss: 0.1885
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 180.20it/s]
100%|██████████| 19/19 [00:00<00:00, 178.08it/s]
Epoch 234, Train Loss: 0.1881
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.40it/s]
100%|██████████| 19/19 [00:00<00:00, 99.28it/s]
Epoch 235, Train Loss: 0.1877
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.34it/s]
100%|██████████| 19/19 [00:00<00:00, 106.23it/s]
Epoch 236, Train Loss: 0.1873
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 98.82it/s]
100%|██████████| 19/19 [00:00<00:00, 95.06it/s]
Epoch 237, Train Loss: 0.1869
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.04it/s]
100%|██████████| 19/19 [00:00<00:00, 103.51it/s]
Epoch 238, Train Loss: 0.1865
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.50it/s]
100%|██████████| 19/19 [00:00<00:00, 94.81it/s]
100%|██████████| 19/19 [00:00<00:00, 93.26it/s]
Epoch 239, Train Loss: 0.1861
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.28it/s]
100%|██████████| 19/19 [00:00<00:00, 94.79it/s]
Epoch 240, Train Loss: 0.1858
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 148.92it/s]
100%|██████████| 19/19 [00:00<00:00, 143.61it/s]
Epoch 241, Train Loss: 0.1854
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.57it/s]
100%|██████████| 19/19 [00:00<00:00, 93.29it/s]
Epoch 242, Train Loss: 0.1850
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.06it/s]
100%|██████████| 19/19 [00:00<00:00, 92.46it/s]
100%|██████████| 19/19 [00:00<00:00, 91.07it/s]
Epoch 243, Train Loss: 0.1846
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.14it/s]
100%|██████████| 19/19 [00:00<00:00, 104.88it/s]
Epoch 244, Train Loss: 0.1842
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.88it/s]
100%|██████████| 19/19 [00:00<00:00, 106.32it/s]
Epoch 245, Train Loss: 0.1838
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.63it/s]
Epoch 246, Train Loss: 0.1835
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.32it/s]
100%|██████████| 19/19 [00:00<00:00, 107.45it/s]
Epoch 247, Train Loss: 0.1831
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.42it/s]
100%|██████████| 19/19 [00:00<00:00, 96.06it/s]
Epoch 248, Train Loss: 0.1827
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.07it/s]
Epoch 249, Train Loss: 0.1823
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.49it/s]
Epoch 250, Train Loss: 0.1820
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.74it/s]
Epoch 251, Train Loss: 0.1816
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.53it/s]
Epoch 252, Train Loss: 0.1812
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.67it/s]
Epoch 253, Train Loss: 0.1809
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.19it/s]
Epoch 254, Train Loss: 0.1805
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 121.51it/s]
100%|██████████| 19/19 [00:00<00:00, 117.56it/s]
Epoch 255, Train Loss: 0.1802
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.75it/s]
100%|██████████| 19/19 [00:00<00:00, 97.42it/s]
Epoch 256, Train Loss: 0.1798
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.44it/s]
100%|██████████| 19/19 [00:00<00:00, 101.00it/s]
Epoch 257, Train Loss: 0.1794
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.63it/s]
100%|██████████| 19/19 [00:00<00:00, 113.68it/s]
Epoch 258, Train Loss: 0.1791
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.39it/s]
100%|██████████| 19/19 [00:00<00:00, 101.89it/s]
Epoch 259, Train Loss: 0.1787
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.97it/s]
100%|██████████| 19/19 [00:00<00:00, 146.00it/s]
Epoch 260, Train Loss: 0.1784
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 254.85it/s]
Epoch 261, Train Loss: 0.1780
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.72it/s]
Epoch 262, Train Loss: 0.1777
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 179.47it/s]
100%|██████████| 19/19 [00:00<00:00, 171.04it/s]
Epoch 263, Train Loss: 0.1773
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.84it/s]
100%|██████████| 19/19 [00:00<00:00, 135.79it/s]
Epoch 264, Train Loss: 0.1770
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.24it/s]
Epoch 265, Train Loss: 0.1766
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.60it/s]
100%|██████████| 19/19 [00:00<00:00, 129.86it/s]
Epoch 266, Train Loss: 0.1763
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.87it/s]
Epoch 267, Train Loss: 0.1759
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.02it/s]
Epoch 268, Train Loss: 0.1756
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.43it/s]
100%|██████████| 19/19 [00:00<00:00, 113.42it/s]
Epoch 269, Train Loss: 0.1752
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.25it/s]
100%|██████████| 19/19 [00:00<00:00, 93.58it/s]
Epoch 270, Train Loss: 0.1749
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.73it/s]
Epoch 271, Train Loss: 0.1746
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.34it/s]
Epoch 272, Train Loss: 0.1742
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.40it/s]
Epoch 273, Train Loss: 0.1739
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 163.95it/s]
100%|██████████| 19/19 [00:00<00:00, 151.96it/s]
Epoch 274, Train Loss: 0.1735
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.95it/s]
Epoch 275, Train Loss: 0.1732
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.99it/s]
100%|██████████| 19/19 [00:00<00:00, 129.18it/s]
Epoch 276, Train Loss: 0.1729
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 253.01it/s]
Epoch 277, Train Loss: 0.1725
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.64it/s]
Epoch 278, Train Loss: 0.1722
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.67it/s]
Epoch 279, Train Loss: 0.1719
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.21it/s]
Epoch 280, Train Loss: 0.1715
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.88it/s]
Epoch 281, Train Loss: 0.1712
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.60it/s]
Epoch 282, Train Loss: 0.1709
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 148.49it/s]
100%|██████████| 19/19 [00:00<00:00, 139.13it/s]
Epoch 283, Train Loss: 0.1705
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.63it/s]
Epoch 284, Train Loss: 0.1702
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.13it/s]
Epoch 285, Train Loss: 0.1699
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.78it/s]
Epoch 286, Train Loss: 0.1695
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.10it/s]
Epoch 287, Train Loss: 0.1692
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.08it/s]
Epoch 288, Train Loss: 0.1689
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.42it/s]
Epoch 289, Train Loss: 0.1686
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 257.87it/s]
Epoch 290, Train Loss: 0.1682
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 256.57it/s]
Epoch 291, Train Loss: 0.1679
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.29it/s]
Epoch 292, Train Loss: 0.1676
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.38it/s]
Epoch 293, Train Loss: 0.1673
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.04it/s]
Epoch 294, Train Loss: 0.1670
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.91it/s]
Epoch 295, Train Loss: 0.1667
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.61it/s]
Epoch 296, Train Loss: 0.1663
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.77it/s]
Epoch 297, Train Loss: 0.1660
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.55it/s]
100%|██████████| 19/19 [00:00<00:00, 150.09it/s]
Epoch 298, Train Loss: 0.1657
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.97it/s]
Epoch 299, Train Loss: 0.1654
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.45it/s]
Epoch 300, Train Loss: 0.1651
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 174.67it/s]
100%|██████████| 19/19 [00:00<00:00, 173.25it/s]
Epoch 301, Train Loss: 0.1648
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.44it/s]
Epoch 302, Train Loss: 0.1645
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.50it/s]
Epoch 303, Train Loss: 0.1642
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.92it/s]
Epoch 304, Train Loss: 0.1639
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.14it/s]
Epoch 305, Train Loss: 0.1636
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.89it/s]
Epoch 306, Train Loss: 0.1633
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.17it/s]
Epoch 307, Train Loss: 0.1630
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.12it/s]
Epoch 308, Train Loss: 0.1627
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.95it/s]
Epoch 309, Train Loss: 0.1624
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.92it/s]
Epoch 310, Train Loss: 0.1621
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.51it/s]
Epoch 311, Train Loss: 0.1618
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.98it/s]
Epoch 312, Train Loss: 0.1616
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.78it/s]
Epoch 313, Train Loss: 0.1613
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.08it/s]
Epoch 314, Train Loss: 0.1610
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.77it/s]
Epoch 315, Train Loss: 0.1607
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.13it/s]
Epoch 316, Train Loss: 0.1604
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.85it/s]
100%|██████████| 19/19 [00:00<00:00, 187.96it/s]
Epoch 317, Train Loss: 0.1602
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.51it/s]
Epoch 318, Train Loss: 0.1599
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 277.28it/s]
Epoch 319, Train Loss: 0.1596
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.44it/s]
Epoch 320, Train Loss: 0.1593
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 285.44it/s]
Epoch 321, Train Loss: 0.1591
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.60it/s]
Epoch 322, Train Loss: 0.1588
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.45it/s]
Epoch 323, Train Loss: 0.1585
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 175.31it/s]
100%|██████████| 19/19 [00:00<00:00, 168.50it/s]
Epoch 324, Train Loss: 0.1583
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.77it/s]
100%|██████████| 19/19 [00:00<00:00, 126.01it/s]
Epoch 325, Train Loss: 0.1580
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.26it/s]
Epoch 326, Train Loss: 0.1578
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.17it/s]
Epoch 327, Train Loss: 0.1575
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.29it/s]
Epoch 328, Train Loss: 0.1573
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.33it/s]
Epoch 329, Train Loss: 0.1570
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.52it/s]
Epoch 330, Train Loss: 0.1568
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.71it/s]
Epoch 331, Train Loss: 0.1565
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.82it/s]
Epoch 332, Train Loss: 0.1563
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 141.21it/s]
100%|██████████| 19/19 [00:00<00:00, 125.34it/s]
Epoch 333, Train Loss: 0.1561
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.39it/s]
100%|██████████| 19/19 [00:00<00:00, 116.79it/s]
Epoch 334, Train Loss: 0.1558
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 131.59it/s]
100%|██████████| 19/19 [00:00<00:00, 128.79it/s]
Epoch 335, Train Loss: 0.1556
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.65it/s]
100%|██████████| 19/19 [00:00<00:00, 110.34it/s]
Epoch 336, Train Loss: 0.1554
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.71it/s]
100%|██████████| 19/19 [00:00<00:00, 109.83it/s]
Epoch 337, Train Loss: 0.1551
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.15it/s]
100%|██████████| 19/19 [00:00<00:00, 113.95it/s]
Epoch 338, Train Loss: 0.1549
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.01it/s]
100%|██████████| 19/19 [00:00<00:00, 100.79it/s]
Epoch 339, Train Loss: 0.1547
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.21it/s]
100%|██████████| 19/19 [00:00<00:00, 113.88it/s]
Epoch 340, Train Loss: 0.1544
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.74it/s]
100%|██████████| 19/19 [00:00<00:00, 112.14it/s]
Epoch 341, Train Loss: 0.1542
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.36it/s]
100%|██████████| 19/19 [00:00<00:00, 106.15it/s]
Epoch 342, Train Loss: 0.1540
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.29it/s]
100%|██████████| 19/19 [00:00<00:00, 95.81it/s]
Epoch 343, Train Loss: 0.1538
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.28it/s]
100%|██████████| 19/19 [00:00<00:00, 91.88it/s]
100%|██████████| 19/19 [00:00<00:00, 90.91it/s]
Epoch 344, Train Loss: 0.1536
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 166.13it/s]
100%|██████████| 19/19 [00:00<00:00, 165.18it/s]
Epoch 345, Train Loss: 0.1534
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 110.97it/s]
100%|██████████| 19/19 [00:00<00:00, 105.24it/s]
Epoch 346, Train Loss: 0.1532
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.71it/s]
100%|██████████| 19/19 [00:00<00:00, 98.00it/s]
Epoch 347, Train Loss: 0.1530
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.23it/s]
100%|██████████| 19/19 [00:00<00:00, 93.05it/s]
Epoch 348, Train Loss: 0.1528
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.60it/s]
100%|██████████| 19/19 [00:00<00:00, 136.15it/s]
Epoch 349, Train Loss: 0.1525
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 152.35it/s]
100%|██████████| 19/19 [00:00<00:00, 145.02it/s]
Epoch 350, Train Loss: 0.1523
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 99.52it/s]
100%|██████████| 19/19 [00:00<00:00, 95.79it/s]
Epoch 351, Train Loss: 0.1522
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.83it/s]
100%|██████████| 19/19 [00:00<00:00, 103.35it/s]
Epoch 352, Train Loss: 0.1520
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.88it/s]
100%|██████████| 19/19 [00:00<00:00, 98.75it/s]
Epoch 353, Train Loss: 0.1518
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.70it/s]
100%|██████████| 19/19 [00:00<00:00, 101.48it/s]
Epoch 354, Train Loss: 0.1516
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 156.26it/s]
100%|██████████| 19/19 [00:00<00:00, 162.64it/s]
Epoch 355, Train Loss: 0.1514
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 173.30it/s]
100%|██████████| 19/19 [00:00<00:00, 163.99it/s]
Epoch 356, Train Loss: 0.1512
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 100.69it/s]
100%|██████████| 19/19 [00:00<00:00, 117.72it/s]
Epoch 357, Train Loss: 0.1510
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.47it/s]
100%|██████████| 19/19 [00:00<00:00, 100.16it/s]
Epoch 358, Train Loss: 0.1508
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.43it/s]
100%|██████████| 19/19 [00:00<00:00, 101.32it/s]
Epoch 359, Train Loss: 0.1506
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.50it/s]
100%|██████████| 19/19 [00:00<00:00, 128.23it/s]
Epoch 360, Train Loss: 0.1505
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.33it/s]
Epoch 361, Train Loss: 0.1503
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.42it/s]
Epoch 362, Train Loss: 0.1501
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 274.59it/s]
Epoch 363, Train Loss: 0.1499
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.31it/s]
Epoch 364, Train Loss: 0.1498
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.04it/s]
100%|██████████| 19/19 [00:00<00:00, 117.38it/s]
Epoch 365, Train Loss: 0.1496
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.47it/s]
100%|██████████| 19/19 [00:00<00:00, 133.74it/s]
Epoch 366, Train Loss: 0.1494
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 256.10it/s]
Epoch 367, Train Loss: 0.1492
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 163.50it/s]
100%|██████████| 19/19 [00:00<00:00, 155.06it/s]
Epoch 368, Train Loss: 0.1491
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 110.67it/s]
100%|██████████| 19/19 [00:00<00:00, 105.28it/s]
Epoch 369, Train Loss: 0.1489
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.64it/s]
100%|██████████| 19/19 [00:00<00:00, 93.74it/s]
Epoch 370, Train Loss: 0.1487
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.87it/s]
100%|██████████| 19/19 [00:00<00:00, 104.14it/s]
Epoch 371, Train Loss: 0.1486
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.42it/s]
Epoch 372, Train Loss: 0.1484
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 265.82it/s]
Epoch 373, Train Loss: 0.1483
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.70it/s]
Epoch 374, Train Loss: 0.1481
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 266.58it/s]
Epoch 375, Train Loss: 0.1479
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 258.97it/s]
Epoch 376, Train Loss: 0.1478
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.05it/s]
100%|██████████| 19/19 [00:00<00:00, 106.66it/s]
Epoch 377, Train Loss: 0.1476
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 129.35it/s]
100%|██████████| 19/19 [00:00<00:00, 116.35it/s]
Epoch 378, Train Loss: 0.1475
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.57it/s]
100%|██████████| 19/19 [00:00<00:00, 116.76it/s]
Epoch 379, Train Loss: 0.1473
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.53it/s]
100%|██████████| 19/19 [00:00<00:00, 101.30it/s]
Epoch 380, Train Loss: 0.1472
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.84it/s]
100%|██████████| 19/19 [00:00<00:00, 104.83it/s]
Epoch 381, Train Loss: 0.1470
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.91it/s]
100%|██████████| 19/19 [00:00<00:00, 97.59it/s]
Epoch 382, Train Loss: 0.1469
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.12it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.96it/s]
100%|██████████| 19/19 [00:00<00:00, 85.07it/s]
Epoch 383, Train Loss: 0.1467
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 127.23it/s]
100%|██████████| 19/19 [00:00<00:00, 119.09it/s]
Epoch 384, Train Loss: 0.1466
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.19it/s]
100%|██████████| 19/19 [00:00<00:00, 133.65it/s]
Epoch 385, Train Loss: 0.1464
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.92it/s]
100%|██████████| 19/19 [00:00<00:00, 187.89it/s]
Epoch 386, Train Loss: 0.1463
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 121.25it/s]
100%|██████████| 19/19 [00:00<00:00, 118.48it/s]
Epoch 387, Train Loss: 0.1461
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.14it/s]
100%|██████████| 19/19 [00:00<00:00, 108.90it/s]
Epoch 388, Train Loss: 0.1460
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.87it/s]
100%|██████████| 19/19 [00:00<00:00, 94.43it/s]
Epoch 389, Train Loss: 0.1459
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.34it/s]
100%|██████████| 19/19 [00:00<00:00, 112.31it/s]
Epoch 390, Train Loss: 0.1457
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 151.56it/s]
100%|██████████| 19/19 [00:00<00:00, 138.14it/s]
Epoch 391, Train Loss: 0.1456
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 98.44it/s]
100%|██████████| 19/19 [00:00<00:00, 121.95it/s]
Epoch 392, Train Loss: 0.1454
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.68it/s]
Epoch 393, Train Loss: 0.1453
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 148.11it/s]
100%|██████████| 19/19 [00:00<00:00, 161.58it/s]
Epoch 394, Train Loss: 0.1452
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 268.33it/s]
Epoch 395, Train Loss: 0.1450
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 269.24it/s]
Epoch 396, Train Loss: 0.1449
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.91it/s]
Epoch 397, Train Loss: 0.1447
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 184.37it/s]
100%|██████████| 19/19 [00:00<00:00, 183.39it/s]
Epoch 398, Train Loss: 0.1446
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 270.47it/s]
Epoch 399, Train Loss: 0.1445
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 260.70it/s]
Epoch 400, Train Loss: 0.1443
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.41it/s]
Epoch 401, Train Loss: 0.1442
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.02it/s]
Epoch 402, Train Loss: 0.1441
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.38it/s]
Epoch 403, Train Loss: 0.1439
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 263.64it/s]
Epoch 404, Train Loss: 0.1438
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.02it/s]
100%|██████████| 19/19 [00:00<00:00, 113.37it/s]
Epoch 405, Train Loss: 0.1437
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 133.86it/s]
100%|██████████| 19/19 [00:00<00:00, 126.40it/s]
Epoch 406, Train Loss: 0.1435
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.93it/s]
100%|██████████| 19/19 [00:00<00:00, 134.88it/s]
Epoch 407, Train Loss: 0.1434
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.63it/s]
100%|██████████| 19/19 [00:00<00:00, 113.58it/s]
Epoch 408, Train Loss: 0.1433
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 172.52it/s]
100%|██████████| 19/19 [00:00<00:00, 172.35it/s]
Epoch 409, Train Loss: 0.1432
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 252.60it/s]
Epoch 410, Train Loss: 0.1430
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.13it/s]
Epoch 411, Train Loss: 0.1429
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.88it/s]
Epoch 412, Train Loss: 0.1428
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 271.80it/s]
Epoch 413, Train Loss: 0.1426
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.03it/s]
Epoch 414, Train Loss: 0.1425
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 140.46it/s]
100%|██████████| 19/19 [00:00<00:00, 134.61it/s]
Epoch 415, Train Loss: 0.1424
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.57it/s]
100%|██████████| 19/19 [00:00<00:00, 155.29it/s]
Epoch 416, Train Loss: 0.1423
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 262.30it/s]
Epoch 417, Train Loss: 0.1421
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.38it/s]
Epoch 418, Train Loss: 0.1420
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 279.35it/s]
Epoch 419, Train Loss: 0.1419
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 118.31it/s]
100%|██████████| 19/19 [00:00<00:00, 135.88it/s]
Epoch 420, Train Loss: 0.1418
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.63it/s]
Epoch 421, Train Loss: 0.1417
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.51it/s]
Epoch 422, Train Loss: 0.1415
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 278.70it/s]
Epoch 423, Train Loss: 0.1414
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.19it/s]
Epoch 424, Train Loss: 0.1413
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 142.04it/s]
100%|██████████| 19/19 [00:00<00:00, 127.92it/s]
Epoch 425, Train Loss: 0.1412
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.49it/s]
100%|██████████| 19/19 [00:00<00:00, 115.79it/s]
Epoch 426, Train Loss: 0.1410
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 112.51it/s]
100%|██████████| 19/19 [00:00<00:00, 109.70it/s]
Epoch 427, Train Loss: 0.1409
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.19it/s]
100%|██████████| 19/19 [00:00<00:00, 93.32it/s]
Epoch 428, Train Loss: 0.1408
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.54it/s]
100%|██████████| 19/19 [00:00<00:00, 134.79it/s]
Epoch 429, Train Loss: 0.1407
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.80it/s]
100%|██████████| 19/19 [00:00<00:00, 100.65it/s]
Epoch 430, Train Loss: 0.1406
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.34it/s]
100%|██████████| 19/19 [00:00<00:00, 90.20it/s]
Epoch 431, Train Loss: 0.1404
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.34it/s]
100%|██████████| 19/19 [00:00<00:00, 93.63it/s]
100%|██████████| 19/19 [00:00<00:00, 91.89it/s]
Epoch 432, Train Loss: 0.1403
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.83it/s]
100%|██████████| 19/19 [00:00<00:00, 100.07it/s]
Epoch 433, Train Loss: 0.1402
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 145.48it/s]
100%|██████████| 19/19 [00:00<00:00, 124.58it/s]
Epoch 434, Train Loss: 0.1401
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.50it/s]
100%|██████████| 19/19 [00:00<00:00, 122.46it/s]
Epoch 435, Train Loss: 0.1400
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.37it/s]
100%|██████████| 19/19 [00:00<00:00, 123.76it/s]
Epoch 436, Train Loss: 0.1399
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 156.18it/s]
100%|██████████| 19/19 [00:00<00:00, 138.84it/s]
Epoch 437, Train Loss: 0.1397
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.89it/s]
100%|██████████| 19/19 [00:00<00:00, 94.57it/s]
Epoch 438, Train Loss: 0.1396
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.48it/s]
Epoch 439, Train Loss: 0.1395
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 273.28it/s]
Epoch 440, Train Loss: 0.1394
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 272.63it/s]
Epoch 441, Train Loss: 0.1393
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.59it/s]
Epoch 442, Train Loss: 0.1392
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.19it/s]
100%|██████████| 19/19 [00:00<00:00, 110.86it/s]
Epoch 443, Train Loss: 0.1390
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 109.72it/s]
100%|██████████| 19/19 [00:00<00:00, 101.03it/s]
Epoch 444, Train Loss: 0.1389
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.03it/s]
100%|██████████| 19/19 [00:00<00:00, 110.64it/s]
Epoch 445, Train Loss: 0.1388
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.28it/s]
100%|██████████| 19/19 [00:00<00:00, 119.74it/s]
Epoch 446, Train Loss: 0.1387
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 195.42it/s]
Epoch 447, Train Loss: 0.1386
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 166.72it/s]
100%|██████████| 19/19 [00:00<00:00, 157.78it/s]
Epoch 448, Train Loss: 0.1385
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 220.24it/s]
Epoch 449, Train Loss: 0.1383
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.66it/s]
Epoch 450, Train Loss: 0.1382
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.73it/s]
Epoch 451, Train Loss: 0.1381
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 178.83it/s]
100%|██████████| 19/19 [00:00<00:00, 180.19it/s]
Epoch 452, Train Loss: 0.1380
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 175.42it/s]
100%|██████████| 19/19 [00:00<00:00, 176.01it/s]
Epoch 453, Train Loss: 0.1379
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 261.51it/s]
Epoch 454, Train Loss: 0.1378
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.20it/s]
100%|██████████| 19/19 [00:00<00:00, 125.19it/s]
Epoch 455, Train Loss: 0.1377
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.11it/s]
Epoch 456, Train Loss: 0.1376
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.59it/s]
100%|██████████| 19/19 [00:00<00:00, 134.26it/s]
Epoch 457, Train Loss: 0.1374
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 127.15it/s]
100%|██████████| 19/19 [00:00<00:00, 110.26it/s]
Epoch 458, Train Loss: 0.1373
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.19it/s]
100%|██████████| 19/19 [00:00<00:00, 101.97it/s]
Epoch 459, Train Loss: 0.1372
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 107.89it/s]
100%|██████████| 19/19 [00:00<00:00, 110.81it/s]
Epoch 460, Train Loss: 0.1371
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.71it/s]
100%|██████████| 19/19 [00:00<00:00, 100.51it/s]
Epoch 461, Train Loss: 0.1370
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.58it/s]
100%|██████████| 19/19 [00:00<00:00, 102.33it/s]
Epoch 462, Train Loss: 0.1369
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 110.90it/s]
100%|██████████| 19/19 [00:00<00:00, 102.25it/s]
Epoch 463, Train Loss: 0.1368
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.27it/s]
100%|██████████| 19/19 [00:00<00:00, 98.94it/s]
Epoch 464, Train Loss: 0.1367
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.60it/s]
100%|██████████| 19/19 [00:00<00:00, 116.57it/s]
Epoch 465, Train Loss: 0.1365
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 129.21it/s]
100%|██████████| 19/19 [00:00<00:00, 117.92it/s]
Epoch 466, Train Loss: 0.1364
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.90it/s]
100%|██████████| 19/19 [00:00<00:00, 143.29it/s]
Epoch 467, Train Loss: 0.1363
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 155.06it/s]
100%|██████████| 19/19 [00:00<00:00, 148.01it/s]
Epoch 468, Train Loss: 0.1362
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 111.53it/s]
100%|██████████| 19/19 [00:00<00:00, 112.76it/s]
Epoch 469, Train Loss: 0.1361
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.22it/s]
100%|██████████| 19/19 [00:00<00:00, 119.58it/s]
Epoch 470, Train Loss: 0.1360
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.55it/s]
100%|██████████| 19/19 [00:00<00:00, 131.21it/s]
Epoch 471, Train Loss: 0.1359
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.31it/s]
100%|██████████| 19/19 [00:00<00:00, 133.23it/s]
Epoch 472, Train Loss: 0.1358
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.13it/s]
100%|██████████| 19/19 [00:00<00:00, 98.73it/s]
Epoch 473, Train Loss: 0.1357
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 162.92it/s]
100%|██████████| 19/19 [00:00<00:00, 157.28it/s]
Epoch 474, Train Loss: 0.1356
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.52it/s]
100%|██████████| 19/19 [00:00<00:00, 135.29it/s]
Epoch 475, Train Loss: 0.1354
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 220.92it/s]
Epoch 476, Train Loss: 0.1353
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 259.30it/s]
Epoch 477, Train Loss: 0.1352
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 275.08it/s]
Epoch 478, Train Loss: 0.1351
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 139.16it/s]
100%|██████████| 19/19 [00:00<00:00, 132.69it/s]
Epoch 479, Train Loss: 0.1350
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 219.93it/s]
Epoch 480, Train Loss: 0.1349
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 154.48it/s]
100%|██████████| 19/19 [00:00<00:00, 145.38it/s]
Epoch 481, Train Loss: 0.1348
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.13it/s]
100%|██████████| 19/19 [00:00<00:00, 109.07it/s]
Epoch 482, Train Loss: 0.1347
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 179.26it/s]
100%|██████████| 19/19 [00:00<00:00, 179.11it/s]
Epoch 483, Train Loss: 0.1346
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.56it/s]
Epoch 484, Train Loss: 0.1345
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 280.49it/s]
Epoch 485, Train Loss: 0.1344
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.59it/s]
Epoch 486, Train Loss: 0.1343
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.88it/s]
Epoch 487, Train Loss: 0.1342
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.22it/s]
Epoch 488, Train Loss: 0.1340
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 276.35it/s]
Epoch 489, Train Loss: 0.1339
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 281.32it/s]
Epoch 490, Train Loss: 0.1338
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 132.20it/s]
100%|██████████| 19/19 [00:00<00:00, 127.60it/s]
Epoch 491, Train Loss: 0.1337
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 98.99it/s]
100%|██████████| 19/19 [00:00<00:00, 93.73it/s]
Epoch 492, Train Loss: 0.1336
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.12it/s]
100%|██████████| 19/19 [00:00<00:00, 113.16it/s]
Epoch 493, Train Loss: 0.1335
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.12it/s]
100%|██████████| 19/19 [00:00<00:00, 113.96it/s]
Epoch 494, Train Loss: 0.1334
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.45it/s]
100%|██████████| 19/19 [00:00<00:00, 100.55it/s]
Epoch 495, Train Loss: 0.1333
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.23it/s]
95%|█████████▍| 18/19 [00:00<00:00, 88.39it/s]
100%|██████████| 19/19 [00:00<00:00, 87.94it/s]
Epoch 496, Train Loss: 0.1332
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.72it/s]
100%|██████████| 19/19 [00:00<00:00, 117.79it/s]
Epoch 497, Train Loss: 0.1331
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.66it/s]
Epoch 498, Train Loss: 0.1330
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 264.65it/s]
Epoch 499, Train Loss: 0.1329
.............................
Validation#
encode, decode = transform_nn(dog_data, encoder, decoder, device=device)
/home/xinqiao/anaconda3/envs/m3_test/lib/python3.10/site-packages/torch/nn/modules/rnn.py:879: UserWarning: RNN module weights are not part of single contiguous chunk of memory. This means they need to be compacted at every call, possibly greatly increasing memory usage. To compact weights again call flatten_parameters(). (Triggered internally at ../aten/src/ATen/native/cudnn/RNN.cpp:982.)
result = _VF.lstm(input, hx, self._flat_weights, self.bias, self.num_layers,
embeddings(encode, shape_=image.shape[0:2], figsize=(10, 5))
latent_generator(decoder, encode, image, 5, 10, device=device,
figsize=(10, 5), divider_=False)
This once again is very hard to interpret and the spectra do not really contain the necessary details
Disentanglement#
Regularization#
Builds the Model#
latent_dim = 12
class Encoder(nn.Module):
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Encoder, self).__init__()
self.lstm = nn.LSTM(1, 12, batch_first=True, bidirectional=True)
self.embedding = nn.Linear(24, self.latent_dim)
self.relu = nn.ReLU()
def forward(self, x):
x, (_, __) = self.lstm(x)
x = x[:, -1, :]
x = self.embedding(x)
x = self.relu(x) # add a relu
return x
class Decoder(nn.Module):
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Decoder, self).__init__()
self.lstm = nn.LSTM(self.latent_dim, 12,
batch_first=True, bidirectional=True)
self.tdd = nn.Conv1d(24, 1, 1)
def forward(self, x):
x = x[:, :, None]
x = x.transpose(1, 2)
x = x.repeat([1, 10, 1])
x, (_, __) = self.lstm(x)
x = x.transpose(1, 2)
x = self.tdd(x)
x = x.transpose(1, 2)
return x
encoder = Encoder().to(device)
decoder = Decoder().to(device)
model = Autoencoder(encoder, decoder).to(device)
# optimizer
optimizer = optim.Adam(model.parameters(), lr=3e-5)
model
Autoencoder(
(encoder): Encoder(
(lstm): LSTM(1, 12, batch_first=True, bidirectional=True)
(embedding): Linear(in_features=24, out_features=12, bias=True)
(relu): ReLU()
)
(decoder): Decoder(
(lstm): LSTM(12, 12, batch_first=True, bidirectional=True)
(tdd): Conv1d(24, 1, kernel_size=(1,), stride=(1,))
)
)
Dataloader#
train_iterator = torch.utils.data.DataLoader(
np.atleast_3d(X_train), batch_size=256, shuffle=False
)
Training#
random_seed(seed=42)
Train(
model,
encoder,
decoder,
train_iterator,
optimizer,
500,
coef=1e-3, # adds a regularization term l1
mse=False,
device=device,
)
Show code cell output
0%| | 0/19 [00:00<?, ?it/s]
5%|▌ | 1/19 [00:00<00:09, 1.90it/s]
100%|██████████| 19/19 [00:00<00:00, 31.58it/s]
Epoch 0, Train Loss: 2.1840
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.59it/s]
Epoch 1, Train Loss: 2.1752
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.49it/s]
Epoch 2, Train Loss: 2.1666
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.33it/s]
Epoch 3, Train Loss: 2.1581
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 137.40it/s]
100%|██████████| 19/19 [00:00<00:00, 121.90it/s]
Epoch 4, Train Loss: 2.1497
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.12it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.70it/s]
100%|██████████| 19/19 [00:00<00:00, 79.59it/s]
Epoch 5, Train Loss: 2.1414
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.42it/s]
89%|████████▉ | 17/19 [00:00<00:00, 81.59it/s]
100%|██████████| 19/19 [00:00<00:00, 80.90it/s]
Epoch 6, Train Loss: 2.1332
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.88it/s]
89%|████████▉ | 17/19 [00:00<00:00, 79.44it/s]
100%|██████████| 19/19 [00:00<00:00, 81.41it/s]
Epoch 7, Train Loss: 2.1250
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.43it/s]
Epoch 8, Train Loss: 2.1169
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 232.30it/s]
Epoch 9, Train Loss: 2.1088
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.44it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.48it/s]
100%|██████████| 19/19 [00:00<00:00, 81.01it/s]
Epoch 10, Train Loss: 2.1007
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.83it/s]
100%|██████████| 19/19 [00:00<00:00, 95.49it/s]
Epoch 11, Train Loss: 2.0927
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.30it/s]
95%|█████████▍| 18/19 [00:00<00:00, 78.39it/s]
100%|██████████| 19/19 [00:00<00:00, 80.77it/s]
Epoch 12, Train Loss: 2.0848
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.04it/s]
Epoch 13, Train Loss: 2.0770
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.69it/s]
Epoch 14, Train Loss: 2.0693
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.85it/s]
Epoch 15, Train Loss: 2.0616
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 183.14it/s]
100%|██████████| 19/19 [00:00<00:00, 180.47it/s]
Epoch 16, Train Loss: 2.0540
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.59it/s]
84%|████████▍ | 16/19 [00:00<00:00, 78.21it/s]
100%|██████████| 19/19 [00:00<00:00, 75.15it/s]
Epoch 17, Train Loss: 2.0464
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.18it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.33it/s]
100%|██████████| 19/19 [00:00<00:00, 76.22it/s]
Epoch 18, Train Loss: 2.0389
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.08it/s]
89%|████████▉ | 17/19 [00:00<00:00, 80.57it/s]
100%|██████████| 19/19 [00:00<00:00, 78.70it/s]
Epoch 19, Train Loss: 2.0315
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 190.20it/s]
Epoch 20, Train Loss: 2.0242
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.12it/s]
Epoch 21, Train Loss: 2.0170
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.52it/s]
95%|█████████▍| 18/19 [00:00<00:00, 81.54it/s]
100%|██████████| 19/19 [00:00<00:00, 81.73it/s]
Epoch 22, Train Loss: 2.0099
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.18it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.07it/s]
100%|██████████| 19/19 [00:00<00:00, 81.45it/s]
Epoch 23, Train Loss: 2.0028
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.44it/s]
95%|█████████▍| 18/19 [00:00<00:00, 89.27it/s]
100%|██████████| 19/19 [00:00<00:00, 88.26it/s]
Epoch 24, Train Loss: 1.9958
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.77it/s]
Epoch 25, Train Loss: 1.9888
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.22it/s]
100%|██████████| 19/19 [00:00<00:00, 106.86it/s]
Epoch 26, Train Loss: 1.9819
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.34it/s]
100%|██████████| 19/19 [00:00<00:00, 107.59it/s]
Epoch 27, Train Loss: 1.9749
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 220.91it/s]
Epoch 28, Train Loss: 1.9679
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.85it/s]
100%|██████████| 19/19 [00:00<00:00, 91.68it/s]
Epoch 29, Train Loss: 1.9611
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.27it/s]
100%|██████████| 19/19 [00:00<00:00, 137.62it/s]
Epoch 30, Train Loss: 1.9546
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.09it/s]
Epoch 31, Train Loss: 1.9482
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.78it/s]
Epoch 32, Train Loss: 1.9419
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.36it/s]
Epoch 33, Train Loss: 1.9357
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.01it/s]
Epoch 34, Train Loss: 1.9296
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.22it/s]
Epoch 35, Train Loss: 1.9235
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.27it/s]
Epoch 36, Train Loss: 1.9176
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.47it/s]
Epoch 37, Train Loss: 1.9117
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.34it/s]
Epoch 38, Train Loss: 1.9058
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 201.11it/s]
Epoch 39, Train Loss: 1.8999
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.68it/s]
Epoch 40, Train Loss: 1.8940
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.37it/s]
Epoch 41, Train Loss: 1.8882
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.24it/s]
Epoch 42, Train Loss: 1.8824
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.97it/s]
Epoch 43, Train Loss: 1.8766
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.73it/s]
Epoch 44, Train Loss: 1.8707
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.44it/s]
Epoch 45, Train Loss: 1.8648
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.29it/s]
Epoch 46, Train Loss: 1.8589
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.95it/s]
Epoch 47, Train Loss: 1.8534
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.29it/s]
Epoch 48, Train Loss: 1.8478
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 154.29it/s]
100%|██████████| 19/19 [00:00<00:00, 162.15it/s]
Epoch 49, Train Loss: 1.8423
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.99it/s]
Epoch 50, Train Loss: 1.8367
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 165.55it/s]
100%|██████████| 19/19 [00:00<00:00, 169.45it/s]
Epoch 51, Train Loss: 1.8312
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.15it/s]
Epoch 52, Train Loss: 1.8255
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.01it/s]
Epoch 53, Train Loss: 1.8199
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.49it/s]
Epoch 54, Train Loss: 1.8141
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.63it/s]
Epoch 55, Train Loss: 1.8082
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.76it/s]
Epoch 56, Train Loss: 1.8023
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.04it/s]
Epoch 57, Train Loss: 1.7962
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.92it/s]
Epoch 58, Train Loss: 1.7900
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.79it/s]
Epoch 59, Train Loss: 1.7837
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.19it/s]
Epoch 60, Train Loss: 1.7773
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.49it/s]
Epoch 61, Train Loss: 1.7707
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 154.68it/s]
100%|██████████| 19/19 [00:00<00:00, 162.75it/s]
Epoch 62, Train Loss: 1.7640
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 149.72it/s]
100%|██████████| 19/19 [00:00<00:00, 161.48it/s]
Epoch 63, Train Loss: 1.7573
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.12it/s]
Epoch 64, Train Loss: 1.7504
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.51it/s]
95%|█████████▍| 18/19 [00:00<00:00, 81.45it/s]
100%|██████████| 19/19 [00:00<00:00, 81.29it/s]
Epoch 65, Train Loss: 1.7435
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.16it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.94it/s]
100%|██████████| 19/19 [00:00<00:00, 76.78it/s]
Epoch 66, Train Loss: 1.7365
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.87it/s]
95%|█████████▍| 18/19 [00:00<00:00, 81.77it/s]
100%|██████████| 19/19 [00:00<00:00, 78.55it/s]
Epoch 67, Train Loss: 1.7294
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.96it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.13it/s]
100%|██████████| 19/19 [00:00<00:00, 84.95it/s]
Epoch 68, Train Loss: 1.7221
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 198.39it/s]
Epoch 69, Train Loss: 1.7147
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.94it/s]
Epoch 70, Train Loss: 1.7072
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.65it/s]
Epoch 71, Train Loss: 1.6994
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.43it/s]
Epoch 72, Train Loss: 1.6916
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.84it/s]
Epoch 73, Train Loss: 1.6836
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 128.94it/s]
100%|██████████| 19/19 [00:00<00:00, 114.03it/s]
Epoch 74, Train Loss: 1.6754
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.75it/s]
100%|██████████| 19/19 [00:00<00:00, 95.13it/s]
Epoch 75, Train Loss: 1.6672
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.59it/s]
Epoch 76, Train Loss: 1.6588
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.71it/s]
100%|██████████| 19/19 [00:00<00:00, 87.01it/s]
Epoch 77, Train Loss: 1.6503
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.17it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.47it/s]
100%|██████████| 19/19 [00:00<00:00, 79.39it/s]
Epoch 78, Train Loss: 1.6416
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.55it/s]
100%|██████████| 19/19 [00:00<00:00, 99.79it/s]
Epoch 79, Train Loss: 1.6329
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.59it/s]
95%|█████████▍| 18/19 [00:00<00:00, 76.58it/s]
100%|██████████| 19/19 [00:00<00:00, 76.44it/s]
Epoch 80, Train Loss: 1.6240
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.66it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.70it/s]
100%|██████████| 19/19 [00:00<00:00, 74.58it/s]
Epoch 81, Train Loss: 1.6150
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.72it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.78it/s]
100%|██████████| 19/19 [00:00<00:00, 83.75it/s]
Epoch 82, Train Loss: 1.6059
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.21it/s]
100%|██████████| 19/19 [00:00<00:00, 121.63it/s]
Epoch 83, Train Loss: 1.5967
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 224.42it/s]
Epoch 84, Train Loss: 1.5875
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.96it/s]
100%|██████████| 19/19 [00:00<00:00, 106.90it/s]
Epoch 85, Train Loss: 1.5781
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.27it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.40it/s]
100%|██████████| 19/19 [00:00<00:00, 81.41it/s]
Epoch 86, Train Loss: 1.5686
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.95it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.90it/s]
100%|██████████| 19/19 [00:00<00:00, 85.52it/s]
Epoch 87, Train Loss: 1.5590
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 129.14it/s]
100%|██████████| 19/19 [00:00<00:00, 117.96it/s]
Epoch 88, Train Loss: 1.5493
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.39it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.70it/s]
100%|██████████| 19/19 [00:00<00:00, 80.30it/s]
Epoch 89, Train Loss: 1.5394
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.58it/s]
89%|████████▉ | 17/19 [00:00<00:00, 80.11it/s]
100%|██████████| 19/19 [00:00<00:00, 79.03it/s]
Epoch 90, Train Loss: 1.5295
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.66it/s]
100%|██████████| 19/19 [00:00<00:00, 141.91it/s]
Epoch 91, Train Loss: 1.5194
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 221.49it/s]
Epoch 92, Train Loss: 1.5093
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.89it/s]
100%|██████████| 19/19 [00:00<00:00, 109.79it/s]
Epoch 93, Train Loss: 1.4992
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.85it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.46it/s]
100%|██████████| 19/19 [00:00<00:00, 76.56it/s]
Epoch 94, Train Loss: 1.4890
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.09it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.75it/s]
100%|██████████| 19/19 [00:00<00:00, 76.45it/s]
Epoch 95, Train Loss: 1.4787
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.81it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.33it/s]
100%|██████████| 19/19 [00:00<00:00, 83.28it/s]
Epoch 96, Train Loss: 1.4684
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.59it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.15it/s]
100%|██████████| 19/19 [00:00<00:00, 77.16it/s]
Epoch 97, Train Loss: 1.4581
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.27it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.85it/s]
100%|██████████| 19/19 [00:00<00:00, 80.20it/s]
Epoch 98, Train Loss: 1.4478
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.50it/s]
100%|██████████| 19/19 [00:00<00:00, 88.95it/s]
Epoch 99, Train Loss: 1.4376
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.75it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.36it/s]
100%|██████████| 19/19 [00:00<00:00, 77.08it/s]
Epoch 100, Train Loss: 1.4273
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.76it/s]
89%|████████▉ | 17/19 [00:00<00:00, 79.88it/s]
100%|██████████| 19/19 [00:00<00:00, 77.96it/s]
Epoch 101, Train Loss: 1.4171
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.49it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.61it/s]
100%|██████████| 19/19 [00:00<00:00, 77.78it/s]
Epoch 102, Train Loss: 1.4069
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.87it/s]
100%|██████████| 19/19 [00:00<00:00, 90.73it/s]
100%|██████████| 19/19 [00:00<00:00, 89.78it/s]
Epoch 103, Train Loss: 1.3967
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.12it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.09it/s]
100%|██████████| 19/19 [00:00<00:00, 75.17it/s]
Epoch 104, Train Loss: 1.3866
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.85it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.98it/s]
100%|██████████| 19/19 [00:00<00:00, 74.21it/s]
Epoch 105, Train Loss: 1.3766
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.72it/s]
95%|█████████▍| 18/19 [00:00<00:00, 88.03it/s]
100%|██████████| 19/19 [00:00<00:00, 87.33it/s]
Epoch 106, Train Loss: 1.3667
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.25it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.26it/s]
100%|██████████| 19/19 [00:00<00:00, 77.14it/s]
Epoch 107, Train Loss: 1.3568
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.44it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.21it/s]
100%|██████████| 19/19 [00:00<00:00, 75.12it/s]
Epoch 108, Train Loss: 1.3470
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.81it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.69it/s]
100%|██████████| 19/19 [00:00<00:00, 74.66it/s]
Epoch 109, Train Loss: 1.3373
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.81it/s]
100%|██████████| 19/19 [00:00<00:00, 86.13it/s]
Epoch 110, Train Loss: 1.3277
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.29it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.22it/s]
100%|██████████| 19/19 [00:00<00:00, 81.83it/s]
Epoch 111, Train Loss: 1.3182
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.88it/s]
84%|████████▍ | 16/19 [00:00<00:00, 79.11it/s]
100%|██████████| 19/19 [00:00<00:00, 80.64it/s]
Epoch 112, Train Loss: 1.3088
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.49it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.38it/s]
100%|██████████| 19/19 [00:00<00:00, 76.40it/s]
Epoch 113, Train Loss: 1.2995
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.80it/s]
89%|████████▉ | 17/19 [00:00<00:00, 81.46it/s]
100%|██████████| 19/19 [00:00<00:00, 81.43it/s]
Epoch 114, Train Loss: 1.2902
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.03it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.23it/s]
100%|██████████| 19/19 [00:00<00:00, 75.29it/s]
Epoch 115, Train Loss: 1.2811
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.92it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.42it/s]
100%|██████████| 19/19 [00:00<00:00, 85.04it/s]
Epoch 116, Train Loss: 1.2720
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.89it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.68it/s]
100%|██████████| 19/19 [00:00<00:00, 82.38it/s]
Epoch 117, Train Loss: 1.2630
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.98it/s]
100%|██████████| 19/19 [00:00<00:00, 87.98it/s]
100%|██████████| 19/19 [00:00<00:00, 86.31it/s]
Epoch 118, Train Loss: 1.2542
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.93it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.42it/s]
100%|██████████| 19/19 [00:00<00:00, 84.20it/s]
Epoch 119, Train Loss: 1.2455
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.32it/s]
89%|████████▉ | 17/19 [00:00<00:00, 79.15it/s]
100%|██████████| 19/19 [00:00<00:00, 75.95it/s]
Epoch 120, Train Loss: 1.2369
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.73it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.92it/s]
100%|██████████| 19/19 [00:00<00:00, 74.90it/s]
Epoch 121, Train Loss: 1.2286
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.54it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.21it/s]
100%|██████████| 19/19 [00:00<00:00, 75.80it/s]
Epoch 122, Train Loss: 1.2203
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.61it/s]
100%|██████████| 19/19 [00:00<00:00, 93.68it/s]
100%|██████████| 19/19 [00:00<00:00, 92.11it/s]
Epoch 123, Train Loss: 1.2123
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 183.80it/s]
100%|██████████| 19/19 [00:00<00:00, 182.06it/s]
Epoch 124, Train Loss: 1.2043
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 142.27it/s]
100%|██████████| 19/19 [00:00<00:00, 126.69it/s]
Epoch 125, Train Loss: 1.1966
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.64it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.44it/s]
100%|██████████| 19/19 [00:00<00:00, 80.25it/s]
Epoch 126, Train Loss: 1.1890
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.40it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.86it/s]
100%|██████████| 19/19 [00:00<00:00, 84.10it/s]
Epoch 127, Train Loss: 1.1816
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.30it/s]
100%|██████████| 19/19 [00:00<00:00, 94.88it/s]
Epoch 128, Train Loss: 1.1743
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.03it/s]
100%|██████████| 19/19 [00:00<00:00, 89.92it/s]
100%|██████████| 19/19 [00:00<00:00, 88.91it/s]
Epoch 129, Train Loss: 1.1672
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.28it/s]
100%|██████████| 19/19 [00:00<00:00, 117.07it/s]
Epoch 130, Train Loss: 1.1602
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 100.07it/s]
100%|██████████| 19/19 [00:00<00:00, 112.07it/s]
Epoch 131, Train Loss: 1.1534
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 219.58it/s]
Epoch 132, Train Loss: 1.1468
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.44it/s]
Epoch 133, Train Loss: 1.1404
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 101.64it/s]
100%|██████████| 19/19 [00:00<00:00, 92.91it/s]
Epoch 134, Train Loss: 1.1341
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.27it/s]
100%|██████████| 19/19 [00:00<00:00, 120.97it/s]
Epoch 135, Train Loss: 1.1279
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 222.72it/s]
Epoch 136, Train Loss: 1.1219
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.15it/s]
Epoch 137, Train Loss: 1.1161
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.36it/s]
100%|██████████| 19/19 [00:00<00:00, 100.89it/s]
Epoch 138, Train Loss: 1.1103
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 184.27it/s]
100%|██████████| 19/19 [00:00<00:00, 182.45it/s]
Epoch 139, Train Loss: 1.1048
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.82it/s]
100%|██████████| 19/19 [00:00<00:00, 125.80it/s]
Epoch 140, Train Loss: 1.0993
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.78it/s]
Epoch 141, Train Loss: 1.0940
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.60it/s]
Epoch 142, Train Loss: 1.0888
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.57it/s]
Epoch 143, Train Loss: 1.0837
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 164.65it/s]
100%|██████████| 19/19 [00:00<00:00, 147.97it/s]
Epoch 144, Train Loss: 1.0787
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 159.89it/s]
100%|██████████| 19/19 [00:00<00:00, 150.61it/s]
Epoch 145, Train Loss: 1.0738
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.64it/s]
100%|██████████| 19/19 [00:00<00:00, 85.93it/s]
Epoch 146, Train Loss: 1.0690
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.39it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.33it/s]
100%|██████████| 19/19 [00:00<00:00, 72.43it/s]
Epoch 147, Train Loss: 1.0642
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.12it/s]
89%|████████▉ | 17/19 [00:00<00:00, 81.65it/s]
100%|██████████| 19/19 [00:00<00:00, 80.25it/s]
Epoch 148, Train Loss: 1.0595
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.73it/s]
95%|█████████▍| 18/19 [00:00<00:00, 78.64it/s]
100%|██████████| 19/19 [00:00<00:00, 76.88it/s]
Epoch 149, Train Loss: 1.0549
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.09it/s]
95%|█████████▍| 18/19 [00:00<00:00, 81.51it/s]
100%|██████████| 19/19 [00:00<00:00, 81.30it/s]
Epoch 150, Train Loss: 1.0502
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.06it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.65it/s]
100%|██████████| 19/19 [00:00<00:00, 84.88it/s]
Epoch 151, Train Loss: 1.0457
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.69it/s]
89%|████████▉ | 17/19 [00:00<00:00, 80.00it/s]
100%|██████████| 19/19 [00:00<00:00, 79.91it/s]
Epoch 152, Train Loss: 1.0411
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.88it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.07it/s]
100%|██████████| 19/19 [00:00<00:00, 75.65it/s]
Epoch 153, Train Loss: 1.0365
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 155.01it/s]
100%|██████████| 19/19 [00:00<00:00, 159.54it/s]
Epoch 154, Train Loss: 1.0319
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 229.46it/s]
Epoch 155, Train Loss: 1.0273
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.68it/s]
100%|██████████| 19/19 [00:00<00:00, 89.41it/s]
Epoch 156, Train Loss: 1.0226
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.65it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.33it/s]
100%|██████████| 19/19 [00:00<00:00, 83.32it/s]
Epoch 157, Train Loss: 1.0179
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.29it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.50it/s]
100%|██████████| 19/19 [00:00<00:00, 75.62it/s]
Epoch 158, Train Loss: 1.0130
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.48it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.37it/s]
100%|██████████| 19/19 [00:00<00:00, 81.29it/s]
Epoch 159, Train Loss: 1.0081
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.23it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.18it/s]
100%|██████████| 19/19 [00:00<00:00, 83.55it/s]
Epoch 160, Train Loss: 1.0030
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.48it/s]
Epoch 161, Train Loss: 0.9977
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.69it/s]
100%|██████████| 19/19 [00:00<00:00, 145.80it/s]
Epoch 162, Train Loss: 0.9923
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.43it/s]
100%|██████████| 19/19 [00:00<00:00, 89.78it/s]
Epoch 163, Train Loss: 0.9866
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.88it/s]
100%|██████████| 19/19 [00:00<00:00, 93.27it/s]
100%|██████████| 19/19 [00:00<00:00, 90.32it/s]
Epoch 164, Train Loss: 0.9807
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.00it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.22it/s]
100%|██████████| 19/19 [00:00<00:00, 82.89it/s]
Epoch 165, Train Loss: 0.9745
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 159.76it/s]
100%|██████████| 19/19 [00:00<00:00, 162.90it/s]
Epoch 166, Train Loss: 0.9680
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.03it/s]
100%|██████████| 19/19 [00:00<00:00, 107.05it/s]
Epoch 167, Train Loss: 0.9611
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.36it/s]
Epoch 168, Train Loss: 0.9538
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 232.61it/s]
Epoch 169, Train Loss: 0.9460
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.97it/s]
Epoch 170, Train Loss: 0.9377
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.78it/s]
Epoch 171, Train Loss: 0.9289
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.47it/s]
Epoch 172, Train Loss: 0.9194
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.25it/s]
Epoch 173, Train Loss: 0.9092
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.35it/s]
100%|██████████| 19/19 [00:00<00:00, 187.14it/s]
Epoch 174, Train Loss: 0.8983
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 185.20it/s]
100%|██████████| 19/19 [00:00<00:00, 183.39it/s]
Epoch 175, Train Loss: 0.8866
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.58it/s]
Epoch 176, Train Loss: 0.8741
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 229.74it/s]
Epoch 177, Train Loss: 0.8608
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.93it/s]
Epoch 178, Train Loss: 0.8466
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.77it/s]
Epoch 179, Train Loss: 0.8315
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.16it/s]
Epoch 180, Train Loss: 0.8156
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.80it/s]
Epoch 181, Train Loss: 0.7990
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.85it/s]
Epoch 182, Train Loss: 0.7817
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 226.97it/s]
Epoch 183, Train Loss: 0.7639
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.07it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.19it/s]
100%|██████████| 19/19 [00:00<00:00, 83.88it/s]
Epoch 184, Train Loss: 0.7454
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.55it/s]
100%|██████████| 19/19 [00:00<00:00, 112.54it/s]
Epoch 185, Train Loss: 0.7260
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.16it/s]
100%|██████████| 19/19 [00:00<00:00, 101.34it/s]
Epoch 186, Train Loss: 0.7059
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.48it/s]
100%|██████████| 19/19 [00:00<00:00, 90.56it/s]
Epoch 187, Train Loss: 0.6858
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.80it/s]
100%|██████████| 19/19 [00:00<00:00, 134.07it/s]
Epoch 188, Train Loss: 0.6661
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.73it/s]
Epoch 189, Train Loss: 0.6470
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.88it/s]
Epoch 190, Train Loss: 0.6288
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 119.77it/s]
100%|██████████| 19/19 [00:00<00:00, 104.74it/s]
Epoch 191, Train Loss: 0.6116
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 136.52it/s]
100%|██████████| 19/19 [00:00<00:00, 148.36it/s]
Epoch 192, Train Loss: 0.5954
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 228.48it/s]
Epoch 193, Train Loss: 0.5802
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 108.80it/s]
100%|██████████| 19/19 [00:00<00:00, 121.82it/s]
Epoch 194, Train Loss: 0.5660
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 218.14it/s]
Epoch 195, Train Loss: 0.5529
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 228.50it/s]
Epoch 196, Train Loss: 0.5407
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.35it/s]
Epoch 197, Train Loss: 0.5293
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.86it/s]
100%|██████████| 19/19 [00:00<00:00, 102.35it/s]
Epoch 198, Train Loss: 0.5187
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 88.46it/s]
100%|██████████| 19/19 [00:00<00:00, 91.61it/s]
Epoch 199, Train Loss: 0.5089
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.96it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.33it/s]
100%|██████████| 19/19 [00:00<00:00, 85.15it/s]
Epoch 200, Train Loss: 0.4998
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.34it/s]
100%|██████████| 19/19 [00:00<00:00, 92.26it/s]
Epoch 201, Train Loss: 0.4913
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 222.16it/s]
Epoch 202, Train Loss: 0.4834
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.48it/s]
Epoch 203, Train Loss: 0.4760
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.20it/s]
Epoch 204, Train Loss: 0.4690
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.22it/s]
Epoch 205, Train Loss: 0.4625
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 99.48it/s]
100%|██████████| 19/19 [00:00<00:00, 93.75it/s]
Epoch 206, Train Loss: 0.4565
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.59it/s]
100%|██████████| 19/19 [00:00<00:00, 128.03it/s]
Epoch 207, Train Loss: 0.4507
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.53it/s]
100%|██████████| 19/19 [00:00<00:00, 103.19it/s]
Epoch 208, Train Loss: 0.4453
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.98it/s]
Epoch 209, Train Loss: 0.4403
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 228.58it/s]
Epoch 210, Train Loss: 0.4355
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 166.23it/s]
100%|██████████| 19/19 [00:00<00:00, 153.13it/s]
Epoch 211, Train Loss: 0.4309
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.43it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.45it/s]
100%|██████████| 19/19 [00:00<00:00, 79.89it/s]
Epoch 212, Train Loss: 0.4266
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 78.57it/s]
89%|████████▉ | 17/19 [00:00<00:00, 79.31it/s]
100%|██████████| 19/19 [00:00<00:00, 78.63it/s]
Epoch 213, Train Loss: 0.4226
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.47it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.58it/s]
100%|██████████| 19/19 [00:00<00:00, 77.07it/s]
Epoch 214, Train Loss: 0.4187
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.04it/s]
95%|█████████▍| 18/19 [00:00<00:00, 79.25it/s]
100%|██████████| 19/19 [00:00<00:00, 79.41it/s]
Epoch 215, Train Loss: 0.4150
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.66it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.57it/s]
100%|██████████| 19/19 [00:00<00:00, 75.16it/s]
Epoch 216, Train Loss: 0.4116
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.73it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.52it/s]
100%|██████████| 19/19 [00:00<00:00, 86.02it/s]
Epoch 217, Train Loss: 0.4083
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 79.74it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.63it/s]
100%|██████████| 19/19 [00:00<00:00, 82.59it/s]
Epoch 218, Train Loss: 0.4051
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.15it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.17it/s]
100%|██████████| 19/19 [00:00<00:00, 84.40it/s]
Epoch 219, Train Loss: 0.4022
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.21it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.37it/s]
100%|██████████| 19/19 [00:00<00:00, 85.33it/s]
Epoch 220, Train Loss: 0.3993
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.38it/s]
95%|█████████▍| 18/19 [00:00<00:00, 81.06it/s]
100%|██████████| 19/19 [00:00<00:00, 80.95it/s]
Epoch 221, Train Loss: 0.3966
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.25it/s]
89%|████████▉ | 17/19 [00:00<00:00, 83.44it/s]
100%|██████████| 19/19 [00:00<00:00, 81.90it/s]
Epoch 222, Train Loss: 0.3941
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.65it/s]
100%|██████████| 19/19 [00:00<00:00, 112.35it/s]
Epoch 223, Train Loss: 0.3916
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.59it/s]
Epoch 224, Train Loss: 0.3893
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.23it/s]
Epoch 225, Train Loss: 0.3871
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.19it/s]
Epoch 226, Train Loss: 0.3850
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.83it/s]
Epoch 227, Train Loss: 0.3829
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.94it/s]
Epoch 228, Train Loss: 0.3810
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.33it/s]
Epoch 229, Train Loss: 0.3792
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.30it/s]
Epoch 230, Train Loss: 0.3774
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.97it/s]
Epoch 231, Train Loss: 0.3757
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 179.69it/s]
100%|██████████| 19/19 [00:00<00:00, 177.08it/s]
Epoch 232, Train Loss: 0.3740
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.39it/s]
Epoch 233, Train Loss: 0.3724
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 228.85it/s]
Epoch 234, Train Loss: 0.3709
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.02it/s]
Epoch 235, Train Loss: 0.3694
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.43it/s]
100%|██████████| 19/19 [00:00<00:00, 96.94it/s]
Epoch 236, Train Loss: 0.3680
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.79it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.88it/s]
100%|██████████| 19/19 [00:00<00:00, 84.50it/s]
Epoch 237, Train Loss: 0.3666
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.95it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.54it/s]
100%|██████████| 19/19 [00:00<00:00, 85.55it/s]
Epoch 238, Train Loss: 0.3652
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.67it/s]
100%|██████████| 19/19 [00:00<00:00, 142.72it/s]
Epoch 239, Train Loss: 0.3639
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 176.88it/s]
100%|██████████| 19/19 [00:00<00:00, 165.22it/s]
Epoch 240, Train Loss: 0.3626
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.90it/s]
100%|██████████| 19/19 [00:00<00:00, 188.14it/s]
Epoch 241, Train Loss: 0.3614
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.71it/s]
100%|██████████| 19/19 [00:00<00:00, 99.06it/s]
Epoch 242, Train Loss: 0.3601
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.94it/s]
100%|██████████| 19/19 [00:00<00:00, 113.66it/s]
Epoch 243, Train Loss: 0.3590
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 219.60it/s]
Epoch 244, Train Loss: 0.3578
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.63it/s]
Epoch 245, Train Loss: 0.3566
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.98it/s]
Epoch 246, Train Loss: 0.3555
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.28it/s]
Epoch 247, Train Loss: 0.3544
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.51it/s]
Epoch 248, Train Loss: 0.3533
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.54it/s]
Epoch 249, Train Loss: 0.3523
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.27it/s]
Epoch 250, Train Loss: 0.3513
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.69it/s]
Epoch 251, Train Loss: 0.3502
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.80it/s]
Epoch 252, Train Loss: 0.3492
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.58it/s]
Epoch 253, Train Loss: 0.3483
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.60it/s]
Epoch 254, Train Loss: 0.3473
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 118.64it/s]
100%|██████████| 19/19 [00:00<00:00, 107.11it/s]
Epoch 255, Train Loss: 0.3463
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.07it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.96it/s]
100%|██████████| 19/19 [00:00<00:00, 81.21it/s]
Epoch 256, Train Loss: 0.3454
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.64it/s]
100%|██████████| 19/19 [00:00<00:00, 132.08it/s]
Epoch 257, Train Loss: 0.3445
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 123.97it/s]
100%|██████████| 19/19 [00:00<00:00, 113.43it/s]
Epoch 258, Train Loss: 0.3436
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.04it/s]
100%|██████████| 19/19 [00:00<00:00, 131.55it/s]
Epoch 259, Train Loss: 0.3427
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.49it/s]
Epoch 260, Train Loss: 0.3418
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.43it/s]
Epoch 261, Train Loss: 0.3409
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.99it/s]
Epoch 262, Train Loss: 0.3400
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.00it/s]
Epoch 263, Train Loss: 0.3391
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.56it/s]
100%|██████████| 19/19 [00:00<00:00, 92.52it/s]
Epoch 264, Train Loss: 0.3383
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.99it/s]
100%|██████████| 19/19 [00:00<00:00, 108.50it/s]
Epoch 265, Train Loss: 0.3374
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 217.69it/s]
Epoch 266, Train Loss: 0.3366
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.54it/s]
100%|██████████| 19/19 [00:00<00:00, 89.71it/s]
Epoch 267, Train Loss: 0.3357
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.92it/s]
95%|█████████▍| 18/19 [00:00<00:00, 81.17it/s]
100%|██████████| 19/19 [00:00<00:00, 80.61it/s]
Epoch 268, Train Loss: 0.3349
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.68it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.76it/s]
100%|██████████| 19/19 [00:00<00:00, 82.57it/s]
Epoch 269, Train Loss: 0.3341
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.59it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.82it/s]
100%|██████████| 19/19 [00:00<00:00, 85.09it/s]
Epoch 270, Train Loss: 0.3333
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.81it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.91it/s]
100%|██████████| 19/19 [00:00<00:00, 84.80it/s]
Epoch 271, Train Loss: 0.3325
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.83it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.67it/s]
100%|██████████| 19/19 [00:00<00:00, 85.58it/s]
Epoch 272, Train Loss: 0.3317
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 91.80it/s]
100%|██████████| 19/19 [00:00<00:00, 88.89it/s]
Epoch 273, Train Loss: 0.3309
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 147.51it/s]
100%|██████████| 19/19 [00:00<00:00, 135.49it/s]
Epoch 274, Train Loss: 0.3302
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.16it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.14it/s]
100%|██████████| 19/19 [00:00<00:00, 74.34it/s]
Epoch 275, Train Loss: 0.3294
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.45it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.75it/s]
100%|██████████| 19/19 [00:00<00:00, 79.23it/s]
Epoch 276, Train Loss: 0.3286
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.34it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.36it/s]
100%|██████████| 19/19 [00:00<00:00, 79.64it/s]
Epoch 277, Train Loss: 0.3278
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.04it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.63it/s]
100%|██████████| 19/19 [00:00<00:00, 76.63it/s]
Epoch 278, Train Loss: 0.3271
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.61it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.66it/s]
100%|██████████| 19/19 [00:00<00:00, 71.29it/s]
Epoch 279, Train Loss: 0.3263
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.11it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.84it/s]
100%|██████████| 19/19 [00:00<00:00, 85.05it/s]
Epoch 280, Train Loss: 0.3256
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.15it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.40it/s]
100%|██████████| 19/19 [00:00<00:00, 77.23it/s]
Epoch 281, Train Loss: 0.3248
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.76it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.36it/s]
100%|██████████| 19/19 [00:00<00:00, 77.51it/s]
Epoch 282, Train Loss: 0.3241
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.28it/s]
100%|██████████| 19/19 [00:00<00:00, 91.24it/s]
100%|██████████| 19/19 [00:00<00:00, 89.52it/s]
Epoch 283, Train Loss: 0.3234
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.47it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.57it/s]
100%|██████████| 19/19 [00:00<00:00, 74.58it/s]
Epoch 284, Train Loss: 0.3226
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.73it/s]
89%|████████▉ | 17/19 [00:00<00:00, 81.90it/s]
100%|██████████| 19/19 [00:00<00:00, 82.34it/s]
Epoch 285, Train Loss: 0.3219
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.67it/s]
100%|██████████| 19/19 [00:00<00:00, 102.35it/s]
Epoch 286, Train Loss: 0.3212
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 222.69it/s]
Epoch 287, Train Loss: 0.3205
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.23it/s]
Epoch 288, Train Loss: 0.3198
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 164.24it/s]
100%|██████████| 19/19 [00:00<00:00, 166.02it/s]
Epoch 289, Train Loss: 0.3191
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.89it/s]
100%|██████████| 19/19 [00:00<00:00, 101.76it/s]
Epoch 290, Train Loss: 0.3184
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.61it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.84it/s]
100%|██████████| 19/19 [00:00<00:00, 80.61it/s]
Epoch 291, Train Loss: 0.3177
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 148.04it/s]
100%|██████████| 19/19 [00:00<00:00, 157.88it/s]
Epoch 292, Train Loss: 0.3170
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 177.12it/s]
100%|██████████| 19/19 [00:00<00:00, 175.13it/s]
Epoch 293, Train Loss: 0.3163
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.37it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.26it/s]
100%|██████████| 19/19 [00:00<00:00, 76.20it/s]
Epoch 294, Train Loss: 0.3157
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.02it/s]
100%|██████████| 19/19 [00:00<00:00, 102.49it/s]
Epoch 295, Train Loss: 0.3150
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 166.52it/s]
100%|██████████| 19/19 [00:00<00:00, 168.38it/s]
Epoch 296, Train Loss: 0.3144
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.10it/s]
100%|██████████| 19/19 [00:00<00:00, 100.88it/s]
Epoch 297, Train Loss: 0.3137
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.90it/s]
95%|█████████▍| 18/19 [00:00<00:00, 81.98it/s]
100%|██████████| 19/19 [00:00<00:00, 81.60it/s]
Epoch 298, Train Loss: 0.3131
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 166.06it/s]
100%|██████████| 19/19 [00:00<00:00, 153.25it/s]
Epoch 299, Train Loss: 0.3125
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 185.48it/s]
100%|██████████| 19/19 [00:00<00:00, 183.62it/s]
Epoch 300, Train Loss: 0.3119
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.13it/s]
Epoch 301, Train Loss: 0.3113
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.69it/s]
Epoch 302, Train Loss: 0.3107
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 146.39it/s]
100%|██████████| 19/19 [00:00<00:00, 133.34it/s]
Epoch 303, Train Loss: 0.3101
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.29it/s]
Epoch 304, Train Loss: 0.3095
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.11it/s]
Epoch 305, Train Loss: 0.3090
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.28it/s]
Epoch 306, Train Loss: 0.3084
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.30it/s]
Epoch 307, Train Loss: 0.3079
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 110.86it/s]
100%|██████████| 19/19 [00:00<00:00, 103.28it/s]
Epoch 308, Train Loss: 0.3073
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.33it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.99it/s]
100%|██████████| 19/19 [00:00<00:00, 73.74it/s]
Epoch 309, Train Loss: 0.3068
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.60it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.86it/s]
100%|██████████| 19/19 [00:00<00:00, 83.34it/s]
Epoch 310, Train Loss: 0.3063
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.67it/s]
89%|████████▉ | 17/19 [00:00<00:00, 80.39it/s]
100%|██████████| 19/19 [00:00<00:00, 79.42it/s]
Epoch 311, Train Loss: 0.3058
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.92it/s]
100%|██████████| 19/19 [00:00<00:00, 104.01it/s]
Epoch 312, Train Loss: 0.3053
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 109.24it/s]
100%|██████████| 19/19 [00:00<00:00, 93.96it/s]
Epoch 313, Train Loss: 0.3048
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.87it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.62it/s]
100%|██████████| 19/19 [00:00<00:00, 77.86it/s]
Epoch 314, Train Loss: 0.3043
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.53it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.95it/s]
100%|██████████| 19/19 [00:00<00:00, 82.69it/s]
Epoch 315, Train Loss: 0.3039
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.52it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.36it/s]
100%|██████████| 19/19 [00:00<00:00, 84.29it/s]
Epoch 316, Train Loss: 0.3034
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.68it/s]
100%|██████████| 19/19 [00:00<00:00, 109.53it/s]
Epoch 317, Train Loss: 0.3029
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.25it/s]
89%|████████▉ | 17/19 [00:00<00:00, 80.77it/s]
100%|██████████| 19/19 [00:00<00:00, 78.95it/s]
Epoch 318, Train Loss: 0.3025
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 188.30it/s]
100%|██████████| 19/19 [00:00<00:00, 186.69it/s]
Epoch 319, Train Loss: 0.3020
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.45it/s]
Epoch 320, Train Loss: 0.3016
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 229.87it/s]
Epoch 321, Train Loss: 0.3011
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.38it/s]
Epoch 322, Train Loss: 0.3007
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.85it/s]
Epoch 323, Train Loss: 0.3003
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 131.81it/s]
100%|██████████| 19/19 [00:00<00:00, 119.16it/s]
Epoch 324, Train Loss: 0.2998
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.85it/s]
100%|██████████| 19/19 [00:00<00:00, 152.36it/s]
Epoch 325, Train Loss: 0.2994
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 223.56it/s]
Epoch 326, Train Loss: 0.2990
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 137.57it/s]
100%|██████████| 19/19 [00:00<00:00, 125.83it/s]
Epoch 327, Train Loss: 0.2986
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.71it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.12it/s]
100%|██████████| 19/19 [00:00<00:00, 85.25it/s]
Epoch 328, Train Loss: 0.2982
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.92it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.24it/s]
100%|██████████| 19/19 [00:00<00:00, 84.53it/s]
Epoch 329, Train Loss: 0.2977
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.48it/s]
89%|████████▉ | 17/19 [00:00<00:00, 84.41it/s]
100%|██████████| 19/19 [00:00<00:00, 82.12it/s]
Epoch 330, Train Loss: 0.2973
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.63it/s]
95%|█████████▍| 18/19 [00:00<00:00, 87.54it/s]
100%|██████████| 19/19 [00:00<00:00, 86.15it/s]
Epoch 331, Train Loss: 0.2969
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 168.34it/s]
100%|██████████| 19/19 [00:00<00:00, 155.19it/s]
Epoch 332, Train Loss: 0.2965
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 126.75it/s]
100%|██████████| 19/19 [00:00<00:00, 125.82it/s]
Epoch 333, Train Loss: 0.2961
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.09it/s]
100%|██████████| 19/19 [00:00<00:00, 121.17it/s]
Epoch 334, Train Loss: 0.2957
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 224.19it/s]
Epoch 335, Train Loss: 0.2953
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.73it/s]
100%|██████████| 19/19 [00:00<00:00, 93.73it/s]
Epoch 336, Train Loss: 0.2949
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.60it/s]
95%|█████████▍| 18/19 [00:00<00:00, 79.38it/s]
100%|██████████| 19/19 [00:00<00:00, 79.65it/s]
Epoch 337, Train Loss: 0.2945
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.62it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.23it/s]
100%|██████████| 19/19 [00:00<00:00, 77.22it/s]
Epoch 338, Train Loss: 0.2941
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 186.62it/s]
100%|██████████| 19/19 [00:00<00:00, 185.43it/s]
Epoch 339, Train Loss: 0.2937
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 222.83it/s]
Epoch 340, Train Loss: 0.2933
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.51it/s]
Epoch 341, Train Loss: 0.2929
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.20it/s]
Epoch 342, Train Loss: 0.2925
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.38it/s]
Epoch 343, Train Loss: 0.2921
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.20it/s]
Epoch 344, Train Loss: 0.2917
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.42it/s]
Epoch 345, Train Loss: 0.2913
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 185.85it/s]
100%|██████████| 19/19 [00:00<00:00, 184.75it/s]
Epoch 346, Train Loss: 0.2909
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.80it/s]
Epoch 347, Train Loss: 0.2904
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.18it/s]
Epoch 348, Train Loss: 0.2900
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.66it/s]
Epoch 349, Train Loss: 0.2896
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.26it/s]
Epoch 350, Train Loss: 0.2892
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.13it/s]
Epoch 351, Train Loss: 0.2888
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.09it/s]
Epoch 352, Train Loss: 0.2884
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 192.82it/s]
Epoch 353, Train Loss: 0.2880
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 99.55it/s]
100%|██████████| 19/19 [00:00<00:00, 89.97it/s]
Epoch 354, Train Loss: 0.2876
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 174.08it/s]
100%|██████████| 19/19 [00:00<00:00, 172.21it/s]
Epoch 355, Train Loss: 0.2872
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 132.81it/s]
100%|██████████| 19/19 [00:00<00:00, 147.60it/s]
Epoch 356, Train Loss: 0.2868
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.93it/s]
Epoch 357, Train Loss: 0.2864
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.22it/s]
Epoch 358, Train Loss: 0.2860
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.26it/s]
Epoch 359, Train Loss: 0.2856
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.52it/s]
Epoch 360, Train Loss: 0.2852
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.17it/s]
Epoch 361, Train Loss: 0.2848
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.61it/s]
Epoch 362, Train Loss: 0.2844
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.08it/s]
Epoch 363, Train Loss: 0.2840
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 247.38it/s]
Epoch 364, Train Loss: 0.2836
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.74it/s]
Epoch 365, Train Loss: 0.2832
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 166.47it/s]
100%|██████████| 19/19 [00:00<00:00, 168.61it/s]
Epoch 366, Train Loss: 0.2828
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 138.63it/s]
100%|██████████| 19/19 [00:00<00:00, 117.97it/s]
Epoch 367, Train Loss: 0.2824
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.50it/s]
100%|██████████| 19/19 [00:00<00:00, 113.71it/s]
Epoch 368, Train Loss: 0.2820
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 159.36it/s]
100%|██████████| 19/19 [00:00<00:00, 157.03it/s]
Epoch 369, Train Loss: 0.2816
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 192.53it/s]
Epoch 370, Train Loss: 0.2812
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.44it/s]
100%|██████████| 19/19 [00:00<00:00, 105.44it/s]
Epoch 371, Train Loss: 0.2808
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.61it/s]
Epoch 372, Train Loss: 0.2803
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 187.81it/s]
100%|██████████| 19/19 [00:00<00:00, 186.47it/s]
Epoch 373, Train Loss: 0.2799
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.72it/s]
100%|██████████| 19/19 [00:00<00:00, 91.73it/s]
Epoch 374, Train Loss: 0.2795
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.13it/s]
100%|██████████| 19/19 [00:00<00:00, 117.29it/s]
Epoch 375, Train Loss: 0.2791
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 122.40it/s]
100%|██████████| 19/19 [00:00<00:00, 104.61it/s]
Epoch 376, Train Loss: 0.2787
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 165.35it/s]
100%|██████████| 19/19 [00:00<00:00, 168.28it/s]
Epoch 377, Train Loss: 0.2783
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.23it/s]
Epoch 378, Train Loss: 0.2779
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 100.36it/s]
100%|██████████| 19/19 [00:00<00:00, 93.44it/s]
Epoch 379, Train Loss: 0.2774
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.53it/s]
100%|██████████| 19/19 [00:00<00:00, 90.70it/s]
Epoch 380, Train Loss: 0.2770
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.07it/s]
100%|██████████| 19/19 [00:00<00:00, 102.09it/s]
Epoch 381, Train Loss: 0.2766
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.33it/s]
Epoch 382, Train Loss: 0.2762
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.65it/s]
Epoch 383, Train Loss: 0.2758
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.41it/s]
Epoch 384, Train Loss: 0.2753
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.24it/s]
Epoch 385, Train Loss: 0.2749
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.98it/s]
Epoch 386, Train Loss: 0.2745
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.29it/s]
100%|██████████| 19/19 [00:00<00:00, 114.80it/s]
Epoch 387, Train Loss: 0.2741
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 154.40it/s]
100%|██████████| 19/19 [00:00<00:00, 153.68it/s]
Epoch 388, Train Loss: 0.2737
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.79it/s]
100%|██████████| 19/19 [00:00<00:00, 102.00it/s]
Epoch 389, Train Loss: 0.2733
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.36it/s]
Epoch 390, Train Loss: 0.2729
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.66it/s]
Epoch 391, Train Loss: 0.2725
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 158.17it/s]
100%|██████████| 19/19 [00:00<00:00, 157.56it/s]
Epoch 392, Train Loss: 0.2721
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 173.11it/s]
100%|██████████| 19/19 [00:00<00:00, 164.07it/s]
Epoch 393, Train Loss: 0.2716
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 139.65it/s]
100%|██████████| 19/19 [00:00<00:00, 139.31it/s]
Epoch 394, Train Loss: 0.2712
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.09it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.97it/s]
100%|██████████| 19/19 [00:00<00:00, 77.02it/s]
Epoch 395, Train Loss: 0.2708
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.05it/s]
84%|████████▍ | 16/19 [00:00<00:00, 78.83it/s]
100%|██████████| 19/19 [00:00<00:00, 76.47it/s]
Epoch 396, Train Loss: 0.2704
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.27it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.24it/s]
100%|██████████| 19/19 [00:00<00:00, 82.10it/s]
Epoch 397, Train Loss: 0.2700
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.84it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.47it/s]
100%|██████████| 19/19 [00:00<00:00, 80.98it/s]
Epoch 398, Train Loss: 0.2696
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.84it/s]
Epoch 399, Train Loss: 0.2692
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 127.93it/s]
100%|██████████| 19/19 [00:00<00:00, 147.37it/s]
Epoch 400, Train Loss: 0.2688
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 232.96it/s]
Epoch 401, Train Loss: 0.2684
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 124.23it/s]
100%|██████████| 19/19 [00:00<00:00, 144.34it/s]
Epoch 402, Train Loss: 0.2681
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.82it/s]
Epoch 403, Train Loss: 0.2677
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.30it/s]
Epoch 404, Train Loss: 0.2673
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.89it/s]
Epoch 405, Train Loss: 0.2669
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.60it/s]
Epoch 406, Train Loss: 0.2665
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.40it/s]
Epoch 407, Train Loss: 0.2661
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 229.88it/s]
Epoch 408, Train Loss: 0.2657
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 142.87it/s]
100%|██████████| 19/19 [00:00<00:00, 122.99it/s]
Epoch 409, Train Loss: 0.2653
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.58it/s]
84%|████████▍ | 16/19 [00:00<00:00, 78.45it/s]
100%|██████████| 19/19 [00:00<00:00, 77.16it/s]
Epoch 410, Train Loss: 0.2649
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.83it/s]
95%|█████████▍| 18/19 [00:00<00:00, 78.97it/s]
100%|██████████| 19/19 [00:00<00:00, 78.60it/s]
Epoch 411, Train Loss: 0.2645
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.81it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.41it/s]
100%|██████████| 19/19 [00:00<00:00, 77.60it/s]
Epoch 412, Train Loss: 0.2641
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.51it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.03it/s]
100%|██████████| 19/19 [00:00<00:00, 74.53it/s]
Epoch 413, Train Loss: 0.2638
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.24it/s]
100%|██████████| 19/19 [00:00<00:00, 99.04it/s]
Epoch 414, Train Loss: 0.2634
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.39it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.23it/s]
100%|██████████| 19/19 [00:00<00:00, 81.97it/s]
Epoch 415, Train Loss: 0.2630
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.65it/s]
95%|█████████▍| 18/19 [00:00<00:00, 82.52it/s]
100%|██████████| 19/19 [00:00<00:00, 81.90it/s]
Epoch 416, Train Loss: 0.2626
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.40it/s]
100%|██████████| 19/19 [00:00<00:00, 93.32it/s]
100%|██████████| 19/19 [00:00<00:00, 91.45it/s]
Epoch 417, Train Loss: 0.2622
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.27it/s]
100%|██████████| 19/19 [00:00<00:00, 112.41it/s]
Epoch 418, Train Loss: 0.2618
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.49it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.05it/s]
100%|██████████| 19/19 [00:00<00:00, 77.12it/s]
Epoch 419, Train Loss: 0.2614
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.63it/s]
89%|████████▉ | 17/19 [00:00<00:00, 85.12it/s]
100%|██████████| 19/19 [00:00<00:00, 84.79it/s]
Epoch 420, Train Loss: 0.2610
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 79.79it/s]
89%|████████▉ | 17/19 [00:00<00:00, 77.42it/s]
100%|██████████| 19/19 [00:00<00:00, 77.44it/s]
Epoch 421, Train Loss: 0.2607
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.82it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.96it/s]
100%|██████████| 19/19 [00:00<00:00, 74.02it/s]
Epoch 422, Train Loss: 0.2603
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 148.96it/s]
100%|██████████| 19/19 [00:00<00:00, 158.71it/s]
Epoch 423, Train Loss: 0.2599
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 229.86it/s]
Epoch 424, Train Loss: 0.2595
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.89it/s]
100%|██████████| 19/19 [00:00<00:00, 112.05it/s]
Epoch 425, Train Loss: 0.2591
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.49it/s]
100%|██████████| 19/19 [00:00<00:00, 97.88it/s]
Epoch 426, Train Loss: 0.2587
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.23it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.74it/s]
100%|██████████| 19/19 [00:00<00:00, 82.76it/s]
Epoch 427, Train Loss: 0.2584
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.60it/s]
89%|████████▉ | 17/19 [00:00<00:00, 80.65it/s]
100%|██████████| 19/19 [00:00<00:00, 78.86it/s]
Epoch 428, Train Loss: 0.2580
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.93it/s]
95%|█████████▍| 18/19 [00:00<00:00, 86.87it/s]
100%|██████████| 19/19 [00:00<00:00, 86.93it/s]
Epoch 429, Train Loss: 0.2576
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.92it/s]
100%|██████████| 19/19 [00:00<00:00, 97.45it/s]
Epoch 430, Train Loss: 0.2572
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 220.30it/s]
Epoch 431, Train Loss: 0.2568
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.77it/s]
Epoch 432, Train Loss: 0.2564
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 103.47it/s]
100%|██████████| 19/19 [00:00<00:00, 89.22it/s]
Epoch 433, Train Loss: 0.2561
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.21it/s]
100%|██████████| 19/19 [00:00<00:00, 130.03it/s]
Epoch 434, Train Loss: 0.2557
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 227.08it/s]
Epoch 435, Train Loss: 0.2553
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.67it/s]
Epoch 436, Train Loss: 0.2549
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 234.06it/s]
Epoch 437, Train Loss: 0.2545
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.61it/s]
Epoch 438, Train Loss: 0.2541
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 236.12it/s]
Epoch 439, Train Loss: 0.2538
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.22it/s]
Epoch 440, Train Loss: 0.2534
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.31it/s]
Epoch 441, Train Loss: 0.2530
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 245.19it/s]
Epoch 442, Train Loss: 0.2526
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.34it/s]
Epoch 443, Train Loss: 0.2522
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.16it/s]
Epoch 444, Train Loss: 0.2519
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.96it/s]
Epoch 445, Train Loss: 0.2515
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.48it/s]
Epoch 446, Train Loss: 0.2511
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 231.73it/s]
Epoch 447, Train Loss: 0.2507
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.68it/s]
Epoch 448, Train Loss: 0.2503
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 232.53it/s]
Epoch 449, Train Loss: 0.2499
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.03it/s]
100%|██████████| 19/19 [00:00<00:00, 142.16it/s]
Epoch 450, Train Loss: 0.2496
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.16it/s]
Epoch 451, Train Loss: 0.2492
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.28it/s]
100%|██████████| 19/19 [00:00<00:00, 139.33it/s]
Epoch 452, Train Loss: 0.2488
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.71it/s]
Epoch 453, Train Loss: 0.2484
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 166.52it/s]
100%|██████████| 19/19 [00:00<00:00, 164.89it/s]
Epoch 454, Train Loss: 0.2481
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.41it/s]
Epoch 455, Train Loss: 0.2477
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.52it/s]
Epoch 456, Train Loss: 0.2473
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.96it/s]
Epoch 457, Train Loss: 0.2469
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.20it/s]
Epoch 458, Train Loss: 0.2465
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 159.68it/s]
100%|██████████| 19/19 [00:00<00:00, 138.45it/s]
Epoch 459, Train Loss: 0.2462
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.58it/s]
100%|██████████| 19/19 [00:00<00:00, 149.74it/s]
Epoch 460, Train Loss: 0.2458
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 222.81it/s]
Epoch 461, Train Loss: 0.2454
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.24it/s]
Epoch 462, Train Loss: 0.2450
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.18it/s]
Epoch 463, Train Loss: 0.2447
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 241.01it/s]
Epoch 464, Train Loss: 0.2443
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 177.43it/s]
100%|██████████| 19/19 [00:00<00:00, 160.27it/s]
Epoch 465, Train Loss: 0.2439
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.85it/s]
100%|██████████| 19/19 [00:00<00:00, 92.59it/s]
Epoch 466, Train Loss: 0.2435
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.86it/s]
100%|██████████| 19/19 [00:00<00:00, 135.17it/s]
Epoch 467, Train Loss: 0.2432
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 127.91it/s]
100%|██████████| 19/19 [00:00<00:00, 145.90it/s]
Epoch 468, Train Loss: 0.2428
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.06it/s]
Epoch 469, Train Loss: 0.2424
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.81it/s]
Epoch 470, Train Loss: 0.2420
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.39it/s]
Epoch 471, Train Loss: 0.2417
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.43it/s]
Epoch 472, Train Loss: 0.2413
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.33it/s]
Epoch 473, Train Loss: 0.2409
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.51it/s]
Epoch 474, Train Loss: 0.2405
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.37it/s]
Epoch 475, Train Loss: 0.2402
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 232.55it/s]
Epoch 476, Train Loss: 0.2398
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 183.61it/s]
100%|██████████| 19/19 [00:00<00:00, 181.98it/s]
Epoch 477, Train Loss: 0.2394
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 225.14it/s]
Epoch 478, Train Loss: 0.2391
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 244.60it/s]
Epoch 479, Train Loss: 0.2387
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 149.69it/s]
100%|██████████| 19/19 [00:00<00:00, 155.49it/s]
Epoch 480, Train Loss: 0.2383
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 230.85it/s]
Epoch 481, Train Loss: 0.2380
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 238.53it/s]
Epoch 482, Train Loss: 0.2376
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.14it/s]
Epoch 483, Train Loss: 0.2372
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.98it/s]
Epoch 484, Train Loss: 0.2369
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 239.77it/s]
Epoch 485, Train Loss: 0.2365
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 242.36it/s]
Epoch 486, Train Loss: 0.2361
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 114.55it/s]
100%|██████████| 19/19 [00:00<00:00, 102.34it/s]
Epoch 487, Train Loss: 0.2358
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.94it/s]
89%|████████▉ | 17/19 [00:00<00:00, 77.72it/s]
100%|██████████| 19/19 [00:00<00:00, 77.86it/s]
Epoch 488, Train Loss: 0.2354
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.95it/s]
Epoch 489, Train Loss: 0.2350
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 240.27it/s]
Epoch 490, Train Loss: 0.2347
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 235.01it/s]
Epoch 491, Train Loss: 0.2343
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 233.89it/s]
Epoch 492, Train Loss: 0.2339
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 243.67it/s]
Epoch 493, Train Loss: 0.2336
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 139.90it/s]
100%|██████████| 19/19 [00:00<00:00, 115.06it/s]
Epoch 494, Train Loss: 0.2332
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.70it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.25it/s]
100%|██████████| 19/19 [00:00<00:00, 75.68it/s]
Epoch 495, Train Loss: 0.2329
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 175.63it/s]
100%|██████████| 19/19 [00:00<00:00, 172.73it/s]
Epoch 496, Train Loss: 0.2325
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 237.37it/s]
Epoch 497, Train Loss: 0.2321
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 117.47it/s]
100%|██████████| 19/19 [00:00<00:00, 140.71it/s]
Epoch 498, Train Loss: 0.2318
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 156.81it/s]
100%|██████████| 19/19 [00:00<00:00, 157.48it/s]
Epoch 499, Train Loss: 0.2314
.............................
Validation#
encode, decode = transform_nn(dog_data, encoder, decoder, device=device)
/home/xinqiao/anaconda3/envs/m3_test/lib/python3.10/site-packages/torch/nn/modules/rnn.py:879: UserWarning: RNN module weights are not part of single contiguous chunk of memory. This means they need to be compacted at every call, possibly greatly increasing memory usage. To compact weights again call flatten_parameters(). (Triggered internally at ../aten/src/ATen/native/cudnn/RNN.cpp:982.)
result = _VF.lstm(input, hx, self._flat_weights, self.bias, self.num_layers,
embeddings(encode, shape_=image.shape[0:2], figsize=(15, 5))
latent_generator(decoder, encode, image, 5, 10, device=device,
figsize=(5, 2.5), divider_=False, indx=[2, 8, 9])
fig, ax = layout_fig(6, mod=3)
ax = ax.ravel()
cmap = plt.cm.viridis
for i, ax in enumerate(ax):
if i < 3:
img = np.zeros(image.shape)
img[:, :, i] = image[:, :, i]
ax.imshow(img)
else:
values = np.zeros((5, 3))
values[:, i - 3] = np.linspace(0, 1, 5)
y_data = generate_data(values, length=10)
for j in range(y_data.shape[0]):
color = cmap((j + 1) / y_data.shape[0])
ax.plot(y_data[j], c=color)
from IPython.display import HTML
# Youtube
HTML(
'<iframe width="560" height="315" src="https://www.youtube.com/embed/ElTwQClLsW0" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>'
)
/home/xinqiao/anaconda3/envs/m3_test/lib/python3.10/site-packages/IPython/core/display.py:431: UserWarning: Consider using IPython.display.IFrame instead
warnings.warn("Consider using IPython.display.IFrame instead")
Beta Variational Autoencoder#
Constrict and sample the latent space from some prior distribution –> generally a gaussian distribution
Normal Autoencoder#
VAE#
Encoder identifies some distribution –> generates from that distribution
Builds the Model#
latent_dim = 12
class Encoder(nn.Module):
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Encoder, self).__init__()
self.lstm = nn.LSTM(1, 12, batch_first=True, bidirectional=True)
self.embedding = nn.Linear(24, self.latent_dim)
self.relu = nn.ReLU()
# extracts the mean and standard deviation
self.mn = nn.Linear(self.latent_dim, self.latent_dim)
self.sd = nn.Linear(self.latent_dim, self.latent_dim)
def forward(self, x):
x, (_, __) = self.lstm(x)
x = x[:, -1, :]
x = self.embedding(x)
x = self.relu(x)
mn = self.mn(x)
sd = self.sd(x)
std = torch.exp(sd * 0.5).cuda()
eps = torch.normal(0, 1, size=std.size()).cuda()
out = eps.mul(std).add_(mn).cuda()
return out, mn, sd
class Decoder(nn.Module):
def __init__(self, latent_dim=12):
self.latent_dim = latent_dim
super(Decoder, self).__init__()
self.lstm = nn.LSTM(
latent_dim, 12, batch_first=True, bidirectional=True)
self.tdd = nn.Conv1d(24, 1, 1)
def forward(self, x):
x = x[:, :, None]
x = x.transpose(1, 2)
x = x.repeat([1, 10, 1])
x, (_, __) = self.lstm(x)
x = x.transpose(1, 2)
x = self.tdd(x)
x = x.transpose(1, 2)
return x
encoder = Encoder().to(device)
decoder = Decoder().to(device)
model = Autoencoder(encoder, decoder).to(device)
# optimizer
optimizer = optim.Adam(model.parameters(), lr=3e-4)
Training#
# training with beta regularization scheduling
def Train(
model,
encoder,
decoder,
train_iterator,
optimizer,
epochs,
coef=0,
coef_1=0,
ln_parm=1,
beta_step_size=0,
epoch_per_beta=10,
initial_epochs=10,
device=device,
save=False,
):
N_EPOCHS = epochs
best_train_loss = float("inf")
for epoch in range(N_EPOCHS):
if epoch < initial_epochs:
# starts training with no VAE regularization
beta = 0
else:
# adds VAE regularization
beta = ((epoch - initial_epochs) //
epoch_per_beta + 1) * beta_step_size
train_loss = loss_function(
model,
encoder,
decoder,
train_iterator,
optimizer,
coef,
coef_1,
ln_parm,
beta=beta,
mse=False,
)
train_loss /= len(train_iterator)
print(f"Epoch {epoch}, Train Loss: {train_loss:.4f}")
print(".............................")
if save:
if (
(epoch - initial_epochs) // epoch_per_beta
== (epoch - initial_epochs) / epoch_per_beta
) and (epoch >= initial_epochs):
best_train_loss = float("inf")
if best_train_loss > train_loss:
best_train_loss = train_loss
patience_counter = 1
checkpoint = {
"net": model.state_dict(),
"optimizer": optimizer.state_dict(),
"epoch": epoch,
"encoder": encoder.state_dict(),
"decoder": decoder.state_dict(),
}
if epoch >= 0:
torch.save(
checkpoint, f"./test__Train_Loss:{train_loss:.4f}-{epoch}.pkl"
)
random_seed(seed=42)
Train(
model,
encoder,
decoder,
train_iterator,
optimizer,
500,
beta_step_size=0.05,
epoch_per_beta=100,
initial_epochs=200,
device=device,
)
Show code cell output
Pytorch seed was set to 42
Numpy seed was set to 42
tensorflow seed was set to 42
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.83it/s]
100%|██████████| 19/19 [00:00<00:00, 118.85it/s]
Epoch 0, Train Loss: 1.8868
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.90it/s]
100%|██████████| 19/19 [00:00<00:00, 157.51it/s]
Epoch 1, Train Loss: 1.8601
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.41it/s]
Epoch 2, Train Loss: 1.8369
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.31it/s]
Epoch 3, Train Loss: 1.8194
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.76it/s]
Epoch 4, Train Loss: 1.7971
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.17it/s]
Epoch 5, Train Loss: 1.7614
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.79it/s]
Epoch 6, Train Loss: 1.7277
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.24it/s]
Epoch 7, Train Loss: 1.6581
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.43it/s]
Epoch 8, Train Loss: 1.5673
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 98.49it/s]
100%|██████████| 19/19 [00:00<00:00, 82.63it/s]
Epoch 9, Train Loss: 1.4347
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 156.34it/s]
100%|██████████| 19/19 [00:00<00:00, 155.65it/s]
Epoch 10, Train Loss: 1.2674
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 149.94it/s]
100%|██████████| 19/19 [00:00<00:00, 125.37it/s]
Epoch 11, Train Loss: 1.1148
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.38it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.35it/s]
100%|██████████| 19/19 [00:00<00:00, 76.59it/s]
Epoch 12, Train Loss: 0.9595
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 166.27it/s]
100%|██████████| 19/19 [00:00<00:00, 167.33it/s]
Epoch 13, Train Loss: 0.8134
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 192.43it/s]
Epoch 14, Train Loss: 0.6702
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.83it/s]
Epoch 15, Train Loss: 0.5385
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.04it/s]
Epoch 16, Train Loss: 0.4226
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.65it/s]
Epoch 17, Train Loss: 0.3489
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 197.49it/s]
Epoch 18, Train Loss: 0.3002
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 97.52it/s]
100%|██████████| 19/19 [00:00<00:00, 112.13it/s]
Epoch 19, Train Loss: 0.2694
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.26it/s]
Epoch 20, Train Loss: 0.2484
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 197.34it/s]
Epoch 21, Train Loss: 0.2366
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.83it/s]
Epoch 22, Train Loss: 0.2302
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 146.06it/s]
100%|██████████| 19/19 [00:00<00:00, 155.34it/s]
Epoch 23, Train Loss: 0.2195
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.50it/s]
100%|██████████| 19/19 [00:00<00:00, 128.83it/s]
Epoch 24, Train Loss: 0.2134
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.63it/s]
Epoch 25, Train Loss: 0.2084
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.39it/s]
Epoch 26, Train Loss: 0.2034
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.79it/s]
Epoch 27, Train Loss: 0.1974
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 202.63it/s]
Epoch 28, Train Loss: 0.1946
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.96it/s]
Epoch 29, Train Loss: 0.1912
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.35it/s]
Epoch 30, Train Loss: 0.1883
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 193.06it/s]
Epoch 31, Train Loss: 0.1846
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.12it/s]
Epoch 32, Train Loss: 0.1818
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.63it/s]
Epoch 33, Train Loss: 0.1795
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 198.26it/s]
Epoch 34, Train Loss: 0.1763
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 146.52it/s]
100%|██████████| 19/19 [00:00<00:00, 156.11it/s]
Epoch 35, Train Loss: 0.1745
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.73it/s]
100%|██████████| 19/19 [00:00<00:00, 123.76it/s]
Epoch 36, Train Loss: 0.1719
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.47it/s]
100%|██████████| 19/19 [00:00<00:00, 187.78it/s]
Epoch 37, Train Loss: 0.1700
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.42it/s]
Epoch 38, Train Loss: 0.1682
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.48it/s]
Epoch 39, Train Loss: 0.1660
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.52it/s]
Epoch 40, Train Loss: 0.1636
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.96it/s]
Epoch 41, Train Loss: 0.1618
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.40it/s]
Epoch 42, Train Loss: 0.1596
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.54it/s]
Epoch 43, Train Loss: 0.1581
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.74it/s]
100%|██████████| 19/19 [00:00<00:00, 84.88it/s]
Epoch 44, Train Loss: 0.1561
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.32it/s]
84%|████████▍ | 16/19 [00:00<00:00, 69.03it/s]
100%|██████████| 19/19 [00:00<00:00, 69.66it/s]
Epoch 45, Train Loss: 0.1540
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.02it/s]
79%|███████▉ | 15/19 [00:00<00:00, 70.81it/s]
100%|██████████| 19/19 [00:00<00:00, 70.04it/s]
Epoch 46, Train Loss: 0.1523
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.77it/s]
74%|███████▎ | 14/19 [00:00<00:00, 67.18it/s]
100%|██████████| 19/19 [00:00<00:00, 66.28it/s]
Epoch 47, Train Loss: 0.1502
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.76it/s]
84%|████████▍ | 16/19 [00:00<00:00, 69.43it/s]
100%|██████████| 19/19 [00:00<00:00, 70.02it/s]
Epoch 48, Train Loss: 0.1483
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.84it/s]
84%|████████▍ | 16/19 [00:00<00:00, 68.82it/s]
100%|██████████| 19/19 [00:00<00:00, 69.12it/s]
Epoch 49, Train Loss: 0.1460
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.75it/s]
84%|████████▍ | 16/19 [00:00<00:00, 78.74it/s]
100%|██████████| 19/19 [00:00<00:00, 84.62it/s]
Epoch 50, Train Loss: 0.1448
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.17it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.97it/s]
100%|██████████| 19/19 [00:00<00:00, 76.60it/s]
Epoch 51, Train Loss: 0.1428
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.27it/s]
89%|████████▉ | 17/19 [00:00<00:00, 79.30it/s]
100%|██████████| 19/19 [00:00<00:00, 77.79it/s]
Epoch 52, Train Loss: 0.1410
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.67it/s]
74%|███████▎ | 14/19 [00:00<00:00, 67.72it/s]
100%|██████████| 19/19 [00:00<00:00, 67.90it/s]
Epoch 53, Train Loss: 0.1391
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.71it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.27it/s]
100%|██████████| 19/19 [00:00<00:00, 77.46it/s]
Epoch 54, Train Loss: 0.1376
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.68it/s]
95%|█████████▍| 18/19 [00:00<00:00, 83.53it/s]
100%|██████████| 19/19 [00:00<00:00, 81.33it/s]
Epoch 55, Train Loss: 0.1361
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.55it/s]
79%|███████▉ | 15/19 [00:00<00:00, 70.65it/s]
100%|██████████| 19/19 [00:00<00:00, 70.48it/s]
Epoch 56, Train Loss: 0.1344
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.54it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.27it/s]
100%|██████████| 19/19 [00:00<00:00, 70.34it/s]
Epoch 57, Train Loss: 0.1331
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.63it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.42it/s]
100%|██████████| 19/19 [00:00<00:00, 70.14it/s]
Epoch 58, Train Loss: 0.1316
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.40it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.01it/s]
100%|██████████| 19/19 [00:00<00:00, 70.18it/s]
Epoch 59, Train Loss: 0.1302
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.31it/s]
79%|███████▉ | 15/19 [00:00<00:00, 71.67it/s]
100%|██████████| 19/19 [00:00<00:00, 71.97it/s]
Epoch 60, Train Loss: 0.1289
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.74it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.75it/s]
100%|██████████| 19/19 [00:00<00:00, 70.93it/s]
Epoch 61, Train Loss: 0.1276
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.25it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.20it/s]
100%|██████████| 19/19 [00:00<00:00, 72.62it/s]
Epoch 62, Train Loss: 0.1266
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.75it/s]
100%|██████████| 19/19 [00:00<00:00, 97.09it/s]
Epoch 63, Train Loss: 0.1255
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 195.60it/s]
Epoch 64, Train Loss: 0.1247
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.11it/s]
Epoch 65, Train Loss: 0.1233
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.29it/s]
Epoch 66, Train Loss: 0.1224
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.83it/s]
Epoch 67, Train Loss: 0.1214
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 201.94it/s]
Epoch 68, Train Loss: 0.1204
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.82it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.63it/s]
100%|██████████| 19/19 [00:00<00:00, 73.21it/s]
Epoch 69, Train Loss: 0.1196
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.50it/s]
74%|███████▎ | 14/19 [00:00<00:00, 67.13it/s]
100%|██████████| 19/19 [00:00<00:00, 66.93it/s]
Epoch 70, Train Loss: 0.1191
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.54it/s]
74%|███████▎ | 14/19 [00:00<00:00, 68.61it/s]
100%|██████████| 19/19 [00:00<00:00, 68.03it/s]
Epoch 71, Train Loss: 0.1180
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.70it/s]
74%|███████▎ | 14/19 [00:00<00:00, 68.24it/s]
100%|██████████| 19/19 [00:00<00:00, 70.25it/s]
Epoch 72, Train Loss: 0.1171
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.93it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.59it/s]
100%|██████████| 19/19 [00:00<00:00, 74.13it/s]
Epoch 73, Train Loss: 0.1162
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.50it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.79it/s]
100%|██████████| 19/19 [00:00<00:00, 70.19it/s]
Epoch 74, Train Loss: 0.1157
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.66it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.23it/s]
100%|██████████| 19/19 [00:00<00:00, 70.07it/s]
Epoch 75, Train Loss: 0.1146
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.58it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.70it/s]
100%|██████████| 19/19 [00:00<00:00, 80.09it/s]
Epoch 76, Train Loss: 0.1141
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 189.80it/s]
100%|██████████| 19/19 [00:00<00:00, 188.69it/s]
Epoch 77, Train Loss: 0.1135
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.90it/s]
Epoch 78, Train Loss: 0.1125
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.14it/s]
95%|█████████▍| 18/19 [00:00<00:00, 76.38it/s]
100%|██████████| 19/19 [00:00<00:00, 76.64it/s]
Epoch 79, Train Loss: 0.1119
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.62it/s]
74%|███████▎ | 14/19 [00:00<00:00, 68.39it/s]
100%|██████████| 19/19 [00:00<00:00, 68.38it/s]
Epoch 80, Train Loss: 0.1113
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.74it/s]
74%|███████▎ | 14/19 [00:00<00:00, 68.65it/s]
100%|██████████| 19/19 [00:00<00:00, 68.42it/s]
Epoch 81, Train Loss: 0.1106
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.44it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.43it/s]
100%|██████████| 19/19 [00:00<00:00, 71.53it/s]
Epoch 82, Train Loss: 0.1097
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 79.39it/s]
89%|████████▉ | 17/19 [00:00<00:00, 72.73it/s]
100%|██████████| 19/19 [00:00<00:00, 72.49it/s]
Epoch 83, Train Loss: 0.1091
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.34it/s]
79%|███████▉ | 15/19 [00:00<00:00, 72.22it/s]
100%|██████████| 19/19 [00:00<00:00, 71.77it/s]
Epoch 84, Train Loss: 0.1085
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.87it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.03it/s]
100%|██████████| 19/19 [00:00<00:00, 70.47it/s]
Epoch 85, Train Loss: 0.1080
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.24it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.02it/s]
100%|██████████| 19/19 [00:00<00:00, 70.85it/s]
Epoch 86, Train Loss: 0.1072
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.12it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.91it/s]
100%|██████████| 19/19 [00:00<00:00, 76.49it/s]
Epoch 87, Train Loss: 0.1068
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.75it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.00it/s]
100%|██████████| 19/19 [00:00<00:00, 71.87it/s]
Epoch 88, Train Loss: 0.1059
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.77it/s]
74%|███████▎ | 14/19 [00:00<00:00, 69.02it/s]
100%|██████████| 19/19 [00:00<00:00, 75.51it/s]
Epoch 89, Train Loss: 0.1054
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.04it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.56it/s]
100%|██████████| 19/19 [00:00<00:00, 72.74it/s]
Epoch 90, Train Loss: 0.1048
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.76it/s]
84%|████████▍ | 16/19 [00:00<00:00, 68.33it/s]
100%|██████████| 19/19 [00:00<00:00, 68.25it/s]
Epoch 91, Train Loss: 0.1043
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 153.20it/s]
100%|██████████| 19/19 [00:00<00:00, 157.29it/s]
Epoch 92, Train Loss: 0.1037
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 194.90it/s]
Epoch 93, Train Loss: 0.1032
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.20it/s]
Epoch 94, Train Loss: 0.1026
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.65it/s]
Epoch 95, Train Loss: 0.1022
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.77it/s]
Epoch 96, Train Loss: 0.1016
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.11it/s]
Epoch 97, Train Loss: 0.1011
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.07it/s]
Epoch 98, Train Loss: 0.1007
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.87it/s]
Epoch 99, Train Loss: 0.1001
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 197.47it/s]
Epoch 100, Train Loss: 0.0997
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.01it/s]
Epoch 101, Train Loss: 0.0993
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.48it/s]
Epoch 102, Train Loss: 0.0986
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.67it/s]
95%|█████████▍| 18/19 [00:00<00:00, 75.64it/s]
100%|██████████| 19/19 [00:00<00:00, 76.73it/s]
Epoch 103, Train Loss: 0.0983
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.04it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.18it/s]
100%|██████████| 19/19 [00:00<00:00, 71.31it/s]
Epoch 104, Train Loss: 0.0976
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.88it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.99it/s]
100%|██████████| 19/19 [00:00<00:00, 74.73it/s]
Epoch 105, Train Loss: 0.0971
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 183.54it/s]
100%|██████████| 19/19 [00:00<00:00, 182.58it/s]
Epoch 106, Train Loss: 0.0966
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 138.61it/s]
100%|██████████| 19/19 [00:00<00:00, 116.61it/s]
Epoch 107, Train Loss: 0.0960
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.56it/s]
95%|█████████▍| 18/19 [00:00<00:00, 85.84it/s]
100%|██████████| 19/19 [00:00<00:00, 83.40it/s]
Epoch 108, Train Loss: 0.0958
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 98.64it/s]
100%|██████████| 19/19 [00:00<00:00, 92.47it/s]
Epoch 109, Train Loss: 0.0949
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.88it/s]
84%|████████▍ | 16/19 [00:00<00:00, 78.19it/s]
100%|██████████| 19/19 [00:00<00:00, 77.11it/s]
Epoch 110, Train Loss: 0.0945
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.08it/s]
79%|███████▉ | 15/19 [00:00<00:00, 73.53it/s]
100%|██████████| 19/19 [00:00<00:00, 81.16it/s]
Epoch 111, Train Loss: 0.0937
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 195.19it/s]
Epoch 112, Train Loss: 0.0931
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.79it/s]
100%|██████████| 19/19 [00:00<00:00, 106.40it/s]
Epoch 113, Train Loss: 0.0924
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 89.82it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.05it/s]
100%|██████████| 19/19 [00:00<00:00, 77.70it/s]
Epoch 114, Train Loss: 0.0917
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.20it/s]
79%|███████▉ | 15/19 [00:00<00:00, 70.41it/s]
100%|██████████| 19/19 [00:00<00:00, 70.85it/s]
Epoch 115, Train Loss: 0.0908
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.25it/s]
100%|██████████| 19/19 [00:00<00:00, 108.51it/s]
Epoch 116, Train Loss: 0.0901
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 66.63it/s]
84%|████████▍ | 16/19 [00:00<00:00, 78.04it/s]
100%|██████████| 19/19 [00:00<00:00, 77.63it/s]
Epoch 117, Train Loss: 0.0892
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.31it/s]
100%|██████████| 19/19 [00:00<00:00, 97.69it/s]
Epoch 118, Train Loss: 0.0883
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.10it/s]
100%|██████████| 19/19 [00:00<00:00, 102.23it/s]
Epoch 119, Train Loss: 0.0872
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 191.37it/s]
Epoch 120, Train Loss: 0.0862
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.14it/s]
Epoch 121, Train Loss: 0.0849
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.58it/s]
Epoch 122, Train Loss: 0.0836
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.10it/s]
100%|██████████| 19/19 [00:00<00:00, 139.21it/s]
Epoch 123, Train Loss: 0.0821
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.43it/s]
Epoch 124, Train Loss: 0.0804
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.10it/s]
Epoch 125, Train Loss: 0.0786
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.39it/s]
100%|██████████| 19/19 [00:00<00:00, 94.76it/s]
Epoch 126, Train Loss: 0.0768
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.38it/s]
95%|█████████▍| 18/19 [00:00<00:00, 79.22it/s]
100%|██████████| 19/19 [00:00<00:00, 78.63it/s]
Epoch 127, Train Loss: 0.0744
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.84it/s]
95%|█████████▍| 18/19 [00:00<00:00, 84.79it/s]
100%|██████████| 19/19 [00:00<00:00, 83.46it/s]
Epoch 128, Train Loss: 0.0723
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.16it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.07it/s]
100%|██████████| 19/19 [00:00<00:00, 69.73it/s]
Epoch 129, Train Loss: 0.0704
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.89it/s]
79%|███████▉ | 15/19 [00:00<00:00, 70.52it/s]
100%|██████████| 19/19 [00:00<00:00, 69.64it/s]
Epoch 130, Train Loss: 0.0687
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.92it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.12it/s]
100%|██████████| 19/19 [00:00<00:00, 70.33it/s]
Epoch 131, Train Loss: 0.0670
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 66.31it/s]
79%|███████▉ | 15/19 [00:00<00:00, 69.69it/s]
100%|██████████| 19/19 [00:00<00:00, 70.58it/s]
Epoch 132, Train Loss: 0.0653
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.11it/s]
84%|████████▍ | 16/19 [00:00<00:00, 68.81it/s]
100%|██████████| 19/19 [00:00<00:00, 69.45it/s]
Epoch 133, Train Loss: 0.0638
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 66.84it/s]
74%|███████▎ | 14/19 [00:00<00:00, 67.65it/s]
100%|██████████| 19/19 [00:00<00:00, 67.86it/s]
Epoch 134, Train Loss: 0.0623
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.22it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.83it/s]
100%|██████████| 19/19 [00:00<00:00, 74.51it/s]
Epoch 135, Train Loss: 0.0611
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.21it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.18it/s]
100%|██████████| 19/19 [00:00<00:00, 71.04it/s]
Epoch 136, Train Loss: 0.0600
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.84it/s]
100%|██████████| 19/19 [00:00<00:00, 105.91it/s]
Epoch 137, Train Loss: 0.0588
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.42it/s]
89%|████████▉ | 17/19 [00:00<00:00, 76.71it/s]
100%|██████████| 19/19 [00:00<00:00, 75.33it/s]
Epoch 138, Train Loss: 0.0578
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 162.67it/s]
100%|██████████| 19/19 [00:00<00:00, 163.60it/s]
Epoch 139, Train Loss: 0.0569
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 81.42it/s]
95%|█████████▍| 18/19 [00:00<00:00, 76.96it/s]
100%|██████████| 19/19 [00:00<00:00, 76.64it/s]
Epoch 140, Train Loss: 0.0560
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.91it/s]
100%|██████████| 19/19 [00:00<00:00, 133.13it/s]
Epoch 141, Train Loss: 0.0549
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.92it/s]
Epoch 142, Train Loss: 0.0541
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.86it/s]
100%|██████████| 19/19 [00:00<00:00, 110.56it/s]
Epoch 143, Train Loss: 0.0533
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.30it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.46it/s]
100%|██████████| 19/19 [00:00<00:00, 71.25it/s]
Epoch 144, Train Loss: 0.0526
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.89it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.52it/s]
100%|██████████| 19/19 [00:00<00:00, 67.31it/s]
Epoch 145, Train Loss: 0.0518
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.69it/s]
84%|████████▍ | 16/19 [00:00<00:00, 69.41it/s]
100%|██████████| 19/19 [00:00<00:00, 68.89it/s]
Epoch 146, Train Loss: 0.0512
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.07it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.61it/s]
100%|██████████| 19/19 [00:00<00:00, 78.25it/s]
Epoch 147, Train Loss: 0.0504
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.01it/s]
84%|████████▍ | 16/19 [00:00<00:00, 66.73it/s]
100%|██████████| 19/19 [00:00<00:00, 67.56it/s]
Epoch 148, Train Loss: 0.0497
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.08it/s]
79%|███████▉ | 15/19 [00:00<00:00, 72.39it/s]
100%|██████████| 19/19 [00:00<00:00, 71.73it/s]
Epoch 149, Train Loss: 0.0489
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.90it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.18it/s]
100%|██████████| 19/19 [00:00<00:00, 73.36it/s]
Epoch 150, Train Loss: 0.0482
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 69.85it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.99it/s]
100%|██████████| 19/19 [00:00<00:00, 70.38it/s]
Epoch 151, Train Loss: 0.0477
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.93it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.51it/s]
100%|██████████| 19/19 [00:00<00:00, 72.27it/s]
Epoch 152, Train Loss: 0.0471
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.81it/s]
100%|██████████| 19/19 [00:00<00:00, 113.83it/s]
Epoch 153, Train Loss: 0.0466
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.34it/s]
Epoch 154, Train Loss: 0.0461
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.36it/s]
Epoch 155, Train Loss: 0.0454
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.40it/s]
Epoch 156, Train Loss: 0.0450
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.53it/s]
Epoch 157, Train Loss: 0.0443
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.11it/s]
Epoch 158, Train Loss: 0.0438
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.00it/s]
Epoch 159, Train Loss: 0.0433
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.92it/s]
Epoch 160, Train Loss: 0.0428
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.61it/s]
Epoch 161, Train Loss: 0.0423
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.68it/s]
Epoch 162, Train Loss: 0.0419
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 136.91it/s]
100%|██████████| 19/19 [00:00<00:00, 116.76it/s]
Epoch 163, Train Loss: 0.0412
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 83.61it/s]
95%|█████████▍| 18/19 [00:00<00:00, 78.19it/s]
100%|██████████| 19/19 [00:00<00:00, 78.39it/s]
Epoch 164, Train Loss: 0.0408
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.94it/s]
74%|███████▎ | 14/19 [00:00<00:00, 68.19it/s]
100%|██████████| 19/19 [00:00<00:00, 67.66it/s]
Epoch 165, Train Loss: 0.0404
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.92it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.96it/s]
100%|██████████| 19/19 [00:00<00:00, 70.32it/s]
Epoch 166, Train Loss: 0.0400
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 62.88it/s]
74%|███████▎ | 14/19 [00:00<00:00, 64.92it/s]
100%|██████████| 19/19 [00:00<00:00, 69.41it/s]
Epoch 167, Train Loss: 0.0396
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 65.95it/s]
74%|███████▎ | 14/19 [00:00<00:00, 64.73it/s]
100%|██████████| 19/19 [00:00<00:00, 67.06it/s]
Epoch 168, Train Loss: 0.0392
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.92it/s]
95%|█████████▍| 18/19 [00:00<00:00, 79.12it/s]
100%|██████████| 19/19 [00:00<00:00, 80.09it/s]
Epoch 169, Train Loss: 0.0385
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.90it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.19it/s]
100%|██████████| 19/19 [00:00<00:00, 67.05it/s]
Epoch 170, Train Loss: 0.0380
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.46it/s]
100%|██████████| 19/19 [00:00<00:00, 107.99it/s]
Epoch 171, Train Loss: 0.0377
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.00it/s]
100%|██████████| 19/19 [00:00<00:00, 122.79it/s]
Epoch 172, Train Loss: 0.0371
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.95it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.02it/s]
100%|██████████| 19/19 [00:00<00:00, 73.80it/s]
Epoch 173, Train Loss: 0.0369
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.41it/s]
100%|██████████| 19/19 [00:00<00:00, 95.33it/s]
Epoch 174, Train Loss: 0.0365
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 115.98it/s]
100%|██████████| 19/19 [00:00<00:00, 104.95it/s]
Epoch 175, Train Loss: 0.0360
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.10it/s]
74%|███████▎ | 14/19 [00:00<00:00, 65.32it/s]
100%|██████████| 19/19 [00:00<00:00, 67.66it/s]
Epoch 176, Train Loss: 0.0356
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.17it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.72it/s]
100%|██████████| 19/19 [00:00<00:00, 70.59it/s]
Epoch 177, Train Loss: 0.0351
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.66it/s]
100%|██████████| 19/19 [00:00<00:00, 126.80it/s]
Epoch 178, Train Loss: 0.0346
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 202.79it/s]
Epoch 179, Train Loss: 0.0343
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.06it/s]
100%|██████████| 19/19 [00:00<00:00, 85.70it/s]
Epoch 180, Train Loss: 0.0338
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 173.19it/s]
100%|██████████| 19/19 [00:00<00:00, 167.42it/s]
Epoch 181, Train Loss: 0.0335
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 163.23it/s]
100%|██████████| 19/19 [00:00<00:00, 161.38it/s]
Epoch 182, Train Loss: 0.0331
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 66.88it/s]
79%|███████▉ | 15/19 [00:00<00:00, 69.62it/s]
100%|██████████| 19/19 [00:00<00:00, 68.07it/s]
Epoch 183, Train Loss: 0.0326
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.75it/s]
100%|██████████| 19/19 [00:00<00:00, 89.42it/s]
Epoch 184, Train Loss: 0.0323
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.52it/s]
Epoch 185, Train Loss: 0.0317
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.30it/s]
Epoch 186, Train Loss: 0.0313
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.66it/s]
Epoch 187, Train Loss: 0.0310
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.04it/s]
Epoch 188, Train Loss: 0.0304
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.78it/s]
100%|██████████| 19/19 [00:00<00:00, 85.04it/s]
Epoch 189, Train Loss: 0.0299
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 143.93it/s]
100%|██████████| 19/19 [00:00<00:00, 151.53it/s]
Epoch 190, Train Loss: 0.0294
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.39it/s]
Epoch 191, Train Loss: 0.0288
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.99it/s]
Epoch 192, Train Loss: 0.0283
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.70it/s]
Epoch 193, Train Loss: 0.0277
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 89.17it/s]
100%|██████████| 19/19 [00:00<00:00, 80.29it/s]
100%|██████████| 19/19 [00:00<00:00, 80.99it/s]
Epoch 194, Train Loss: 0.0272
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.59it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.25it/s]
100%|██████████| 19/19 [00:00<00:00, 67.26it/s]
Epoch 195, Train Loss: 0.0269
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 62.58it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.52it/s]
100%|██████████| 19/19 [00:00<00:00, 66.47it/s]
Epoch 196, Train Loss: 0.0263
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.82it/s]
79%|███████▉ | 15/19 [00:00<00:00, 69.02it/s]
100%|██████████| 19/19 [00:00<00:00, 68.03it/s]
Epoch 197, Train Loss: 0.0259
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.45it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.99it/s]
100%|██████████| 19/19 [00:00<00:00, 71.66it/s]
Epoch 198, Train Loss: 0.0255
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.64it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.90it/s]
100%|██████████| 19/19 [00:00<00:00, 72.63it/s]
Epoch 199, Train Loss: 0.0252
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.54it/s]
100%|██████████| 19/19 [00:00<00:00, 98.92it/s]
Epoch 200, Train Loss: 2.6322
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 186.03it/s]
100%|██████████| 19/19 [00:00<00:00, 184.84it/s]
Epoch 201, Train Loss: 1.1233
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.93it/s]
Epoch 202, Train Loss: 0.7742
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 143.35it/s]
100%|██████████| 19/19 [00:00<00:00, 152.46it/s]
Epoch 203, Train Loss: 0.6060
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.41it/s]
Epoch 204, Train Loss: 0.5094
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.46it/s]
Epoch 205, Train Loss: 0.4462
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 79.70it/s]
84%|████████▍ | 16/19 [00:00<00:00, 78.21it/s]
100%|██████████| 19/19 [00:00<00:00, 78.91it/s]
Epoch 206, Train Loss: 0.4063
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.71it/s]
100%|██████████| 19/19 [00:00<00:00, 90.08it/s]
Epoch 207, Train Loss: 0.3747
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 197.46it/s]
Epoch 208, Train Loss: 0.3496
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 137.70it/s]
100%|██████████| 19/19 [00:00<00:00, 123.23it/s]
Epoch 209, Train Loss: 0.3333
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.84it/s]
100%|██████████| 19/19 [00:00<00:00, 120.27it/s]
Epoch 210, Train Loss: 0.3203
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.61it/s]
Epoch 211, Train Loss: 0.3077
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 109.62it/s]
100%|██████████| 19/19 [00:00<00:00, 108.93it/s]
Epoch 212, Train Loss: 0.3000
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.41it/s]
Epoch 213, Train Loss: 0.2910
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.98it/s]
Epoch 214, Train Loss: 0.2819
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.51it/s]
100%|██████████| 19/19 [00:00<00:00, 89.72it/s]
Epoch 215, Train Loss: 0.2749
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 108.26it/s]
100%|██████████| 19/19 [00:00<00:00, 132.57it/s]
Epoch 216, Train Loss: 0.2684
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.10it/s]
Epoch 217, Train Loss: 0.2664
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.91it/s]
Epoch 218, Train Loss: 0.2622
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.37it/s]
100%|██████████| 19/19 [00:00<00:00, 98.38it/s]
Epoch 219, Train Loss: 0.2600
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.27it/s]
100%|██████████| 19/19 [00:00<00:00, 105.76it/s]
Epoch 220, Train Loss: 0.2551
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.26it/s]
Epoch 221, Train Loss: 0.2516
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 135.09it/s]
100%|██████████| 19/19 [00:00<00:00, 143.53it/s]
Epoch 222, Train Loss: 0.2482
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.70it/s]
Epoch 223, Train Loss: 0.2441
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.22it/s]
Epoch 224, Train Loss: 0.2412
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 93.65it/s]
100%|██████████| 19/19 [00:00<00:00, 78.17it/s]
Epoch 225, Train Loss: 0.2382
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.27it/s]
100%|██████████| 19/19 [00:00<00:00, 92.35it/s]
Epoch 226, Train Loss: 0.2361
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.78it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.52it/s]
100%|██████████| 19/19 [00:00<00:00, 70.66it/s]
Epoch 227, Train Loss: 0.2343
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.27it/s]
84%|████████▍ | 16/19 [00:00<00:00, 66.92it/s]
100%|██████████| 19/19 [00:00<00:00, 66.69it/s]
Epoch 228, Train Loss: 0.2323
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.98it/s]
79%|███████▉ | 15/19 [00:00<00:00, 72.46it/s]
100%|██████████| 19/19 [00:00<00:00, 70.22it/s]
Epoch 229, Train Loss: 0.2304
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.32it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.64it/s]
100%|██████████| 19/19 [00:00<00:00, 69.23it/s]
Epoch 230, Train Loss: 0.2305
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.52it/s]
100%|██████████| 19/19 [00:00<00:00, 115.63it/s]
Epoch 231, Train Loss: 0.2264
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 107.57it/s]
100%|██████████| 19/19 [00:00<00:00, 98.38it/s]
Epoch 232, Train Loss: 0.2256
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.39it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.32it/s]
100%|██████████| 19/19 [00:00<00:00, 70.07it/s]
Epoch 233, Train Loss: 0.2229
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.26it/s]
74%|███████▎ | 14/19 [00:00<00:00, 65.35it/s]
100%|██████████| 19/19 [00:00<00:00, 69.32it/s]
Epoch 234, Train Loss: 0.2220
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 109.16it/s]
100%|██████████| 19/19 [00:00<00:00, 131.89it/s]
Epoch 235, Train Loss: 0.2192
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.79it/s]
100%|██████████| 19/19 [00:00<00:00, 104.00it/s]
Epoch 236, Train Loss: 0.2173
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 195.55it/s]
Epoch 237, Train Loss: 0.2159
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 150.04it/s]
100%|██████████| 19/19 [00:00<00:00, 134.41it/s]
Epoch 238, Train Loss: 0.2162
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 157.30it/s]
100%|██████████| 19/19 [00:00<00:00, 162.25it/s]
Epoch 239, Train Loss: 0.2119
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.16it/s]
100%|██████████| 19/19 [00:00<00:00, 81.77it/s]
Epoch 240, Train Loss: 0.2105
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.47it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.91it/s]
100%|██████████| 19/19 [00:00<00:00, 70.88it/s]
Epoch 241, Train Loss: 0.2092
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.25it/s]
84%|████████▍ | 16/19 [00:00<00:00, 70.18it/s]
100%|██████████| 19/19 [00:00<00:00, 70.09it/s]
Epoch 242, Train Loss: 0.2083
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.52it/s]
95%|█████████▍| 18/19 [00:00<00:00, 88.37it/s]
100%|██████████| 19/19 [00:00<00:00, 88.42it/s]
Epoch 243, Train Loss: 0.2080
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.89it/s]
95%|█████████▍| 18/19 [00:00<00:00, 87.50it/s]
100%|██████████| 19/19 [00:00<00:00, 87.08it/s]
Epoch 244, Train Loss: 0.2048
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 198.85it/s]
Epoch 245, Train Loss: 0.2044
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.76it/s]
95%|█████████▍| 18/19 [00:00<00:00, 79.28it/s]
100%|██████████| 19/19 [00:00<00:00, 79.85it/s]
Epoch 246, Train Loss: 0.1998
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.57it/s]
89%|████████▉ | 17/19 [00:00<00:00, 84.65it/s]
100%|██████████| 19/19 [00:00<00:00, 87.95it/s]
Epoch 247, Train Loss: 0.1961
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 195.21it/s]
Epoch 248, Train Loss: 0.1948
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 202.69it/s]
Epoch 249, Train Loss: 0.1931
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.17it/s]
Epoch 250, Train Loss: 0.1918
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.41it/s]
Epoch 251, Train Loss: 0.1872
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 86.43it/s]
100%|██████████| 19/19 [00:00<00:00, 93.91it/s]
Epoch 252, Train Loss: 0.1866
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.75it/s]
100%|██████████| 19/19 [00:00<00:00, 121.30it/s]
Epoch 253, Train Loss: 0.1848
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.77it/s]
100%|██████████| 19/19 [00:00<00:00, 102.77it/s]
Epoch 254, Train Loss: 0.1814
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 64.23it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.23it/s]
100%|██████████| 19/19 [00:00<00:00, 66.23it/s]
Epoch 255, Train Loss: 0.1800
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.64it/s]
79%|███████▉ | 15/19 [00:00<00:00, 72.39it/s]
100%|██████████| 19/19 [00:00<00:00, 80.75it/s]
Epoch 256, Train Loss: 0.1773
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.52it/s]
Epoch 257, Train Loss: 0.1760
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.47it/s]
Epoch 258, Train Loss: 0.1761
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.31it/s]
Epoch 259, Train Loss: 0.1731
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.60it/s]
Epoch 260, Train Loss: 0.1726
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.58it/s]
Epoch 261, Train Loss: 0.1695
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.95it/s]
Epoch 262, Train Loss: 0.1688
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.02it/s]
Epoch 263, Train Loss: 0.1689
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.31it/s]
Epoch 264, Train Loss: 0.1662
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.46it/s]
Epoch 265, Train Loss: 0.1656
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.11it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.54it/s]
100%|██████████| 19/19 [00:00<00:00, 72.96it/s]
Epoch 266, Train Loss: 0.1650
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.81it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.41it/s]
100%|██████████| 19/19 [00:00<00:00, 74.65it/s]
Epoch 267, Train Loss: 0.1628
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.67it/s]
100%|██████████| 19/19 [00:00<00:00, 95.99it/s]
Epoch 268, Train Loss: 0.1596
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 80.81it/s]
95%|█████████▍| 18/19 [00:00<00:00, 71.88it/s]
100%|██████████| 19/19 [00:00<00:00, 71.84it/s]
Epoch 269, Train Loss: 0.1605
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.52it/s]
100%|██████████| 19/19 [00:00<00:00, 115.41it/s]
Epoch 270, Train Loss: 0.1604
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 99.68it/s]
100%|██████████| 19/19 [00:00<00:00, 85.01it/s]
Epoch 271, Train Loss: 0.1586
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.20it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.74it/s]
100%|██████████| 19/19 [00:00<00:00, 71.14it/s]
Epoch 272, Train Loss: 0.1576
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 157.04it/s]
100%|██████████| 19/19 [00:00<00:00, 161.00it/s]
Epoch 273, Train Loss: 0.1574
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.69it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.14it/s]
100%|██████████| 19/19 [00:00<00:00, 76.20it/s]
Epoch 274, Train Loss: 0.1551
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 123.95it/s]
100%|██████████| 19/19 [00:00<00:00, 123.55it/s]
Epoch 275, Train Loss: 0.1546
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 84.31it/s]
95%|█████████▍| 18/19 [00:00<00:00, 75.55it/s]
100%|██████████| 19/19 [00:00<00:00, 77.61it/s]
Epoch 276, Train Loss: 0.1519
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 100.25it/s]
100%|██████████| 19/19 [00:00<00:00, 82.72it/s]
Epoch 277, Train Loss: 0.1517
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 134.87it/s]
100%|██████████| 19/19 [00:00<00:00, 145.97it/s]
Epoch 278, Train Loss: 0.1516
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.78it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.96it/s]
100%|██████████| 19/19 [00:00<00:00, 74.20it/s]
Epoch 279, Train Loss: 0.1505
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 126.39it/s]
100%|██████████| 19/19 [00:00<00:00, 141.34it/s]
Epoch 280, Train Loss: 0.1487
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 105.34it/s]
100%|██████████| 19/19 [00:00<00:00, 130.33it/s]
Epoch 281, Train Loss: 0.1471
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.98it/s]
Epoch 282, Train Loss: 0.1471
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.56it/s]
95%|█████████▍| 18/19 [00:00<00:00, 77.91it/s]
100%|██████████| 19/19 [00:00<00:00, 77.48it/s]
Epoch 283, Train Loss: 0.1454
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 67.99it/s]
74%|███████▎ | 14/19 [00:00<00:00, 67.68it/s]
100%|██████████| 19/19 [00:00<00:00, 67.66it/s]
Epoch 284, Train Loss: 0.1456
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 137.65it/s]
100%|██████████| 19/19 [00:00<00:00, 116.82it/s]
Epoch 285, Train Loss: 0.1456
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 65.51it/s]
79%|███████▉ | 15/19 [00:00<00:00, 69.79it/s]
100%|██████████| 19/19 [00:00<00:00, 68.40it/s]
Epoch 286, Train Loss: 0.1437
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.99it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.28it/s]
100%|██████████| 19/19 [00:00<00:00, 71.57it/s]
Epoch 287, Train Loss: 0.1445
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.55it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.31it/s]
100%|██████████| 19/19 [00:00<00:00, 67.41it/s]
Epoch 288, Train Loss: 0.1416
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.60it/s]
100%|██████████| 19/19 [00:00<00:00, 114.06it/s]
Epoch 289, Train Loss: 0.1420
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 78.40it/s]
100%|██████████| 19/19 [00:00<00:00, 105.13it/s]
Epoch 290, Train Loss: 0.1412
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.74it/s]
Epoch 291, Train Loss: 0.1399
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.53it/s]
Epoch 292, Train Loss: 0.1397
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.43it/s]
95%|█████████▍| 18/19 [00:00<00:00, 76.01it/s]
100%|██████████| 19/19 [00:00<00:00, 76.64it/s]
Epoch 293, Train Loss: 0.1396
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 159.68it/s]
100%|██████████| 19/19 [00:00<00:00, 162.40it/s]
Epoch 294, Train Loss: 0.1387
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.10it/s]
Epoch 295, Train Loss: 0.1358
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.15it/s]
Epoch 296, Train Loss: 0.1365
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 201.53it/s]
Epoch 297, Train Loss: 0.1358
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.77it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.31it/s]
100%|██████████| 19/19 [00:00<00:00, 78.63it/s]
Epoch 298, Train Loss: 0.1359
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.93it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.44it/s]
100%|██████████| 19/19 [00:00<00:00, 71.15it/s]
Epoch 299, Train Loss: 0.1344
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.20it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.32it/s]
100%|██████████| 19/19 [00:00<00:00, 67.79it/s]
Epoch 300, Train Loss: 0.1889
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 66.25it/s]
100%|██████████| 19/19 [00:00<00:00, 104.96it/s]
Epoch 301, Train Loss: 0.1851
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 198.73it/s]
Epoch 302, Train Loss: 0.1802
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.89it/s]
Epoch 303, Train Loss: 0.1783
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.32it/s]
Epoch 304, Train Loss: 0.1761
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.70it/s]
Epoch 305, Train Loss: 0.1763
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.72it/s]
Epoch 306, Train Loss: 0.1758
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.97it/s]
100%|██████████| 19/19 [00:00<00:00, 91.08it/s]
Epoch 307, Train Loss: 0.1750
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.34it/s]
100%|██████████| 19/19 [00:00<00:00, 112.47it/s]
Epoch 308, Train Loss: 0.1740
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.40it/s]
Epoch 309, Train Loss: 0.1726
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.61it/s]
Epoch 310, Train Loss: 0.1718
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.90it/s]
Epoch 311, Train Loss: 0.1701
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.18it/s]
Epoch 312, Train Loss: 0.1695
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.96it/s]
Epoch 313, Train Loss: 0.1697
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.27it/s]
Epoch 314, Train Loss: 0.1684
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.89it/s]
Epoch 315, Train Loss: 0.1692
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.59it/s]
Epoch 316, Train Loss: 0.1662
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.44it/s]
Epoch 317, Train Loss: 0.1671
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 219.10it/s]
Epoch 318, Train Loss: 0.1658
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.95it/s]
Epoch 319, Train Loss: 0.1656
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.97it/s]
Epoch 320, Train Loss: 0.1645
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.62it/s]
Epoch 321, Train Loss: 0.1632
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 188.30it/s]
100%|██████████| 19/19 [00:00<00:00, 187.15it/s]
Epoch 322, Train Loss: 0.1640
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.76it/s]
Epoch 323, Train Loss: 0.1643
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.67it/s]
Epoch 324, Train Loss: 0.1619
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.15it/s]
Epoch 325, Train Loss: 0.1622
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.00it/s]
Epoch 326, Train Loss: 0.1604
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 198.42it/s]
Epoch 327, Train Loss: 0.1609
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.29it/s]
Epoch 328, Train Loss: 0.1578
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.99it/s]
Epoch 329, Train Loss: 0.1584
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.70it/s]
Epoch 330, Train Loss: 0.1570
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.73it/s]
Epoch 331, Train Loss: 0.1574
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.96it/s]
Epoch 332, Train Loss: 0.1589
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.34it/s]
Epoch 333, Train Loss: 0.1566
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.74it/s]
Epoch 334, Train Loss: 0.1547
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.45it/s]
Epoch 335, Train Loss: 0.1551
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.81it/s]
Epoch 336, Train Loss: 0.1538
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.62it/s]
Epoch 337, Train Loss: 0.1532
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.24it/s]
Epoch 338, Train Loss: 0.1512
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.67it/s]
Epoch 339, Train Loss: 0.1527
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.60it/s]
Epoch 340, Train Loss: 0.1517
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.71it/s]
Epoch 341, Train Loss: 0.1502
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.89it/s]
Epoch 342, Train Loss: 0.1514
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 173.95it/s]
100%|██████████| 19/19 [00:00<00:00, 171.98it/s]
Epoch 343, Train Loss: 0.1496
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.94it/s]
95%|█████████▍| 18/19 [00:00<00:00, 75.22it/s]
100%|██████████| 19/19 [00:00<00:00, 74.08it/s]
Epoch 344, Train Loss: 0.1487
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 116.65it/s]
100%|██████████| 19/19 [00:00<00:00, 131.87it/s]
Epoch 345, Train Loss: 0.1490
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.07it/s]
Epoch 346, Train Loss: 0.1486
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 95.15it/s]
100%|██████████| 19/19 [00:00<00:00, 85.32it/s]
Epoch 347, Train Loss: 0.1487
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.87it/s]
100%|██████████| 19/19 [00:00<00:00, 100.87it/s]
Epoch 348, Train Loss: 0.1464
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 199.21it/s]
Epoch 349, Train Loss: 0.1461
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.24it/s]
Epoch 350, Train Loss: 0.1442
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 115.39it/s]
100%|██████████| 19/19 [00:00<00:00, 97.62it/s]
Epoch 351, Train Loss: 0.1460
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.95it/s]
84%|████████▍ | 16/19 [00:00<00:00, 68.63it/s]
100%|██████████| 19/19 [00:00<00:00, 68.27it/s]
Epoch 352, Train Loss: 0.1443
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.75it/s]
84%|████████▍ | 16/19 [00:00<00:00, 69.38it/s]
100%|██████████| 19/19 [00:00<00:00, 69.70it/s]
Epoch 353, Train Loss: 0.1434
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.29it/s]
84%|████████▍ | 16/19 [00:00<00:00, 79.00it/s]
100%|██████████| 19/19 [00:00<00:00, 76.96it/s]
Epoch 354, Train Loss: 0.1424
.............................
0%| | 0/19 [00:00<?, ?it/s]
74%|███████▎ | 14/19 [00:00<00:00, 136.59it/s]
100%|██████████| 19/19 [00:00<00:00, 143.59it/s]
Epoch 355, Train Loss: 0.1425
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.39it/s]
Epoch 356, Train Loss: 0.1416
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.88it/s]
Epoch 357, Train Loss: 0.1415
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 113.42it/s]
100%|██████████| 19/19 [00:00<00:00, 135.36it/s]
Epoch 358, Train Loss: 0.1415
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.05it/s]
Epoch 359, Train Loss: 0.1396
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.76it/s]
Epoch 360, Train Loss: 0.1393
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.91it/s]
Epoch 361, Train Loss: 0.1385
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.14it/s]
Epoch 362, Train Loss: 0.1380
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.36it/s]
Epoch 363, Train Loss: 0.1375
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.77it/s]
Epoch 364, Train Loss: 0.1375
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.41it/s]
Epoch 365, Train Loss: 0.1364
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.61it/s]
Epoch 366, Train Loss: 0.1376
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.65it/s]
Epoch 367, Train Loss: 0.1352
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.45it/s]
Epoch 368, Train Loss: 0.1359
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.29it/s]
Epoch 369, Train Loss: 0.1349
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.11it/s]
Epoch 370, Train Loss: 0.1338
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.66it/s]
Epoch 371, Train Loss: 0.1351
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.65it/s]
95%|█████████▍| 18/19 [00:00<00:00, 78.87it/s]
100%|██████████| 19/19 [00:00<00:00, 79.11it/s]
Epoch 372, Train Loss: 0.1314
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.04it/s]
74%|███████▎ | 14/19 [00:00<00:00, 68.06it/s]
100%|██████████| 19/19 [00:00<00:00, 68.90it/s]
Epoch 373, Train Loss: 0.1329
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 65.56it/s]
79%|███████▉ | 15/19 [00:00<00:00, 70.85it/s]
100%|██████████| 19/19 [00:00<00:00, 73.79it/s]
Epoch 374, Train Loss: 0.1301
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 169.59it/s]
100%|██████████| 19/19 [00:00<00:00, 169.43it/s]
Epoch 375, Train Loss: 0.1310
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.37it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.53it/s]
100%|██████████| 19/19 [00:00<00:00, 72.83it/s]
Epoch 376, Train Loss: 0.1290
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.07it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.62it/s]
100%|██████████| 19/19 [00:00<00:00, 72.86it/s]
Epoch 377, Train Loss: 0.1294
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.07it/s]
100%|██████████| 19/19 [00:00<00:00, 98.90it/s]
Epoch 378, Train Loss: 0.1295
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.31it/s]
Epoch 379, Train Loss: 0.1274
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.23it/s]
Epoch 380, Train Loss: 0.1273
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.88it/s]
Epoch 381, Train Loss: 0.1273
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.40it/s]
Epoch 382, Train Loss: 0.1276
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 146.51it/s]
100%|██████████| 19/19 [00:00<00:00, 128.56it/s]
Epoch 383, Train Loss: 0.1254
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.74it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.78it/s]
100%|██████████| 19/19 [00:00<00:00, 80.66it/s]
Epoch 384, Train Loss: 0.1260
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 77.42it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.00it/s]
100%|██████████| 19/19 [00:00<00:00, 70.83it/s]
Epoch 385, Train Loss: 0.1256
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 64.47it/s]
79%|███████▉ | 15/19 [00:00<00:00, 69.25it/s]
100%|██████████| 19/19 [00:00<00:00, 69.12it/s]
Epoch 386, Train Loss: 0.1243
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 66.66it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.37it/s]
100%|██████████| 19/19 [00:00<00:00, 66.39it/s]
Epoch 387, Train Loss: 0.1237
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 70.08it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.07it/s]
100%|██████████| 19/19 [00:00<00:00, 71.63it/s]
Epoch 388, Train Loss: 0.1233
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 65.32it/s]
79%|███████▉ | 15/19 [00:00<00:00, 71.53it/s]
100%|██████████| 19/19 [00:00<00:00, 70.38it/s]
Epoch 389, Train Loss: 0.1233
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.17it/s]
84%|████████▍ | 16/19 [00:00<00:00, 69.10it/s]
100%|██████████| 19/19 [00:00<00:00, 69.31it/s]
Epoch 390, Train Loss: 0.1211
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.80it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.02it/s]
100%|██████████| 19/19 [00:00<00:00, 73.44it/s]
Epoch 391, Train Loss: 0.1215
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 176.13it/s]
100%|██████████| 19/19 [00:00<00:00, 165.88it/s]
Epoch 392, Train Loss: 0.1208
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.00it/s]
84%|████████▍ | 16/19 [00:00<00:00, 75.45it/s]
100%|██████████| 19/19 [00:00<00:00, 74.38it/s]
Epoch 393, Train Loss: 0.1209
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.53it/s]
84%|████████▍ | 16/19 [00:00<00:00, 72.99it/s]
100%|██████████| 19/19 [00:00<00:00, 73.23it/s]
Epoch 394, Train Loss: 0.1203
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.37it/s]
84%|████████▍ | 16/19 [00:00<00:00, 74.12it/s]
100%|██████████| 19/19 [00:00<00:00, 72.76it/s]
Epoch 395, Train Loss: 0.1189
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 78.79it/s]
89%|████████▉ | 17/19 [00:00<00:00, 71.43it/s]
100%|██████████| 19/19 [00:00<00:00, 72.74it/s]
Epoch 396, Train Loss: 0.1182
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.91it/s]
79%|███████▉ | 15/19 [00:00<00:00, 70.89it/s]
100%|██████████| 19/19 [00:00<00:00, 71.79it/s]
Epoch 397, Train Loss: 0.1194
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 102.98it/s]
100%|██████████| 19/19 [00:00<00:00, 101.96it/s]
Epoch 398, Train Loss: 0.1184
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.95it/s]
89%|████████▉ | 17/19 [00:00<00:00, 82.38it/s]
100%|██████████| 19/19 [00:00<00:00, 80.37it/s]
Epoch 399, Train Loss: 0.1178
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.96it/s]
84%|████████▍ | 16/19 [00:00<00:00, 77.68it/s]
100%|██████████| 19/19 [00:00<00:00, 76.74it/s]
Epoch 400, Train Loss: 0.1453
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.43it/s]
89%|████████▉ | 17/19 [00:00<00:00, 81.76it/s]
100%|██████████| 19/19 [00:00<00:00, 80.81it/s]
Epoch 401, Train Loss: 0.1418
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.78it/s]
100%|██████████| 19/19 [00:00<00:00, 88.84it/s]
100%|██████████| 19/19 [00:00<00:00, 88.19it/s]
Epoch 402, Train Loss: 0.1407
.............................
0%| | 0/19 [00:00<?, ?it/s]
63%|██████▎ | 12/19 [00:00<00:00, 119.76it/s]
100%|██████████| 19/19 [00:00<00:00, 107.73it/s]
Epoch 403, Train Loss: 0.1399
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.19it/s]
100%|██████████| 19/19 [00:00<00:00, 91.37it/s]
Epoch 404, Train Loss: 0.1398
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 158.49it/s]
100%|██████████| 19/19 [00:00<00:00, 140.87it/s]
Epoch 405, Train Loss: 0.1390
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 90.50it/s]
100%|██████████| 19/19 [00:00<00:00, 79.67it/s]
Epoch 406, Train Loss: 0.1379
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.67it/s]
100%|██████████| 19/19 [00:00<00:00, 122.22it/s]
Epoch 407, Train Loss: 0.1374
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 87.80it/s]
100%|██████████| 19/19 [00:00<00:00, 110.80it/s]
Epoch 408, Train Loss: 0.1377
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 104.64it/s]
100%|██████████| 19/19 [00:00<00:00, 113.84it/s]
Epoch 409, Train Loss: 0.1362
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 196.51it/s]
Epoch 410, Train Loss: 0.1358
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.25it/s]
Epoch 411, Train Loss: 0.1376
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.67it/s]
Epoch 412, Train Loss: 0.1349
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.70it/s]
Epoch 413, Train Loss: 0.1341
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.73it/s]
Epoch 414, Train Loss: 0.1340
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.11it/s]
Epoch 415, Train Loss: 0.1327
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.81it/s]
Epoch 416, Train Loss: 0.1327
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.58it/s]
Epoch 417, Train Loss: 0.1319
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.33it/s]
Epoch 418, Train Loss: 0.1308
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 205.59it/s]
Epoch 419, Train Loss: 0.1303
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.08it/s]
Epoch 420, Train Loss: 0.1304
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.23it/s]
Epoch 421, Train Loss: 0.1294
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.77it/s]
Epoch 422, Train Loss: 0.1295
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.83it/s]
Epoch 423, Train Loss: 0.1284
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.98it/s]
Epoch 424, Train Loss: 0.1274
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 210.66it/s]
Epoch 425, Train Loss: 0.1277
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.22it/s]
Epoch 426, Train Loss: 0.1295
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.17it/s]
Epoch 427, Train Loss: 0.1276
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 217.78it/s]
Epoch 428, Train Loss: 0.1283
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.62it/s]
Epoch 429, Train Loss: 0.1277
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.19it/s]
Epoch 430, Train Loss: 0.1253
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 125.00it/s]
100%|██████████| 19/19 [00:00<00:00, 103.69it/s]
Epoch 431, Train Loss: 0.1275
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.22it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.58it/s]
100%|██████████| 19/19 [00:00<00:00, 68.64it/s]
Epoch 432, Train Loss: 0.1258
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 72.78it/s]
84%|████████▍ | 16/19 [00:00<00:00, 68.74it/s]
100%|██████████| 19/19 [00:00<00:00, 68.20it/s]
Epoch 433, Train Loss: 0.1272
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 65.68it/s]
74%|███████▎ | 14/19 [00:00<00:00, 67.21it/s]
100%|██████████| 19/19 [00:00<00:00, 76.49it/s]
Epoch 434, Train Loss: 0.1242
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 174.62it/s]
100%|██████████| 19/19 [00:00<00:00, 174.03it/s]
Epoch 435, Train Loss: 0.1248
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.86it/s]
Epoch 436, Train Loss: 0.1238
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 197.34it/s]
Epoch 437, Train Loss: 0.1249
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.55it/s]
100%|██████████| 19/19 [00:00<00:00, 128.16it/s]
Epoch 438, Train Loss: 0.1244
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 82.27it/s]
95%|█████████▍| 18/19 [00:00<00:00, 78.28it/s]
100%|██████████| 19/19 [00:00<00:00, 78.46it/s]
Epoch 439, Train Loss: 0.1226
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 74.05it/s]
84%|████████▍ | 16/19 [00:00<00:00, 71.14it/s]
100%|██████████| 19/19 [00:00<00:00, 70.90it/s]
Epoch 440, Train Loss: 0.1243
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 78.26it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.74it/s]
100%|██████████| 19/19 [00:00<00:00, 74.87it/s]
Epoch 441, Train Loss: 0.1234
.............................
0%| | 0/19 [00:00<?, ?it/s]
58%|█████▊ | 11/19 [00:00<00:00, 106.93it/s]
100%|██████████| 19/19 [00:00<00:00, 130.76it/s]
Epoch 442, Train Loss: 0.1216
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 178.85it/s]
100%|██████████| 19/19 [00:00<00:00, 178.49it/s]
Epoch 443, Train Loss: 0.1218
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.77it/s]
Epoch 444, Train Loss: 0.1216
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.75it/s]
Epoch 445, Train Loss: 0.1222
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.22it/s]
Epoch 446, Train Loss: 0.1210
.............................
0%| | 0/19 [00:00<?, ?it/s]
89%|████████▉ | 17/19 [00:00<00:00, 152.74it/s]
100%|██████████| 19/19 [00:00<00:00, 144.41it/s]
Epoch 447, Train Loss: 0.1207
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 204.19it/s]
Epoch 448, Train Loss: 0.1216
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.36it/s]
Epoch 449, Train Loss: 0.1206
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 185.32it/s]
100%|██████████| 19/19 [00:00<00:00, 183.88it/s]
Epoch 450, Train Loss: 0.1197
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 147.67it/s]
100%|██████████| 19/19 [00:00<00:00, 154.98it/s]
Epoch 451, Train Loss: 0.1203
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.43it/s]
Epoch 452, Train Loss: 0.1195
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 88.85it/s]
95%|█████████▍| 18/19 [00:00<00:00, 78.47it/s]
100%|██████████| 19/19 [00:00<00:00, 79.14it/s]
Epoch 453, Train Loss: 0.1200
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 68.64it/s]
79%|███████▉ | 15/19 [00:00<00:00, 70.36it/s]
100%|██████████| 19/19 [00:00<00:00, 69.72it/s]
Epoch 454, Train Loss: 0.1187
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 87.59it/s]
100%|██████████| 19/19 [00:00<00:00, 121.90it/s]
Epoch 455, Train Loss: 0.1174
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 187.74it/s]
100%|██████████| 19/19 [00:00<00:00, 186.11it/s]
Epoch 456, Train Loss: 0.1200
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.90it/s]
Epoch 457, Train Loss: 0.1187
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.52it/s]
Epoch 458, Train Loss: 0.1188
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 207.48it/s]
Epoch 459, Train Loss: 0.1187
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.53it/s]
Epoch 460, Train Loss: 0.1184
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.16it/s]
Epoch 461, Train Loss: 0.1176
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.79it/s]
Epoch 462, Train Loss: 0.1177
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.22it/s]
Epoch 463, Train Loss: 0.1186
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.09it/s]
Epoch 464, Train Loss: 0.1171
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 202.16it/s]
Epoch 465, Train Loss: 0.1169
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 92.88it/s]
100%|██████████| 19/19 [00:00<00:00, 88.14it/s]
Epoch 466, Train Loss: 0.1157
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.69it/s]
100%|██████████| 19/19 [00:00<00:00, 86.91it/s]
Epoch 467, Train Loss: 0.1169
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 73.59it/s]
100%|██████████| 19/19 [00:00<00:00, 101.03it/s]
Epoch 468, Train Loss: 0.1163
.............................
0%| | 0/19 [00:00<?, ?it/s]
95%|█████████▍| 18/19 [00:00<00:00, 172.38it/s]
100%|██████████| 19/19 [00:00<00:00, 168.20it/s]
Epoch 469, Train Loss: 0.1165
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 200.57it/s]
Epoch 470, Train Loss: 0.1167
.............................
0%| | 0/19 [00:00<?, ?it/s]
84%|████████▍ | 16/19 [00:00<00:00, 150.65it/s]
100%|██████████| 19/19 [00:00<00:00, 133.41it/s]
Epoch 471, Train Loss: 0.1170
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 99.67it/s]
100%|██████████| 19/19 [00:00<00:00, 86.91it/s]
Epoch 472, Train Loss: 0.1149
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 71.19it/s]
84%|████████▍ | 16/19 [00:00<00:00, 69.09it/s]
100%|██████████| 19/19 [00:00<00:00, 68.26it/s]
Epoch 473, Train Loss: 0.1152
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 69.17it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.16it/s]
100%|██████████| 19/19 [00:00<00:00, 71.22it/s]
Epoch 474, Train Loss: 0.1169
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 97.05it/s]
100%|██████████| 19/19 [00:00<00:00, 120.68it/s]
Epoch 475, Train Loss: 0.1158
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.52it/s]
Epoch 476, Train Loss: 0.1148
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 203.97it/s]
Epoch 477, Train Loss: 0.1152
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.21it/s]
Epoch 478, Train Loss: 0.1152
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 96.48it/s]
100%|██████████| 19/19 [00:00<00:00, 98.77it/s]
Epoch 479, Train Loss: 0.1147
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 75.25it/s]
84%|████████▍ | 16/19 [00:00<00:00, 76.91it/s]
100%|██████████| 19/19 [00:00<00:00, 74.65it/s]
Epoch 480, Train Loss: 0.1143
.............................
0%| | 0/19 [00:00<?, ?it/s]
37%|███▋ | 7/19 [00:00<00:00, 63.95it/s]
74%|███████▎ | 14/19 [00:00<00:00, 66.74it/s]
100%|██████████| 19/19 [00:00<00:00, 72.64it/s]
Epoch 481, Train Loss: 0.1151
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 187.45it/s]
100%|██████████| 19/19 [00:00<00:00, 185.45it/s]
Epoch 482, Train Loss: 0.1133
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 208.97it/s]
Epoch 483, Train Loss: 0.1152
.............................
0%| | 0/19 [00:00<?, ?it/s]
53%|█████▎ | 10/19 [00:00<00:00, 94.66it/s]
100%|██████████| 19/19 [00:00<00:00, 120.71it/s]
Epoch 484, Train Loss: 0.1144
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 206.50it/s]
Epoch 485, Train Loss: 0.1143
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 215.71it/s]
Epoch 486, Train Loss: 0.1132
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 216.51it/s]
Epoch 487, Train Loss: 0.1149
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 214.90it/s]
Epoch 488, Train Loss: 0.1129
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 213.31it/s]
Epoch 489, Train Loss: 0.1128
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 211.78it/s]
Epoch 490, Train Loss: 0.1123
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 191.45it/s]
Epoch 491, Train Loss: 0.1123
.............................
0%| | 0/19 [00:00<?, ?it/s]
47%|████▋ | 9/19 [00:00<00:00, 85.86it/s]
95%|█████████▍| 18/19 [00:00<00:00, 80.46it/s]
100%|██████████| 19/19 [00:00<00:00, 78.86it/s]
Epoch 492, Train Loss: 0.1129
.............................
0%| | 0/19 [00:00<?, ?it/s]
79%|███████▉ | 15/19 [00:00<00:00, 149.60it/s]
100%|██████████| 19/19 [00:00<00:00, 156.98it/s]
Epoch 493, Train Loss: 0.1128
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 185.33it/s]
100%|██████████| 19/19 [00:00<00:00, 183.56it/s]
Epoch 494, Train Loss: 0.1122
.............................
0%| | 0/19 [00:00<?, ?it/s]
68%|██████▊ | 13/19 [00:00<00:00, 123.81it/s]
100%|██████████| 19/19 [00:00<00:00, 103.69it/s]
Epoch 495, Train Loss: 0.1129
.............................
0%| | 0/19 [00:00<?, ?it/s]
42%|████▏ | 8/19 [00:00<00:00, 76.32it/s]
84%|████████▍ | 16/19 [00:00<00:00, 73.33it/s]
100%|██████████| 19/19 [00:00<00:00, 73.86it/s]
Epoch 496, Train Loss: 0.1124
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 187.53it/s]
100%|██████████| 19/19 [00:00<00:00, 186.44it/s]
Epoch 497, Train Loss: 0.1126
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 209.89it/s]
Epoch 498, Train Loss: 0.1108
.............................
0%| | 0/19 [00:00<?, ?it/s]
100%|██████████| 19/19 [00:00<00:00, 212.85it/s]
Epoch 499, Train Loss: 0.1119
.............................
Validation#
encoded_spectra, mn, sd = encoder(
torch.tensor(np.atleast_3d(dog_data), dtype=torch.float32).to(device)
)
decoded_spectra = decoder(encoded_spectra)
encoded_spectra = encoded_spectra.to("cpu")
encoded_spectra = encoded_spectra.detach().numpy()
decoded_spectra = decoded_spectra.to("cpu")
decoded_spectra = decoded_spectra.detach().numpy()
embeddings(encoded_spectra, shape_=image.shape[0:2], figsize=(15, 5))
latent_generator(decoder, encoded_spectra, image, 5, 10,
device=device, figsize=(15, 5), divider_=False, indx=[1, 3, 4])
disentanglement with \(\beta\) VAE requires careful control of optimiztion.