Lab12 - Redes Neurais - MLP
Desafio1¶
Calcule a saida do perceptron abaixo:
x0 = 2; x1 = 0; x2 = -1,24; bias = 1; w0 = 0; w1 = 2; w3 = 1; função de ativação = Heaviside
Resposta:¶
Implementação de uma rede perceptron¶
Vamos usar um framework de machine learnning chamado TensorFlow/keras para fazer esta implementação.
pip install tensorflow
In [2]:
Copied!
import tensorflow as tf
from tensorflow import keras
import tensorflow as tf
from tensorflow import keras
In [4]:
Copied!
from tensorflow.keras import layers
model = keras.Sequential([
layers.Dense(units=1, input_shape=[3])
])
model.summary()
from tensorflow.keras import layers
model = keras.Sequential([
layers.Dense(units=1, input_shape=[3])
])
model.summary()
Model: "sequential_1" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= dense_1 (Dense) (None, 1) 4 ================================================================= Total params: 4 Trainable params: 4 Non-trainable params: 0 _________________________________________________________________
Layers¶
O arranjo de neuronios define a quantidade de camadas ou layers que a rede neural possui na rede perceptron possui apenas uma camada. Em uma rede MLP (multlayer perceptron) possui além das camadas de entrada e saída, camadas ocultas ou hiden layers, essas redes tambem são conhecidas por redes densas ou fully-connected.
Funão de ativação¶
É basicamente uma função matematica que é responsavel por ativar ou não a saída do neuronio. Dentre as mais comuns se destaca a função ReLU (Rectifier linear unit)
Outras funções de ativação muito utilizadas são:
- softplus
- elu
- sigmoid
- tanh
In [15]:
Copied!
## Sua resposta aqui...
## Sua resposta aqui...
Backpropagation¶
Trata-se de uma técnica para realizar o ajuste dos pesos de uma rede neural. O objetivo de um rede neural é sempre minimar o seu erro, tendo a menor Losspara guiar o modelo para a direção certa.
A função Loss mede o quão boa estão as predições darede, para problemas de regressão são mais utilizados o MSE, ou MAE. Já par classifiação, são utlizados BCE.
Os algoritimos otimizadores são utilzados para ajustar os pesos das redes, o passo dado na descida do gradiente é chamada de taxa de aprendizado e mais utilizados são:
- SGD
- RMSprop
- Adam
- Adadelta
- Adagrad
- Adamax
- Nadam
- Ftrl
Cada iteração das amostras de treinamento é chamada de bach e uma rodada completa de treinamento é chamada de epoch. O numero
In [16]:
Copied!
model.compile(optimizer=tf.keras.optimizers.Adam(0.1), loss = 'mse')
model.compile(optimizer=tf.keras.optimizers.Adam(0.1), loss = 'mse')
In [49]:
Copied!
import pandas as pd
import numpy as np
df = pd.read_csv('SalesData.csv')
df.info()
X_train = df['Temperature']
y_train = df['Revenue']
import pandas as pd
import numpy as np
df = pd.read_csv('SalesData.csv')
df.info()
X_train = df['Temperature']
y_train = df['Revenue']
<class 'pandas.core.frame.DataFrame'> RangeIndex: 500 entries, 0 to 499 Data columns (total 2 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 Temperature 500 non-null float64 1 Revenue 500 non-null float64 dtypes: float64(2) memory usage: 7.9 KB
In [18]:
Copied!
import seaborn as sns
sns.scatterplot(X_train, y_train);
import seaborn as sns
sns.scatterplot(X_train, y_train);
/home/iot/.local/lib/python3.8/site-packages/seaborn/_decorators.py:36: FutureWarning: Pass the following variables as keyword args: x, y. From version 0.12, the only valid positional argument will be `data`, and passing other arguments without an explicit keyword will result in an error or misinterpretation. warnings.warn(
In [19]:
Copied!
epochs_hist = model.fit(X_train, y_train, epochs=1000)
epochs_hist = model.fit(X_train, y_train, epochs=1000)
Epoch 1/1000 16/16 [==============================] - 0s 600us/step - loss: 289600.4688 Epoch 2/1000 16/16 [==============================] - 0s 657us/step - loss: 249734.8125 Epoch 3/1000 16/16 [==============================] - 0s 581us/step - loss: 213406.7031 Epoch 4/1000 16/16 [==============================] - 0s 558us/step - loss: 181404.0625 Epoch 5/1000 16/16 [==============================] - 0s 541us/step - loss: 152917.0625 Epoch 6/1000 16/16 [==============================] - 0s 526us/step - loss: 128144.7344 Epoch 7/1000 16/16 [==============================] - 0s 586us/step - loss: 106522.3359 Epoch 8/1000 16/16 [==============================] - 0s 545us/step - loss: 88155.4062 Epoch 9/1000 16/16 [==============================] - 0s 578us/step - loss: 72225.1328 Epoch 10/1000 16/16 [==============================] - 0s 615us/step - loss: 58770.3984 Epoch 11/1000 16/16 [==============================] - 0s 598us/step - loss: 47678.9727 Epoch 12/1000 16/16 [==============================] - 0s 555us/step - loss: 38084.4336 Epoch 13/1000 16/16 [==============================] - 0s 564us/step - loss: 30406.3457 Epoch 14/1000 16/16 [==============================] - 0s 559us/step - loss: 24076.0996 Epoch 15/1000 16/16 [==============================] - 0s 596us/step - loss: 18817.1504 Epoch 16/1000 16/16 [==============================] - 0s 566us/step - loss: 14760.2344 Epoch 17/1000 16/16 [==============================] - 0s 546us/step - loss: 11419.9512 Epoch 18/1000 16/16 [==============================] - 0s 623us/step - loss: 8838.6602 Epoch 19/1000 16/16 [==============================] - 0s 623us/step - loss: 6814.2100 Epoch 20/1000 16/16 [==============================] - 0s 587us/step - loss: 5248.8560 Epoch 21/1000 16/16 [==============================] - 0s 557us/step - loss: 4059.1125 Epoch 22/1000 16/16 [==============================] - 0s 508us/step - loss: 3133.6096 Epoch 23/1000 16/16 [==============================] - 0s 594us/step - loss: 2466.8081 Epoch 24/1000 16/16 [==============================] - 0s 513us/step - loss: 1953.2614 Epoch 25/1000 16/16 [==============================] - 0s 571us/step - loss: 1590.7760 Epoch 26/1000 16/16 [==============================] - 0s 607us/step - loss: 1322.6981 Epoch 27/1000 16/16 [==============================] - 0s 515us/step - loss: 1125.4635 Epoch 28/1000 16/16 [==============================] - 0s 670us/step - loss: 989.6883 Epoch 29/1000 16/16 [==============================] - 0s 573us/step - loss: 890.3770 Epoch 30/1000 16/16 [==============================] - 0s 542us/step - loss: 822.1512 Epoch 31/1000 16/16 [==============================] - 0s 604us/step - loss: 774.1565 Epoch 32/1000 16/16 [==============================] - 0s 606us/step - loss: 742.8004 Epoch 33/1000 16/16 [==============================] - 0s 579us/step - loss: 721.1259 Epoch 34/1000 16/16 [==============================] - 0s 617us/step - loss: 706.8210 Epoch 35/1000 16/16 [==============================] - 0s 530us/step - loss: 695.9993 Epoch 36/1000 16/16 [==============================] - 0s 577us/step - loss: 690.2024 Epoch 37/1000 16/16 [==============================] - 0s 570us/step - loss: 685.8608 Epoch 38/1000 16/16 [==============================] - 0s 583us/step - loss: 682.8726 Epoch 39/1000 16/16 [==============================] - 0s 574us/step - loss: 681.2815 Epoch 40/1000 16/16 [==============================] - 0s 564us/step - loss: 679.9489 Epoch 41/1000 16/16 [==============================] - 0s 598us/step - loss: 679.1830 Epoch 42/1000 16/16 [==============================] - 0s 693us/step - loss: 678.8563 Epoch 43/1000 16/16 [==============================] - 0s 603us/step - loss: 678.4165 Epoch 44/1000 16/16 [==============================] - 0s 501us/step - loss: 678.2496 Epoch 45/1000 16/16 [==============================] - 0s 616us/step - loss: 677.9113 Epoch 46/1000 16/16 [==============================] - 0s 604us/step - loss: 677.7866 Epoch 47/1000 16/16 [==============================] - 0s 577us/step - loss: 677.6162 Epoch 48/1000 16/16 [==============================] - 0s 601us/step - loss: 677.3763 Epoch 49/1000 16/16 [==============================] - 0s 569us/step - loss: 677.2235 Epoch 50/1000 16/16 [==============================] - 0s 615us/step - loss: 677.1064 Epoch 51/1000 16/16 [==============================] - 0s 653us/step - loss: 676.9532 Epoch 52/1000 16/16 [==============================] - 0s 566us/step - loss: 676.8326 Epoch 53/1000 16/16 [==============================] - 0s 632us/step - loss: 676.7018 Epoch 54/1000 16/16 [==============================] - 0s 562us/step - loss: 676.5667 Epoch 55/1000 16/16 [==============================] - 0s 610us/step - loss: 676.4442 Epoch 56/1000 16/16 [==============================] - 0s 578us/step - loss: 676.2453 Epoch 57/1000 16/16 [==============================] - 0s 484us/step - loss: 676.1726 Epoch 58/1000 16/16 [==============================] - 0s 554us/step - loss: 676.0189 Epoch 59/1000 16/16 [==============================] - 0s 544us/step - loss: 675.9175 Epoch 60/1000 16/16 [==============================] - 0s 544us/step - loss: 676.0021 Epoch 61/1000 16/16 [==============================] - 0s 546us/step - loss: 675.8038 Epoch 62/1000 16/16 [==============================] - 0s 555us/step - loss: 675.4056 Epoch 63/1000 16/16 [==============================] - 0s 559us/step - loss: 675.3588 Epoch 64/1000 16/16 [==============================] - 0s 557us/step - loss: 675.2067 Epoch 65/1000 16/16 [==============================] - 0s 542us/step - loss: 675.0636 Epoch 66/1000 16/16 [==============================] - 0s 579us/step - loss: 674.8516 Epoch 67/1000 16/16 [==============================] - 0s 505us/step - loss: 674.9022 Epoch 68/1000 16/16 [==============================] - 0s 540us/step - loss: 674.5974 Epoch 69/1000 16/16 [==============================] - 0s 526us/step - loss: 674.3734 Epoch 70/1000 16/16 [==============================] - 0s 500us/step - loss: 674.3798 Epoch 71/1000 16/16 [==============================] - 0s 517us/step - loss: 674.1731 Epoch 72/1000 16/16 [==============================] - 0s 587us/step - loss: 674.4160 Epoch 73/1000 16/16 [==============================] - 0s 532us/step - loss: 673.7010 Epoch 74/1000 16/16 [==============================] - 0s 552us/step - loss: 673.6025 Epoch 75/1000 16/16 [==============================] - 0s 488us/step - loss: 673.5515 Epoch 76/1000 16/16 [==============================] - 0s 527us/step - loss: 673.3136 Epoch 77/1000 16/16 [==============================] - 0s 554us/step - loss: 673.1105 Epoch 78/1000 16/16 [==============================] - 0s 523us/step - loss: 673.0409 Epoch 79/1000 16/16 [==============================] - 0s 498us/step - loss: 673.1075 Epoch 80/1000 16/16 [==============================] - 0s 536us/step - loss: 673.3247 Epoch 81/1000 16/16 [==============================] - 0s 553us/step - loss: 672.3982 Epoch 82/1000 16/16 [==============================] - 0s 581us/step - loss: 672.2358 Epoch 83/1000 16/16 [==============================] - 0s 768us/step - loss: 672.1506 Epoch 84/1000 16/16 [==============================] - 0s 535us/step - loss: 671.8209 Epoch 85/1000 16/16 [==============================] - 0s 617us/step - loss: 671.7312 Epoch 86/1000 16/16 [==============================] - 0s 559us/step - loss: 671.4907 Epoch 87/1000 16/16 [==============================] - 0s 488us/step - loss: 671.5620 Epoch 88/1000 16/16 [==============================] - 0s 578us/step - loss: 671.2952 Epoch 89/1000 16/16 [==============================] - 0s 533us/step - loss: 670.9758 Epoch 90/1000 16/16 [==============================] - 0s 600us/step - loss: 671.2031 Epoch 91/1000 16/16 [==============================] - 0s 613us/step - loss: 670.6249 Epoch 92/1000 16/16 [==============================] - 0s 524us/step - loss: 670.5137 Epoch 93/1000 16/16 [==============================] - 0s 556us/step - loss: 670.2879 Epoch 94/1000 16/16 [==============================] - 0s 496us/step - loss: 670.0164 Epoch 95/1000 16/16 [==============================] - 0s 547us/step - loss: 670.0200 Epoch 96/1000 16/16 [==============================] - 0s 522us/step - loss: 669.7661 Epoch 97/1000 16/16 [==============================] - 0s 457us/step - loss: 669.9259 Epoch 98/1000 16/16 [==============================] - 0s 570us/step - loss: 669.2336 Epoch 99/1000 16/16 [==============================] - 0s 568us/step - loss: 669.1627 Epoch 100/1000 16/16 [==============================] - 0s 549us/step - loss: 669.1835 Epoch 101/1000 16/16 [==============================] - 0s 499us/step - loss: 668.9136 Epoch 102/1000 16/16 [==============================] - 0s 511us/step - loss: 668.6921 Epoch 103/1000 16/16 [==============================] - 0s 580us/step - loss: 668.4669 Epoch 104/1000 16/16 [==============================] - 0s 485us/step - loss: 668.1212 Epoch 105/1000 16/16 [==============================] - 0s 615us/step - loss: 668.1058 Epoch 106/1000 16/16 [==============================] - 0s 502us/step - loss: 667.6498 Epoch 107/1000 16/16 [==============================] - 0s 544us/step - loss: 668.4786 Epoch 108/1000 16/16 [==============================] - 0s 549us/step - loss: 667.4417 Epoch 109/1000 16/16 [==============================] - 0s 533us/step - loss: 666.9782 Epoch 110/1000 16/16 [==============================] - 0s 523us/step - loss: 667.1061 Epoch 111/1000 16/16 [==============================] - 0s 481us/step - loss: 666.6415 Epoch 112/1000 16/16 [==============================] - 0s 592us/step - loss: 666.5453 Epoch 113/1000 16/16 [==============================] - 0s 565us/step - loss: 666.4080 Epoch 114/1000 16/16 [==============================] - 0s 532us/step - loss: 666.3937 Epoch 115/1000 16/16 [==============================] - 0s 553us/step - loss: 665.8564 Epoch 116/1000 16/16 [==============================] - 0s 523us/step - loss: 665.6285 Epoch 117/1000 16/16 [==============================] - 0s 521us/step - loss: 665.4855 Epoch 118/1000 16/16 [==============================] - 0s 455us/step - loss: 665.3724 Epoch 119/1000 16/16 [==============================] - 0s 553us/step - loss: 665.6638 Epoch 120/1000 16/16 [==============================] - 0s 578us/step - loss: 664.6917 Epoch 121/1000 16/16 [==============================] - 0s 522us/step - loss: 664.7163 Epoch 122/1000 16/16 [==============================] - 0s 580us/step - loss: 664.4241 Epoch 123/1000 16/16 [==============================] - 0s 507us/step - loss: 664.0649 Epoch 124/1000 16/16 [==============================] - 0s 512us/step - loss: 664.7659 Epoch 125/1000 16/16 [==============================] - 0s 460us/step - loss: 664.2064 Epoch 126/1000 16/16 [==============================] - 0s 561us/step - loss: 663.6422 Epoch 127/1000 16/16 [==============================] - 0s 544us/step - loss: 664.5529 Epoch 128/1000 16/16 [==============================] - 0s 497us/step - loss: 663.9099 Epoch 129/1000 16/16 [==============================] - 0s 557us/step - loss: 663.2093 Epoch 130/1000 16/16 [==============================] - 0s 467us/step - loss: 662.6366 Epoch 131/1000 16/16 [==============================] - 0s 495us/step - loss: 662.2151 Epoch 132/1000 16/16 [==============================] - 0s 478us/step - loss: 662.2678 Epoch 133/1000 16/16 [==============================] - 0s 479us/step - loss: 661.9575 Epoch 134/1000 16/16 [==============================] - 0s 559us/step - loss: 661.7233 Epoch 135/1000 16/16 [==============================] - 0s 525us/step - loss: 661.5922 Epoch 136/1000 16/16 [==============================] - 0s 530us/step - loss: 661.2389 Epoch 137/1000 16/16 [==============================] - 0s 497us/step - loss: 661.2017 Epoch 138/1000 16/16 [==============================] - 0s 576us/step - loss: 660.8491 Epoch 139/1000 16/16 [==============================] - 0s 538us/step - loss: 660.6234 Epoch 140/1000 16/16 [==============================] - 0s 509us/step - loss: 660.3094 Epoch 141/1000 16/16 [==============================] - 0s 529us/step - loss: 660.2123 Epoch 142/1000 16/16 [==============================] - 0s 487us/step - loss: 659.8137 Epoch 143/1000 16/16 [==============================] - 0s 520us/step - loss: 659.6633 Epoch 144/1000 16/16 [==============================] - 0s 511us/step - loss: 659.6647 Epoch 145/1000 16/16 [==============================] - 0s 603us/step - loss: 659.5439 Epoch 146/1000 16/16 [==============================] - 0s 542us/step - loss: 659.0759 Epoch 147/1000 16/16 [==============================] - 0s 480us/step - loss: 658.7670 Epoch 148/1000 16/16 [==============================] - 0s 552us/step - loss: 658.4149 Epoch 149/1000 16/16 [==============================] - 0s 459us/step - loss: 658.3484 Epoch 150/1000 16/16 [==============================] - 0s 547us/step - loss: 658.0568 Epoch 151/1000 16/16 [==============================] - 0s 540us/step - loss: 657.7832 Epoch 152/1000 16/16 [==============================] - 0s 554us/step - loss: 657.5911 Epoch 153/1000 16/16 [==============================] - 0s 530us/step - loss: 657.2733 Epoch 154/1000 16/16 [==============================] - 0s 559us/step - loss: 657.0065 Epoch 155/1000 16/16 [==============================] - 0s 575us/step - loss: 657.2662 Epoch 156/1000 16/16 [==============================] - 0s 525us/step - loss: 656.8452 Epoch 157/1000 16/16 [==============================] - 0s 551us/step - loss: 656.4056 Epoch 158/1000 16/16 [==============================] - 0s 557us/step - loss: 656.1110 Epoch 159/1000 16/16 [==============================] - 0s 528us/step - loss: 656.3228 Epoch 160/1000 16/16 [==============================] - 0s 515us/step - loss: 655.4553 Epoch 161/1000 16/16 [==============================] - 0s 487us/step - loss: 655.3937 Epoch 162/1000 16/16 [==============================] - 0s 520us/step - loss: 655.1068 Epoch 163/1000 16/16 [==============================] - 0s 493us/step - loss: 655.1434 Epoch 164/1000 16/16 [==============================] - 0s 567us/step - loss: 654.9708 Epoch 165/1000 16/16 [==============================] - 0s 561us/step - loss: 654.7844 Epoch 166/1000 16/16 [==============================] - 0s 531us/step - loss: 654.1033 Epoch 167/1000 16/16 [==============================] - 0s 522us/step - loss: 653.7421 Epoch 168/1000 16/16 [==============================] - 0s 442us/step - loss: 653.7177 Epoch 169/1000 16/16 [==============================] - 0s 541us/step - loss: 653.7064 Epoch 170/1000 16/16 [==============================] - 0s 543us/step - loss: 653.1500 Epoch 171/1000 16/16 [==============================] - 0s 580us/step - loss: 653.3521 Epoch 172/1000 16/16 [==============================] - 0s 547us/step - loss: 652.8120 Epoch 173/1000 16/16 [==============================] - 0s 471us/step - loss: 652.7393 Epoch 174/1000 16/16 [==============================] - 0s 583us/step - loss: 652.0715 Epoch 175/1000 16/16 [==============================] - 0s 510us/step - loss: 652.2900 Epoch 176/1000 16/16 [==============================] - 0s 496us/step - loss: 651.8378 Epoch 177/1000 16/16 [==============================] - 0s 506us/step - loss: 651.8420 Epoch 178/1000 16/16 [==============================] - 0s 508us/step - loss: 651.3478 Epoch 179/1000 16/16 [==============================] - 0s 595us/step - loss: 651.3406 Epoch 180/1000 16/16 [==============================] - 0s 453us/step - loss: 650.9197 Epoch 181/1000 16/16 [==============================] - 0s 519us/step - loss: 650.4445 Epoch 182/1000 16/16 [==============================] - 0s 449us/step - loss: 650.3360 Epoch 183/1000 16/16 [==============================] - 0s 602us/step - loss: 650.0646 Epoch 184/1000 16/16 [==============================] - 0s 520us/step - loss: 649.9540 Epoch 185/1000 16/16 [==============================] - 0s 546us/step - loss: 649.9462 Epoch 186/1000 16/16 [==============================] - 0s 537us/step - loss: 649.2351 Epoch 187/1000 16/16 [==============================] - 0s 551us/step - loss: 649.0887 Epoch 188/1000 16/16 [==============================] - 0s 544us/step - loss: 648.7100 Epoch 189/1000 16/16 [==============================] - 0s 534us/step - loss: 648.5651 Epoch 190/1000 16/16 [==============================] - 0s 566us/step - loss: 648.4254 Epoch 191/1000 16/16 [==============================] - 0s 573us/step - loss: 648.7129 Epoch 192/1000 16/16 [==============================] - 0s 495us/step - loss: 648.0240 Epoch 193/1000 16/16 [==============================] - 0s 578us/step - loss: 648.2502 Epoch 194/1000 16/16 [==============================] - 0s 530us/step - loss: 648.6072 Epoch 195/1000 16/16 [==============================] - 0s 558us/step - loss: 647.4894 Epoch 196/1000 16/16 [==============================] - 0s 501us/step - loss: 646.8566 Epoch 197/1000 16/16 [==============================] - 0s 471us/step - loss: 646.6538 Epoch 198/1000 16/16 [==============================] - 0s 512us/step - loss: 647.5095 Epoch 199/1000 16/16 [==============================] - 0s 474us/step - loss: 646.3800 Epoch 200/1000 16/16 [==============================] - 0s 515us/step - loss: 646.0630 Epoch 201/1000 16/16 [==============================] - 0s 462us/step - loss: 645.7543 Epoch 202/1000 16/16 [==============================] - 0s 589us/step - loss: 645.5288 Epoch 203/1000 16/16 [==============================] - 0s 605us/step - loss: 645.4688 Epoch 204/1000 16/16 [==============================] - 0s 549us/step - loss: 645.0549 Epoch 205/1000 16/16 [==============================] - 0s 541us/step - loss: 644.9713 Epoch 206/1000 16/16 [==============================] - 0s 588us/step - loss: 644.5126 Epoch 207/1000 16/16 [==============================] - 0s 548us/step - loss: 644.4686 Epoch 208/1000 16/16 [==============================] - 0s 563us/step - loss: 644.1545 Epoch 209/1000 16/16 [==============================] - 0s 546us/step - loss: 644.2523 Epoch 210/1000 16/16 [==============================] - 0s 559us/step - loss: 643.7820 Epoch 211/1000 16/16 [==============================] - 0s 523us/step - loss: 643.4297 Epoch 212/1000 16/16 [==============================] - 0s 530us/step - loss: 643.3353 Epoch 213/1000 16/16 [==============================] - 0s 517us/step - loss: 645.3302 Epoch 214/1000 16/16 [==============================] - 0s 580us/step - loss: 643.2214 Epoch 215/1000 16/16 [==============================] - 0s 550us/step - loss: 642.6486 Epoch 216/1000 16/16 [==============================] - 0s 468us/step - loss: 643.1629 Epoch 217/1000 16/16 [==============================] - 0s 615us/step - loss: 642.1848 Epoch 218/1000 16/16 [==============================] - 0s 496us/step - loss: 641.7324 Epoch 219/1000 16/16 [==============================] - 0s 541us/step - loss: 641.8348 Epoch 220/1000 16/16 [==============================] - 0s 515us/step - loss: 641.8445 Epoch 221/1000 16/16 [==============================] - 0s 535us/step - loss: 642.1785 Epoch 222/1000 16/16 [==============================] - 0s 525us/step - loss: 641.2731 Epoch 223/1000 16/16 [==============================] - 0s 517us/step - loss: 640.9163 Epoch 224/1000 16/16 [==============================] - 0s 572us/step - loss: 640.4742 Epoch 225/1000 16/16 [==============================] - 0s 465us/step - loss: 640.9769 Epoch 226/1000 16/16 [==============================] - 0s 532us/step - loss: 640.2819 Epoch 227/1000 16/16 [==============================] - 0s 519us/step - loss: 640.8456 Epoch 228/1000 16/16 [==============================] - 0s 508us/step - loss: 639.7007 Epoch 229/1000 16/16 [==============================] - 0s 546us/step - loss: 639.5319 Epoch 230/1000 16/16 [==============================] - 0s 481us/step - loss: 640.1086 Epoch 231/1000 16/16 [==============================] - 0s 535us/step - loss: 639.9565 Epoch 232/1000 16/16 [==============================] - 0s 503us/step - loss: 639.6434 Epoch 233/1000 16/16 [==============================] - 0s 556us/step - loss: 638.4318 Epoch 234/1000 16/16 [==============================] - 0s 624us/step - loss: 638.3177 Epoch 235/1000 16/16 [==============================] - 0s 454us/step - loss: 638.3361 Epoch 236/1000 16/16 [==============================] - 0s 599us/step - loss: 638.5441 Epoch 237/1000 16/16 [==============================] - 0s 532us/step - loss: 638.7856 Epoch 238/1000 16/16 [==============================] - 0s 580us/step - loss: 637.7487 Epoch 239/1000 16/16 [==============================] - 0s 571us/step - loss: 640.7881 Epoch 240/1000 16/16 [==============================] - 0s 479us/step - loss: 636.7926 Epoch 241/1000 16/16 [==============================] - 0s 528us/step - loss: 638.3126 Epoch 242/1000 16/16 [==============================] - 0s 475us/step - loss: 636.5522 Epoch 243/1000 16/16 [==============================] - 0s 525us/step - loss: 636.8318 Epoch 244/1000 16/16 [==============================] - 0s 472us/step - loss: 637.5928 Epoch 245/1000 16/16 [==============================] - 0s 498us/step - loss: 636.0380 Epoch 246/1000 16/16 [==============================] - 0s 566us/step - loss: 636.4359 Epoch 247/1000 16/16 [==============================] - 0s 486us/step - loss: 637.0108 Epoch 248/1000 16/16 [==============================] - 0s 552us/step - loss: 635.5426 Epoch 249/1000 16/16 [==============================] - ETA: 0s - loss: 551.419 - 0s 504us/step - loss: 636.0056 Epoch 250/1000 16/16 [==============================] - 0s 545us/step - loss: 635.0952 Epoch 251/1000 16/16 [==============================] - 0s 482us/step - loss: 635.1935 Epoch 252/1000 16/16 [==============================] - 0s 533us/step - loss: 635.9478 Epoch 253/1000 16/16 [==============================] - 0s 495us/step - loss: 634.5674 Epoch 254/1000 16/16 [==============================] - 0s 578us/step - loss: 635.6084 Epoch 255/1000 16/16 [==============================] - 0s 577us/step - loss: 633.9606 Epoch 256/1000 16/16 [==============================] - 0s 464us/step - loss: 634.7614 Epoch 257/1000 16/16 [==============================] - 0s 522us/step - loss: 634.3735 Epoch 258/1000 16/16 [==============================] - 0s 567us/step - loss: 634.2164 Epoch 259/1000 16/16 [==============================] - 0s 528us/step - loss: 633.3873 Epoch 260/1000 16/16 [==============================] - 0s 490us/step - loss: 633.5662 Epoch 261/1000 16/16 [==============================] - 0s 466us/step - loss: 633.9677 Epoch 262/1000 16/16 [==============================] - 0s 531us/step - loss: 633.8298 Epoch 263/1000 16/16 [==============================] - 0s 562us/step - loss: 634.0450 Epoch 264/1000 16/16 [==============================] - 0s 552us/step - loss: 632.9540 Epoch 265/1000 16/16 [==============================] - 0s 527us/step - loss: 632.8033 Epoch 266/1000 16/16 [==============================] - 0s 559us/step - loss: 632.7846 Epoch 267/1000 16/16 [==============================] - 0s 500us/step - loss: 632.5721 Epoch 268/1000 16/16 [==============================] - 0s 513us/step - loss: 632.2706 Epoch 269/1000 16/16 [==============================] - 0s 534us/step - loss: 632.9540 Epoch 270/1000 16/16 [==============================] - 0s 556us/step - loss: 635.1144 Epoch 271/1000 16/16 [==============================] - 0s 521us/step - loss: 633.1031 Epoch 272/1000 16/16 [==============================] - 0s 506us/step - loss: 632.4228 Epoch 273/1000 16/16 [==============================] - 0s 588us/step - loss: 631.7523 Epoch 274/1000 16/16 [==============================] - 0s 561us/step - loss: 633.3891 Epoch 275/1000 16/16 [==============================] - 0s 499us/step - loss: 632.8027 Epoch 276/1000 16/16 [==============================] - 0s 595us/step - loss: 631.5535 Epoch 277/1000 16/16 [==============================] - 0s 519us/step - loss: 631.5756 Epoch 278/1000 16/16 [==============================] - 0s 505us/step - loss: 631.3323 Epoch 279/1000 16/16 [==============================] - 0s 516us/step - loss: 630.3414 Epoch 280/1000 16/16 [==============================] - 0s 528us/step - loss: 631.2656 Epoch 281/1000 16/16 [==============================] - 0s 599us/step - loss: 631.0125 Epoch 282/1000 16/16 [==============================] - 0s 463us/step - loss: 632.0811 Epoch 283/1000 16/16 [==============================] - 0s 615us/step - loss: 630.9930 Epoch 284/1000 16/16 [==============================] - 0s 564us/step - loss: 632.5519 Epoch 285/1000 16/16 [==============================] - 0s 548us/step - loss: 630.5054 Epoch 286/1000 16/16 [==============================] - 0s 559us/step - loss: 629.9319 Epoch 287/1000 16/16 [==============================] - 0s 492us/step - loss: 632.7005 Epoch 288/1000 16/16 [==============================] - 0s 565us/step - loss: 630.8834 Epoch 289/1000 16/16 [==============================] - 0s 533us/step - loss: 629.9037 Epoch 290/1000 16/16 [==============================] - 0s 568us/step - loss: 629.9665 Epoch 291/1000 16/16 [==============================] - 0s 537us/step - loss: 630.2266 Epoch 292/1000 16/16 [==============================] - 0s 519us/step - loss: 629.7653 Epoch 293/1000 16/16 [==============================] - 0s 546us/step - loss: 628.7740 Epoch 294/1000 16/16 [==============================] - 0s 534us/step - loss: 629.3576 Epoch 295/1000 16/16 [==============================] - 0s 541us/step - loss: 629.7620 Epoch 296/1000 16/16 [==============================] - 0s 458us/step - loss: 631.2361 Epoch 297/1000 16/16 [==============================] - 0s 521us/step - loss: 628.1876 Epoch 298/1000 16/16 [==============================] - 0s 554us/step - loss: 629.2155 Epoch 299/1000 16/16 [==============================] - 0s 467us/step - loss: 628.8694 Epoch 300/1000 16/16 [==============================] - 0s 531us/step - loss: 628.2947 Epoch 301/1000 16/16 [==============================] - 0s 560us/step - loss: 628.9042 Epoch 302/1000 16/16 [==============================] - 0s 527us/step - loss: 627.6041 Epoch 303/1000 16/16 [==============================] - 0s 513us/step - loss: 627.8470 Epoch 304/1000 16/16 [==============================] - 0s 548us/step - loss: 628.0145 Epoch 305/1000 16/16 [==============================] - 0s 540us/step - loss: 628.2238 Epoch 306/1000 16/16 [==============================] - 0s 487us/step - loss: 627.4340 Epoch 307/1000 16/16 [==============================] - 0s 568us/step - loss: 628.4655 Epoch 308/1000 16/16 [==============================] - 0s 539us/step - loss: 628.4854 Epoch 309/1000 16/16 [==============================] - 0s 524us/step - loss: 627.5380 Epoch 310/1000 16/16 [==============================] - 0s 559us/step - loss: 628.6539 Epoch 311/1000 16/16 [==============================] - 0s 553us/step - loss: 628.9548 Epoch 312/1000 16/16 [==============================] - 0s 521us/step - loss: 632.7083 Epoch 313/1000 16/16 [==============================] - 0s 556us/step - loss: 626.6309 Epoch 314/1000 16/16 [==============================] - 0s 562us/step - loss: 627.8016 Epoch 315/1000 16/16 [==============================] - 0s 585us/step - loss: 626.9426 Epoch 316/1000 16/16 [==============================] - 0s 501us/step - loss: 631.2941 Epoch 317/1000 16/16 [==============================] - 0s 609us/step - loss: 631.2849 Epoch 318/1000 16/16 [==============================] - 0s 543us/step - loss: 626.1016 Epoch 319/1000 16/16 [==============================] - 0s 561us/step - loss: 627.7065 Epoch 320/1000 16/16 [==============================] - 0s 577us/step - loss: 626.8929 Epoch 321/1000 16/16 [==============================] - 0s 576us/step - loss: 626.6800 Epoch 322/1000 16/16 [==============================] - 0s 609us/step - loss: 627.0311 Epoch 323/1000 16/16 [==============================] - 0s 592us/step - loss: 626.9901 Epoch 324/1000 16/16 [==============================] - 0s 549us/step - loss: 627.0002 Epoch 325/1000 16/16 [==============================] - 0s 514us/step - loss: 627.0162 Epoch 326/1000 16/16 [==============================] - 0s 507us/step - loss: 626.2166 Epoch 327/1000 16/16 [==============================] - 0s 526us/step - loss: 627.1196 Epoch 328/1000 16/16 [==============================] - 0s 511us/step - loss: 626.2672 Epoch 329/1000 16/16 [==============================] - 0s 529us/step - loss: 626.2142 Epoch 330/1000 16/16 [==============================] - 0s 550us/step - loss: 625.7172 Epoch 331/1000 16/16 [==============================] - 0s 438us/step - loss: 626.2865 Epoch 332/1000 16/16 [==============================] - 0s 473us/step - loss: 625.3998 Epoch 333/1000 16/16 [==============================] - 0s 523us/step - loss: 627.7906 Epoch 334/1000 16/16 [==============================] - 0s 535us/step - loss: 630.3742 Epoch 335/1000 16/16 [==============================] - 0s 535us/step - loss: 627.9489 Epoch 336/1000 16/16 [==============================] - 0s 523us/step - loss: 625.8708 Epoch 337/1000 16/16 [==============================] - 0s 531us/step - loss: 627.3346 Epoch 338/1000 16/16 [==============================] - 0s 511us/step - loss: 625.9564 Epoch 339/1000 16/16 [==============================] - 0s 554us/step - loss: 625.9881 Epoch 340/1000 16/16 [==============================] - 0s 493us/step - loss: 626.9404 Epoch 341/1000 16/16 [==============================] - 0s 514us/step - loss: 626.0911 Epoch 342/1000 16/16 [==============================] - 0s 451us/step - loss: 625.7954 Epoch 343/1000 16/16 [==============================] - 0s 480us/step - loss: 625.9161 Epoch 344/1000 16/16 [==============================] - 0s 582us/step - loss: 625.2907 Epoch 345/1000 16/16 [==============================] - 0s 581us/step - loss: 625.0192 Epoch 346/1000 16/16 [==============================] - 0s 592us/step - loss: 625.1440 Epoch 347/1000 16/16 [==============================] - 0s 508us/step - loss: 629.0966 Epoch 348/1000 16/16 [==============================] - 0s 523us/step - loss: 631.0361 Epoch 349/1000 16/16 [==============================] - 0s 554us/step - loss: 623.5940 Epoch 350/1000 16/16 [==============================] - 0s 555us/step - loss: 631.5015 Epoch 351/1000 16/16 [==============================] - 0s 584us/step - loss: 625.1418 Epoch 352/1000 16/16 [==============================] - 0s 528us/step - loss: 625.4241 Epoch 353/1000 16/16 [==============================] - 0s 553us/step - loss: 627.7592 Epoch 354/1000 16/16 [==============================] - 0s 596us/step - loss: 622.7491 Epoch 355/1000 16/16 [==============================] - 0s 506us/step - loss: 626.1078 Epoch 356/1000 16/16 [==============================] - 0s 468us/step - loss: 624.3181 Epoch 357/1000 16/16 [==============================] - 0s 536us/step - loss: 624.3381 Epoch 358/1000 16/16 [==============================] - 0s 532us/step - loss: 625.1335 Epoch 359/1000 16/16 [==============================] - 0s 498us/step - loss: 626.2069 Epoch 360/1000 16/16 [==============================] - 0s 484us/step - loss: 624.6736 Epoch 361/1000 16/16 [==============================] - 0s 526us/step - loss: 624.4357 Epoch 362/1000 16/16 [==============================] - 0s 560us/step - loss: 624.4858 Epoch 363/1000 16/16 [==============================] - 0s 537us/step - loss: 624.4253 Epoch 364/1000 16/16 [==============================] - 0s 469us/step - loss: 625.9888 Epoch 365/1000 16/16 [==============================] - 0s 577us/step - loss: 623.1890 Epoch 366/1000 16/16 [==============================] - 0s 518us/step - loss: 625.7180 Epoch 367/1000 16/16 [==============================] - 0s 492us/step - loss: 625.3770 Epoch 368/1000 16/16 [==============================] - 0s 544us/step - loss: 627.4176 Epoch 369/1000 16/16 [==============================] - 0s 551us/step - loss: 624.0944 Epoch 370/1000 16/16 [==============================] - 0s 530us/step - loss: 627.0947 Epoch 371/1000 16/16 [==============================] - 0s 517us/step - loss: 625.2469 Epoch 372/1000 16/16 [==============================] - 0s 496us/step - loss: 624.4193 Epoch 373/1000 16/16 [==============================] - 0s 532us/step - loss: 626.6870 Epoch 374/1000 16/16 [==============================] - 0s 494us/step - loss: 626.4590 Epoch 375/1000 16/16 [==============================] - 0s 496us/step - loss: 624.6080 Epoch 376/1000 16/16 [==============================] - 0s 499us/step - loss: 624.8785 Epoch 377/1000 16/16 [==============================] - 0s 518us/step - loss: 624.9704 Epoch 378/1000 16/16 [==============================] - 0s 559us/step - loss: 623.7751 Epoch 379/1000 16/16 [==============================] - 0s 529us/step - loss: 624.3729 Epoch 380/1000 16/16 [==============================] - 0s 494us/step - loss: 625.3849 Epoch 381/1000 16/16 [==============================] - 0s 577us/step - loss: 628.9221 Epoch 382/1000 16/16 [==============================] - 0s 503us/step - loss: 625.7240 Epoch 383/1000 16/16 [==============================] - 0s 545us/step - loss: 633.9473 Epoch 384/1000 16/16 [==============================] - 0s 559us/step - loss: 629.0547 Epoch 385/1000 16/16 [==============================] - 0s 538us/step - loss: 622.1895 Epoch 386/1000 16/16 [==============================] - 0s 641us/step - loss: 625.8453 Epoch 387/1000 16/16 [==============================] - 0s 587us/step - loss: 624.5527 Epoch 388/1000 16/16 [==============================] - 0s 515us/step - loss: 625.1224 Epoch 389/1000 16/16 [==============================] - 0s 535us/step - loss: 627.0594 Epoch 390/1000 16/16 [==============================] - 0s 455us/step - loss: 624.6967 Epoch 391/1000 16/16 [==============================] - 0s 504us/step - loss: 626.2750 Epoch 392/1000 16/16 [==============================] - 0s 452us/step - loss: 624.0765 Epoch 393/1000 16/16 [==============================] - 0s 510us/step - loss: 625.3088 Epoch 394/1000 16/16 [==============================] - 0s 542us/step - loss: 627.9275 Epoch 395/1000 16/16 [==============================] - 0s 595us/step - loss: 627.6080 Epoch 396/1000 16/16 [==============================] - 0s 514us/step - loss: 624.9312 Epoch 397/1000 16/16 [==============================] - 0s 521us/step - loss: 625.6089 Epoch 398/1000 16/16 [==============================] - 0s 609us/step - loss: 625.0918 Epoch 399/1000 16/16 [==============================] - 0s 504us/step - loss: 624.3710 Epoch 400/1000 16/16 [==============================] - 0s 549us/step - loss: 626.3395 Epoch 401/1000 16/16 [==============================] - 0s 453us/step - loss: 625.5132 Epoch 402/1000 16/16 [==============================] - 0s 511us/step - loss: 625.1113 Epoch 403/1000 16/16 [==============================] - 0s 579us/step - loss: 625.0710 Epoch 404/1000 16/16 [==============================] - 0s 516us/step - loss: 624.3244 Epoch 405/1000 16/16 [==============================] - 0s 557us/step - loss: 625.8611 Epoch 406/1000 16/16 [==============================] - 0s 490us/step - loss: 624.4536 Epoch 407/1000 16/16 [==============================] - 0s 534us/step - loss: 631.4476 Epoch 408/1000 16/16 [==============================] - 0s 544us/step - loss: 628.5786 Epoch 409/1000 16/16 [==============================] - 0s 561us/step - loss: 630.8698 Epoch 410/1000 16/16 [==============================] - 0s 518us/step - loss: 624.5186 Epoch 411/1000 16/16 [==============================] - 0s 516us/step - loss: 628.9389 Epoch 412/1000 16/16 [==============================] - 0s 538us/step - loss: 623.6414 Epoch 413/1000 16/16 [==============================] - 0s 519us/step - loss: 625.2821 Epoch 414/1000 16/16 [==============================] - 0s 536us/step - loss: 627.5006 Epoch 415/1000 16/16 [==============================] - 0s 586us/step - loss: 627.9194 Epoch 416/1000 16/16 [==============================] - 0s 522us/step - loss: 625.2422 Epoch 417/1000 16/16 [==============================] - 0s 551us/step - loss: 625.6765 Epoch 418/1000 16/16 [==============================] - 0s 504us/step - loss: 631.9670 Epoch 419/1000 16/16 [==============================] - 0s 530us/step - loss: 627.0494 Epoch 420/1000 16/16 [==============================] - ETA: 0s - loss: 772.088 - 0s 479us/step - loss: 625.4821 Epoch 421/1000 16/16 [==============================] - 0s 564us/step - loss: 626.7655 Epoch 422/1000 16/16 [==============================] - 0s 585us/step - loss: 625.9962 Epoch 423/1000 16/16 [==============================] - 0s 478us/step - loss: 626.4542 Epoch 424/1000 16/16 [==============================] - 0s 570us/step - loss: 626.0955 Epoch 425/1000 16/16 [==============================] - 0s 514us/step - loss: 624.7668 Epoch 426/1000 16/16 [==============================] - 0s 574us/step - loss: 623.9572 Epoch 427/1000 16/16 [==============================] - 0s 539us/step - loss: 625.1588 Epoch 428/1000 16/16 [==============================] - 0s 555us/step - loss: 630.7330 Epoch 429/1000 16/16 [==============================] - 0s 518us/step - loss: 624.7980 Epoch 430/1000 16/16 [==============================] - 0s 535us/step - loss: 624.9210 Epoch 431/1000 16/16 [==============================] - 0s 523us/step - loss: 626.8890 Epoch 432/1000 16/16 [==============================] - 0s 551us/step - loss: 627.3205 Epoch 433/1000 16/16 [==============================] - 0s 542us/step - loss: 626.0201 Epoch 434/1000 16/16 [==============================] - 0s 599us/step - loss: 624.5666 Epoch 435/1000 16/16 [==============================] - 0s 505us/step - loss: 627.6349 Epoch 436/1000 16/16 [==============================] - 0s 525us/step - loss: 625.0275 Epoch 437/1000 16/16 [==============================] - 0s 494us/step - loss: 626.1270 Epoch 438/1000 16/16 [==============================] - 0s 581us/step - loss: 629.7851 Epoch 439/1000 16/16 [==============================] - 0s 523us/step - loss: 625.5931 Epoch 440/1000 16/16 [==============================] - 0s 532us/step - loss: 623.9202 Epoch 441/1000 16/16 [==============================] - 0s 509us/step - loss: 624.9843 Epoch 442/1000 16/16 [==============================] - 0s 498us/step - loss: 625.9683 Epoch 443/1000 16/16 [==============================] - 0s 563us/step - loss: 629.0457 Epoch 444/1000 16/16 [==============================] - 0s 534us/step - loss: 625.0892 Epoch 445/1000 16/16 [==============================] - 0s 546us/step - loss: 625.9434 Epoch 446/1000 16/16 [==============================] - 0s 570us/step - loss: 628.4105 Epoch 447/1000 16/16 [==============================] - 0s 452us/step - loss: 626.1812 Epoch 448/1000 16/16 [==============================] - 0s 537us/step - loss: 625.4258 Epoch 449/1000 16/16 [==============================] - 0s 469us/step - loss: 624.9014 Epoch 450/1000 16/16 [==============================] - 0s 539us/step - loss: 626.2489 Epoch 451/1000 16/16 [==============================] - 0s 480us/step - loss: 623.9226 Epoch 452/1000 16/16 [==============================] - 0s 527us/step - loss: 624.6110 Epoch 453/1000 16/16 [==============================] - 0s 543us/step - loss: 625.0714 Epoch 454/1000 16/16 [==============================] - 0s 513us/step - loss: 624.5704 Epoch 455/1000 16/16 [==============================] - 0s 529us/step - loss: 625.6758 Epoch 456/1000 16/16 [==============================] - 0s 500us/step - loss: 625.3940 Epoch 457/1000 16/16 [==============================] - 0s 515us/step - loss: 624.5969 Epoch 458/1000 16/16 [==============================] - 0s 584us/step - loss: 625.5344 Epoch 459/1000 16/16 [==============================] - 0s 505us/step - loss: 626.6696 Epoch 460/1000 16/16 [==============================] - 0s 498us/step - loss: 624.1316 Epoch 461/1000 16/16 [==============================] - 0s 540us/step - loss: 624.5406 Epoch 462/1000 16/16 [==============================] - 0s 596us/step - loss: 630.4134 Epoch 463/1000 16/16 [==============================] - 0s 551us/step - loss: 628.6576 Epoch 464/1000 16/16 [==============================] - 0s 554us/step - loss: 624.3312 Epoch 465/1000 16/16 [==============================] - 0s 533us/step - loss: 624.9331 Epoch 466/1000 16/16 [==============================] - 0s 500us/step - loss: 623.6824 Epoch 467/1000 16/16 [==============================] - 0s 516us/step - loss: 625.1120 Epoch 468/1000 16/16 [==============================] - 0s 540us/step - loss: 625.7380 Epoch 469/1000 16/16 [==============================] - 0s 541us/step - loss: 624.2573 Epoch 470/1000 16/16 [==============================] - 0s 555us/step - loss: 626.0991 Epoch 471/1000 16/16 [==============================] - 0s 540us/step - loss: 625.0904 Epoch 472/1000 16/16 [==============================] - 0s 488us/step - loss: 625.3901 Epoch 473/1000 16/16 [==============================] - 0s 476us/step - loss: 626.2177 Epoch 474/1000 16/16 [==============================] - 0s 547us/step - loss: 632.7318 Epoch 475/1000 16/16 [==============================] - 0s 551us/step - loss: 627.3055 Epoch 476/1000 16/16 [==============================] - 0s 513us/step - loss: 625.3239 Epoch 477/1000 16/16 [==============================] - 0s 472us/step - loss: 626.5545 Epoch 478/1000 16/16 [==============================] - 0s 543us/step - loss: 635.8879 Epoch 479/1000 16/16 [==============================] - 0s 549us/step - loss: 627.1603 Epoch 480/1000 16/16 [==============================] - 0s 553us/step - loss: 635.9047 Epoch 481/1000 16/16 [==============================] - 0s 565us/step - loss: 630.4215 Epoch 482/1000 16/16 [==============================] - 0s 538us/step - loss: 626.5628 Epoch 483/1000 16/16 [==============================] - 0s 511us/step - loss: 625.4540 Epoch 484/1000 16/16 [==============================] - 0s 450us/step - loss: 632.1264 Epoch 485/1000 16/16 [==============================] - 0s 524us/step - loss: 625.7151 Epoch 486/1000 16/16 [==============================] - 0s 594us/step - loss: 625.9002 Epoch 487/1000 16/16 [==============================] - 0s 501us/step - loss: 627.9471 Epoch 488/1000 16/16 [==============================] - 0s 514us/step - loss: 628.5887 Epoch 489/1000 16/16 [==============================] - 0s 545us/step - loss: 627.7901 Epoch 490/1000 16/16 [==============================] - 0s 565us/step - loss: 623.7240 Epoch 491/1000 16/16 [==============================] - 0s 455us/step - loss: 625.0464 Epoch 492/1000 16/16 [==============================] - 0s 446us/step - loss: 625.2748 Epoch 493/1000 16/16 [==============================] - 0s 547us/step - loss: 624.7393 Epoch 494/1000 16/16 [==============================] - 0s 534us/step - loss: 627.7809 Epoch 495/1000 16/16 [==============================] - 0s 535us/step - loss: 626.8825 Epoch 496/1000 16/16 [==============================] - 0s 542us/step - loss: 628.0123 Epoch 497/1000 16/16 [==============================] - 0s 541us/step - loss: 629.0299 Epoch 498/1000 16/16 [==============================] - 0s 505us/step - loss: 641.1992 Epoch 499/1000 16/16 [==============================] - 0s 514us/step - loss: 624.2857 Epoch 500/1000 16/16 [==============================] - 0s 537us/step - loss: 632.9587 Epoch 501/1000 16/16 [==============================] - 0s 575us/step - loss: 629.4567 Epoch 502/1000 16/16 [==============================] - 0s 531us/step - loss: 624.5360 Epoch 503/1000 16/16 [==============================] - 0s 480us/step - loss: 626.8781 Epoch 504/1000 16/16 [==============================] - 0s 1ms/step - loss: 626.9135 Epoch 505/1000 16/16 [==============================] - 0s 1ms/step - loss: 627.4448 Epoch 506/1000 16/16 [==============================] - 0s 621us/step - loss: 626.8463 Epoch 507/1000 16/16 [==============================] - 0s 489us/step - loss: 623.9912 Epoch 508/1000 16/16 [==============================] - 0s 572us/step - loss: 627.6519 Epoch 509/1000 16/16 [==============================] - 0s 545us/step - loss: 627.1562 Epoch 510/1000 16/16 [==============================] - 0s 513us/step - loss: 625.6622 Epoch 511/1000 16/16 [==============================] - 0s 508us/step - loss: 630.7817 Epoch 512/1000 16/16 [==============================] - 0s 524us/step - loss: 625.8043 Epoch 513/1000 16/16 [==============================] - 0s 534us/step - loss: 632.4673 Epoch 514/1000 16/16 [==============================] - 0s 479us/step - loss: 631.7971 Epoch 515/1000 16/16 [==============================] - 0s 548us/step - loss: 625.0798 Epoch 516/1000 16/16 [==============================] - 0s 464us/step - loss: 629.9678 Epoch 517/1000 16/16 [==============================] - 0s 518us/step - loss: 634.5988 Epoch 518/1000 16/16 [==============================] - 0s 499us/step - loss: 627.3489 Epoch 519/1000 16/16 [==============================] - 0s 500us/step - loss: 631.5130 Epoch 520/1000 16/16 [==============================] - 0s 500us/step - loss: 631.3703 Epoch 521/1000 16/16 [==============================] - 0s 558us/step - loss: 628.0236 Epoch 522/1000 16/16 [==============================] - 0s 547us/step - loss: 623.9805 Epoch 523/1000 16/16 [==============================] - 0s 482us/step - loss: 629.5175 Epoch 524/1000 16/16 [==============================] - 0s 560us/step - loss: 629.9803 Epoch 525/1000 16/16 [==============================] - 0s 538us/step - loss: 627.1923 Epoch 526/1000 16/16 [==============================] - 0s 532us/step - loss: 627.8197 Epoch 527/1000 16/16 [==============================] - 0s 527us/step - loss: 629.5542 Epoch 528/1000 16/16 [==============================] - 0s 523us/step - loss: 627.1221 Epoch 529/1000 16/16 [==============================] - 0s 536us/step - loss: 627.1776 Epoch 530/1000 16/16 [==============================] - 0s 541us/step - loss: 629.3998 Epoch 531/1000 16/16 [==============================] - 0s 529us/step - loss: 634.3271 Epoch 532/1000 16/16 [==============================] - 0s 546us/step - loss: 628.0706 Epoch 533/1000 16/16 [==============================] - 0s 487us/step - loss: 626.6099 Epoch 534/1000 16/16 [==============================] - 0s 509us/step - loss: 627.1594 Epoch 535/1000 16/16 [==============================] - 0s 523us/step - loss: 624.2892 Epoch 536/1000 16/16 [==============================] - 0s 559us/step - loss: 624.9995 Epoch 537/1000 16/16 [==============================] - 0s 488us/step - loss: 632.0331 Epoch 538/1000 16/16 [==============================] - 0s 521us/step - loss: 625.1722 Epoch 539/1000 16/16 [==============================] - 0s 541us/step - loss: 628.9335 Epoch 540/1000 16/16 [==============================] - 0s 517us/step - loss: 631.4006 Epoch 541/1000 16/16 [==============================] - 0s 517us/step - loss: 628.3309 Epoch 542/1000 16/16 [==============================] - 0s 466us/step - loss: 625.6580 Epoch 543/1000 16/16 [==============================] - 0s 555us/step - loss: 624.9980 Epoch 544/1000 16/16 [==============================] - 0s 514us/step - loss: 624.6450 Epoch 545/1000 16/16 [==============================] - 0s 506us/step - loss: 625.0341 Epoch 546/1000 16/16 [==============================] - 0s 510us/step - loss: 625.0676 Epoch 547/1000 16/16 [==============================] - 0s 539us/step - loss: 626.6923 Epoch 548/1000 16/16 [==============================] - 0s 546us/step - loss: 624.3544 Epoch 549/1000 16/16 [==============================] - 0s 507us/step - loss: 624.2022 Epoch 550/1000 16/16 [==============================] - 0s 502us/step - loss: 630.7359 Epoch 551/1000 16/16 [==============================] - 0s 457us/step - loss: 635.9343 Epoch 552/1000 16/16 [==============================] - 0s 548us/step - loss: 625.6456 Epoch 553/1000 16/16 [==============================] - 0s 562us/step - loss: 624.1470 Epoch 554/1000 16/16 [==============================] - 0s 566us/step - loss: 627.7502 Epoch 555/1000 16/16 [==============================] - 0s 564us/step - loss: 624.4397 Epoch 556/1000 16/16 [==============================] - 0s 493us/step - loss: 625.0015 Epoch 557/1000 16/16 [==============================] - 0s 539us/step - loss: 626.5494 Epoch 558/1000 16/16 [==============================] - 0s 508us/step - loss: 624.2210 Epoch 559/1000 16/16 [==============================] - 0s 468us/step - loss: 624.0049 Epoch 560/1000 16/16 [==============================] - 0s 474us/step - loss: 624.9916 Epoch 561/1000 16/16 [==============================] - 0s 550us/step - loss: 625.6562 Epoch 562/1000 16/16 [==============================] - 0s 590us/step - loss: 628.7698 Epoch 563/1000 16/16 [==============================] - 0s 552us/step - loss: 629.6451 Epoch 564/1000 16/16 [==============================] - 0s 504us/step - loss: 626.8605 Epoch 565/1000 16/16 [==============================] - 0s 590us/step - loss: 624.7446 Epoch 566/1000 16/16 [==============================] - 0s 554us/step - loss: 625.5417 Epoch 567/1000 16/16 [==============================] - 0s 591us/step - loss: 626.7648 Epoch 568/1000 16/16 [==============================] - 0s 481us/step - loss: 623.8068 Epoch 569/1000 16/16 [==============================] - 0s 511us/step - loss: 625.4590 Epoch 570/1000 16/16 [==============================] - 0s 507us/step - loss: 629.4100 Epoch 571/1000 16/16 [==============================] - 0s 531us/step - loss: 625.3329 Epoch 572/1000 16/16 [==============================] - 0s 545us/step - loss: 624.8920 Epoch 573/1000 16/16 [==============================] - 0s 570us/step - loss: 624.0950 Epoch 574/1000 16/16 [==============================] - 0s 544us/step - loss: 626.3256 Epoch 575/1000 16/16 [==============================] - 0s 519us/step - loss: 625.4906 Epoch 576/1000 16/16 [==============================] - 0s 582us/step - loss: 623.7281 Epoch 577/1000 16/16 [==============================] - 0s 473us/step - loss: 627.3848 Epoch 578/1000 16/16 [==============================] - 0s 492us/step - loss: 627.3631 Epoch 579/1000 16/16 [==============================] - 0s 472us/step - loss: 625.7534 Epoch 580/1000 16/16 [==============================] - 0s 504us/step - loss: 623.9418 Epoch 581/1000 16/16 [==============================] - 0s 534us/step - loss: 627.0049 Epoch 582/1000 16/16 [==============================] - 0s 538us/step - loss: 626.2687 Epoch 583/1000 16/16 [==============================] - 0s 588us/step - loss: 627.1301 Epoch 584/1000 16/16 [==============================] - 0s 489us/step - loss: 624.4213 Epoch 585/1000 16/16 [==============================] - 0s 483us/step - loss: 624.6893 Epoch 586/1000 16/16 [==============================] - 0s 575us/step - loss: 624.3265 Epoch 587/1000 16/16 [==============================] - 0s 514us/step - loss: 628.7178 Epoch 588/1000 16/16 [==============================] - 0s 559us/step - loss: 631.6290 Epoch 589/1000 16/16 [==============================] - 0s 543us/step - loss: 625.8157 Epoch 590/1000 16/16 [==============================] - 0s 488us/step - loss: 636.0170 Epoch 591/1000 16/16 [==============================] - 0s 534us/step - loss: 624.5222 Epoch 592/1000 16/16 [==============================] - 0s 556us/step - loss: 625.4031 Epoch 593/1000 16/16 [==============================] - 0s 530us/step - loss: 651.3856 Epoch 594/1000 16/16 [==============================] - 0s 523us/step - loss: 633.1493 Epoch 595/1000 16/16 [==============================] - 0s 564us/step - loss: 624.9967 Epoch 596/1000 16/16 [==============================] - 0s 534us/step - loss: 629.3331 Epoch 597/1000 16/16 [==============================] - 0s 583us/step - loss: 626.8019 Epoch 598/1000 16/16 [==============================] - 0s 567us/step - loss: 624.0817 Epoch 599/1000 16/16 [==============================] - 0s 504us/step - loss: 626.2665 Epoch 600/1000 16/16 [==============================] - 0s 557us/step - loss: 631.8407 Epoch 601/1000 16/16 [==============================] - 0s 501us/step - loss: 625.1180 Epoch 602/1000 16/16 [==============================] - 0s 547us/step - loss: 626.9800 Epoch 603/1000 16/16 [==============================] - 0s 552us/step - loss: 627.7486 Epoch 604/1000 16/16 [==============================] - 0s 500us/step - loss: 626.1198 Epoch 605/1000 16/16 [==============================] - 0s 537us/step - loss: 627.1145 Epoch 606/1000 16/16 [==============================] - 0s 439us/step - loss: 629.5341 Epoch 607/1000 16/16 [==============================] - 0s 460us/step - loss: 630.1857 Epoch 608/1000 16/16 [==============================] - 0s 478us/step - loss: 630.7855 Epoch 609/1000 16/16 [==============================] - 0s 516us/step - loss: 636.3297 Epoch 610/1000 16/16 [==============================] - 0s 552us/step - loss: 623.0310 Epoch 611/1000 16/16 [==============================] - 0s 565us/step - loss: 626.5092 Epoch 612/1000 16/16 [==============================] - 0s 569us/step - loss: 624.0467 Epoch 613/1000 16/16 [==============================] - 0s 474us/step - loss: 623.7747 Epoch 614/1000 16/16 [==============================] - 0s 534us/step - loss: 624.2241 Epoch 615/1000 16/16 [==============================] - 0s 464us/step - loss: 626.0032 Epoch 616/1000 16/16 [==============================] - 0s 550us/step - loss: 625.4194 Epoch 617/1000 16/16 [==============================] - 0s 583us/step - loss: 625.7014 Epoch 618/1000 16/16 [==============================] - 0s 545us/step - loss: 629.7010 Epoch 619/1000 16/16 [==============================] - 0s 482us/step - loss: 627.9033 Epoch 620/1000 16/16 [==============================] - 0s 531us/step - loss: 635.5919 Epoch 621/1000 16/16 [==============================] - 0s 551us/step - loss: 627.1794 Epoch 622/1000 16/16 [==============================] - 0s 492us/step - loss: 629.4480 Epoch 623/1000 16/16 [==============================] - 0s 519us/step - loss: 629.5718 Epoch 624/1000 16/16 [==============================] - 0s 544us/step - loss: 635.9761 Epoch 625/1000 16/16 [==============================] - 0s 540us/step - loss: 630.2128 Epoch 626/1000 16/16 [==============================] - 0s 536us/step - loss: 633.6220 Epoch 627/1000 16/16 [==============================] - 0s 522us/step - loss: 627.6250 Epoch 628/1000 16/16 [==============================] - 0s 542us/step - loss: 625.2053 Epoch 629/1000 16/16 [==============================] - 0s 554us/step - loss: 626.0597 Epoch 630/1000 16/16 [==============================] - 0s 502us/step - loss: 627.7889 Epoch 631/1000 16/16 [==============================] - 0s 605us/step - loss: 633.9888 Epoch 632/1000 16/16 [==============================] - 0s 540us/step - loss: 626.6402 Epoch 633/1000 16/16 [==============================] - 0s 576us/step - loss: 625.8558 Epoch 634/1000 16/16 [==============================] - 0s 518us/step - loss: 629.9333 Epoch 635/1000 16/16 [==============================] - 0s 561us/step - loss: 627.4874 Epoch 636/1000 16/16 [==============================] - 0s 534us/step - loss: 624.7762 Epoch 637/1000 16/16 [==============================] - 0s 520us/step - loss: 624.7727 Epoch 638/1000 16/16 [==============================] - 0s 583us/step - loss: 625.0840 Epoch 639/1000 16/16 [==============================] - 0s 537us/step - loss: 630.4032 Epoch 640/1000 16/16 [==============================] - 0s 562us/step - loss: 630.0735 Epoch 641/1000 16/16 [==============================] - 0s 540us/step - loss: 628.2964 Epoch 642/1000 16/16 [==============================] - 0s 500us/step - loss: 625.8773 Epoch 643/1000 16/16 [==============================] - 0s 584us/step - loss: 623.9885 Epoch 644/1000 16/16 [==============================] - 0s 512us/step - loss: 626.5229 Epoch 645/1000 16/16 [==============================] - 0s 526us/step - loss: 629.6376 Epoch 646/1000 16/16 [==============================] - 0s 544us/step - loss: 628.8647 Epoch 647/1000 16/16 [==============================] - 0s 466us/step - loss: 625.7206 Epoch 648/1000 16/16 [==============================] - 0s 556us/step - loss: 631.9755 Epoch 649/1000 16/16 [==============================] - 0s 506us/step - loss: 631.7192 Epoch 650/1000 16/16 [==============================] - 0s 518us/step - loss: 627.5265 Epoch 651/1000 16/16 [==============================] - 0s 492us/step - loss: 629.1462 Epoch 652/1000 16/16 [==============================] - 0s 556us/step - loss: 629.7988 Epoch 653/1000 16/16 [==============================] - 0s 533us/step - loss: 625.1378 Epoch 654/1000 16/16 [==============================] - 0s 532us/step - loss: 629.9706 Epoch 655/1000 16/16 [==============================] - 0s 536us/step - loss: 626.2067 Epoch 656/1000 16/16 [==============================] - 0s 442us/step - loss: 626.3839 Epoch 657/1000 16/16 [==============================] - 0s 523us/step - loss: 630.3499 Epoch 658/1000 16/16 [==============================] - 0s 588us/step - loss: 627.9229 Epoch 659/1000 16/16 [==============================] - 0s 565us/step - loss: 636.7274 Epoch 660/1000 16/16 [==============================] - 0s 480us/step - loss: 623.4714 Epoch 661/1000 16/16 [==============================] - 0s 510us/step - loss: 631.7878 Epoch 662/1000 16/16 [==============================] - 0s 586us/step - loss: 626.4171 Epoch 663/1000 16/16 [==============================] - 0s 495us/step - loss: 625.4421 Epoch 664/1000 16/16 [==============================] - 0s 506us/step - loss: 626.9183 Epoch 665/1000 16/16 [==============================] - 0s 476us/step - loss: 627.1400 Epoch 666/1000 16/16 [==============================] - 0s 614us/step - loss: 627.3600 Epoch 667/1000 16/16 [==============================] - 0s 552us/step - loss: 626.4876 Epoch 668/1000 16/16 [==============================] - 0s 530us/step - loss: 625.9880 Epoch 669/1000 16/16 [==============================] - 0s 532us/step - loss: 627.2563 Epoch 670/1000 16/16 [==============================] - 0s 522us/step - loss: 630.1780 Epoch 671/1000 16/16 [==============================] - 0s 507us/step - loss: 629.1797 Epoch 672/1000 16/16 [==============================] - 0s 464us/step - loss: 625.7186 Epoch 673/1000 16/16 [==============================] - 0s 500us/step - loss: 624.9489 Epoch 674/1000 16/16 [==============================] - 0s 480us/step - loss: 627.1113 Epoch 675/1000 16/16 [==============================] - 0s 576us/step - loss: 630.2881 Epoch 676/1000 16/16 [==============================] - 0s 558us/step - loss: 630.1391 Epoch 677/1000 16/16 [==============================] - 0s 452us/step - loss: 627.6053 Epoch 678/1000 16/16 [==============================] - 0s 568us/step - loss: 627.0082 Epoch 679/1000 16/16 [==============================] - 0s 553us/step - loss: 627.5014 Epoch 680/1000 16/16 [==============================] - 0s 500us/step - loss: 624.0226 Epoch 681/1000 16/16 [==============================] - 0s 603us/step - loss: 628.2258 Epoch 682/1000 16/16 [==============================] - 0s 507us/step - loss: 628.5308 Epoch 683/1000 16/16 [==============================] - 0s 542us/step - loss: 625.3557 Epoch 684/1000 16/16 [==============================] - 0s 517us/step - loss: 629.2413 Epoch 685/1000 16/16 [==============================] - 0s 489us/step - loss: 629.0634 Epoch 686/1000 16/16 [==============================] - 0s 558us/step - loss: 628.3192 Epoch 687/1000 16/16 [==============================] - 0s 466us/step - loss: 626.6627 Epoch 688/1000 16/16 [==============================] - 0s 555us/step - loss: 634.4310 Epoch 689/1000 16/16 [==============================] - 0s 515us/step - loss: 635.4897 Epoch 690/1000 16/16 [==============================] - 0s 584us/step - loss: 640.9616 Epoch 691/1000 16/16 [==============================] - 0s 506us/step - loss: 630.1642 Epoch 692/1000 16/16 [==============================] - 0s 511us/step - loss: 625.4732 Epoch 693/1000 16/16 [==============================] - 0s 554us/step - loss: 625.2646 Epoch 694/1000 16/16 [==============================] - 0s 531us/step - loss: 623.9106 Epoch 695/1000 16/16 [==============================] - 0s 585us/step - loss: 626.9764 Epoch 696/1000 16/16 [==============================] - 0s 487us/step - loss: 626.9792 Epoch 697/1000 16/16 [==============================] - 0s 526us/step - loss: 625.4160 Epoch 698/1000 16/16 [==============================] - 0s 564us/step - loss: 635.3041 Epoch 699/1000 16/16 [==============================] - 0s 513us/step - loss: 625.2064 Epoch 700/1000 16/16 [==============================] - 0s 609us/step - loss: 632.7625 Epoch 701/1000 16/16 [==============================] - 0s 465us/step - loss: 625.0647 Epoch 702/1000 16/16 [==============================] - 0s 527us/step - loss: 625.4193 Epoch 703/1000 16/16 [==============================] - 0s 507us/step - loss: 625.3212 Epoch 704/1000 16/16 [==============================] - 0s 521us/step - loss: 630.0239 Epoch 705/1000 16/16 [==============================] - 0s 497us/step - loss: 624.1701 Epoch 706/1000 16/16 [==============================] - 0s 554us/step - loss: 625.6415 Epoch 707/1000 16/16 [==============================] - 0s 539us/step - loss: 622.0583 Epoch 708/1000 16/16 [==============================] - 0s 508us/step - loss: 626.0744 Epoch 709/1000 16/16 [==============================] - 0s 527us/step - loss: 627.2501 Epoch 710/1000 16/16 [==============================] - 0s 515us/step - loss: 624.6556 Epoch 711/1000 16/16 [==============================] - 0s 521us/step - loss: 626.1045 Epoch 712/1000 16/16 [==============================] - 0s 541us/step - loss: 627.2506 Epoch 713/1000 16/16 [==============================] - 0s 537us/step - loss: 632.3076 Epoch 714/1000 16/16 [==============================] - 0s 567us/step - loss: 636.2328 Epoch 715/1000 16/16 [==============================] - 0s 537us/step - loss: 636.4690 Epoch 716/1000 16/16 [==============================] - 0s 558us/step - loss: 638.6722 Epoch 717/1000 16/16 [==============================] - 0s 519us/step - loss: 634.0427 Epoch 718/1000 16/16 [==============================] - 0s 486us/step - loss: 629.7567 Epoch 719/1000 16/16 [==============================] - 0s 581us/step - loss: 628.9230 Epoch 720/1000 16/16 [==============================] - 0s 498us/step - loss: 630.5732 Epoch 721/1000 16/16 [==============================] - 0s 523us/step - loss: 632.0309 Epoch 722/1000 16/16 [==============================] - 0s 498us/step - loss: 626.5026 Epoch 723/1000 16/16 [==============================] - 0s 541us/step - loss: 627.4551 Epoch 724/1000 16/16 [==============================] - 0s 520us/step - loss: 626.0226 Epoch 725/1000 16/16 [==============================] - 0s 545us/step - loss: 627.6295 Epoch 726/1000 16/16 [==============================] - 0s 557us/step - loss: 629.7347 Epoch 727/1000 16/16 [==============================] - 0s 452us/step - loss: 628.2794 Epoch 728/1000 16/16 [==============================] - 0s 603us/step - loss: 623.9400 Epoch 729/1000 16/16 [==============================] - 0s 569us/step - loss: 624.7849 Epoch 730/1000 16/16 [==============================] - 0s 528us/step - loss: 626.6757 Epoch 731/1000 16/16 [==============================] - 0s 443us/step - loss: 625.7490 Epoch 732/1000 16/16 [==============================] - 0s 537us/step - loss: 626.7205 Epoch 733/1000 16/16 [==============================] - 0s 617us/step - loss: 625.5409 Epoch 734/1000 16/16 [==============================] - 0s 610us/step - loss: 628.4846 Epoch 735/1000 16/16 [==============================] - 0s 619us/step - loss: 625.5921 Epoch 736/1000 16/16 [==============================] - 0s 637us/step - loss: 625.7590 Epoch 737/1000 16/16 [==============================] - 0s 566us/step - loss: 625.8183 Epoch 738/1000 16/16 [==============================] - 0s 656us/step - loss: 637.5785 Epoch 739/1000 16/16 [==============================] - 0s 611us/step - loss: 624.2060 Epoch 740/1000 16/16 [==============================] - 0s 594us/step - loss: 626.7719 Epoch 741/1000 16/16 [==============================] - 0s 678us/step - loss: 626.7710 Epoch 742/1000 16/16 [==============================] - 0s 642us/step - loss: 627.5589 Epoch 743/1000 16/16 [==============================] - 0s 607us/step - loss: 630.8387 Epoch 744/1000 16/16 [==============================] - 0s 674us/step - loss: 634.0345 Epoch 745/1000 16/16 [==============================] - 0s 575us/step - loss: 638.5429 Epoch 746/1000 16/16 [==============================] - 0s 740us/step - loss: 629.1945 Epoch 747/1000 16/16 [==============================] - 0s 754us/step - loss: 627.5055 Epoch 748/1000 16/16 [==============================] - 0s 757us/step - loss: 632.1229 Epoch 749/1000 16/16 [==============================] - 0s 729us/step - loss: 624.1714 Epoch 750/1000 16/16 [==============================] - 0s 766us/step - loss: 638.0186 Epoch 751/1000 16/16 [==============================] - 0s 582us/step - loss: 636.1804 Epoch 752/1000 16/16 [==============================] - 0s 534us/step - loss: 627.3482 Epoch 753/1000 16/16 [==============================] - 0s 590us/step - loss: 626.6903 Epoch 754/1000 16/16 [==============================] - 0s 616us/step - loss: 626.6907 Epoch 755/1000 16/16 [==============================] - 0s 595us/step - loss: 624.0685 Epoch 756/1000 16/16 [==============================] - 0s 613us/step - loss: 641.5250 Epoch 757/1000 16/16 [==============================] - 0s 511us/step - loss: 638.0133 Epoch 758/1000 16/16 [==============================] - 0s 623us/step - loss: 635.9318 Epoch 759/1000 16/16 [==============================] - 0s 637us/step - loss: 624.9687 Epoch 760/1000 16/16 [==============================] - 0s 558us/step - loss: 627.6839 Epoch 761/1000 16/16 [==============================] - 0s 570us/step - loss: 624.2616 Epoch 762/1000 16/16 [==============================] - 0s 575us/step - loss: 626.6548 Epoch 763/1000 16/16 [==============================] - 0s 514us/step - loss: 628.8915 Epoch 764/1000 16/16 [==============================] - 0s 552us/step - loss: 625.6821 Epoch 765/1000 16/16 [==============================] - 0s 524us/step - loss: 623.9557 Epoch 766/1000 16/16 [==============================] - 0s 547us/step - loss: 626.9004 Epoch 767/1000 16/16 [==============================] - 0s 560us/step - loss: 631.0443 Epoch 768/1000 16/16 [==============================] - 0s 435us/step - loss: 630.4969 Epoch 769/1000 16/16 [==============================] - 0s 552us/step - loss: 638.0487 Epoch 770/1000 16/16 [==============================] - 0s 454us/step - loss: 626.0242 Epoch 771/1000 16/16 [==============================] - 0s 519us/step - loss: 627.6756 Epoch 772/1000 16/16 [==============================] - 0s 571us/step - loss: 627.2629 Epoch 773/1000 16/16 [==============================] - 0s 566us/step - loss: 629.7173 Epoch 774/1000 16/16 [==============================] - 0s 619us/step - loss: 634.2602 Epoch 775/1000 16/16 [==============================] - 0s 631us/step - loss: 629.1890 Epoch 776/1000 16/16 [==============================] - 0s 678us/step - loss: 631.8733 Epoch 777/1000 16/16 [==============================] - 0s 737us/step - loss: 631.7973 Epoch 778/1000 16/16 [==============================] - 0s 659us/step - loss: 627.2825 Epoch 779/1000 16/16 [==============================] - 0s 629us/step - loss: 624.6089 Epoch 780/1000 16/16 [==============================] - 0s 649us/step - loss: 626.6610 Epoch 781/1000 16/16 [==============================] - 0s 691us/step - loss: 634.9104 Epoch 782/1000 16/16 [==============================] - 0s 682us/step - loss: 626.6021 Epoch 783/1000 16/16 [==============================] - 0s 681us/step - loss: 628.5828 Epoch 784/1000 16/16 [==============================] - 0s 735us/step - loss: 628.5170 Epoch 785/1000 16/16 [==============================] - 0s 653us/step - loss: 630.3497 Epoch 786/1000 16/16 [==============================] - 0s 586us/step - loss: 627.2359 Epoch 787/1000 16/16 [==============================] - 0s 742us/step - loss: 636.2994 Epoch 788/1000 16/16 [==============================] - 0s 632us/step - loss: 635.6361 Epoch 789/1000 16/16 [==============================] - 0s 575us/step - loss: 626.2837 Epoch 790/1000 16/16 [==============================] - 0s 601us/step - loss: 625.8046 Epoch 791/1000 16/16 [==============================] - 0s 605us/step - loss: 624.7410 Epoch 792/1000 16/16 [==============================] - 0s 620us/step - loss: 626.9925 Epoch 793/1000 16/16 [==============================] - 0s 544us/step - loss: 632.5504 Epoch 794/1000 16/16 [==============================] - 0s 634us/step - loss: 629.0164 Epoch 795/1000 16/16 [==============================] - 0s 619us/step - loss: 627.6495 Epoch 796/1000 16/16 [==============================] - 0s 551us/step - loss: 624.5389 Epoch 797/1000 16/16 [==============================] - 0s 532us/step - loss: 624.2859 Epoch 798/1000 16/16 [==============================] - 0s 571us/step - loss: 631.1953 Epoch 799/1000 16/16 [==============================] - 0s 646us/step - loss: 632.7537 Epoch 800/1000 16/16 [==============================] - 0s 609us/step - loss: 631.0410 Epoch 801/1000 16/16 [==============================] - 0s 514us/step - loss: 628.7879 Epoch 802/1000 16/16 [==============================] - 0s 586us/step - loss: 629.2214 Epoch 803/1000 16/16 [==============================] - 0s 621us/step - loss: 625.5284 Epoch 804/1000 16/16 [==============================] - 0s 623us/step - loss: 624.9859 Epoch 805/1000 16/16 [==============================] - 0s 566us/step - loss: 626.6749 Epoch 806/1000 16/16 [==============================] - 0s 623us/step - loss: 628.4374 Epoch 807/1000 16/16 [==============================] - 0s 680us/step - loss: 631.3560 Epoch 808/1000 16/16 [==============================] - 0s 616us/step - loss: 630.9643 Epoch 809/1000 16/16 [==============================] - 0s 610us/step - loss: 625.3734 Epoch 810/1000 16/16 [==============================] - 0s 539us/step - loss: 638.6658 Epoch 811/1000 16/16 [==============================] - 0s 536us/step - loss: 635.7294 Epoch 812/1000 16/16 [==============================] - 0s 462us/step - loss: 628.7380 Epoch 813/1000 16/16 [==============================] - 0s 564us/step - loss: 624.3210 Epoch 814/1000 16/16 [==============================] - 0s 501us/step - loss: 639.7764 Epoch 815/1000 16/16 [==============================] - 0s 520us/step - loss: 633.5381 Epoch 816/1000 16/16 [==============================] - 0s 507us/step - loss: 633.0997 Epoch 817/1000 16/16 [==============================] - 0s 574us/step - loss: 630.4592 Epoch 818/1000 16/16 [==============================] - 0s 553us/step - loss: 626.5473 Epoch 819/1000 16/16 [==============================] - 0s 485us/step - loss: 623.0805 Epoch 820/1000 16/16 [==============================] - 0s 571us/step - loss: 628.0190 Epoch 821/1000 16/16 [==============================] - 0s 554us/step - loss: 624.1404 Epoch 822/1000 16/16 [==============================] - 0s 485us/step - loss: 632.9379 Epoch 823/1000 16/16 [==============================] - 0s 540us/step - loss: 625.1146 Epoch 824/1000 16/16 [==============================] - 0s 554us/step - loss: 625.4991 Epoch 825/1000 16/16 [==============================] - 0s 558us/step - loss: 626.6394 Epoch 826/1000 16/16 [==============================] - 0s 700us/step - loss: 626.3483 Epoch 827/1000 16/16 [==============================] - 0s 583us/step - loss: 635.9070 Epoch 828/1000 16/16 [==============================] - 0s 590us/step - loss: 630.9606 Epoch 829/1000 16/16 [==============================] - 0s 558us/step - loss: 627.8102 Epoch 830/1000 16/16 [==============================] - 0s 599us/step - loss: 628.1980 Epoch 831/1000 16/16 [==============================] - 0s 581us/step - loss: 626.5461 Epoch 832/1000 16/16 [==============================] - 0s 616us/step - loss: 624.0089 Epoch 833/1000 16/16 [==============================] - 0s 560us/step - loss: 628.3639 Epoch 834/1000 16/16 [==============================] - 0s 574us/step - loss: 631.7368 Epoch 835/1000 16/16 [==============================] - 0s 529us/step - loss: 625.4322 Epoch 836/1000 16/16 [==============================] - 0s 577us/step - loss: 626.1959 Epoch 837/1000 16/16 [==============================] - 0s 459us/step - loss: 624.0137 Epoch 838/1000 16/16 [==============================] - 0s 480us/step - loss: 623.3736 Epoch 839/1000 16/16 [==============================] - 0s 462us/step - loss: 628.3688 Epoch 840/1000 16/16 [==============================] - 0s 523us/step - loss: 627.9410 Epoch 841/1000 16/16 [==============================] - 0s 522us/step - loss: 626.3790 Epoch 842/1000 16/16 [==============================] - 0s 563us/step - loss: 625.9512 Epoch 843/1000 16/16 [==============================] - 0s 476us/step - loss: 624.8824 Epoch 844/1000 16/16 [==============================] - 0s 479us/step - loss: 624.8878 Epoch 845/1000 16/16 [==============================] - 0s 470us/step - loss: 628.8329 Epoch 846/1000 16/16 [==============================] - 0s 471us/step - loss: 628.0654 Epoch 847/1000 16/16 [==============================] - 0s 502us/step - loss: 625.9852 Epoch 848/1000 16/16 [==============================] - 0s 513us/step - loss: 629.4915 Epoch 849/1000 16/16 [==============================] - 0s 581us/step - loss: 624.5107 Epoch 850/1000 16/16 [==============================] - 0s 518us/step - loss: 625.9510 Epoch 851/1000 16/16 [==============================] - 0s 485us/step - loss: 627.6893 Epoch 852/1000 16/16 [==============================] - 0s 487us/step - loss: 624.8704 Epoch 853/1000 16/16 [==============================] - 0s 557us/step - loss: 630.2441 Epoch 854/1000 16/16 [==============================] - 0s 561us/step - loss: 623.7491 Epoch 855/1000 16/16 [==============================] - 0s 499us/step - loss: 627.5732 Epoch 856/1000 16/16 [==============================] - 0s 487us/step - loss: 629.5228 Epoch 857/1000 16/16 [==============================] - 0s 486us/step - loss: 630.3923 Epoch 858/1000 16/16 [==============================] - 0s 524us/step - loss: 627.1154 Epoch 859/1000 16/16 [==============================] - 0s 515us/step - loss: 626.2328 Epoch 860/1000 16/16 [==============================] - 0s 487us/step - loss: 625.9296 Epoch 861/1000 16/16 [==============================] - 0s 501us/step - loss: 627.4097 Epoch 862/1000 16/16 [==============================] - 0s 546us/step - loss: 624.8992 Epoch 863/1000 16/16 [==============================] - 0s 525us/step - loss: 630.2500 Epoch 864/1000 16/16 [==============================] - 0s 546us/step - loss: 638.3765 Epoch 865/1000 16/16 [==============================] - 0s 585us/step - loss: 625.1742 Epoch 866/1000 16/16 [==============================] - 0s 544us/step - loss: 626.4726 Epoch 867/1000 16/16 [==============================] - 0s 547us/step - loss: 634.9918 Epoch 868/1000 16/16 [==============================] - 0s 559us/step - loss: 628.5493 Epoch 869/1000 16/16 [==============================] - 0s 506us/step - loss: 629.6156 Epoch 870/1000 16/16 [==============================] - 0s 544us/step - loss: 638.2088 Epoch 871/1000 16/16 [==============================] - 0s 540us/step - loss: 631.4145 Epoch 872/1000 16/16 [==============================] - ETA: 0s - loss: 591.504 - 0s 504us/step - loss: 627.5311 Epoch 873/1000 16/16 [==============================] - 0s 582us/step - loss: 625.8085 Epoch 874/1000 16/16 [==============================] - 0s 511us/step - loss: 627.5531 Epoch 875/1000 16/16 [==============================] - 0s 578us/step - loss: 628.7131 Epoch 876/1000 16/16 [==============================] - 0s 582us/step - loss: 635.9265 Epoch 877/1000 16/16 [==============================] - 0s 559us/step - loss: 645.8206 Epoch 878/1000 16/16 [==============================] - 0s 514us/step - loss: 636.9637 Epoch 879/1000 16/16 [==============================] - 0s 463us/step - loss: 629.7833 Epoch 880/1000 16/16 [==============================] - 0s 501us/step - loss: 630.1360 Epoch 881/1000 16/16 [==============================] - 0s 507us/step - loss: 633.7525 Epoch 882/1000 16/16 [==============================] - 0s 489us/step - loss: 628.2113 Epoch 883/1000 16/16 [==============================] - 0s 482us/step - loss: 634.3714 Epoch 884/1000 16/16 [==============================] - 0s 547us/step - loss: 631.5237 Epoch 885/1000 16/16 [==============================] - 0s 549us/step - loss: 629.5874 Epoch 886/1000 16/16 [==============================] - 0s 507us/step - loss: 627.0346 Epoch 887/1000 16/16 [==============================] - 0s 517us/step - loss: 630.6785 Epoch 888/1000 16/16 [==============================] - 0s 475us/step - loss: 632.2159 Epoch 889/1000 16/16 [==============================] - 0s 498us/step - loss: 647.8031 Epoch 890/1000 16/16 [==============================] - 0s 546us/step - loss: 629.4761 Epoch 891/1000 16/16 [==============================] - 0s 531us/step - loss: 626.2902 Epoch 892/1000 16/16 [==============================] - 0s 489us/step - loss: 626.3047 Epoch 893/1000 16/16 [==============================] - 0s 649us/step - loss: 628.3770 Epoch 894/1000 16/16 [==============================] - 0s 568us/step - loss: 629.4524 Epoch 895/1000 16/16 [==============================] - 0s 564us/step - loss: 624.8334 Epoch 896/1000 16/16 [==============================] - 0s 568us/step - loss: 624.9731 Epoch 897/1000 16/16 [==============================] - 0s 567us/step - loss: 634.1280 Epoch 898/1000 16/16 [==============================] - 0s 515us/step - loss: 629.3651 Epoch 899/1000 16/16 [==============================] - 0s 523us/step - loss: 631.1553 Epoch 900/1000 16/16 [==============================] - 0s 544us/step - loss: 630.0607 Epoch 901/1000 16/16 [==============================] - 0s 623us/step - loss: 623.2217 Epoch 902/1000 16/16 [==============================] - 0s 561us/step - loss: 627.0771 Epoch 903/1000 16/16 [==============================] - 0s 483us/step - loss: 627.5510 Epoch 904/1000 16/16 [==============================] - 0s 533us/step - loss: 628.1187 Epoch 905/1000 16/16 [==============================] - 0s 497us/step - loss: 624.1213 Epoch 906/1000 16/16 [==============================] - 0s 563us/step - loss: 636.8654 Epoch 907/1000 16/16 [==============================] - 0s 526us/step - loss: 629.6392 Epoch 908/1000 16/16 [==============================] - 0s 579us/step - loss: 628.2908 Epoch 909/1000 16/16 [==============================] - 0s 561us/step - loss: 629.5238 Epoch 910/1000 16/16 [==============================] - 0s 596us/step - loss: 627.9373 Epoch 911/1000 16/16 [==============================] - 0s 576us/step - loss: 625.6861 Epoch 912/1000 16/16 [==============================] - 0s 578us/step - loss: 627.3746 Epoch 913/1000 16/16 [==============================] - 0s 558us/step - loss: 625.0844 Epoch 914/1000 16/16 [==============================] - 0s 566us/step - loss: 624.9068 Epoch 915/1000 16/16 [==============================] - 0s 558us/step - loss: 626.8097 Epoch 916/1000 16/16 [==============================] - 0s 608us/step - loss: 623.4763 Epoch 917/1000 16/16 [==============================] - 0s 601us/step - loss: 625.5227 Epoch 918/1000 16/16 [==============================] - 0s 513us/step - loss: 628.4565 Epoch 919/1000 16/16 [==============================] - 0s 573us/step - loss: 622.7001 Epoch 920/1000 16/16 [==============================] - 0s 552us/step - loss: 630.8879 Epoch 921/1000 16/16 [==============================] - 0s 522us/step - loss: 629.5280 Epoch 922/1000 16/16 [==============================] - 0s 556us/step - loss: 624.0518 Epoch 923/1000 16/16 [==============================] - 0s 526us/step - loss: 626.2769 Epoch 924/1000 16/16 [==============================] - 0s 542us/step - loss: 629.1635 Epoch 925/1000 16/16 [==============================] - 0s 489us/step - loss: 631.0576 Epoch 926/1000 16/16 [==============================] - 0s 546us/step - loss: 626.7554 Epoch 927/1000 16/16 [==============================] - 0s 554us/step - loss: 625.5422 Epoch 928/1000 16/16 [==============================] - 0s 490us/step - loss: 623.8107 Epoch 929/1000 16/16 [==============================] - 0s 524us/step - loss: 627.5132 Epoch 930/1000 16/16 [==============================] - 0s 554us/step - loss: 624.3129 Epoch 931/1000 16/16 [==============================] - 0s 564us/step - loss: 626.0959 Epoch 932/1000 16/16 [==============================] - 0s 546us/step - loss: 631.8267 Epoch 933/1000 16/16 [==============================] - 0s 589us/step - loss: 626.7101 Epoch 934/1000 16/16 [==============================] - 0s 521us/step - loss: 635.7714 Epoch 935/1000 16/16 [==============================] - 0s 543us/step - loss: 625.4196 Epoch 936/1000 16/16 [==============================] - 0s 614us/step - loss: 633.0273 Epoch 937/1000 16/16 [==============================] - 0s 628us/step - loss: 625.6469 Epoch 938/1000 16/16 [==============================] - 0s 501us/step - loss: 624.3533 Epoch 939/1000 16/16 [==============================] - 0s 516us/step - loss: 628.3557 Epoch 940/1000 16/16 [==============================] - 0s 614us/step - loss: 628.9756 Epoch 941/1000 16/16 [==============================] - 0s 614us/step - loss: 625.6172 Epoch 942/1000 16/16 [==============================] - 0s 537us/step - loss: 625.7137 Epoch 943/1000 16/16 [==============================] - 0s 534us/step - loss: 630.1515 Epoch 944/1000 16/16 [==============================] - 0s 577us/step - loss: 630.5021 Epoch 945/1000 16/16 [==============================] - 0s 581us/step - loss: 625.1791 Epoch 946/1000 16/16 [==============================] - 0s 497us/step - loss: 625.5793 Epoch 947/1000 16/16 [==============================] - 0s 573us/step - loss: 628.2488 Epoch 948/1000 16/16 [==============================] - 0s 568us/step - loss: 627.6001 Epoch 949/1000 16/16 [==============================] - 0s 537us/step - loss: 630.6805 Epoch 950/1000 16/16 [==============================] - 0s 573us/step - loss: 631.3030 Epoch 951/1000 16/16 [==============================] - 0s 459us/step - loss: 631.5513 Epoch 952/1000 16/16 [==============================] - 0s 540us/step - loss: 625.5720 Epoch 953/1000 16/16 [==============================] - 0s 467us/step - loss: 625.0289 Epoch 954/1000 16/16 [==============================] - ETA: 0s - loss: 535.949 - 0s 578us/step - loss: 627.2053 Epoch 955/1000 16/16 [==============================] - 0s 651us/step - loss: 626.8775 Epoch 956/1000 16/16 [==============================] - 0s 476us/step - loss: 629.5267 Epoch 957/1000 16/16 [==============================] - 0s 606us/step - loss: 625.7551 Epoch 958/1000 16/16 [==============================] - 0s 635us/step - loss: 623.8372 Epoch 959/1000 16/16 [==============================] - 0s 499us/step - loss: 632.1951 Epoch 960/1000 16/16 [==============================] - 0s 567us/step - loss: 626.0174 Epoch 961/1000 16/16 [==============================] - 0s 554us/step - loss: 630.7542 Epoch 962/1000 16/16 [==============================] - 0s 540us/step - loss: 633.8970 Epoch 963/1000 16/16 [==============================] - 0s 562us/step - loss: 636.1564 Epoch 964/1000 16/16 [==============================] - 0s 538us/step - loss: 627.6042 Epoch 965/1000 16/16 [==============================] - 0s 592us/step - loss: 631.9976 Epoch 966/1000 16/16 [==============================] - 0s 573us/step - loss: 636.2906 Epoch 967/1000 16/16 [==============================] - 0s 547us/step - loss: 639.3265 Epoch 968/1000 16/16 [==============================] - 0s 543us/step - loss: 627.4012 Epoch 969/1000 16/16 [==============================] - 0s 450us/step - loss: 627.6493 Epoch 970/1000 16/16 [==============================] - 0s 496us/step - loss: 626.4966 Epoch 971/1000 16/16 [==============================] - 0s 489us/step - loss: 626.0011 Epoch 972/1000 16/16 [==============================] - 0s 559us/step - loss: 626.2546 Epoch 973/1000 16/16 [==============================] - 0s 525us/step - loss: 631.0100 Epoch 974/1000 16/16 [==============================] - 0s 598us/step - loss: 625.7029 Epoch 975/1000 16/16 [==============================] - 0s 562us/step - loss: 631.0296 Epoch 976/1000 16/16 [==============================] - 0s 530us/step - loss: 625.1855 Epoch 977/1000 16/16 [==============================] - 0s 519us/step - loss: 626.8986 Epoch 978/1000 16/16 [==============================] - 0s 567us/step - loss: 625.4437 Epoch 979/1000 16/16 [==============================] - 0s 578us/step - loss: 629.0932 Epoch 980/1000 16/16 [==============================] - 0s 571us/step - loss: 627.0010 Epoch 981/1000 16/16 [==============================] - 0s 595us/step - loss: 627.5155 Epoch 982/1000 16/16 [==============================] - 0s 577us/step - loss: 628.9271 Epoch 983/1000 16/16 [==============================] - 0s 588us/step - loss: 630.4009 Epoch 984/1000 16/16 [==============================] - 0s 525us/step - loss: 630.6677 Epoch 985/1000 16/16 [==============================] - 0s 536us/step - loss: 623.6005 Epoch 986/1000 16/16 [==============================] - 0s 620us/step - loss: 625.9358 Epoch 987/1000 16/16 [==============================] - 0s 553us/step - loss: 626.4574 Epoch 988/1000 16/16 [==============================] - 0s 580us/step - loss: 627.9215 Epoch 989/1000 16/16 [==============================] - 0s 525us/step - loss: 625.2110 Epoch 990/1000 16/16 [==============================] - 0s 612us/step - loss: 625.7256 Epoch 991/1000 16/16 [==============================] - 0s 581us/step - loss: 630.9247 Epoch 992/1000 16/16 [==============================] - 0s 633us/step - loss: 633.0897 Epoch 993/1000 16/16 [==============================] - 0s 555us/step - loss: 628.6583 Epoch 994/1000 16/16 [==============================] - 0s 606us/step - loss: 623.6570 Epoch 995/1000 16/16 [==============================] - 0s 557us/step - loss: 632.0029 Epoch 996/1000 16/16 [==============================] - 0s 621us/step - loss: 624.0747 Epoch 997/1000 16/16 [==============================] - 0s 622us/step - loss: 626.2163 Epoch 998/1000 16/16 [==============================] - 0s 511us/step - loss: 625.0337 Epoch 999/1000 16/16 [==============================] - 0s 523us/step - loss: 626.3347 Epoch 1000/1000 16/16 [==============================] - 0s 579us/step - loss: 627.8661
In [50]:
Copied!
import pandas as pd
history_df = pd.DataFrame(epochs_hist.history)
history_df['loss'].plot();
import pandas as pd
history_df = pd.DataFrame(epochs_hist.history)
history_df['loss'].plot();
In [51]:
Copied!
# Previsões com o modelo treinado
temp = 5
revenue = model.predict([temp])
print('Revenue Predictions Using Trained ANN =', revenue)
# Previsões com o modelo treinado
temp = 5
revenue = model.predict([temp])
print('Revenue Predictions Using Trained ANN =', revenue)
Revenue Predictions Using Trained ANN = [[151.52942]]
In [52]:
Copied!
plt.scatter(X_train, y_train, color = 'gray')
plt.plot(X_train, model.predict(X_train), color = 'red')
plt.ylabel('Revenue [dollars]')
plt.xlabel('Temperature [degC]')
plt.title('Revenue Generated vs. Temperature @Ice Cream Stand');
plt.scatter(X_train, y_train, color = 'gray')
plt.plot(X_train, model.predict(X_train), color = 'red')
plt.ylabel('Revenue [dollars]')
plt.xlabel('Temperature [degC]')
plt.title('Revenue Generated vs. Temperature @Ice Cream Stand');
Desafio: Implementação end-to-end MLP¶
Realize o treinamento de uma rede MLP para o dataset Fashion MNIST. Um guia passo a passo pode ser encontrado no link https://www.tensorflow.org/tutorials/keras/classification.
In [46]:
Copied!
### Seu código aqui.....
### Seu código aqui.....
Last update:
September 12, 2022