Learn by Coding Examples in Applied Machine Learning

Binary Classification with Sonar Dataset: Baseline Keras Model in Python

# ignore warnings
import warnings
warnings.filterwarnings("ignore")

Binary Classification with Sonar Dataset: Baseline Keras Model

from pandas import read_csv
from keras.models import Sequential
from keras.layers import Dense
from keras.wrappers.scikit_learn import KerasClassifier
from sklearn.model_selection import cross_val_score
from sklearn.preprocessing import LabelEncoder
from sklearn.model_selection import StratifiedKFold

# load dataset
dataframe = read_csv("sonar.mines.data.csv", header=None)

print(); print(dataframe.head())

dataset = dataframe.values

# split into input (X) and output (Y) variables
X = dataset[:,0:60].astype(float)
Y = dataset[:,60]

# encode class values as integers
encoder = LabelEncoder()
encoder.fit(Y)
encoded_Y = encoder.transform(Y)

# baseline model
def create_baseline():
    # create model
    model = Sequential()
    model.add(Dense(60, input_dim=60, activation='relu'))
    model.add(Dense(1, activation='sigmoid'))
    
    # Compile model
    model.compile(loss='binary_crossentropy', optimizer='adam', metrics=['accuracy'])
    return model

# evaluate model with standardized dataset
estimator = KerasClassifier(build_fn=create_baseline, epochs=100, batch_size=5, verbose=1)
kfold = StratifiedKFold(n_splits=10, shuffle=True)
results = cross_val_score(estimator, X, encoded_Y, cv=kfold)

print(); print("Accuracy Results: ")
print("Baseline: %.2f%% (%.2f%%)" % (results.mean()*100, results.std()*100))

       0       1       2       3       4       5       6       7       8   \
0  0.0200  0.0371  0.0428  0.0207  0.0954  0.0986  0.1539  0.1601  0.3109   
1  0.0453  0.0523  0.0843  0.0689  0.1183  0.2583  0.2156  0.3481  0.3337   
2  0.0262  0.0582  0.1099  0.1083  0.0974  0.2280  0.2431  0.3771  0.5598   
3  0.0100  0.0171  0.0623  0.0205  0.0205  0.0368  0.1098  0.1276  0.0598   
4  0.0762  0.0666  0.0481  0.0394  0.0590  0.0649  0.1209  0.2467  0.3564   

       9   ...      51      52      53      54      55      56      57  \
0  0.2111  ...  0.0027  0.0065  0.0159  0.0072  0.0167  0.0180  0.0084   
1  0.2872  ...  0.0084  0.0089  0.0048  0.0094  0.0191  0.0140  0.0049   
2  0.6194  ...  0.0232  0.0166  0.0095  0.0180  0.0244  0.0316  0.0164   
3  0.1264  ...  0.0121  0.0036  0.0150  0.0085  0.0073  0.0050  0.0044   
4  0.4459  ...  0.0031  0.0054  0.0105  0.0110  0.0015  0.0072  0.0048   

       58      59  60  
0  0.0090  0.0032   R  
1  0.0052  0.0044   R  
2  0.0095  0.0078   R  
3  0.0040  0.0117   R  
4  0.0107  0.0094   R  

[5 rows x 61 columns]
Epoch 1/100
186/186 [==============================] - 1s 3ms/step - loss: 0.6896 - acc: 0.5430
Epoch 2/100
186/186 [==============================] - 0s 215us/step - loss: 0.6583 - acc: 0.6290
Epoch 3/100
186/186 [==============================] - 0s 210us/step - loss: 0.6521 - acc: 0.5860
Epoch 4/100
186/186 [==============================] - 0s 201us/step - loss: 0.6254 - acc: 0.6935
Epoch 5/100
186/186 [==============================] - 0s 181us/step - loss: 0.5845 - acc: 0.7473
Epoch 6/100
186/186 [==============================] - 0s 230us/step - loss: 0.5720 - acc: 0.6935
Epoch 7/100
186/186 [==============================] - 0s 237us/step - loss: 0.5470 - acc: 0.7473
Epoch 8/100
186/186 [==============================] - 0s 174us/step - loss: 0.5289 - acc: 0.7527
Epoch 9/100
186/186 [==============================] - 0s 164us/step - loss: 0.5077 - acc: 0.7742
Epoch 10/100
186/186 [==============================] - 0s 182us/step - loss: 0.4952 - acc: 0.7796
Epoch 11/100
186/186 [==============================] - 0s 178us/step - loss: 0.4808 - acc: 0.8065
Epoch 12/100
186/186 [==============================] - 0s 180us/step - loss: 0.4614 - acc: 0.8226
Epoch 13/100
186/186 [==============================] - 0s 174us/step - loss: 0.4521 - acc: 0.8118
Epoch 14/100
186/186 [==============================] - 0s 160us/step - loss: 0.4408 - acc: 0.8226
Epoch 15/100
186/186 [==============================] - 0s 162us/step - loss: 0.4365 - acc: 0.8226
Epoch 16/100
186/186 [==============================] - 0s 168us/step - loss: 0.4251 - acc: 0.8118
Epoch 17/100
186/186 [==============================] - 0s 194us/step - loss: 0.4137 - acc: 0.8387
Epoch 18/100
186/186 [==============================] - 0s 186us/step - loss: 0.4050 - acc: 0.8333
Epoch 19/100
186/186 [==============================] - 0s 181us/step - loss: 0.3951 - acc: 0.8333
Epoch 20/100
186/186 [==============================] - 0s 181us/step - loss: 0.3893 - acc: 0.8280
Epoch 21/100
186/186 [==============================] - 0s 183us/step - loss: 0.4025 - acc: 0.8065
Epoch 22/100
186/186 [==============================] - 0s 178us/step - loss: 0.3780 - acc: 0.8441
Epoch 23/100
186/186 [==============================] - 0s 204us/step - loss: 0.3775 - acc: 0.8387
Epoch 24/100
186/186 [==============================] - 0s 191us/step - loss: 0.3654 - acc: 0.8602
Epoch 25/100
186/186 [==============================] - 0s 183us/step - loss: 0.3605 - acc: 0.8333
Epoch 26/100
186/186 [==============================] - 0s 177us/step - loss: 0.3485 - acc: 0.8817
Epoch 27/100
186/186 [==============================] - 0s 182us/step - loss: 0.3523 - acc: 0.8387
Epoch 28/100
186/186 [==============================] - 0s 182us/step - loss: 0.3462 - acc: 0.8656
Epoch 29/100
186/186 [==============================] - 0s 179us/step - loss: 0.3432 - acc: 0.8602
Epoch 30/100
186/186 [==============================] - 0s 180us/step - loss: 0.3391 - acc: 0.8495
Epoch 31/100
186/186 [==============================] - 0s 181us/step - loss: 0.3275 - acc: 0.8871
Epoch 32/100
186/186 [==============================] - 0s 179us/step - loss: 0.3211 - acc: 0.8763
Epoch 33/100
186/186 [==============================] - 0s 180us/step - loss: 0.3356 - acc: 0.8656
Epoch 34/100
186/186 [==============================] - 0s 180us/step - loss: 0.3125 - acc: 0.8817
Epoch 35/100
186/186 [==============================] - 0s 177us/step - loss: 0.3164 - acc: 0.8817
Epoch 36/100
186/186 [==============================] - 0s 162us/step - loss: 0.3035 - acc: 0.9140
Epoch 37/100
186/186 [==============================] - 0s 159us/step - loss: 0.3117 - acc: 0.8871
Epoch 38/100
186/186 [==============================] - 0s 160us/step - loss: 0.3077 - acc: 0.8817
Epoch 39/100
186/186 [==============================] - 0s 163us/step - loss: 0.3022 - acc: 0.8925
Epoch 40/100
186/186 [==============================] - 0s 176us/step - loss: 0.2905 - acc: 0.8978
Epoch 41/100
186/186 [==============================] - 0s 208us/step - loss: 0.3054 - acc: 0.8710
Epoch 42/100
186/186 [==============================] - 0s 249us/step - loss: 0.3087 - acc: 0.8656
Epoch 43/100
186/186 [==============================] - 0s 184us/step - loss: 0.2837 - acc: 0.9032
Epoch 44/100
186/186 [==============================] - 0s 166us/step - loss: 0.2767 - acc: 0.8925
Epoch 45/100
186/186 [==============================] - 0s 195us/step - loss: 0.2887 - acc: 0.9032
Epoch 46/100
186/186 [==============================] - 0s 170us/step - loss: 0.2774 - acc: 0.9086
Epoch 47/100
186/186 [==============================] - 0s 175us/step - loss: 0.2689 - acc: 0.9032
Epoch 48/100
186/186 [==============================] - 0s 176us/step - loss: 0.2712 - acc: 0.8817
Epoch 49/100
186/186 [==============================] - 0s 179us/step - loss: 0.2627 - acc: 0.9086
Epoch 50/100
186/186 [==============================] - 0s 169us/step - loss: 0.2613 - acc: 0.8925
Epoch 51/100
186/186 [==============================] - 0s 205us/step - loss: 0.2690 - acc: 0.8817
Epoch 52/100
186/186 [==============================] - 0s 178us/step - loss: 0.2518 - acc: 0.8978
Epoch 53/100
186/186 [==============================] - 0s 168us/step - loss: 0.2516 - acc: 0.9032
Epoch 54/100
186/186 [==============================] - 0s 159us/step - loss: 0.2507 - acc: 0.9032
Epoch 55/100
186/186 [==============================] - 0s 171us/step - loss: 0.2689 - acc: 0.8817
Epoch 56/100
186/186 [==============================] - 0s 173us/step - loss: 0.2721 - acc: 0.8817
Epoch 57/100
186/186 [==============================] - 0s 173us/step - loss: 0.2360 - acc: 0.9086
Epoch 58/100
186/186 [==============================] - 0s 179us/step - loss: 0.2421 - acc: 0.9140
Epoch 59/100
186/186 [==============================] - 0s 161us/step - loss: 0.2434 - acc: 0.9247
Epoch 60/100
186/186 [==============================] - 0s 168us/step - loss: 0.2370 - acc: 0.9032
Epoch 61/100
186/186 [==============================] - 0s 160us/step - loss: 0.2389 - acc: 0.9086
Epoch 62/100
186/186 [==============================] - 0s 165us/step - loss: 0.2290 - acc: 0.9194
Epoch 63/100
186/186 [==============================] - 0s 159us/step - loss: 0.2226 - acc: 0.9194
Epoch 64/100
186/186 [==============================] - 0s 160us/step - loss: 0.2203 - acc: 0.9140
Epoch 65/100
186/186 [==============================] - 0s 162us/step - loss: 0.2250 - acc: 0.9194
Epoch 66/100
186/186 [==============================] - 0s 161us/step - loss: 0.2172 - acc: 0.9194
Epoch 67/100
186/186 [==============================] - 0s 161us/step - loss: 0.2137 - acc: 0.9247
Epoch 68/100
186/186 [==============================] - 0s 168us/step - loss: 0.2129 - acc: 0.9194
Epoch 69/100
186/186 [==============================] - 0s 160us/step - loss: 0.2141 - acc: 0.9194
Epoch 70/100
186/186 [==============================] - 0s 158us/step - loss: 0.2060 - acc: 0.9140
Epoch 71/100
186/186 [==============================] - 0s 157us/step - loss: 0.2102 - acc: 0.9140
Epoch 72/100
186/186 [==============================] - 0s 177us/step - loss: 0.2042 - acc: 0.9194
Epoch 73/100
186/186 [==============================] - 0s 187us/step - loss: 0.2000 - acc: 0.9301
Epoch 74/100
186/186 [==============================] - 0s 181us/step - loss: 0.1992 - acc: 0.9301
Epoch 75/100
186/186 [==============================] - 0s 170us/step - loss: 0.2103 - acc: 0.9032
Epoch 76/100
186/186 [==============================] - 0s 159us/step - loss: 0.1972 - acc: 0.9194
Epoch 77/100
186/186 [==============================] - 0s 186us/step - loss: 0.1918 - acc: 0.9247
Epoch 78/100
186/186 [==============================] - 0s 205us/step - loss: 0.1989 - acc: 0.9355
Epoch 79/100
186/186 [==============================] - 0s 181us/step - loss: 0.1993 - acc: 0.9032
Epoch 80/100
186/186 [==============================] - 0s 175us/step - loss: 0.2079 - acc: 0.9247
Epoch 81/100
186/186 [==============================] - 0s 193us/step - loss: 0.1931 - acc: 0.9462
Epoch 82/100
186/186 [==============================] - 0s 179us/step - loss: 0.1842 - acc: 0.9355
Epoch 83/100
186/186 [==============================] - 0s 186us/step - loss: 0.1819 - acc: 0.9462
Epoch 84/100
186/186 [==============================] - 0s 166us/step - loss: 0.1789 - acc: 0.9409
Epoch 85/100
186/186 [==============================] - 0s 188us/step - loss: 0.1751 - acc: 0.9409
Epoch 86/100
186/186 [==============================] - 0s 171us/step - loss: 0.1702 - acc: 0.9462
Epoch 87/100
186/186 [==============================] - 0s 183us/step - loss: 0.1794 - acc: 0.9409
Epoch 88/100
186/186 [==============================] - 0s 177us/step - loss: 0.1745 - acc: 0.9409
Epoch 89/100
186/186 [==============================] - 0s 164us/step - loss: 0.1694 - acc: 0.9355
Epoch 90/100
186/186 [==============================] - 0s 184us/step - loss: 0.1657 - acc: 0.9409
Epoch 91/100
186/186 [==============================] - 0s 181us/step - loss: 0.1648 - acc: 0.9516
Epoch 92/100
186/186 [==============================] - 0s 179us/step - loss: 0.1647 - acc: 0.9409
Epoch 93/100
186/186 [==============================] - 0s 199us/step - loss: 0.1661 - acc: 0.9409
Epoch 94/100
186/186 [==============================] - 0s 182us/step - loss: 0.1610 - acc: 0.9516
Epoch 95/100
186/186 [==============================] - 0s 166us/step - loss: 0.1583 - acc: 0.9570
Epoch 96/100
186/186 [==============================] - 0s 162us/step - loss: 0.1664 - acc: 0.9247
Epoch 97/100
186/186 [==============================] - 0s 156us/step - loss: 0.1582 - acc: 0.9516
Epoch 98/100
186/186 [==============================] - 0s 162us/step - loss: 0.1497 - acc: 0.9570
Epoch 99/100
186/186 [==============================] - 0s 161us/step - loss: 0.1527 - acc: 0.9624
Epoch 100/100
186/186 [==============================] - 0s 156us/step - loss: 0.1483 - acc: 0.9516
22/22 [==============================] - 0s 7ms/step
Epoch 1/100
187/187 [==============================] - 1s 3ms/step - loss: 0.6934 - acc: 0.5508
Epoch 2/100
187/187 [==============================] - 0s 195us/step - loss: 0.6623 - acc: 0.6471
Epoch 3/100
187/187 [==============================] - 0s 186us/step - loss: 0.6394 - acc: 0.6310
Epoch 4/100
187/187 [==============================] - 0s 160us/step - loss: 0.6142 - acc: 0.7487
Epoch 5/100
187/187 [==============================] - 0s 168us/step - loss: 0.5972 - acc: 0.7380
Epoch 6/100
187/187 [==============================] - 0s 161us/step - loss: 0.5740 - acc: 0.7380
Epoch 7/100
187/187 [==============================] - 0s 157us/step - loss: 0.5531 - acc: 0.7487
Epoch 8/100
187/187 [==============================] - 0s 160us/step - loss: 0.5390 - acc: 0.7647
Epoch 9/100
187/187 [==============================] - 0s 162us/step - loss: 0.5216 - acc: 0.7701
Epoch 10/100
187/187 [==============================] - 0s 167us/step - loss: 0.5028 - acc: 0.8021
Epoch 11/100
187/187 [==============================] - 0s 164us/step - loss: 0.5003 - acc: 0.7914
Epoch 12/100
187/187 [==============================] - 0s 161us/step - loss: 0.4911 - acc: 0.7914
Epoch 13/100
187/187 [==============================] - 0s 158us/step - loss: 0.4719 - acc: 0.7861
Epoch 14/100
187/187 [==============================] - 0s 160us/step - loss: 0.4812 - acc: 0.7754
Epoch 15/100
187/187 [==============================] - 0s 157us/step - loss: 0.4561 - acc: 0.8128
Epoch 16/100
187/187 [==============================] - 0s 160us/step - loss: 0.4550 - acc: 0.7861
Epoch 17/100
187/187 [==============================] - 0s 161us/step - loss: 0.4506 - acc: 0.7968
Epoch 18/100
187/187 [==============================] - 0s 162us/step - loss: 0.4360 - acc: 0.8021
Epoch 19/100
187/187 [==============================] - 0s 156us/step - loss: 0.4348 - acc: 0.7968
Epoch 20/100
187/187 [==============================] - 0s 154us/step - loss: 0.4330 - acc: 0.8021
Epoch 21/100
187/187 [==============================] - 0s 161us/step - loss: 0.4152 - acc: 0.8289
Epoch 22/100
187/187 [==============================] - 0s 158us/step - loss: 0.4131 - acc: 0.8289
Epoch 23/100
187/187 [==============================] - 0s 164us/step - loss: 0.4099 - acc: 0.8289
Epoch 24/100
187/187 [==============================] - 0s 158us/step - loss: 0.4030 - acc: 0.8342
Epoch 25/100
187/187 [==============================] - 0s 160us/step - loss: 0.4051 - acc: 0.8342
Epoch 26/100
187/187 [==============================] - 0s 156us/step - loss: 0.3920 - acc: 0.8342
Epoch 27/100
187/187 [==============================] - 0s 157us/step - loss: 0.3881 - acc: 0.8556
Epoch 28/100
187/187 [==============================] - 0s 156us/step - loss: 0.3827 - acc: 0.8342
Epoch 29/100
187/187 [==============================] - 0s 157us/step - loss: 0.3839 - acc: 0.8182
Epoch 30/100
187/187 [==============================] - 0s 157us/step - loss: 0.3858 - acc: 0.8342
Epoch 31/100
187/187 [==============================] - 0s 157us/step - loss: 0.3716 - acc: 0.8396
Epoch 32/100
187/187 [==============================] - 0s 158us/step - loss: 0.3743 - acc: 0.8449
Epoch 33/100
187/187 [==============================] - 0s 155us/step - loss: 0.3563 - acc: 0.8556
Epoch 34/100
187/187 [==============================] - 0s 155us/step - loss: 0.3632 - acc: 0.8396
Epoch 35/100
187/187 [==============================] - 0s 153us/step - loss: 0.3501 - acc: 0.8717
Epoch 36/100
187/187 [==============================] - 0s 153us/step - loss: 0.3531 - acc: 0.8342
Epoch 37/100
187/187 [==============================] - 0s 155us/step - loss: 0.3418 - acc: 0.8449
Epoch 38/100
187/187 [==============================] - 0s 155us/step - loss: 0.3395 - acc: 0.8503
Epoch 39/100
187/187 [==============================] - 0s 153us/step - loss: 0.3441 - acc: 0.8449
Epoch 40/100
187/187 [==============================] - 0s 154us/step - loss: 0.3317 - acc: 0.8717
Epoch 41/100
187/187 [==============================] - 0s 155us/step - loss: 0.3321 - acc: 0.8449
Epoch 42/100
187/187 [==============================] - 0s 154us/step - loss: 0.3283 - acc: 0.8610
Epoch 43/100
187/187 [==============================] - 0s 176us/step - loss: 0.3181 - acc: 0.8824
Epoch 44/100
187/187 [==============================] - 0s 164us/step - loss: 0.3166 - acc: 0.8610
Epoch 45/100
187/187 [==============================] - 0s 168us/step - loss: 0.3176 - acc: 0.8556
Epoch 46/100
187/187 [==============================] - 0s 160us/step - loss: 0.3108 - acc: 0.8824
Epoch 47/100
187/187 [==============================] - 0s 164us/step - loss: 0.3098 - acc: 0.8717
Epoch 48/100
187/187 [==============================] - 0s 168us/step - loss: 0.3071 - acc: 0.8610
Epoch 49/100
187/187 [==============================] - 0s 163us/step - loss: 0.2982 - acc: 0.9037
Epoch 50/100
187/187 [==============================] - 0s 166us/step - loss: 0.2972 - acc: 0.8984
Epoch 51/100
187/187 [==============================] - 0s 167us/step - loss: 0.2913 - acc: 0.8770
Epoch 52/100
187/187 [==============================] - 0s 169us/step - loss: 0.2951 - acc: 0.8717
Epoch 53/100
187/187 [==============================] - 0s 167us/step - loss: 0.2819 - acc: 0.9091
Epoch 54/100
187/187 [==============================] - 0s 165us/step - loss: 0.2805 - acc: 0.8824
Epoch 55/100
187/187 [==============================] - 0s 198us/step - loss: 0.2880 - acc: 0.8824
Epoch 56/100
187/187 [==============================] - 0s 168us/step - loss: 0.2867 - acc: 0.8930
Epoch 57/100
187/187 [==============================] - 0s 158us/step - loss: 0.2705 - acc: 0.8984
Epoch 58/100
187/187 [==============================] - 0s 153us/step - loss: 0.2730 - acc: 0.8984
Epoch 59/100
187/187 [==============================] - 0s 153us/step - loss: 0.2616 - acc: 0.8930
Epoch 60/100
187/187 [==============================] - 0s 154us/step - loss: 0.2601 - acc: 0.8930
Epoch 61/100
187/187 [==============================] - 0s 155us/step - loss: 0.2518 - acc: 0.8877
Epoch 62/100
187/187 [==============================] - 0s 154us/step - loss: 0.2631 - acc: 0.9144
Epoch 63/100
187/187 [==============================] - 0s 155us/step - loss: 0.2553 - acc: 0.8984
Epoch 64/100
187/187 [==============================] - 0s 156us/step - loss: 0.2478 - acc: 0.9198
Epoch 65/100
187/187 [==============================] - 0s 155us/step - loss: 0.2492 - acc: 0.9251
Epoch 66/100
187/187 [==============================] - 0s 160us/step - loss: 0.2416 - acc: 0.9144
Epoch 67/100
187/187 [==============================] - 0s 177us/step - loss: 0.2412 - acc: 0.9198
Epoch 68/100
187/187 [==============================] - 0s 189us/step - loss: 0.2449 - acc: 0.9412
Epoch 69/100
187/187 [==============================] - 0s 221us/step - loss: 0.2330 - acc: 0.9091
Epoch 70/100
187/187 [==============================] - 0s 164us/step - loss: 0.2286 - acc: 0.9358
Epoch 71/100
187/187 [==============================] - 0s 163us/step - loss: 0.2298 - acc: 0.9251
Epoch 72/100
187/187 [==============================] - 0s 163us/step - loss: 0.2232 - acc: 0.9091
Epoch 73/100
187/187 [==============================] - 0s 162us/step - loss: 0.2156 - acc: 0.9251
Epoch 74/100
187/187 [==============================] - 0s 162us/step - loss: 0.2258 - acc: 0.9037
Epoch 75/100
187/187 [==============================] - 0s 163us/step - loss: 0.2148 - acc: 0.9572
Epoch 76/100
187/187 [==============================] - 0s 162us/step - loss: 0.2127 - acc: 0.9358
Epoch 77/100
187/187 [==============================] - 0s 162us/step - loss: 0.2100 - acc: 0.9412
Epoch 78/100
187/187 [==============================] - 0s 161us/step - loss: 0.2082 - acc: 0.9305
Epoch 79/100
187/187 [==============================] - 0s 162us/step - loss: 0.2047 - acc: 0.9412
Epoch 80/100
187/187 [==============================] - 0s 165us/step - loss: 0.2050 - acc: 0.9358
Epoch 81/100
187/187 [==============================] - 0s 161us/step - loss: 0.1992 - acc: 0.9251
Epoch 82/100
187/187 [==============================] - 0s 162us/step - loss: 0.1955 - acc: 0.9412
Epoch 83/100
187/187 [==============================] - 0s 162us/step - loss: 0.2037 - acc: 0.9358
Epoch 84/100
187/187 [==============================] - 0s 162us/step - loss: 0.1992 - acc: 0.9358
Epoch 85/100
187/187 [==============================] - 0s 161us/step - loss: 0.1925 - acc: 0.9572
Epoch 86/100
187/187 [==============================] - 0s 161us/step - loss: 0.1915 - acc: 0.9519
Epoch 87/100
187/187 [==============================] - 0s 166us/step - loss: 0.1864 - acc: 0.9465
Epoch 88/100
187/187 [==============================] - 0s 168us/step - loss: 0.1810 - acc: 0.9679
Epoch 89/100
187/187 [==============================] - 0s 167us/step - loss: 0.1860 - acc: 0.9465
Epoch 90/100
187/187 [==============================] - 0s 165us/step - loss: 0.1836 - acc: 0.9412
Epoch 91/100
187/187 [==============================] - 0s 161us/step - loss: 0.1796 - acc: 0.9465
Epoch 92/100
187/187 [==============================] - 0s 161us/step - loss: 0.1794 - acc: 0.9519
Epoch 93/100
187/187 [==============================] - 0s 161us/step - loss: 0.1760 - acc: 0.9519
Epoch 94/100
187/187 [==============================] - 0s 161us/step - loss: 0.1722 - acc: 0.9626
Epoch 95/100
187/187 [==============================] - 0s 163us/step - loss: 0.1673 - acc: 0.9626
Epoch 96/100
187/187 [==============================] - 0s 163us/step - loss: 0.1662 - acc: 0.9572
Epoch 97/100
187/187 [==============================] - 0s 162us/step - loss: 0.1661 - acc: 0.9733
Epoch 98/100
187/187 [==============================] - 0s 161us/step - loss: 0.1713 - acc: 0.9572
Epoch 99/100
187/187 [==============================] - 0s 161us/step - loss: 0.1623 - acc: 0.9626
Epoch 100/100
187/187 [==============================] - 0s 160us/step - loss: 0.1534 - acc: 0.9626
21/21 [==============================] - 0s 8ms/step
Epoch 1/100
187/187 [==============================] - 1s 3ms/step - loss: 0.6735 - acc: 0.5348
Epoch 2/100
187/187 [==============================] - 0s 212us/step - loss: 0.6383 - acc: 0.6310
Epoch 3/100
187/187 [==============================] - 0s 212us/step - loss: 0.6183 - acc: 0.6631
Epoch 4/100
187/187 [==============================] - 0s 168us/step - loss: 0.5913 - acc: 0.7112
Epoch 5/100
187/187 [==============================] - 0s 166us/step - loss: 0.5625 - acc: 0.7433
Epoch 6/100
187/187 [==============================] - 0s 174us/step - loss: 0.5453 - acc: 0.7433
Epoch 7/100
187/187 [==============================] - 0s 166us/step - loss: 0.5235 - acc: 0.7647
Epoch 8/100
187/187 [==============================] - 0s 168us/step - loss: 0.5082 - acc: 0.7914
Epoch 9/100
187/187 [==============================] - 0s 166us/step - loss: 0.4903 - acc: 0.7807
Epoch 10/100
187/187 [==============================] - 0s 172us/step - loss: 0.4792 - acc: 0.8021
Epoch 11/100
187/187 [==============================] - 0s 166us/step - loss: 0.4606 - acc: 0.8235
Epoch 12/100
187/187 [==============================] - 0s 166us/step - loss: 0.4551 - acc: 0.8235
Epoch 13/100
187/187 [==============================] - 0s 167us/step - loss: 0.4434 - acc: 0.8342
Epoch 14/100
187/187 [==============================] - 0s 166us/step - loss: 0.4457 - acc: 0.7914
Epoch 15/100
187/187 [==============================] - 0s 165us/step - loss: 0.4289 - acc: 0.8182
Epoch 16/100
187/187 [==============================] - 0s 162us/step - loss: 0.4241 - acc: 0.8235
Epoch 17/100
187/187 [==============================] - 0s 156us/step - loss: 0.4137 - acc: 0.8128
Epoch 18/100
187/187 [==============================] - 0s 156us/step - loss: 0.4070 - acc: 0.8342
Epoch 19/100
187/187 [==============================] - 0s 156us/step - loss: 0.4058 - acc: 0.8396
Epoch 20/100
187/187 [==============================] - 0s 160us/step - loss: 0.3979 - acc: 0.8182
Epoch 21/100
187/187 [==============================] - 0s 158us/step - loss: 0.3904 - acc: 0.8503
Epoch 22/100
187/187 [==============================] - 0s 160us/step - loss: 0.3781 - acc: 0.8396
Epoch 23/100
187/187 [==============================] - 0s 159us/step - loss: 0.3776 - acc: 0.8663
Epoch 24/100
187/187 [==============================] - 0s 159us/step - loss: 0.3823 - acc: 0.8289
Epoch 25/100
187/187 [==============================] - 0s 157us/step - loss: 0.3734 - acc: 0.8342
Epoch 26/100
187/187 [==============================] - 0s 164us/step - loss: 0.3591 - acc: 0.8556
Epoch 27/100
187/187 [==============================] - 0s 167us/step - loss: 0.3636 - acc: 0.8449
Epoch 28/100
187/187 [==============================] - 0s 166us/step - loss: 0.3525 - acc: 0.8556
Epoch 29/100
187/187 [==============================] - 0s 160us/step - loss: 0.3559 - acc: 0.8396
Epoch 30/100
187/187 [==============================] - 0s 156us/step - loss: 0.3388 - acc: 0.8503
Epoch 31/100
187/187 [==============================] - 0s 156us/step - loss: 0.3387 - acc: 0.8503
Epoch 32/100
187/187 [==============================] - 0s 157us/step - loss: 0.3328 - acc: 0.8503
Epoch 33/100
187/187 [==============================] - 0s 157us/step - loss: 0.3379 - acc: 0.8717
Epoch 34/100
187/187 [==============================] - 0s 155us/step - loss: 0.3201 - acc: 0.8824
Epoch 35/100
187/187 [==============================] - 0s 157us/step - loss: 0.3313 - acc: 0.8503
Epoch 36/100
187/187 [==============================] - 0s 157us/step - loss: 0.3213 - acc: 0.8824
Epoch 37/100
187/187 [==============================] - 0s 156us/step - loss: 0.3039 - acc: 0.8877
Epoch 38/100
187/187 [==============================] - 0s 157us/step - loss: 0.3091 - acc: 0.8610
Epoch 39/100
187/187 [==============================] - 0s 157us/step - loss: 0.3059 - acc: 0.8770
Epoch 40/100
187/187 [==============================] - 0s 158us/step - loss: 0.3003 - acc: 0.8824
Epoch 41/100
187/187 [==============================] - 0s 155us/step - loss: 0.2972 - acc: 0.8663
Epoch 42/100
187/187 [==============================] - 0s 162us/step - loss: 0.2955 - acc: 0.8717
Epoch 43/100
187/187 [==============================] - 0s 164us/step - loss: 0.2881 - acc: 0.8877
Epoch 44/100
187/187 [==============================] - 0s 163us/step - loss: 0.2892 - acc: 0.8824
Epoch 45/100
187/187 [==============================] - 0s 162us/step - loss: 0.2741 - acc: 0.9091
Epoch 46/100
187/187 [==============================] - 0s 156us/step - loss: 0.2682 - acc: 0.9037
Epoch 47/100
187/187 [==============================] - 0s 156us/step - loss: 0.2712 - acc: 0.9037
Epoch 48/100
187/187 [==============================] - 0s 157us/step - loss: 0.2578 - acc: 0.8930
Epoch 49/100
187/187 [==============================] - 0s 156us/step - loss: 0.2855 - acc: 0.8770
Epoch 50/100
187/187 [==============================] - 0s 156us/step - loss: 0.2578 - acc: 0.8930
Epoch 51/100
187/187 [==============================] - 0s 157us/step - loss: 0.2530 - acc: 0.9198
Epoch 52/100
187/187 [==============================] - 0s 158us/step - loss: 0.2540 - acc: 0.8984
Epoch 53/100
187/187 [==============================] - 0s 157us/step - loss: 0.2469 - acc: 0.9198
Epoch 54/100
187/187 [==============================] - 0s 154us/step - loss: 0.2468 - acc: 0.9037
Epoch 55/100
187/187 [==============================] - 0s 158us/step - loss: 0.2441 - acc: 0.9144
Epoch 56/100
187/187 [==============================] - 0s 161us/step - loss: 0.2344 - acc: 0.8984
Epoch 57/100
187/187 [==============================] - 0s 159us/step - loss: 0.2387 - acc: 0.9251
Epoch 58/100
187/187 [==============================] - 0s 159us/step - loss: 0.2324 - acc: 0.9305
Epoch 59/100
187/187 [==============================] - 0s 161us/step - loss: 0.2242 - acc: 0.8984
Epoch 60/100
187/187 [==============================] - 0s 163us/step - loss: 0.2334 - acc: 0.9251
Epoch 61/100
187/187 [==============================] - 0s 159us/step - loss: 0.2225 - acc: 0.9198
Epoch 62/100
187/187 [==============================] - 0s 158us/step - loss: 0.2293 - acc: 0.8930
Epoch 63/100
187/187 [==============================] - 0s 157us/step - loss: 0.2145 - acc: 0.9412
Epoch 64/100
187/187 [==============================] - 0s 158us/step - loss: 0.2195 - acc: 0.9144
Epoch 65/100
187/187 [==============================] - 0s 161us/step - loss: 0.2110 - acc: 0.9251
Epoch 66/100
187/187 [==============================] - 0s 162us/step - loss: 0.2033 - acc: 0.9251
Epoch 67/100
187/187 [==============================] - 0s 158us/step - loss: 0.2026 - acc: 0.9519
Epoch 68/100
187/187 [==============================] - 0s 159us/step - loss: 0.2016 - acc: 0.9251
Epoch 69/100
187/187 [==============================] - 0s 161us/step - loss: 0.2002 - acc: 0.9465
Epoch 70/100
187/187 [==============================] - 0s 159us/step - loss: 0.1964 - acc: 0.9358
Epoch 71/100
187/187 [==============================] - 0s 161us/step - loss: 0.1919 - acc: 0.9465
Epoch 72/100
187/187 [==============================] - 0s 159us/step - loss: 0.1895 - acc: 0.9358
Epoch 73/100
187/187 [==============================] - 0s 158us/step - loss: 0.1836 - acc: 0.9412
Epoch 74/100
187/187 [==============================] - 0s 166us/step - loss: 0.1832 - acc: 0.9626
Epoch 75/100
187/187 [==============================] - 0s 161us/step - loss: 0.1771 - acc: 0.9519
Epoch 76/100
187/187 [==============================] - 0s 157us/step - loss: 0.1902 - acc: 0.9358
Epoch 77/100
187/187 [==============================] - 0s 163us/step - loss: 0.1801 - acc: 0.9412
Epoch 78/100
187/187 [==============================] - 0s 165us/step - loss: 0.1696 - acc: 0.9465
Epoch 79/100
187/187 [==============================] - 0s 163us/step - loss: 0.1753 - acc: 0.9412
Epoch 80/100
187/187 [==============================] - 0s 168us/step - loss: 0.1735 - acc: 0.9465
Epoch 81/100
187/187 [==============================] - 0s 161us/step - loss: 0.1636 - acc: 0.9626
Epoch 82/100
187/187 [==============================] - 0s 162us/step - loss: 0.1701 - acc: 0.9465
Epoch 83/100
187/187 [==============================] - 0s 156us/step - loss: 0.1598 - acc: 0.9572
Epoch 84/100
187/187 [==============================] - 0s 155us/step - loss: 0.1534 - acc: 0.9626
Epoch 85/100
187/187 [==============================] - 0s 157us/step - loss: 0.1670 - acc: 0.9358
Epoch 86/100
187/187 [==============================] - 0s 155us/step - loss: 0.1605 - acc: 0.9519
Epoch 87/100
187/187 [==============================] - 0s 155us/step - loss: 0.1480 - acc: 0.9733
Epoch 88/100
187/187 [==============================] - 0s 156us/step - loss: 0.1472 - acc: 0.9519
Epoch 89/100
187/187 [==============================] - 0s 155us/step - loss: 0.1478 - acc: 0.9626
Epoch 90/100
187/187 [==============================] - 0s 155us/step - loss: 0.1398 - acc: 0.9733
Epoch 91/100
187/187 [==============================] - 0s 155us/step - loss: 0.1460 - acc: 0.9679
Epoch 92/100
187/187 [==============================] - 0s 155us/step - loss: 0.1465 - acc: 0.9733
Epoch 93/100
187/187 [==============================] - 0s 156us/step - loss: 0.1450 - acc: 0.9572
Epoch 94/100
187/187 [==============================] - 0s 157us/step - loss: 0.1386 - acc: 0.9679
Epoch 95/100
187/187 [==============================] - 0s 156us/step - loss: 0.1334 - acc: 0.9679
Epoch 96/100
187/187 [==============================] - 0s 156us/step - loss: 0.1285 - acc: 0.9786
Epoch 97/100
187/187 [==============================] - 0s 157us/step - loss: 0.1347 - acc: 0.9519
Epoch 98/100
187/187 [==============================] - 0s 157us/step - loss: 0.1292 - acc: 0.9840
Epoch 99/100
187/187 [==============================] - 0s 159us/step - loss: 0.1274 - acc: 0.9786
Epoch 100/100
187/187 [==============================] - 0s 155us/step - loss: 0.1243 - acc: 0.9840
21/21 [==============================] - 0s 9ms/step
Epoch 1/100
187/187 [==============================] - 1s 3ms/step - loss: 0.6768 - acc: 0.5508
Epoch 2/100
187/187 [==============================] - 0s 217us/step - loss: 0.6433 - acc: 0.6631
Epoch 3/100
187/187 [==============================] - 0s 195us/step - loss: 0.6086 - acc: 0.6791
Epoch 4/100
187/187 [==============================] - 0s 189us/step - loss: 0.5932 - acc: 0.7594
Epoch 5/100
187/187 [==============================] - 0s 180us/step - loss: 0.5702 - acc: 0.7647
Epoch 6/100
187/187 [==============================] - 0s 162us/step - loss: 0.5450 - acc: 0.7807
Epoch 7/100
187/187 [==============================] - 0s 185us/step - loss: 0.5401 - acc: 0.7540
Epoch 8/100
187/187 [==============================] - 0s 171us/step - loss: 0.5136 - acc: 0.7807
Epoch 9/100
187/187 [==============================] - 0s 163us/step - loss: 0.5017 - acc: 0.7968
Epoch 10/100
187/187 [==============================] - 0s 177us/step - loss: 0.4863 - acc: 0.8182
Epoch 11/100
187/187 [==============================] - 0s 173us/step - loss: 0.4894 - acc: 0.7861
Epoch 12/100
187/187 [==============================] - 0s 178us/step - loss: 0.4668 - acc: 0.7968
Epoch 13/100
187/187 [==============================] - 0s 165us/step - loss: 0.4526 - acc: 0.8021
Epoch 14/100
187/187 [==============================] - 0s 160us/step - loss: 0.4606 - acc: 0.8021
Epoch 15/100
187/187 [==============================] - 0s 163us/step - loss: 0.4389 - acc: 0.8182
Epoch 16/100
187/187 [==============================] - 0s 159us/step - loss: 0.4360 - acc: 0.8021
Epoch 17/100
187/187 [==============================] - 0s 158us/step - loss: 0.4208 - acc: 0.8182
Epoch 18/100
187/187 [==============================] - 0s 159us/step - loss: 0.4110 - acc: 0.8396
Epoch 19/100
187/187 [==============================] - 0s 158us/step - loss: 0.4097 - acc: 0.8289
Epoch 20/100
187/187 [==============================] - 0s 158us/step - loss: 0.4051 - acc: 0.8289
Epoch 21/100
187/187 [==============================] - 0s 157us/step - loss: 0.3968 - acc: 0.8396
Epoch 22/100
187/187 [==============================] - 0s 162us/step - loss: 0.3886 - acc: 0.8235
Epoch 23/100
187/187 [==============================] - 0s 159us/step - loss: 0.3848 - acc: 0.8556
Epoch 24/100
187/187 [==============================] - 0s 158us/step - loss: 0.3790 - acc: 0.8503
Epoch 25/100
187/187 [==============================] - 0s 158us/step - loss: 0.3758 - acc: 0.8770
Epoch 26/100
187/187 [==============================] - 0s 159us/step - loss: 0.3768 - acc: 0.8342
Epoch 27/100
187/187 [==============================] - 0s 159us/step - loss: 0.3651 - acc: 0.8556
Epoch 28/100
187/187 [==============================] - 0s 159us/step - loss: 0.3721 - acc: 0.8449
Epoch 29/100
187/187 [==============================] - 0s 160us/step - loss: 0.3667 - acc: 0.8449
Epoch 30/100
187/187 [==============================] - 0s 157us/step - loss: 0.3620 - acc: 0.8556
Epoch 31/100
187/187 [==============================] - 0s 157us/step - loss: 0.3482 - acc: 0.8449
Epoch 32/100
187/187 [==============================] - 0s 159us/step - loss: 0.3570 - acc: 0.8396
Epoch 33/100
187/187 [==============================] - 0s 158us/step - loss: 0.3404 - acc: 0.8824
Epoch 34/100
187/187 [==============================] - 0s 158us/step - loss: 0.3360 - acc: 0.8824
Epoch 35/100
187/187 [==============================] - 0s 161us/step - loss: 0.3354 - acc: 0.8717
Epoch 36/100
187/187 [==============================] - 0s 158us/step - loss: 0.3329 - acc: 0.8770
Epoch 37/100
187/187 [==============================] - 0s 158us/step - loss: 0.3331 - acc: 0.8717
Epoch 38/100
187/187 [==============================] - 0s 159us/step - loss: 0.3341 - acc: 0.8770
Epoch 39/100
187/187 [==============================] - 0s 157us/step - loss: 0.3280 - acc: 0.8610
Epoch 40/100
187/187 [==============================] - 0s 158us/step - loss: 0.3190 - acc: 0.8877
Epoch 41/100
187/187 [==============================] - 0s 158us/step - loss: 0.3096 - acc: 0.8877
Epoch 42/100
187/187 [==============================] - 0s 160us/step - loss: 0.3114 - acc: 0.8930
Epoch 43/100
187/187 [==============================] - 0s 157us/step - loss: 0.3094 - acc: 0.8770
Epoch 44/100
187/187 [==============================] - 0s 158us/step - loss: 0.3024 - acc: 0.8930
Epoch 45/100
187/187 [==============================] - 0s 159us/step - loss: 0.3040 - acc: 0.8877
Epoch 46/100
187/187 [==============================] - 0s 158us/step - loss: 0.2963 - acc: 0.8984
Epoch 47/100
187/187 [==============================] - 0s 157us/step - loss: 0.2955 - acc: 0.9037
Epoch 48/100
187/187 [==============================] - 0s 162us/step - loss: 0.2887 - acc: 0.9091
Epoch 49/100
187/187 [==============================] - 0s 158us/step - loss: 0.2976 - acc: 0.8824
Epoch 50/100
187/187 [==============================] - 0s 159us/step - loss: 0.2867 - acc: 0.9037
Epoch 51/100
187/187 [==============================] - 0s 159us/step - loss: 0.2852 - acc: 0.8930
Epoch 52/100
187/187 [==============================] - 0s 160us/step - loss: 0.2855 - acc: 0.8984
Epoch 53/100
187/187 [==============================] - 0s 158us/step - loss: 0.2769 - acc: 0.9144
Epoch 54/100
187/187 [==============================] - 0s 159us/step - loss: 0.2722 - acc: 0.9037
Epoch 55/100
187/187 [==============================] - 0s 163us/step - loss: 0.2744 - acc: 0.8984
Epoch 56/100
187/187 [==============================] - 0s 160us/step - loss: 0.2684 - acc: 0.9251
Epoch 57/100
187/187 [==============================] - 0s 159us/step - loss: 0.2630 - acc: 0.9198
Epoch 58/100
187/187 [==============================] - 0s 159us/step - loss: 0.2656 - acc: 0.9144
Epoch 59/100
187/187 [==============================] - 0s 160us/step - loss: 0.2672 - acc: 0.9037
Epoch 60/100
187/187 [==============================] - 0s 158us/step - loss: 0.2559 - acc: 0.9198
Epoch 61/100
187/187 [==============================] - 0s 159us/step - loss: 0.2537 - acc: 0.9251
Epoch 62/100
187/187 [==============================] - 0s 160us/step - loss: 0.2553 - acc: 0.9091
Epoch 63/100
187/187 [==============================] - 0s 157us/step - loss: 0.2427 - acc: 0.9251
Epoch 64/100
187/187 [==============================] - 0s 158us/step - loss: 0.2478 - acc: 0.9198
Epoch 65/100
187/187 [==============================] - 0s 159us/step - loss: 0.2495 - acc: 0.9251
Epoch 66/100
187/187 [==============================] - 0s 160us/step - loss: 0.2494 - acc: 0.8930
Epoch 67/100
187/187 [==============================] - 0s 160us/step - loss: 0.2473 - acc: 0.9198
Epoch 68/100
187/187 [==============================] - 0s 161us/step - loss: 0.2405 - acc: 0.9305
Epoch 69/100
187/187 [==============================] - 0s 159us/step - loss: 0.2339 - acc: 0.9358
Epoch 70/100
187/187 [==============================] - 0s 158us/step - loss: 0.2321 - acc: 0.9412
Epoch 71/100
187/187 [==============================] - 0s 160us/step - loss: 0.2276 - acc: 0.9465
Epoch 72/100
187/187 [==============================] - 0s 160us/step - loss: 0.2220 - acc: 0.9412
Epoch 73/100
187/187 [==============================] - 0s 161us/step - loss: 0.2300 - acc: 0.9412
Epoch 74/100
187/187 [==============================] - 0s 160us/step - loss: 0.2291 - acc: 0.9465
Epoch 75/100
187/187 [==============================] - 0s 162us/step - loss: 0.2288 - acc: 0.9251
Epoch 76/100
187/187 [==============================] - 0s 158us/step - loss: 0.2312 - acc: 0.9251
Epoch 77/100
187/187 [==============================] - 0s 159us/step - loss: 0.2177 - acc: 0.9358
Epoch 78/100
187/187 [==============================] - 0s 163us/step - loss: 0.2179 - acc: 0.9358
Epoch 79/100
187/187 [==============================] - 0s 163us/step - loss: 0.2112 - acc: 0.9465
Epoch 80/100
187/187 [==============================] - 0s 162us/step - loss: 0.2160 - acc: 0.9358
Epoch 81/100
187/187 [==============================] - 0s 162us/step - loss: 0.2082 - acc: 0.9412
Epoch 82/100
187/187 [==============================] - 0s 158us/step - loss: 0.2032 - acc: 0.9412
Epoch 83/100
187/187 [==============================] - 0s 159us/step - loss: 0.2217 - acc: 0.9198
Epoch 84/100
187/187 [==============================] - 0s 159us/step - loss: 0.2100 - acc: 0.9412
Epoch 85/100
187/187 [==============================] - 0s 160us/step - loss: 0.1993 - acc: 0.9572
Epoch 86/100
187/187 [==============================] - 0s 158us/step - loss: 0.1985 - acc: 0.9465
Epoch 87/100
187/187 [==============================] - 0s 159us/step - loss: 0.1990 - acc: 0.9519
Epoch 88/100
187/187 [==============================] - 0s 162us/step - loss: 0.1911 - acc: 0.9572
Epoch 89/100
187/187 [==============================] - 0s 162us/step - loss: 0.1912 - acc: 0.9519
Epoch 90/100
187/187 [==============================] - 0s 165us/step - loss: 0.1888 - acc: 0.9572
Epoch 91/100
187/187 [==============================] - 0s 160us/step - loss: 0.1863 - acc: 0.9519
Epoch 92/100
187/187 [==============================] - 0s 160us/step - loss: 0.1973 - acc: 0.9519
Epoch 93/100
187/187 [==============================] - 0s 170us/step - loss: 0.1854 - acc: 0.9626
Epoch 94/100
187/187 [==============================] - 0s 170us/step - loss: 0.2167 - acc: 0.9358
Epoch 95/100
187/187 [==============================] - 0s 159us/step - loss: 0.1840 - acc: 0.9572
Epoch 96/100
187/187 [==============================] - 0s 161us/step - loss: 0.1784 - acc: 0.9519
Epoch 97/100
187/187 [==============================] - 0s 159us/step - loss: 0.1773 - acc: 0.9572
Epoch 98/100
187/187 [==============================] - 0s 161us/step - loss: 0.1746 - acc: 0.9519
Epoch 99/100
187/187 [==============================] - 0s 163us/step - loss: 0.1815 - acc: 0.9519
Epoch 100/100
187/187 [==============================] - 0s 168us/step - loss: 0.1675 - acc: 0.9679
21/21 [==============================] - 0s 10ms/step
Epoch 1/100
187/187 [==============================] - 1s 4ms/step - loss: 0.6864 - acc: 0.5775
Epoch 2/100
187/187 [==============================] - 0s 264us/step - loss: 0.6553 - acc: 0.5882
Epoch 3/100
187/187 [==============================] - 0s 210us/step - loss: 0.6299 - acc: 0.6631
Epoch 4/100
187/187 [==============================] - 0s 183us/step - loss: 0.5972 - acc: 0.7005
Epoch 5/100
187/187 [==============================] - 0s 220us/step - loss: 0.5768 - acc: 0.7219
Epoch 6/100
187/187 [==============================] - 0s 194us/step - loss: 0.5665 - acc: 0.7166
Epoch 7/100
187/187 [==============================] - 0s 203us/step - loss: 0.5428 - acc: 0.7380
Epoch 8/100
187/187 [==============================] - 0s 190us/step - loss: 0.5220 - acc: 0.7754
Epoch 9/100
187/187 [==============================] - 0s 199us/step - loss: 0.5103 - acc: 0.7968
Epoch 10/100
187/187 [==============================] - 0s 173us/step - loss: 0.4960 - acc: 0.7861
Epoch 11/100
187/187 [==============================] - 0s 182us/step - loss: 0.4929 - acc: 0.7861
Epoch 12/100
187/187 [==============================] - 0s 198us/step - loss: 0.4924 - acc: 0.7754
Epoch 13/100
187/187 [==============================] - 0s 174us/step - loss: 0.4731 - acc: 0.7968
Epoch 14/100
187/187 [==============================] - 0s 187us/step - loss: 0.4632 - acc: 0.7968
Epoch 15/100
187/187 [==============================] - 0s 180us/step - loss: 0.4649 - acc: 0.7807
Epoch 16/100
187/187 [==============================] - 0s 198us/step - loss: 0.4354 - acc: 0.8289
Epoch 17/100
187/187 [==============================] - 0s 176us/step - loss: 0.4353 - acc: 0.8182
Epoch 18/100
187/187 [==============================] - 0s 182us/step - loss: 0.4246 - acc: 0.8235
Epoch 19/100
187/187 [==============================] - 0s 191us/step - loss: 0.4177 - acc: 0.8556
Epoch 20/100
187/187 [==============================] - 0s 238us/step - loss: 0.4072 - acc: 0.8289
Epoch 21/100
187/187 [==============================] - 0s 260us/step - loss: 0.4222 - acc: 0.8182
Epoch 22/100
187/187 [==============================] - 0s 221us/step - loss: 0.4039 - acc: 0.8396
Epoch 23/100
187/187 [==============================] - 0s 187us/step - loss: 0.3895 - acc: 0.8449
Epoch 24/100
187/187 [==============================] - 0s 178us/step - loss: 0.3897 - acc: 0.8289
Epoch 25/100
187/187 [==============================] - 0s 173us/step - loss: 0.3950 - acc: 0.8449
Epoch 26/100
187/187 [==============================] - 0s 169us/step - loss: 0.3957 - acc: 0.8235
Epoch 27/100
187/187 [==============================] - 0s 174us/step - loss: 0.3880 - acc: 0.8396
Epoch 28/100
187/187 [==============================] - 0s 186us/step - loss: 0.3734 - acc: 0.8610
Epoch 29/100
187/187 [==============================] - 0s 179us/step - loss: 0.3714 - acc: 0.8610
Epoch 30/100
187/187 [==============================] - 0s 196us/step - loss: 0.3616 - acc: 0.8610
Epoch 31/100
187/187 [==============================] - 0s 225us/step - loss: 0.3510 - acc: 0.8824
Epoch 32/100
187/187 [==============================] - 0s 229us/step - loss: 0.3506 - acc: 0.8610
Epoch 33/100
187/187 [==============================] - 0s 205us/step - loss: 0.3419 - acc: 0.8930
Epoch 34/100
187/187 [==============================] - 0s 161us/step - loss: 0.3489 - acc: 0.8449
Epoch 35/100
187/187 [==============================] - 0s 187us/step - loss: 0.3284 - acc: 0.8717
Epoch 36/100
187/187 [==============================] - 0s 164us/step - loss: 0.3288 - acc: 0.8877
Epoch 37/100
187/187 [==============================] - 0s 189us/step - loss: 0.3251 - acc: 0.8717
Epoch 38/100
187/187 [==============================] - 0s 192us/step - loss: 0.3295 - acc: 0.8930
Epoch 39/100
187/187 [==============================] - 0s 170us/step - loss: 0.3185 - acc: 0.8930
Epoch 40/100
187/187 [==============================] - 0s 194us/step - loss: 0.3130 - acc: 0.8984
Epoch 41/100
187/187 [==============================] - 0s 174us/step - loss: 0.3100 - acc: 0.8984
Epoch 42/100
187/187 [==============================] - 0s 169us/step - loss: 0.3089 - acc: 0.8824
Epoch 43/100
187/187 [==============================] - 0s 179us/step - loss: 0.3040 - acc: 0.8717
Epoch 44/100
187/187 [==============================] - 0s 172us/step - loss: 0.3090 - acc: 0.8824
Epoch 45/100
187/187 [==============================] - 0s 174us/step - loss: 0.2949 - acc: 0.9037
Epoch 46/100
187/187 [==============================] - 0s 168us/step - loss: 0.2930 - acc: 0.9091
Epoch 47/100
187/187 [==============================] - 0s 173us/step - loss: 0.2807 - acc: 0.9251
Epoch 48/100
187/187 [==============================] - 0s 172us/step - loss: 0.2931 - acc: 0.8824
Epoch 49/100
187/187 [==============================] - 0s 172us/step - loss: 0.2893 - acc: 0.8984
Epoch 50/100
187/187 [==============================] - 0s 172us/step - loss: 0.2839 - acc: 0.8984
Epoch 51/100
187/187 [==============================] - 0s 181us/step - loss: 0.2718 - acc: 0.9144
Epoch 52/100
187/187 [==============================] - 0s 173us/step - loss: 0.2682 - acc: 0.9091
Epoch 53/100
187/187 [==============================] - 0s 216us/step - loss: 0.2639 - acc: 0.9091
Epoch 54/100
187/187 [==============================] - 0s 220us/step - loss: 0.2579 - acc: 0.9144
Epoch 55/100
187/187 [==============================] - 0s 217us/step - loss: 0.2706 - acc: 0.8984
Epoch 56/100
187/187 [==============================] - 0s 191us/step - loss: 0.2621 - acc: 0.9091
Epoch 57/100
187/187 [==============================] - 0s 173us/step - loss: 0.2517 - acc: 0.9198
Epoch 58/100
187/187 [==============================] - 0s 178us/step - loss: 0.2479 - acc: 0.9251
Epoch 59/100
187/187 [==============================] - 0s 169us/step - loss: 0.2491 - acc: 0.9037
Epoch 60/100
187/187 [==============================] - 0s 180us/step - loss: 0.2440 - acc: 0.9198
Epoch 61/100
187/187 [==============================] - 0s 168us/step - loss: 0.2478 - acc: 0.9251
Epoch 62/100
187/187 [==============================] - 0s 167us/step - loss: 0.2307 - acc: 0.9358
Epoch 63/100
187/187 [==============================] - 0s 169us/step - loss: 0.2362 - acc: 0.9091
Epoch 64/100
187/187 [==============================] - 0s 168us/step - loss: 0.2322 - acc: 0.9198
Epoch 65/100
187/187 [==============================] - 0s 165us/step - loss: 0.2238 - acc: 0.9358
Epoch 66/100
187/187 [==============================] - 0s 167us/step - loss: 0.2270 - acc: 0.9144
Epoch 67/100
187/187 [==============================] - 0s 165us/step - loss: 0.2195 - acc: 0.9358
Epoch 68/100
187/187 [==============================] - 0s 165us/step - loss: 0.2127 - acc: 0.9519
Epoch 69/100
187/187 [==============================] - 0s 171us/step - loss: 0.2118 - acc: 0.9358
Epoch 70/100
187/187 [==============================] - 0s 163us/step - loss: 0.2080 - acc: 0.9358
Epoch 71/100
187/187 [==============================] - 0s 163us/step - loss: 0.2191 - acc: 0.9198
Epoch 72/100
187/187 [==============================] - 0s 163us/step - loss: 0.1963 - acc: 0.9465
Epoch 73/100
187/187 [==============================] - 0s 172us/step - loss: 0.1997 - acc: 0.9412
Epoch 74/100
187/187 [==============================] - 0s 171us/step - loss: 0.1890 - acc: 0.9465
Epoch 75/100
187/187 [==============================] - 0s 172us/step - loss: 0.2069 - acc: 0.9519
Epoch 76/100
187/187 [==============================] - 0s 185us/step - loss: 0.1911 - acc: 0.9251
Epoch 77/100
187/187 [==============================] - 0s 163us/step - loss: 0.1897 - acc: 0.9626
Epoch 78/100
187/187 [==============================] - 0s 165us/step - loss: 0.1906 - acc: 0.9465
Epoch 79/100
187/187 [==============================] - 0s 162us/step - loss: 0.1844 - acc: 0.9465
Epoch 80/100
187/187 [==============================] - 0s 170us/step - loss: 0.1796 - acc: 0.9519
Epoch 81/100
187/187 [==============================] - 0s 174us/step - loss: 0.1828 - acc: 0.9465
Epoch 82/100
187/187 [==============================] - 0s 168us/step - loss: 0.1808 - acc: 0.9626
Epoch 83/100
187/187 [==============================] - 0s 165us/step - loss: 0.1719 - acc: 0.9412
Epoch 84/100
187/187 [==============================] - 0s 164us/step - loss: 0.1681 - acc: 0.9679
Epoch 85/100
187/187 [==============================] - 0s 164us/step - loss: 0.1617 - acc: 0.9572
Epoch 86/100
187/187 [==============================] - 0s 179us/step - loss: 0.1654 - acc: 0.9519
Epoch 87/100
187/187 [==============================] - 0s 207us/step - loss: 0.1609 - acc: 0.9572
Epoch 88/100
187/187 [==============================] - 0s 180us/step - loss: 0.1578 - acc: 0.9679
Epoch 89/100
187/187 [==============================] - 0s 172us/step - loss: 0.1574 - acc: 0.9626
Epoch 90/100
187/187 [==============================] - 0s 162us/step - loss: 0.1558 - acc: 0.9465
Epoch 91/100
187/187 [==============================] - 0s 160us/step - loss: 0.1530 - acc: 0.9572
Epoch 92/100
187/187 [==============================] - 0s 161us/step - loss: 0.1538 - acc: 0.9679
Epoch 93/100
187/187 [==============================] - 0s 167us/step - loss: 0.1492 - acc: 0.9626
Epoch 94/100
187/187 [==============================] - 0s 160us/step - loss: 0.1431 - acc: 0.9786
Epoch 95/100
187/187 [==============================] - 0s 164us/step - loss: 0.1427 - acc: 0.9733
Epoch 96/100
187/187 [==============================] - 0s 167us/step - loss: 0.1438 - acc: 0.9679
Epoch 97/100
187/187 [==============================] - 0s 175us/step - loss: 0.1381 - acc: 0.9786
Epoch 98/100
187/187 [==============================] - 0s 169us/step - loss: 0.1444 - acc: 0.9733
Epoch 99/100
187/187 [==============================] - 0s 161us/step - loss: 0.1313 - acc: 0.9679
Epoch 100/100
187/187 [==============================] - 0s 162us/step - loss: 0.1333 - acc: 0.9840
21/21 [==============================] - 0s 10ms/step
Epoch 1/100
187/187 [==============================] - 1s 4ms/step - loss: 0.6796 - acc: 0.6043
Epoch 2/100
187/187 [==============================] - 0s 223us/step - loss: 0.6415 - acc: 0.6364
Epoch 3/100
187/187 [==============================] - 0s 215us/step - loss: 0.6064 - acc: 0.7166
Epoch 4/100
187/187 [==============================] - 0s 174us/step - loss: 0.5852 - acc: 0.7326
Epoch 5/100
187/187 [==============================] - 0s 186us/step - loss: 0.5613 - acc: 0.7005
Epoch 6/100
187/187 [==============================] - 0s 188us/step - loss: 0.5479 - acc: 0.7326
Epoch 7/100
187/187 [==============================] - 0s 185us/step - loss: 0.5187 - acc: 0.7701
Epoch 8/100
187/187 [==============================] - 0s 188us/step - loss: 0.5022 - acc: 0.7594
Epoch 9/100
187/187 [==============================] - 0s 199us/step - loss: 0.5009 - acc: 0.7861
Epoch 10/100
187/187 [==============================] - 0s 182us/step - loss: 0.4955 - acc: 0.7914
Epoch 11/100
187/187 [==============================] - 0s 172us/step - loss: 0.4686 - acc: 0.7968
Epoch 12/100
187/187 [==============================] - 0s 173us/step - loss: 0.4527 - acc: 0.8075
Epoch 13/100
187/187 [==============================] - 0s 169us/step - loss: 0.4474 - acc: 0.7754
Epoch 14/100
187/187 [==============================] - 0s 171us/step - loss: 0.4359 - acc: 0.8128
Epoch 15/100
187/187 [==============================] - 0s 182us/step - loss: 0.4248 - acc: 0.8021
Epoch 16/100
187/187 [==============================] - 0s 175us/step - loss: 0.4182 - acc: 0.8075
Epoch 17/100
187/187 [==============================] - 0s 171us/step - loss: 0.4115 - acc: 0.8235
Epoch 18/100
187/187 [==============================] - 0s 187us/step - loss: 0.4172 - acc: 0.8128
Epoch 19/100
187/187 [==============================] - 0s 186us/step - loss: 0.4092 - acc: 0.8182
Epoch 20/100
187/187 [==============================] - 0s 192us/step - loss: 0.3944 - acc: 0.8128
Epoch 21/100
187/187 [==============================] - 0s 183us/step - loss: 0.3921 - acc: 0.8075
Epoch 22/100
187/187 [==============================] - 0s 194us/step - loss: 0.3830 - acc: 0.8235
Epoch 23/100
187/187 [==============================] - 0s 189us/step - loss: 0.3861 - acc: 0.8342
Epoch 24/100
187/187 [==============================] - 0s 192us/step - loss: 0.3772 - acc: 0.8289
Epoch 25/100
187/187 [==============================] - 0s 187us/step - loss: 0.3685 - acc: 0.8128
Epoch 26/100
187/187 [==============================] - 0s 162us/step - loss: 0.3587 - acc: 0.8396
Epoch 27/100
187/187 [==============================] - 0s 174us/step - loss: 0.3584 - acc: 0.8663
Epoch 28/100
187/187 [==============================] - 0s 164us/step - loss: 0.3662 - acc: 0.8342
Epoch 29/100
187/187 [==============================] - 0s 168us/step - loss: 0.3481 - acc: 0.8342
Epoch 30/100
187/187 [==============================] - 0s 166us/step - loss: 0.3384 - acc: 0.8717
Epoch 31/100
187/187 [==============================] - 0s 163us/step - loss: 0.3402 - acc: 0.8396
Epoch 32/100
187/187 [==============================] - 0s 163us/step - loss: 0.3314 - acc: 0.8556
Epoch 33/100
187/187 [==============================] - 0s 164us/step - loss: 0.3260 - acc: 0.8770
Epoch 34/100
187/187 [==============================] - 0s 163us/step - loss: 0.3336 - acc: 0.8503
Epoch 35/100
187/187 [==============================] - 0s 165us/step - loss: 0.3186 - acc: 0.8930
Epoch 36/100
187/187 [==============================] - 0s 172us/step - loss: 0.3183 - acc: 0.8503
Epoch 37/100
187/187 [==============================] - 0s 175us/step - loss: 0.3140 - acc: 0.8556
Epoch 38/100
187/187 [==============================] - 0s 170us/step - loss: 0.3060 - acc: 0.8770
Epoch 39/100
187/187 [==============================] - 0s 163us/step - loss: 0.3008 - acc: 0.8824
Epoch 40/100
187/187 [==============================] - 0s 162us/step - loss: 0.3111 - acc: 0.8556
Epoch 41/100
187/187 [==============================] - 0s 163us/step - loss: 0.3007 - acc: 0.8770
Epoch 42/100
187/187 [==============================] - 0s 167us/step - loss: 0.2964 - acc: 0.8877
Epoch 43/100
187/187 [==============================] - 0s 167us/step - loss: 0.2946 - acc: 0.8824
Epoch 44/100
187/187 [==============================] - 0s 166us/step - loss: 0.2780 - acc: 0.8930
Epoch 45/100
187/187 [==============================] - 0s 166us/step - loss: 0.2849 - acc: 0.8930
Epoch 46/100
187/187 [==============================] - 0s 165us/step - loss: 0.2817 - acc: 0.9144
Epoch 47/100
187/187 [==============================] - 0s 164us/step - loss: 0.2756 - acc: 0.8877
Epoch 48/100
187/187 [==============================] - 0s 163us/step - loss: 0.2700 - acc: 0.8984
Epoch 49/100
187/187 [==============================] - 0s 163us/step - loss: 0.2674 - acc: 0.9144
Epoch 50/100
187/187 [==============================] - 0s 162us/step - loss: 0.2772 - acc: 0.8770
Epoch 51/100
187/187 [==============================] - 0s 163us/step - loss: 0.2610 - acc: 0.9037
Epoch 52/100
187/187 [==============================] - 0s 163us/step - loss: 0.2556 - acc: 0.9037
Epoch 53/100
187/187 [==============================] - 0s 164us/step - loss: 0.2542 - acc: 0.9091
Epoch 54/100
187/187 [==============================] - 0s 162us/step - loss: 0.2535 - acc: 0.9091
Epoch 55/100
187/187 [==============================] - 0s 163us/step - loss: 0.2435 - acc: 0.8984
Epoch 56/100
187/187 [==============================] - 0s 162us/step - loss: 0.2462 - acc: 0.9144
Epoch 57/100
187/187 [==============================] - 0s 162us/step - loss: 0.2434 - acc: 0.9358
Epoch 58/100
187/187 [==============================] - 0s 161us/step - loss: 0.2455 - acc: 0.8984
Epoch 59/100
187/187 [==============================] - 0s 161us/step - loss: 0.2351 - acc: 0.9144
Epoch 60/100
187/187 [==============================] - 0s 162us/step - loss: 0.2308 - acc: 0.9198
Epoch 61/100
187/187 [==============================] - 0s 162us/step - loss: 0.2262 - acc: 0.9144
Epoch 62/100
187/187 [==============================] - 0s 162us/step - loss: 0.2318 - acc: 0.9305
Epoch 63/100
187/187 [==============================] - 0s 161us/step - loss: 0.2237 - acc: 0.9144
Epoch 64/100
187/187 [==============================] - 0s 162us/step - loss: 0.2184 - acc: 0.9358
Epoch 65/100
187/187 [==============================] - 0s 164us/step - loss: 0.2140 - acc: 0.9412
Epoch 66/100
187/187 [==============================] - 0s 164us/step - loss: 0.2123 - acc: 0.9358
Epoch 67/100
187/187 [==============================] - 0s 163us/step - loss: 0.2148 - acc: 0.9358
Epoch 68/100
187/187 [==============================] - 0s 165us/step - loss: 0.2130 - acc: 0.9305
Epoch 69/100
187/187 [==============================] - 0s 161us/step - loss: 0.2019 - acc: 0.9465
Epoch 70/100
187/187 [==============================] - 0s 161us/step - loss: 0.2082 - acc: 0.9198
Epoch 71/100
187/187 [==============================] - 0s 161us/step - loss: 0.1988 - acc: 0.9305
Epoch 72/100
187/187 [==============================] - 0s 161us/step - loss: 0.2024 - acc: 0.9412
Epoch 73/100
187/187 [==============================] - 0s 160us/step - loss: 0.2001 - acc: 0.9412
Epoch 74/100
187/187 [==============================] - 0s 161us/step - loss: 0.1985 - acc: 0.9412
Epoch 75/100
187/187 [==============================] - 0s 162us/step - loss: 0.2007 - acc: 0.9465
Epoch 76/100
187/187 [==============================] - 0s 162us/step - loss: 0.1916 - acc: 0.9305
Epoch 77/100
187/187 [==============================] - 0s 161us/step - loss: 0.1927 - acc: 0.9412
Epoch 78/100
187/187 [==============================] - 0s 161us/step - loss: 0.1852 - acc: 0.9465
Epoch 79/100
187/187 [==============================] - 0s 161us/step - loss: 0.1822 - acc: 0.9572
Epoch 80/100
187/187 [==============================] - 0s 161us/step - loss: 0.1806 - acc: 0.9519
Epoch 81/100
187/187 [==============================] - 0s 163us/step - loss: 0.1734 - acc: 0.9626
Epoch 82/100
187/187 [==============================] - 0s 161us/step - loss: 0.1834 - acc: 0.9519
Epoch 83/100
187/187 [==============================] - 0s 162us/step - loss: 0.1791 - acc: 0.9626
Epoch 84/100
187/187 [==============================] - 0s 160us/step - loss: 0.1820 - acc: 0.9412
Epoch 85/100
187/187 [==============================] - 0s 161us/step - loss: 0.1728 - acc: 0.9412
Epoch 86/100
187/187 [==============================] - 0s 163us/step - loss: 0.1725 - acc: 0.9519
Epoch 87/100
187/187 [==============================] - 0s 161us/step - loss: 0.1719 - acc: 0.9465
Epoch 88/100
187/187 [==============================] - 0s 164us/step - loss: 0.1683 - acc: 0.9465
Epoch 89/100
187/187 [==============================] - 0s 161us/step - loss: 0.1559 - acc: 0.9572
Epoch 90/100
187/187 [==============================] - 0s 161us/step - loss: 0.1589 - acc: 0.9572
Epoch 91/100
187/187 [==============================] - 0s 160us/step - loss: 0.1580 - acc: 0.9679
Epoch 92/100
187/187 [==============================] - 0s 161us/step - loss: 0.1514 - acc: 0.9572
Epoch 93/100
187/187 [==============================] - 0s 162us/step - loss: 0.1554 - acc: 0.9519
Epoch 94/100
187/187 [==============================] - 0s 162us/step - loss: 0.1531 - acc: 0.9572
Epoch 95/100
187/187 [==============================] - 0s 161us/step - loss: 0.1496 - acc: 0.9733
Epoch 96/100
187/187 [==============================] - 0s 161us/step - loss: 0.1452 - acc: 0.9679
Epoch 97/100
187/187 [==============================] - 0s 161us/step - loss: 0.1471 - acc: 0.9519
Epoch 98/100
187/187 [==============================] - 0s 161us/step - loss: 0.1463 - acc: 0.9519
Epoch 99/100
187/187 [==============================] - 0s 161us/step - loss: 0.1434 - acc: 0.9679
Epoch 100/100
187/187 [==============================] - 0s 162us/step - loss: 0.1362 - acc: 0.9679
21/21 [==============================] - 0s 11ms/step
Epoch 1/100
187/187 [==============================] - 1s 4ms/step - loss: 0.6895 - acc: 0.5508
Epoch 2/100
187/187 [==============================] - 0s 217us/step - loss: 0.6595 - acc: 0.5508
Epoch 3/100
187/187 [==============================] - 0s 241us/step - loss: 0.6395 - acc: 0.6417
Epoch 4/100
187/187 [==============================] - 0s 182us/step - loss: 0.6138 - acc: 0.7540
Epoch 5/100
187/187 [==============================] - 0s 189us/step - loss: 0.5918 - acc: 0.7326
Epoch 6/100
187/187 [==============================] - 0s 177us/step - loss: 0.5710 - acc: 0.7807
Epoch 7/100
187/187 [==============================] - 0s 181us/step - loss: 0.5520 - acc: 0.7594
Epoch 8/100
187/187 [==============================] - 0s 202us/step - loss: 0.5278 - acc: 0.7540
Epoch 9/100
187/187 [==============================] - 0s 183us/step - loss: 0.5128 - acc: 0.7754
Epoch 10/100
187/187 [==============================] - 0s 181us/step - loss: 0.4907 - acc: 0.8075
Epoch 11/100
187/187 [==============================] - 0s 169us/step - loss: 0.4735 - acc: 0.7861
Epoch 12/100
187/187 [==============================] - 0s 175us/step - loss: 0.4642 - acc: 0.7914
Epoch 13/100
187/187 [==============================] - 0s 193us/step - loss: 0.4481 - acc: 0.7861
Epoch 14/100
187/187 [==============================] - 0s 197us/step - loss: 0.4495 - acc: 0.7914
Epoch 15/100
187/187 [==============================] - 0s 195us/step - loss: 0.4330 - acc: 0.7968
Epoch 16/100
187/187 [==============================] - 0s 197us/step - loss: 0.4239 - acc: 0.8182
Epoch 17/100
187/187 [==============================] - 0s 195us/step - loss: 0.4143 - acc: 0.8289
Epoch 18/100
187/187 [==============================] - 0s 197us/step - loss: 0.4053 - acc: 0.8182
Epoch 19/100
187/187 [==============================] - 0s 196us/step - loss: 0.3961 - acc: 0.8128
Epoch 20/100
187/187 [==============================] - 0s 195us/step - loss: 0.3884 - acc: 0.8289
Epoch 21/100
187/187 [==============================] - 0s 197us/step - loss: 0.3821 - acc: 0.8449
Epoch 22/100
187/187 [==============================] - 0s 201us/step - loss: 0.3846 - acc: 0.8235
Epoch 23/100
187/187 [==============================] - 0s 190us/step - loss: 0.3753 - acc: 0.8396
Epoch 24/100
187/187 [==============================] - 0s 173us/step - loss: 0.3768 - acc: 0.8503
Epoch 25/100
187/187 [==============================] - 0s 180us/step - loss: 0.3646 - acc: 0.8342
Epoch 26/100
187/187 [==============================] - 0s 170us/step - loss: 0.3576 - acc: 0.8342
Epoch 27/100
187/187 [==============================] - 0s 166us/step - loss: 0.3587 - acc: 0.8503
Epoch 28/100
187/187 [==============================] - 0s 165us/step - loss: 0.3546 - acc: 0.8396
Epoch 29/100
187/187 [==============================] - 0s 168us/step - loss: 0.3534 - acc: 0.8396
Epoch 30/100
187/187 [==============================] - 0s 164us/step - loss: 0.3427 - acc: 0.8663
Epoch 31/100
187/187 [==============================] - 0s 164us/step - loss: 0.3482 - acc: 0.8503
Epoch 32/100
187/187 [==============================] - 0s 164us/step - loss: 0.3565 - acc: 0.8396
Epoch 33/100
187/187 [==============================] - 0s 164us/step - loss: 0.3331 - acc: 0.8556
Epoch 34/100
187/187 [==============================] - 0s 164us/step - loss: 0.3304 - acc: 0.8663
Epoch 35/100
187/187 [==============================] - 0s 163us/step - loss: 0.3314 - acc: 0.8396
Epoch 36/100
187/187 [==============================] - 0s 163us/step - loss: 0.3253 - acc: 0.8610
Epoch 37/100
187/187 [==============================] - 0s 165us/step - loss: 0.3189 - acc: 0.8877
Epoch 38/100
187/187 [==============================] - 0s 164us/step - loss: 0.3171 - acc: 0.8717
Epoch 39/100
187/187 [==============================] - 0s 177us/step - loss: 0.3142 - acc: 0.8770
Epoch 40/100
187/187 [==============================] - 0s 165us/step - loss: 0.3216 - acc: 0.8717
Epoch 41/100
187/187 [==============================] - 0s 164us/step - loss: 0.3115 - acc: 0.8770
Epoch 42/100
187/187 [==============================] - 0s 167us/step - loss: 0.3048 - acc: 0.8877
Epoch 43/100
187/187 [==============================] - 0s 166us/step - loss: 0.3000 - acc: 0.8930
Epoch 44/100
187/187 [==============================] - 0s 166us/step - loss: 0.3130 - acc: 0.8556
Epoch 45/100
187/187 [==============================] - 0s 165us/step - loss: 0.2988 - acc: 0.8930
Epoch 46/100
187/187 [==============================] - 0s 167us/step - loss: 0.2925 - acc: 0.8930
Epoch 47/100
187/187 [==============================] - 0s 177us/step - loss: 0.3062 - acc: 0.8930
Epoch 48/100
187/187 [==============================] - 0s 183us/step - loss: 0.2884 - acc: 0.9037
Epoch 49/100
187/187 [==============================] - 0s 179us/step - loss: 0.3023 - acc: 0.8717
Epoch 50/100
187/187 [==============================] - 0s 165us/step - loss: 0.2824 - acc: 0.9037
Epoch 51/100
187/187 [==============================] - 0s 165us/step - loss: 0.2844 - acc: 0.8930
Epoch 52/100
187/187 [==============================] - 0s 164us/step - loss: 0.2862 - acc: 0.8770
Epoch 53/100
187/187 [==============================] - 0s 166us/step - loss: 0.2779 - acc: 0.8930
Epoch 54/100
187/187 [==============================] - 0s 164us/step - loss: 0.2785 - acc: 0.8877
Epoch 55/100
187/187 [==============================] - 0s 164us/step - loss: 0.2764 - acc: 0.8877
Epoch 56/100
187/187 [==============================] - 0s 163us/step - loss: 0.2713 - acc: 0.8877
Epoch 57/100
187/187 [==============================] - 0s 164us/step - loss: 0.2777 - acc: 0.8930
Epoch 58/100
187/187 [==============================] - 0s 165us/step - loss: 0.2683 - acc: 0.8930
Epoch 59/100
187/187 [==============================] - 0s 165us/step - loss: 0.2705 - acc: 0.8877
Epoch 60/100
187/187 [==============================] - 0s 164us/step - loss: 0.2600 - acc: 0.9091
Epoch 61/100
187/187 [==============================] - 0s 164us/step - loss: 0.2628 - acc: 0.9037
Epoch 62/100
187/187 [==============================] - 0s 163us/step - loss: 0.2574 - acc: 0.8877
Epoch 63/100
187/187 [==============================] - 0s 164us/step - loss: 0.2629 - acc: 0.8930
Epoch 64/100
187/187 [==============================] - 0s 164us/step - loss: 0.2622 - acc: 0.8877
Epoch 65/100
187/187 [==============================] - 0s 163us/step - loss: 0.2536 - acc: 0.9144
Epoch 66/100
187/187 [==============================] - 0s 164us/step - loss: 0.2492 - acc: 0.9037
Epoch 67/100
187/187 [==============================] - 0s 166us/step - loss: 0.2510 - acc: 0.9251
Epoch 68/100
187/187 [==============================] - 0s 175us/step - loss: 0.2443 - acc: 0.8984
Epoch 69/100
187/187 [==============================] - 0s 180us/step - loss: 0.2449 - acc: 0.8984
Epoch 70/100
187/187 [==============================] - 0s 183us/step - loss: 0.2485 - acc: 0.8984
Epoch 71/100
187/187 [==============================] - 0s 174us/step - loss: 0.2357 - acc: 0.9144
Epoch 72/100
187/187 [==============================] - 0s 165us/step - loss: 0.2405 - acc: 0.9198
Epoch 73/100
187/187 [==============================] - 0s 166us/step - loss: 0.2339 - acc: 0.9305
Epoch 74/100
187/187 [==============================] - 0s 165us/step - loss: 0.2308 - acc: 0.9198
Epoch 75/100
187/187 [==============================] - 0s 165us/step - loss: 0.2351 - acc: 0.9091
Epoch 76/100
187/187 [==============================] - 0s 166us/step - loss: 0.2339 - acc: 0.8930
Epoch 77/100
187/187 [==============================] - 0s 166us/step - loss: 0.2276 - acc: 0.9144
Epoch 78/100
187/187 [==============================] - 0s 164us/step - loss: 0.2234 - acc: 0.9198
Epoch 79/100
187/187 [==============================] - 0s 163us/step - loss: 0.2196 - acc: 0.9198
Epoch 80/100
187/187 [==============================] - 0s 166us/step - loss: 0.2195 - acc: 0.9305
Epoch 81/100
187/187 [==============================] - 0s 168us/step - loss: 0.2204 - acc: 0.9251
Epoch 82/100
187/187 [==============================] - 0s 166us/step - loss: 0.2146 - acc: 0.9198
Epoch 83/100
187/187 [==============================] - 0s 164us/step - loss: 0.2147 - acc: 0.9412
Epoch 84/100
187/187 [==============================] - 0s 165us/step - loss: 0.2098 - acc: 0.9305
Epoch 85/100
187/187 [==============================] - 0s 165us/step - loss: 0.2144 - acc: 0.9251
Epoch 86/100
187/187 [==============================] - 0s 176us/step - loss: 0.2024 - acc: 0.9305
Epoch 87/100
187/187 [==============================] - 0s 165us/step - loss: 0.2016 - acc: 0.9305
Epoch 88/100
187/187 [==============================] - 0s 166us/step - loss: 0.2089 - acc: 0.9251
Epoch 89/100
187/187 [==============================] - 0s 165us/step - loss: 0.2035 - acc: 0.9358
Epoch 90/100
187/187 [==============================] - 0s 168us/step - loss: 0.1976 - acc: 0.9465
Epoch 91/100
187/187 [==============================] - 0s 165us/step - loss: 0.1974 - acc: 0.9519
Epoch 92/100
187/187 [==============================] - 0s 164us/step - loss: 0.1986 - acc: 0.9358
Epoch 93/100
187/187 [==============================] - 0s 164us/step - loss: 0.1942 - acc: 0.9198
Epoch 94/100
187/187 [==============================] - 0s 163us/step - loss: 0.1965 - acc: 0.9358
Epoch 95/100
187/187 [==============================] - 0s 163us/step - loss: 0.1914 - acc: 0.9412
Epoch 96/100
187/187 [==============================] - 0s 164us/step - loss: 0.1911 - acc: 0.9305
Epoch 97/100
187/187 [==============================] - 0s 163us/step - loss: 0.1890 - acc: 0.9305
Epoch 98/100
187/187 [==============================] - 0s 164us/step - loss: 0.1863 - acc: 0.9465
Epoch 99/100
187/187 [==============================] - 0s 163us/step - loss: 0.1941 - acc: 0.9358
Epoch 100/100
187/187 [==============================] - 0s 165us/step - loss: 0.1865 - acc: 0.9465
21/21 [==============================] - 0s 12ms/step
Epoch 1/100
188/188 [==============================] - 1s 5ms/step - loss: 0.6875 - acc: 0.5745
Epoch 2/100
188/188 [==============================] - 0s 242us/step - loss: 0.6406 - acc: 0.6170
Epoch 3/100
188/188 [==============================] - 0s 223us/step - loss: 0.6117 - acc: 0.7287
Epoch 4/100
188/188 [==============================] - 0s 200us/step - loss: 0.5829 - acc: 0.7181
Epoch 5/100
188/188 [==============================] - 0s 206us/step - loss: 0.5604 - acc: 0.7234
Epoch 6/100
188/188 [==============================] - 0s 209us/step - loss: 0.5337 - acc: 0.7606
Epoch 7/100
188/188 [==============================] - 0s 209us/step - loss: 0.5107 - acc: 0.8032
Epoch 8/100
188/188 [==============================] - 0s 199us/step - loss: 0.5011 - acc: 0.7872
Epoch 9/100
188/188 [==============================] - 0s 195us/step - loss: 0.4832 - acc: 0.8085
Epoch 10/100
188/188 [==============================] - 0s 181us/step - loss: 0.4601 - acc: 0.8298
Epoch 11/100
188/188 [==============================] - 0s 177us/step - loss: 0.4527 - acc: 0.8457
Epoch 12/100
188/188 [==============================] - 0s 183us/step - loss: 0.4426 - acc: 0.8032
Epoch 13/100
188/188 [==============================] - 0s 187us/step - loss: 0.4347 - acc: 0.7979
Epoch 14/100
188/188 [==============================] - 0s 179us/step - loss: 0.4226 - acc: 0.8298
Epoch 15/100
188/188 [==============================] - 0s 178us/step - loss: 0.4134 - acc: 0.8404
Epoch 16/100
188/188 [==============================] - 0s 176us/step - loss: 0.4114 - acc: 0.8457
Epoch 17/100
188/188 [==============================] - 0s 177us/step - loss: 0.3981 - acc: 0.8404
Epoch 18/100
188/188 [==============================] - 0s 181us/step - loss: 0.3992 - acc: 0.8298
Epoch 19/100
188/188 [==============================] - 0s 181us/step - loss: 0.3885 - acc: 0.8191
Epoch 20/100
188/188 [==============================] - 0s 174us/step - loss: 0.3815 - acc: 0.8351
Epoch 21/100
188/188 [==============================] - 0s 208us/step - loss: 0.3760 - acc: 0.8511
Epoch 22/100
188/188 [==============================] - 0s 198us/step - loss: 0.3705 - acc: 0.8404
Epoch 23/100
188/188 [==============================] - 0s 201us/step - loss: 0.3619 - acc: 0.8457
Epoch 24/100
188/188 [==============================] - 0s 202us/step - loss: 0.3572 - acc: 0.8617
Epoch 25/100
188/188 [==============================] - 0s 188us/step - loss: 0.3612 - acc: 0.8298
Epoch 26/100
188/188 [==============================] - 0s 199us/step - loss: 0.3444 - acc: 0.8404
Epoch 27/100
188/188 [==============================] - 0s 198us/step - loss: 0.3418 - acc: 0.8670
Epoch 28/100
188/188 [==============================] - 0s 183us/step - loss: 0.3370 - acc: 0.8511
Epoch 29/100
188/188 [==============================] - 0s 200us/step - loss: 0.3349 - acc: 0.8617
Epoch 30/100
188/188 [==============================] - 0s 197us/step - loss: 0.3432 - acc: 0.8404
Epoch 31/100
188/188 [==============================] - 0s 203us/step - loss: 0.3277 - acc: 0.8404
Epoch 32/100
188/188 [==============================] - 0s 218us/step - loss: 0.3247 - acc: 0.8511
Epoch 33/100
188/188 [==============================] - 0s 204us/step - loss: 0.3139 - acc: 0.8404
Epoch 34/100
188/188 [==============================] - 0s 211us/step - loss: 0.3138 - acc: 0.8670
Epoch 35/100
188/188 [==============================] - 0s 177us/step - loss: 0.3079 - acc: 0.8617
Epoch 36/100
188/188 [==============================] - 0s 185us/step - loss: 0.3059 - acc: 0.8723
Epoch 37/100
188/188 [==============================] - 0s 194us/step - loss: 0.3060 - acc: 0.8777
Epoch 38/100
188/188 [==============================] - 0s 194us/step - loss: 0.2975 - acc: 0.8777
Epoch 39/100
188/188 [==============================] - 0s 197us/step - loss: 0.2913 - acc: 0.8883
Epoch 40/100
188/188 [==============================] - 0s 199us/step - loss: 0.2846 - acc: 0.9043
Epoch 41/100
188/188 [==============================] - 0s 177us/step - loss: 0.2807 - acc: 0.9043
Epoch 42/100
188/188 [==============================] - 0s 192us/step - loss: 0.2773 - acc: 0.8989
Epoch 43/100
188/188 [==============================] - 0s 185us/step - loss: 0.2806 - acc: 0.8989
Epoch 44/100
188/188 [==============================] - 0s 183us/step - loss: 0.2762 - acc: 0.8936
Epoch 45/100
188/188 [==============================] - 0s 173us/step - loss: 0.2900 - acc: 0.8777
Epoch 46/100
188/188 [==============================] - 0s 168us/step - loss: 0.2817 - acc: 0.8617
Epoch 47/100
188/188 [==============================] - 0s 168us/step - loss: 0.2695 - acc: 0.8883
Epoch 48/100
188/188 [==============================] - 0s 165us/step - loss: 0.2606 - acc: 0.9043
Epoch 49/100
188/188 [==============================] - 0s 170us/step - loss: 0.2591 - acc: 0.9043
Epoch 50/100
188/188 [==============================] - 0s 179us/step - loss: 0.2538 - acc: 0.9255
Epoch 51/100
188/188 [==============================] - 0s 180us/step - loss: 0.2542 - acc: 0.9149
Epoch 52/100
188/188 [==============================] - 0s 182us/step - loss: 0.2502 - acc: 0.9043
Epoch 53/100
188/188 [==============================] - 0s 177us/step - loss: 0.2425 - acc: 0.9202
Epoch 54/100
188/188 [==============================] - 0s 172us/step - loss: 0.2383 - acc: 0.9255
Epoch 55/100
188/188 [==============================] - 0s 173us/step - loss: 0.2398 - acc: 0.9043
Epoch 56/100
188/188 [==============================] - 0s 166us/step - loss: 0.2389 - acc: 0.9149
Epoch 57/100
188/188 [==============================] - 0s 169us/step - loss: 0.2326 - acc: 0.9096
Epoch 58/100
188/188 [==============================] - 0s 166us/step - loss: 0.2356 - acc: 0.9202
Epoch 59/100
188/188 [==============================] - 0s 168us/step - loss: 0.2270 - acc: 0.9309
Epoch 60/100
188/188 [==============================] - 0s 167us/step - loss: 0.2193 - acc: 0.9415
Epoch 61/100
188/188 [==============================] - 0s 168us/step - loss: 0.2196 - acc: 0.9309
Epoch 62/100
188/188 [==============================] - 0s 167us/step - loss: 0.2155 - acc: 0.9149
Epoch 63/100
188/188 [==============================] - 0s 167us/step - loss: 0.2329 - acc: 0.9309
Epoch 64/100
188/188 [==============================] - 0s 168us/step - loss: 0.2097 - acc: 0.9468
Epoch 65/100
188/188 [==============================] - 0s 176us/step - loss: 0.2089 - acc: 0.9415
Epoch 66/100
188/188 [==============================] - 0s 175us/step - loss: 0.2044 - acc: 0.9415
Epoch 67/100
188/188 [==============================] - 0s 174us/step - loss: 0.2070 - acc: 0.9468
Epoch 68/100
188/188 [==============================] - 0s 175us/step - loss: 0.2117 - acc: 0.9362
Epoch 69/100
188/188 [==============================] - 0s 170us/step - loss: 0.1952 - acc: 0.9574
Epoch 70/100
188/188 [==============================] - 0s 167us/step - loss: 0.2039 - acc: 0.9255
Epoch 71/100
188/188 [==============================] - 0s 168us/step - loss: 0.1939 - acc: 0.9521
Epoch 72/100
188/188 [==============================] - 0s 169us/step - loss: 0.1954 - acc: 0.9574
Epoch 73/100
188/188 [==============================] - 0s 175us/step - loss: 0.1886 - acc: 0.9468
Epoch 74/100
188/188 [==============================] - 0s 175us/step - loss: 0.1914 - acc: 0.9521
Epoch 75/100
188/188 [==============================] - 0s 175us/step - loss: 0.1815 - acc: 0.9628
Epoch 76/100
188/188 [==============================] - 0s 167us/step - loss: 0.1818 - acc: 0.9628
Epoch 77/100
188/188 [==============================] - 0s 166us/step - loss: 0.2003 - acc: 0.9309
Epoch 78/100
188/188 [==============================] - 0s 173us/step - loss: 0.1858 - acc: 0.9309
Epoch 79/100
188/188 [==============================] - 0s 193us/step - loss: 0.1750 - acc: 0.9574
Epoch 80/100
188/188 [==============================] - 0s 169us/step - loss: 0.1714 - acc: 0.9628
Epoch 81/100
188/188 [==============================] - 0s 174us/step - loss: 0.1740 - acc: 0.9574
Epoch 82/100
188/188 [==============================] - 0s 172us/step - loss: 0.1685 - acc: 0.9681
Epoch 83/100
188/188 [==============================] - 0s 174us/step - loss: 0.1845 - acc: 0.9362
Epoch 84/100
188/188 [==============================] - 0s 171us/step - loss: 0.1700 - acc: 0.9681
Epoch 85/100
188/188 [==============================] - 0s 173us/step - loss: 0.1628 - acc: 0.9734
Epoch 86/100
188/188 [==============================] - 0s 172us/step - loss: 0.1599 - acc: 0.9681
Epoch 87/100
188/188 [==============================] - 0s 174us/step - loss: 0.1590 - acc: 0.9574
Epoch 88/100
188/188 [==============================] - 0s 172us/step - loss: 0.1659 - acc: 0.9362
Epoch 89/100
188/188 [==============================] - 0s 175us/step - loss: 0.1566 - acc: 0.9681
Epoch 90/100
188/188 [==============================] - 0s 172us/step - loss: 0.1627 - acc: 0.9468
Epoch 91/100
188/188 [==============================] - 0s 186us/step - loss: 0.1543 - acc: 0.9574
Epoch 92/100
188/188 [==============================] - 0s 210us/step - loss: 0.1503 - acc: 0.9574
Epoch 93/100
188/188 [==============================] - 0s 216us/step - loss: 0.1481 - acc: 0.9628
Epoch 94/100
188/188 [==============================] - 0s 198us/step - loss: 0.1419 - acc: 0.9681
Epoch 95/100
188/188 [==============================] - 0s 188us/step - loss: 0.1443 - acc: 0.9468
Epoch 96/100
188/188 [==============================] - 0s 174us/step - loss: 0.1452 - acc: 0.9521
Epoch 97/100
188/188 [==============================] - 0s 171us/step - loss: 0.1424 - acc: 0.9628
Epoch 98/100
188/188 [==============================] - 0s 169us/step - loss: 0.1398 - acc: 0.9681
Epoch 99/100
188/188 [==============================] - 0s 170us/step - loss: 0.1372 - acc: 0.9734
Epoch 100/100
188/188 [==============================] - 0s 171us/step - loss: 0.1363 - acc: 0.9574
20/20 [==============================] - 0s 14ms/step
Epoch 1/100
188/188 [==============================] - 1s 4ms/step - loss: 0.6884 - acc: 0.5426
Epoch 2/100
188/188 [==============================] - 0s 210us/step - loss: 0.6584 - acc: 0.6223
Epoch 3/100
188/188 [==============================] - 0s 197us/step - loss: 0.6364 - acc: 0.6755
Epoch 4/100
188/188 [==============================] - 0s 177us/step - loss: 0.6151 - acc: 0.7287
Epoch 5/100
188/188 [==============================] - 0s 174us/step - loss: 0.5894 - acc: 0.7128
Epoch 6/100
188/188 [==============================] - 0s 177us/step - loss: 0.5674 - acc: 0.7766
Epoch 7/100
188/188 [==============================] - 0s 174us/step - loss: 0.5497 - acc: 0.7394
Epoch 8/100
188/188 [==============================] - 0s 173us/step - loss: 0.5313 - acc: 0.7287
Epoch 9/100
188/188 [==============================] - 0s 173us/step - loss: 0.5090 - acc: 0.7766
Epoch 10/100
188/188 [==============================] - 0s 173us/step - loss: 0.4948 - acc: 0.7766
Epoch 11/100
188/188 [==============================] - 0s 175us/step - loss: 0.4797 - acc: 0.8404
Epoch 12/100
188/188 [==============================] - 0s 171us/step - loss: 0.4739 - acc: 0.7979
Epoch 13/100
188/188 [==============================] - 0s 172us/step - loss: 0.4554 - acc: 0.7979
Epoch 14/100
188/188 [==============================] - 0s 172us/step - loss: 0.4495 - acc: 0.7926
Epoch 15/100
188/188 [==============================] - 0s 172us/step - loss: 0.4556 - acc: 0.7713
Epoch 16/100
188/188 [==============================] - 0s 172us/step - loss: 0.4409 - acc: 0.7979
Epoch 17/100
188/188 [==============================] - 0s 174us/step - loss: 0.4215 - acc: 0.8298
Epoch 18/100
188/188 [==============================] - 0s 170us/step - loss: 0.4237 - acc: 0.7819
Epoch 19/100
188/188 [==============================] - 0s 170us/step - loss: 0.4103 - acc: 0.7926
Epoch 20/100
188/188 [==============================] - 0s 170us/step - loss: 0.3994 - acc: 0.8404
Epoch 21/100
188/188 [==============================] - 0s 173us/step - loss: 0.4012 - acc: 0.8191
Epoch 22/100
188/188 [==============================] - 0s 174us/step - loss: 0.4101 - acc: 0.7979
Epoch 23/100
188/188 [==============================] - 0s 173us/step - loss: 0.3944 - acc: 0.8191
Epoch 24/100
188/188 [==============================] - 0s 176us/step - loss: 0.3808 - acc: 0.8404
Epoch 25/100
188/188 [==============================] - 0s 199us/step - loss: 0.3785 - acc: 0.8085
Epoch 26/100
188/188 [==============================] - 0s 190us/step - loss: 0.3721 - acc: 0.8564
Epoch 27/100
188/188 [==============================] - 0s 189us/step - loss: 0.3749 - acc: 0.7979
Epoch 28/100
188/188 [==============================] - 0s 190us/step - loss: 0.3651 - acc: 0.8564
Epoch 29/100
188/188 [==============================] - 0s 208us/step - loss: 0.3604 - acc: 0.8511
Epoch 30/100
188/188 [==============================] - 0s 220us/step - loss: 0.3554 - acc: 0.8404
Epoch 31/100
188/188 [==============================] - 0s 221us/step - loss: 0.3576 - acc: 0.8245
Epoch 32/100
188/188 [==============================] - 0s 193us/step - loss: 0.3515 - acc: 0.8404
Epoch 33/100
188/188 [==============================] - 0s 181us/step - loss: 0.3408 - acc: 0.8723
Epoch 34/100
188/188 [==============================] - 0s 173us/step - loss: 0.3388 - acc: 0.8511
Epoch 35/100
188/188 [==============================] - 0s 169us/step - loss: 0.3341 - acc: 0.8723
Epoch 36/100
188/188 [==============================] - 0s 168us/step - loss: 0.3355 - acc: 0.8617
Epoch 37/100
188/188 [==============================] - 0s 174us/step - loss: 0.3278 - acc: 0.8723
Epoch 38/100
188/188 [==============================] - 0s 173us/step - loss: 0.3243 - acc: 0.8723
Epoch 39/100
188/188 [==============================] - 0s 175us/step - loss: 0.3196 - acc: 0.8457
Epoch 40/100
188/188 [==============================] - 0s 169us/step - loss: 0.3152 - acc: 0.8777
Epoch 41/100
188/188 [==============================] - 0s 170us/step - loss: 0.3117 - acc: 0.8723
Epoch 42/100
188/188 [==============================] - 0s 169us/step - loss: 0.3096 - acc: 0.8670
Epoch 43/100
188/188 [==============================] - 0s 170us/step - loss: 0.3033 - acc: 0.8830
Epoch 44/100
188/188 [==============================] - 0s 169us/step - loss: 0.3060 - acc: 0.8670
Epoch 45/100
188/188 [==============================] - 0s 168us/step - loss: 0.2972 - acc: 0.8989
Epoch 46/100
188/188 [==============================] - 0s 169us/step - loss: 0.2980 - acc: 0.8777
Epoch 47/100
188/188 [==============================] - 0s 171us/step - loss: 0.2936 - acc: 0.8777
Epoch 48/100
188/188 [==============================] - 0s 169us/step - loss: 0.2888 - acc: 0.8936
Epoch 49/100
188/188 [==============================] - 0s 172us/step - loss: 0.2930 - acc: 0.8777
Epoch 50/100
188/188 [==============================] - 0s 179us/step - loss: 0.2833 - acc: 0.8830
Epoch 51/100
188/188 [==============================] - 0s 192us/step - loss: 0.2772 - acc: 0.8830
Epoch 52/100
188/188 [==============================] - 0s 197us/step - loss: 0.2728 - acc: 0.8883
Epoch 53/100
188/188 [==============================] - 0s 191us/step - loss: 0.2824 - acc: 0.8830
Epoch 54/100
188/188 [==============================] - 0s 179us/step - loss: 0.2675 - acc: 0.8936
Epoch 55/100
188/188 [==============================] - 0s 171us/step - loss: 0.2684 - acc: 0.9149
Epoch 56/100
188/188 [==============================] - 0s 173us/step - loss: 0.2663 - acc: 0.9096
Epoch 57/100
188/188 [==============================] - 0s 178us/step - loss: 0.2626 - acc: 0.8830
Epoch 58/100
188/188 [==============================] - 0s 179us/step - loss: 0.2668 - acc: 0.8830
Epoch 59/100
188/188 [==============================] - 0s 174us/step - loss: 0.2543 - acc: 0.9096
Epoch 60/100
188/188 [==============================] - 0s 169us/step - loss: 0.2541 - acc: 0.9202
Epoch 61/100
188/188 [==============================] - 0s 171us/step - loss: 0.2517 - acc: 0.9096
Epoch 62/100
188/188 [==============================] - 0s 172us/step - loss: 0.2494 - acc: 0.8777
Epoch 63/100
188/188 [==============================] - 0s 170us/step - loss: 0.2575 - acc: 0.8936
Epoch 64/100
188/188 [==============================] - 0s 184us/step - loss: 0.2576 - acc: 0.8830
Epoch 65/100
188/188 [==============================] - 0s 184us/step - loss: 0.2372 - acc: 0.9415
Epoch 66/100
188/188 [==============================] - 0s 166us/step - loss: 0.2332 - acc: 0.9255
Epoch 67/100
188/188 [==============================] - 0s 167us/step - loss: 0.2335 - acc: 0.9255
Epoch 68/100
188/188 [==============================] - 0s 168us/step - loss: 0.2328 - acc: 0.9096
Epoch 69/100
188/188 [==============================] - 0s 169us/step - loss: 0.2251 - acc: 0.9149
Epoch 70/100
188/188 [==============================] - 0s 175us/step - loss: 0.2245 - acc: 0.9255
Epoch 71/100
188/188 [==============================] - 0s 168us/step - loss: 0.2247 - acc: 0.9362
Epoch 72/100
188/188 [==============================] - 0s 168us/step - loss: 0.2261 - acc: 0.9255
Epoch 73/100
188/188 [==============================] - 0s 167us/step - loss: 0.2107 - acc: 0.9255
Epoch 74/100
188/188 [==============================] - 0s 167us/step - loss: 0.2272 - acc: 0.9202
Epoch 75/100
188/188 [==============================] - 0s 168us/step - loss: 0.2213 - acc: 0.9202
Epoch 76/100
188/188 [==============================] - 0s 167us/step - loss: 0.2100 - acc: 0.9309
Epoch 77/100
188/188 [==============================] - 0s 166us/step - loss: 0.2060 - acc: 0.9362
Epoch 78/100
188/188 [==============================] - 0s 167us/step - loss: 0.2023 - acc: 0.9362
Epoch 79/100
188/188 [==============================] - 0s 166us/step - loss: 0.1964 - acc: 0.9309
Epoch 80/100
188/188 [==============================] - 0s 167us/step - loss: 0.2041 - acc: 0.9309
Epoch 81/100
188/188 [==============================] - 0s 168us/step - loss: 0.2030 - acc: 0.9362
Epoch 82/100
188/188 [==============================] - 0s 168us/step - loss: 0.1997 - acc: 0.9468
Epoch 83/100
188/188 [==============================] - 0s 168us/step - loss: 0.1978 - acc: 0.9628
Epoch 84/100
188/188 [==============================] - 0s 168us/step - loss: 0.1902 - acc: 0.9468
Epoch 85/100
188/188 [==============================] - 0s 167us/step - loss: 0.1898 - acc: 0.9415
Epoch 86/100
188/188 [==============================] - 0s 167us/step - loss: 0.1873 - acc: 0.9415
Epoch 87/100
188/188 [==============================] - 0s 171us/step - loss: 0.1833 - acc: 0.9521
Epoch 88/100
188/188 [==============================] - 0s 173us/step - loss: 0.1821 - acc: 0.9628
Epoch 89/100
188/188 [==============================] - 0s 167us/step - loss: 0.1766 - acc: 0.9521
Epoch 90/100
188/188 [==============================] - 0s 168us/step - loss: 0.1807 - acc: 0.9362
Epoch 91/100
188/188 [==============================] - 0s 168us/step - loss: 0.1746 - acc: 0.9574
Epoch 92/100
188/188 [==============================] - 0s 171us/step - loss: 0.1772 - acc: 0.9628
Epoch 93/100
188/188 [==============================] - 0s 172us/step - loss: 0.1665 - acc: 0.9681
Epoch 94/100
188/188 [==============================] - 0s 169us/step - loss: 0.1707 - acc: 0.9628
Epoch 95/100
188/188 [==============================] - 0s 168us/step - loss: 0.1638 - acc: 0.9574
Epoch 96/100
188/188 [==============================] - 0s 168us/step - loss: 0.1661 - acc: 0.9574
Epoch 97/100
188/188 [==============================] - 0s 172us/step - loss: 0.1772 - acc: 0.9415
Epoch 98/100
188/188 [==============================] - 0s 171us/step - loss: 0.1720 - acc: 0.9521
Epoch 99/100
188/188 [==============================] - 0s 171us/step - loss: 0.1579 - acc: 0.9681
Epoch 100/100
188/188 [==============================] - 0s 200us/step - loss: 0.1541 - acc: 0.9681
20/20 [==============================] - 0s 15ms/step
Epoch 1/100
188/188 [==============================] - 1s 5ms/step - loss: 0.7062 - acc: 0.5000
Epoch 2/100
188/188 [==============================] - 0s 218us/step - loss: 0.6609 - acc: 0.6117
Epoch 3/100
188/188 [==============================] - 0s 195us/step - loss: 0.6349 - acc: 0.6543
Epoch 4/100
188/188 [==============================] - 0s 180us/step - loss: 0.6220 - acc: 0.6809
Epoch 5/100
188/188 [==============================] - 0s 185us/step - loss: 0.5961 - acc: 0.7128
Epoch 6/100
188/188 [==============================] - 0s 174us/step - loss: 0.5746 - acc: 0.7287
Epoch 7/100
188/188 [==============================] - 0s 174us/step - loss: 0.5573 - acc: 0.7553
Epoch 8/100
188/188 [==============================] - 0s 172us/step - loss: 0.5386 - acc: 0.7447
Epoch 9/100
188/188 [==============================] - 0s 173us/step - loss: 0.5268 - acc: 0.7872
Epoch 10/100
188/188 [==============================] - 0s 173us/step - loss: 0.5129 - acc: 0.7660
Epoch 11/100
188/188 [==============================] - 0s 232us/step - loss: 0.5107 - acc: 0.7606
Epoch 12/100
188/188 [==============================] - 0s 196us/step - loss: 0.4907 - acc: 0.8032
Epoch 13/100
188/188 [==============================] - 0s 196us/step - loss: 0.4809 - acc: 0.7872
Epoch 14/100
188/188 [==============================] - 0s 194us/step - loss: 0.4716 - acc: 0.7819
Epoch 15/100
188/188 [==============================] - 0s 191us/step - loss: 0.4645 - acc: 0.7979
Epoch 16/100
188/188 [==============================] - 0s 192us/step - loss: 0.4536 - acc: 0.8245
Epoch 17/100
188/188 [==============================] - 0s 188us/step - loss: 0.4419 - acc: 0.8085
Epoch 18/100
188/188 [==============================] - 0s 195us/step - loss: 0.4374 - acc: 0.8191
Epoch 19/100
188/188 [==============================] - 0s 197us/step - loss: 0.4255 - acc: 0.8404
Epoch 20/100
188/188 [==============================] - 0s 185us/step - loss: 0.4293 - acc: 0.8245
Epoch 21/100
188/188 [==============================] - 0s 177us/step - loss: 0.4215 - acc: 0.8085
Epoch 22/100
188/188 [==============================] - 0s 185us/step - loss: 0.4134 - acc: 0.8245
Epoch 23/100
188/188 [==============================] - 0s 182us/step - loss: 0.4069 - acc: 0.8457
Epoch 24/100
188/188 [==============================] - 0s 177us/step - loss: 0.3955 - acc: 0.8564
Epoch 25/100
188/188 [==============================] - 0s 182us/step - loss: 0.3942 - acc: 0.8351
Epoch 26/100
188/188 [==============================] - 0s 194us/step - loss: 0.4200 - acc: 0.7713
Epoch 27/100
188/188 [==============================] - 0s 185us/step - loss: 0.3851 - acc: 0.8617
Epoch 28/100
188/188 [==============================] - 0s 202us/step - loss: 0.3849 - acc: 0.8511
Epoch 29/100
188/188 [==============================] - 0s 263us/step - loss: 0.3738 - acc: 0.8617
Epoch 30/100
188/188 [==============================] - 0s 179us/step - loss: 0.3743 - acc: 0.8351
Epoch 31/100
188/188 [==============================] - 0s 188us/step - loss: 0.3772 - acc: 0.8457
Epoch 32/100
188/188 [==============================] - 0s 189us/step - loss: 0.3634 - acc: 0.8564
Epoch 33/100
188/188 [==============================] - 0s 188us/step - loss: 0.3613 - acc: 0.8830
Epoch 34/100
188/188 [==============================] - 0s 180us/step - loss: 0.3615 - acc: 0.8723
Epoch 35/100
188/188 [==============================] - 0s 174us/step - loss: 0.3547 - acc: 0.8617
Epoch 36/100
188/188 [==============================] - 0s 180us/step - loss: 0.3484 - acc: 0.8564
Epoch 37/100
188/188 [==============================] - 0s 172us/step - loss: 0.3399 - acc: 0.8830
Epoch 38/100
188/188 [==============================] - 0s 174us/step - loss: 0.3409 - acc: 0.8670
Epoch 39/100
188/188 [==============================] - 0s 175us/step - loss: 0.3466 - acc: 0.8564
Epoch 40/100
188/188 [==============================] - 0s 172us/step - loss: 0.3460 - acc: 0.8670
Epoch 41/100
188/188 [==============================] - 0s 175us/step - loss: 0.3257 - acc: 0.8830
Epoch 42/100
188/188 [==============================] - 0s 173us/step - loss: 0.3274 - acc: 0.8723
Epoch 43/100
188/188 [==============================] - 0s 174us/step - loss: 0.3191 - acc: 0.8777
Epoch 44/100
188/188 [==============================] - 0s 182us/step - loss: 0.3297 - acc: 0.8670
Epoch 45/100
188/188 [==============================] - 0s 195us/step - loss: 0.3202 - acc: 0.8723
Epoch 46/100
188/188 [==============================] - 0s 203us/step - loss: 0.3167 - acc: 0.8457
Epoch 47/100
188/188 [==============================] - 0s 203us/step - loss: 0.3098 - acc: 0.8723
Epoch 48/100
188/188 [==============================] - 0s 205us/step - loss: 0.3223 - acc: 0.8883
Epoch 49/100
188/188 [==============================] - 0s 240us/step - loss: 0.2974 - acc: 0.8936
Epoch 50/100
188/188 [==============================] - 0s 207us/step - loss: 0.2994 - acc: 0.9255
Epoch 51/100
188/188 [==============================] - 0s 180us/step - loss: 0.2938 - acc: 0.8989
Epoch 52/100
188/188 [==============================] - 0s 178us/step - loss: 0.2961 - acc: 0.9043
Epoch 53/100
188/188 [==============================] - 0s 180us/step - loss: 0.2862 - acc: 0.9096
Epoch 54/100
188/188 [==============================] - 0s 175us/step - loss: 0.2850 - acc: 0.9096
Epoch 55/100
188/188 [==============================] - 0s 172us/step - loss: 0.2907 - acc: 0.8989
Epoch 56/100
188/188 [==============================] - 0s 172us/step - loss: 0.2720 - acc: 0.9202
Epoch 57/100
188/188 [==============================] - 0s 172us/step - loss: 0.2714 - acc: 0.9309
Epoch 58/100
188/188 [==============================] - 0s 171us/step - loss: 0.2764 - acc: 0.9149
Epoch 59/100
188/188 [==============================] - 0s 175us/step - loss: 0.2778 - acc: 0.8989
Epoch 60/100
188/188 [==============================] - 0s 178us/step - loss: 0.2637 - acc: 0.9096
Epoch 61/100
188/188 [==============================] - 0s 189us/step - loss: 0.2619 - acc: 0.9202
Epoch 62/100
188/188 [==============================] - 0s 177us/step - loss: 0.2653 - acc: 0.9149
Epoch 63/100
188/188 [==============================] - 0s 179us/step - loss: 0.2564 - acc: 0.9309
Epoch 64/100
188/188 [==============================] - 0s 183us/step - loss: 0.2565 - acc: 0.8989
Epoch 65/100
188/188 [==============================] - 0s 188us/step - loss: 0.2486 - acc: 0.9096
Epoch 66/100
188/188 [==============================] - 0s 194us/step - loss: 0.2519 - acc: 0.9149
Epoch 67/100
188/188 [==============================] - 0s 192us/step - loss: 0.2431 - acc: 0.9255
Epoch 68/100
188/188 [==============================] - 0s 183us/step - loss: 0.2442 - acc: 0.9202
Epoch 69/100
188/188 [==============================] - 0s 177us/step - loss: 0.2479 - acc: 0.8936
Epoch 70/100
188/188 [==============================] - 0s 177us/step - loss: 0.2329 - acc: 0.9415
Epoch 71/100
188/188 [==============================] - 0s 180us/step - loss: 0.2361 - acc: 0.9202
Epoch 72/100
188/188 [==============================] - 0s 186us/step - loss: 0.2367 - acc: 0.9255
Epoch 73/100
188/188 [==============================] - 0s 177us/step - loss: 0.2245 - acc: 0.9468
Epoch 74/100
188/188 [==============================] - 0s 173us/step - loss: 0.2233 - acc: 0.9415
Epoch 75/100
188/188 [==============================] - 0s 172us/step - loss: 0.2288 - acc: 0.9362
Epoch 76/100
188/188 [==============================] - 0s 171us/step - loss: 0.2346 - acc: 0.9096
Epoch 77/100
188/188 [==============================] - 0s 171us/step - loss: 0.2155 - acc: 0.9468
Epoch 78/100
188/188 [==============================] - 0s 170us/step - loss: 0.2103 - acc: 0.9574
Epoch 79/100
188/188 [==============================] - 0s 172us/step - loss: 0.2158 - acc: 0.9362
Epoch 80/100
188/188 [==============================] - 0s 171us/step - loss: 0.2141 - acc: 0.9521
Epoch 81/100
188/188 [==============================] - 0s 171us/step - loss: 0.2151 - acc: 0.9309
Epoch 82/100
188/188 [==============================] - 0s 172us/step - loss: 0.2092 - acc: 0.9574
Epoch 83/100
188/188 [==============================] - 0s 175us/step - loss: 0.2023 - acc: 0.9468
Epoch 84/100
188/188 [==============================] - 0s 173us/step - loss: 0.1969 - acc: 0.9574
Epoch 85/100
188/188 [==============================] - 0s 170us/step - loss: 0.1953 - acc: 0.9574
Epoch 86/100
188/188 [==============================] - 0s 172us/step - loss: 0.1996 - acc: 0.9202
Epoch 87/100
188/188 [==============================] - 0s 170us/step - loss: 0.2059 - acc: 0.9255
Epoch 88/100
188/188 [==============================] - 0s 170us/step - loss: 0.1942 - acc: 0.9415
Epoch 89/100
188/188 [==============================] - 0s 171us/step - loss: 0.1990 - acc: 0.9309
Epoch 90/100
188/188 [==============================] - 0s 172us/step - loss: 0.1918 - acc: 0.9468
Epoch 91/100
188/188 [==============================] - 0s 175us/step - loss: 0.1839 - acc: 0.9415
Epoch 92/100
188/188 [==============================] - 0s 182us/step - loss: 0.1849 - acc: 0.9415
Epoch 93/100
188/188 [==============================] - 0s 181us/step - loss: 0.1889 - acc: 0.9415
Epoch 94/100
188/188 [==============================] - 0s 178us/step - loss: 0.1765 - acc: 0.9681
Epoch 95/100
188/188 [==============================] - 0s 180us/step - loss: 0.1776 - acc: 0.9521
Epoch 96/100
188/188 [==============================] - 0s 173us/step - loss: 0.1678 - acc: 0.9734
Epoch 97/100
188/188 [==============================] - 0s 170us/step - loss: 0.1877 - acc: 0.9309
Epoch 98/100
188/188 [==============================] - 0s 170us/step - loss: 0.1719 - acc: 0.9468
Epoch 99/100
188/188 [==============================] - 0s 169us/step - loss: 0.1710 - acc: 0.9574
Epoch 100/100
188/188 [==============================] - 0s 169us/step - loss: 0.1595 - acc: 0.9681
20/20 [==============================] - 0s 16ms/step

Accuracy Results: 
Baseline: 81.84% (7.05%)