画像分類のための敵対的正則化

TensorFlow.orgで表示 Google Colab で実行 GitHub でソースを表示{

概要

このチュートリアルでは、Neural Structured Learning(NSL)フレームワークを用いた画像分類のための敵対的学習(Goodfellow et al.、2014)の使用について説明します。

敵対的学習の中核となる考え方は、有機的な学習データに加え、敵対的なデータ(敵対的サンプルと呼ばれる)を用いてモデルをトレーニングすることです。これらの敵対的サンプルは人間の目には元のデータと同じように見えますが、摂動がモデルを混乱させ、誤った予測や分類が行われる原因となります。敵対的サンプルはモデルに誤った予測や分類を行わせ、誤認識させるように意図的に構成されています。このような例を用いてトレーニングを行うことによって、モデルは予測を行う際に敵対的摂動に対してロバストになるよう学習します。

このチュートリアルでは、Neural Structured Learning のフレームワークを使用し、ロバストなモデルを得るために敵対的学習を適用する手順を以下に説明します。

  1. 基本モデルとしてニューラルネットワークを作成します。このチュートリアルでは、tf.keras Functional API で基本モデルを作成します。この手順は、tf.keras Sequential API および Subclassing API で作成されたモデルと互換性があります。TensorFlow における Keras モデルの詳細については、こちらのドキュメントをご覧ください。
  2. NSL フレームワークが提供するラッパークラス AdversarialRegularization で基本モデルをラップして、新しい tf.keras.Model インスタンスを作成します。この新しいモデルには、トレーニング目的の正則化項として敵対的損失が含まれます。
  3. トレーニングデータの例を特徴ディクショナリに変換します。
  4. 新しいモデルをトレーニングして評価します。

セットアップ

Neural Structured Learning パッケージをインストールします。

pip install --quiet neural-structured-learning

ライブラリをインポートします。neural_structured_learning を nsl と略します。

import matplotlib.pyplot as plt
import neural_structured_learning as nsl
import numpy as np
import tensorflow as tf
import tensorflow_datasets as tfds

ハイパーパラメータ

モデルのトレーニングと評価のための(HParams オブジェクト内の)ハイパーパラメータを集めて説明します。

入力/出力:

  • input_shape:入力テンソルの形状。各画像は 28×28 ピクセルで 1 チャンネルです。
  • num_classes:[0-9] に対応する数字 10 個分があり、合計 10 クラスです。

モデルアーキテクチャ:

  • conv_filters:各畳み込みレイヤーのフィルタ数を指定する数値のリスト。
  • kernel_size:すべての畳み込みレイヤーで共有する 2 次元の畳み込みウィンドウのサイズ。
  • pool_size:各最大 Pooling レイヤーで画像をダウンスケールするための係数。
  • num_fc_units:完全に接続された各レイヤーの単位(すなわち幅)の数。

トレーニングと評価:

  • batch_size:トレーニングや評価に使用するバッチサイズ。
  • epochs:トレーニングのエポック数。

敵対的学習:

  • adv_multiplier:ラベル付けされた損失に対して相対的な、トレーニング目的内の敵対的損失の重み。
  • adv_step_size:敵対的摂動の大きさ。
  • adv_grad_norm:敵対的摂動の大きさを測るノルム。
class HParams(object):
  def __init__(self):
    self.input_shape = [28, 28, 1]
    self.num_classes = 10
    self.conv_filters = [32, 64, 64]
    self.kernel_size = (3, 3)
    self.pool_size = (2, 2)
    self.num_fc_units = [64]
    self.batch_size = 32
    self.epochs = 5
    self.adv_multiplier = 0.2
    self.adv_step_size = 0.2
    self.adv_grad_norm = 'infinity'

HPARAMS = HParams()

MNIST データセット

MNIST データセットには手書きの数字( '0' から '9' まで)のグレースケール画像が含まれています。各画像は低解像度(28×28 ピクセル)で数字 1 文字を示しています。このタスクでは、画像を数字ごとに 1 つずつ、10 のカテゴリに分類します。

ここで TensorFlow Datasets から MNIST データセットを読み込みます。これはデータのダウンロードと tf.data.Dataset の構築処理をします。読み込んだデータセットには 2 つのサブセットがあります。

  • 6 万個の例を含む train
  • 1 万個の例を含む test

両方のサブセットに含まれる例は、以下の 2 つのキーを持つ特徴ディクショナリに格納されています。

  • image:0 から 255 までのピクセル値の配列。
  • label:0 から 9までの真の正解ラベル。
datasets = tfds.load('mnist')

train_dataset = datasets['train']
test_dataset = datasets['test']

IMAGE_INPUT_NAME = 'image'
LABEL_INPUT_NAME = 'label'

モデルを数値的に安定させるには、normalize 関数にデータセットをマッピングし、ピクセル値を [0, 1] に正規化します。トレーニングセットをシャッフルしてバッチ処理を行った後、基本モデルをトレーニングするために例を特徴タプル (image, label) に変換します。また、後で使用できるようにタプルをディクショナリに変換する関数も用意しています。

def normalize(features):
  features[IMAGE_INPUT_NAME] = tf.cast(
      features[IMAGE_INPUT_NAME], dtype=tf.float32) / 255.0
  return features

def convert_to_tuples(features):
  return features[IMAGE_INPUT_NAME], features[LABEL_INPUT_NAME]

def convert_to_dictionaries(image, label):
  return {IMAGE_INPUT_NAME: image, LABEL_INPUT_NAME: label}

train_dataset = train_dataset.map(normalize).shuffle(10000).batch(HPARAMS.batch_size).map(convert_to_tuples)
test_dataset = test_dataset.map(normalize).batch(HPARAMS.batch_size).map(convert_to_tuples)

基本モデル

基本モデルは、3 つの畳み込みレイヤーと 2 つの完全に接続されたレイヤー(HPARAMS で定義されている)から成るニューラルネットワークです。ここでは Keras の Functional API を使用して定義しています。他の API やモデルアーキテクチャを自由に試してみてください。

def build_base_model(hparams):
  """Builds a model according to the architecture defined in `hparams`."""
  inputs = tf.keras.Input(
      shape=hparams.input_shape, dtype=tf.float32, name=IMAGE_INPUT_NAME)

  x = inputs
  for i, num_filters in enumerate(hparams.conv_filters):
    x = tf.keras.layers.Conv2D(
        num_filters, hparams.kernel_size, activation='relu')(
            x)
    if i < len(hparams.conv_filters) - 1:
      # max pooling between convolutional layers
      x = tf.keras.layers.MaxPooling2D(hparams.pool_size)(x)
  x = tf.keras.layers.Flatten()(x)
  for num_units in hparams.num_fc_units:
    x = tf.keras.layers.Dense(num_units, activation='relu')(x)
  pred = tf.keras.layers.Dense(hparams.num_classes, activation='softmax')(x)
  model = tf.keras.Model(inputs=inputs, outputs=pred)
  return model
base_model = build_base_model(HPARAMS)
base_model.summary()
Model: "model"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
image (InputLayer)           [(None, 28, 28, 1)]       0         
_________________________________________________________________
conv2d (Conv2D)              (None, 26, 26, 32)        320       
_________________________________________________________________
max_pooling2d (MaxPooling2D) (None, 13, 13, 32)        0         
_________________________________________________________________
conv2d_1 (Conv2D)            (None, 11, 11, 64)        18496     
_________________________________________________________________
max_pooling2d_1 (MaxPooling2 (None, 5, 5, 64)          0         
_________________________________________________________________
conv2d_2 (Conv2D)            (None, 3, 3, 64)          36928     
_________________________________________________________________
flatten (Flatten)            (None, 576)               0         
_________________________________________________________________
dense (Dense)                (None, 64)                36928     
_________________________________________________________________
dense_1 (Dense)              (None, 10)                650       
=================================================================
Total params: 93,322
Trainable params: 93,322
Non-trainable params: 0
_________________________________________________________________

次に、基本モデルのトレーニングと評価を行います。

base_model.compile(optimizer='adam', loss='sparse_categorical_crossentropy',
                   metrics=['acc'])
base_model.fit(train_dataset, epochs=HPARAMS.epochs)
Epoch 1/5
1/1875 [..............................] - ETA: 1:40:15 - loss: 2.3070 - acc: 0.1250
9/1875 [..............................] - ETA: 12s - loss: 2.2814 - acc: 0.2203
18/1875 [..............................] - ETA: 11s - loss: 2.2622 - acc: 0.2192
27/1875 [..............................] - ETA: 11s - loss: 2.2154 - acc: 0.2483
36/1875 [..............................] - ETA: 11s - loss: 2.1397 - acc: 0.2847
45/1875 [..............................] - ETA: 10s - loss: 2.0564 - acc: 0.3192
54/1875 [..............................] - ETA: 10s - loss: 1.9715 - acc: 0.3512
64/1875 [>.............................] - ETA: 10s - loss: 1.8808 - acc: 0.3845
73/1875 [>.............................] - ETA: 10s - loss: 1.8052 - acc: 0.4117
82/1875 [>.............................] - ETA: 10s - loss: 1.7353 - acc: 0.4364
91/1875 [>.............................] - ETA: 10s - loss: 1.6705 - acc: 0.4588
100/1875 [>.............................] - ETA: 10s - loss: 1.6113 - acc: 0.4791
110/1875 [>.............................] - ETA: 10s - loss: 1.5520 - acc: 0.4992
119/1875 [>.............................] - ETA: 10s - loss: 1.5032 - acc: 0.5156
128/1875 [=>............................] - ETA: 10s - loss: 1.4583 - acc: 0.5307
138/1875 [=>............................] - ETA: 9s - loss: 1.4123 - acc: 0.5461
148/1875 [=>............................] - ETA: 9s - loss: 1.3699 - acc: 0.5603
157/1875 [=>............................] - ETA: 9s - loss: 1.3344 - acc: 0.5721
166/1875 [=>............................] - ETA: 9s - loss: 1.3015 - acc: 0.5829
175/1875 [=>............................] - ETA: 9s - loss: 1.2708 - acc: 0.5931
184/1875 [=>............................] - ETA: 9s - loss: 1.2420 - acc: 0.6026
193/1875 [==>...........................] - ETA: 9s - loss: 1.2147 - acc: 0.6116
202/1875 [==>...........................] - ETA: 9s - loss: 1.1891 - acc: 0.6200
212/1875 [==>...........................] - ETA: 9s - loss: 1.1623 - acc: 0.6288
221/1875 [==>...........................] - ETA: 9s - loss: 1.1395 - acc: 0.6362
230/1875 [==>...........................] - ETA: 9s - loss: 1.1178 - acc: 0.6433
240/1875 [==>...........................] - ETA: 9s - loss: 1.0951 - acc: 0.6507
250/1875 [===>..........................] - ETA: 9s - loss: 1.0736 - acc: 0.6577
259/1875 [===>..........................] - ETA: 9s - loss: 1.0551 - acc: 0.6637
268/1875 [===>..........................] - ETA: 9s - loss: 1.0374 - acc: 0.6694
278/1875 [===>..........................] - ETA: 9s - loss: 1.0187 - acc: 0.6754
287/1875 [===>..........................] - ETA: 9s - loss: 1.0027 - acc: 0.6806
296/1875 [===>..........................] - ETA: 8s - loss: 0.9873 - acc: 0.6856
305/1875 [===>..........................] - ETA: 8s - loss: 0.9726 - acc: 0.6904
314/1875 [====>.........................] - ETA: 8s - loss: 0.9584 - acc: 0.6950
323/1875 [====>.........................] - ETA: 8s - loss: 0.9447 - acc: 0.6994
332/1875 [====>.........................] - ETA: 8s - loss: 0.9315 - acc: 0.7036
341/1875 [====>.........................] - ETA: 8s - loss: 0.9188 - acc: 0.7077
350/1875 [====>.........................] - ETA: 8s - loss: 0.9065 - acc: 0.7117
360/1875 [====>.........................] - ETA: 8s - loss: 0.8934 - acc: 0.7159
370/1875 [====>.........................] - ETA: 8s - loss: 0.8807 - acc: 0.7199
379/1875 [=====>........................] - ETA: 8s - loss: 0.8697 - acc: 0.7235
389/1875 [=====>........................] - ETA: 8s - loss: 0.8580 - acc: 0.7272
399/1875 [=====>........................] - ETA: 8s - loss: 0.8467 - acc: 0.7309
409/1875 [=====>........................] - ETA: 8s - loss: 0.8357 - acc: 0.7344
418/1875 [=====>........................] - ETA: 8s - loss: 0.8261 - acc: 0.7374
427/1875 [=====>........................] - ETA: 8s - loss: 0.8169 - acc: 0.7404
437/1875 [=====>........................] - ETA: 8s - loss: 0.8069 - acc: 0.7436
447/1875 [======>.......................] - ETA: 8s - loss: 0.7972 - acc: 0.7467
456/1875 [======>.......................] - ETA: 8s - loss: 0.7887 - acc: 0.7494
466/1875 [======>.......................] - ETA: 8s - loss: 0.7796 - acc: 0.7523
476/1875 [======>.......................] - ETA: 7s - loss: 0.7708 - acc: 0.7552
485/1875 [======>.......................] - ETA: 7s - loss: 0.7630 - acc: 0.7576
494/1875 [======>.......................] - ETA: 7s - loss: 0.7555 - acc: 0.7600
503/1875 [=======>......................] - ETA: 7s - loss: 0.7482 - acc: 0.7624
512/1875 [=======>......................] - ETA: 7s - loss: 0.7411 - acc: 0.7647
521/1875 [=======>......................] - ETA: 7s - loss: 0.7341 - acc: 0.7669
530/1875 [=======>......................] - ETA: 7s - loss: 0.7274 - acc: 0.7691
540/1875 [=======>......................] - ETA: 7s - loss: 0.7200 - acc: 0.7714
550/1875 [=======>......................] - ETA: 7s - loss: 0.7129 - acc: 0.7737
560/1875 [=======>......................] - ETA: 7s - loss: 0.7059 - acc: 0.7759
569/1875 [========>.....................] - ETA: 7s - loss: 0.6998 - acc: 0.7779
578/1875 [========>.....................] - ETA: 7s - loss: 0.6938 - acc: 0.7798
588/1875 [========>.....................] - ETA: 7s - loss: 0.6873 - acc: 0.7819
597/1875 [========>.....................] - ETA: 7s - loss: 0.6816 - acc: 0.7837
606/1875 [========>.....................] - ETA: 7s - loss: 0.6760 - acc: 0.7855
615/1875 [========>.....................] - ETA: 7s - loss: 0.6706 - acc: 0.7873
625/1875 [=========>....................] - ETA: 7s - loss: 0.6647 - acc: 0.7892
634/1875 [=========>....................] - ETA: 7s - loss: 0.6595 - acc: 0.7908
643/1875 [=========>....................] - ETA: 6s - loss: 0.6543 - acc: 0.7925
652/1875 [=========>....................] - ETA: 6s - loss: 0.6493 - acc: 0.7941
662/1875 [=========>....................] - ETA: 6s - loss: 0.6439 - acc: 0.7958
672/1875 [=========>....................] - ETA: 6s - loss: 0.6386 - acc: 0.7975
681/1875 [=========>....................] - ETA: 6s - loss: 0.6339 - acc: 0.7990
691/1875 [==========>...................] - ETA: 6s - loss: 0.6288 - acc: 0.8007
700/1875 [==========>...................] - ETA: 6s - loss: 0.6242 - acc: 0.8021
710/1875 [==========>...................] - ETA: 6s - loss: 0.6193 - acc: 0.8037
719/1875 [==========>...................] - ETA: 6s - loss: 0.6150 - acc: 0.8051
728/1875 [==========>...................] - ETA: 6s - loss: 0.6108 - acc: 0.8064
737/1875 [==========>...................] - ETA: 6s - loss: 0.6066 - acc: 0.8077
746/1875 [==========>...................] - ETA: 6s - loss: 0.6025 - acc: 0.8091
755/1875 [===========>..................] - ETA: 6s - loss: 0.5985 - acc: 0.8103
765/1875 [===========>..................] - ETA: 6s - loss: 0.5941 - acc: 0.8118
774/1875 [===========>..................] - ETA: 6s - loss: 0.5902 - acc: 0.8130
783/1875 [===========>..................] - ETA: 6s - loss: 0.5864 - acc: 0.8142
792/1875 [===========>..................] - ETA: 6s - loss: 0.5826 - acc: 0.8154
801/1875 [===========>..................] - ETA: 6s - loss: 0.5789 - acc: 0.8166
810/1875 [===========>..................] - ETA: 6s - loss: 0.5753 - acc: 0.8178
820/1875 [============>.................] - ETA: 5s - loss: 0.5713 - acc: 0.8190
830/1875 [============>.................] - ETA: 5s - loss: 0.5675 - acc: 0.8203
841/1875 [============>.................] - ETA: 5s - loss: 0.5633 - acc: 0.8216
852/1875 [============>.................] - ETA: 5s - loss: 0.5592 - acc: 0.8229
862/1875 [============>.................] - ETA: 5s - loss: 0.5555 - acc: 0.8241
872/1875 [============>.................] - ETA: 5s - loss: 0.5519 - acc: 0.8252
882/1875 [=============>................] - ETA: 5s - loss: 0.5484 - acc: 0.8264
892/1875 [=============>................] - ETA: 5s - loss: 0.5449 - acc: 0.8275
902/1875 [=============>................] - ETA: 5s - loss: 0.5414 - acc: 0.8286
912/1875 [=============>................] - ETA: 5s - loss: 0.5381 - acc: 0.8297
922/1875 [=============>................] - ETA: 5s - loss: 0.5348 - acc: 0.8307
932/1875 [=============>................] - ETA: 5s - loss: 0.5315 - acc: 0.8318
941/1875 [==============>...............] - ETA: 5s - loss: 0.5286 - acc: 0.8327
951/1875 [==============>...............] - ETA: 5s - loss: 0.5254 - acc: 0.8337
961/1875 [==============>...............] - ETA: 5s - loss: 0.5223 - acc: 0.8347
971/1875 [==============>...............] - ETA: 5s - loss: 0.5192 - acc: 0.8357
981/1875 [==============>...............] - ETA: 5s - loss: 0.5162 - acc: 0.8366
991/1875 [==============>...............] - ETA: 4s - loss: 0.5133 - acc: 0.8376
1001/1875 [===============>..............] - ETA: 4s - loss: 0.5103 - acc: 0.8385
1011/1875 [===============>..............] - ETA: 4s - loss: 0.5075 - acc: 0.8394
1021/1875 [===============>..............] - ETA: 4s - loss: 0.5046 - acc: 0.8403
1031/1875 [===============>..............] - ETA: 4s - loss: 0.5019 - acc: 0.8412
1041/1875 [===============>..............] - ETA: 4s - loss: 0.4991 - acc: 0.8421
1051/1875 [===============>..............] - ETA: 4s - loss: 0.4964 - acc: 0.8430
1061/1875 [===============>..............] - ETA: 4s - loss: 0.4938 - acc: 0.8438
1071/1875 [================>.............] - ETA: 4s - loss: 0.4911 - acc: 0.8447
1081/1875 [================>.............] - ETA: 4s - loss: 0.4886 - acc: 0.8455
1091/1875 [================>.............] - ETA: 4s - loss: 0.4860 - acc: 0.8463
1101/1875 [================>.............] - ETA: 4s - loss: 0.4835 - acc: 0.8471
1111/1875 [================>.............] - ETA: 4s - loss: 0.4810 - acc: 0.8479
1121/1875 [================>.............] - ETA: 4s - loss: 0.4786 - acc: 0.8487
1131/1875 [=================>............] - ETA: 4s - loss: 0.4761 - acc: 0.8495
1140/1875 [=================>............] - ETA: 4s - loss: 0.4740 - acc: 0.8501
1150/1875 [=================>............] - ETA: 4s - loss: 0.4716 - acc: 0.8509
1160/1875 [=================>............] - ETA: 3s - loss: 0.4693 - acc: 0.8516
1170/1875 [=================>............] - ETA: 3s - loss: 0.4670 - acc: 0.8524
1179/1875 [=================>............] - ETA: 3s - loss: 0.4650 - acc: 0.8530
1189/1875 [==================>...........] - ETA: 3s - loss: 0.4628 - acc: 0.8537
1199/1875 [==================>...........] - ETA: 3s - loss: 0.4606 - acc: 0.8544
1208/1875 [==================>...........] - ETA: 3s - loss: 0.4586 - acc: 0.8551
1217/1875 [==================>...........] - ETA: 3s - loss: 0.4567 - acc: 0.8557
1227/1875 [==================>...........] - ETA: 3s - loss: 0.4546 - acc: 0.8564
1237/1875 [==================>...........] - ETA: 3s - loss: 0.4525 - acc: 0.8570
1247/1875 [==================>...........] - ETA: 3s - loss: 0.4504 - acc: 0.8577
1256/1875 [===================>..........] - ETA: 3s - loss: 0.4485 - acc: 0.8583
1266/1875 [===================>..........] - ETA: 3s - loss: 0.4465 - acc: 0.8589
1276/1875 [===================>..........] - ETA: 3s - loss: 0.4445 - acc: 0.8596
1286/1875 [===================>..........] - ETA: 3s - loss: 0.4425 - acc: 0.8602
1296/1875 [===================>..........] - ETA: 3s - loss: 0.4406 - acc: 0.8608
1306/1875 [===================>..........] - ETA: 3s - loss: 0.4387 - acc: 0.8615
1316/1875 [====================>.........] - ETA: 3s - loss: 0.4368 - acc: 0.8621
1326/1875 [====================>.........] - ETA: 3s - loss: 0.4349 - acc: 0.8627
1336/1875 [====================>.........] - ETA: 2s - loss: 0.4330 - acc: 0.8633
1346/1875 [====================>.........] - ETA: 2s - loss: 0.4312 - acc: 0.8639
1356/1875 [====================>.........] - ETA: 2s - loss: 0.4294 - acc: 0.8644
1366/1875 [====================>.........] - ETA: 2s - loss: 0.4276 - acc: 0.8650
1376/1875 [=====================>........] - ETA: 2s - loss: 0.4258 - acc: 0.8656
1386/1875 [=====================>........] - ETA: 2s - loss: 0.4240 - acc: 0.8661
1396/1875 [=====================>........] - ETA: 2s - loss: 0.4223 - acc: 0.8667
1406/1875 [=====================>........] - ETA: 2s - loss: 0.4206 - acc: 0.8673
1416/1875 [=====================>........] - ETA: 2s - loss: 0.4189 - acc: 0.8678
1426/1875 [=====================>........] - ETA: 2s - loss: 0.4172 - acc: 0.8683
1436/1875 [=====================>........] - ETA: 2s - loss: 0.4155 - acc: 0.8689
1445/1875 [======================>.......] - ETA: 2s - loss: 0.4140 - acc: 0.8693
1455/1875 [======================>.......] - ETA: 2s - loss: 0.4124 - acc: 0.8699
1465/1875 [======================>.......] - ETA: 2s - loss: 0.4108 - acc: 0.8704
1475/1875 [======================>.......] - ETA: 2s - loss: 0.4092 - acc: 0.8709
1484/1875 [======================>.......] - ETA: 2s - loss: 0.4078 - acc: 0.8714
1494/1875 [======================>.......] - ETA: 2s - loss: 0.4062 - acc: 0.8719
1503/1875 [=======================>......] - ETA: 2s - loss: 0.4048 - acc: 0.8723
1513/1875 [=======================>......] - ETA: 1s - loss: 0.4033 - acc: 0.8728
1523/1875 [=======================>......] - ETA: 1s - loss: 0.4018 - acc: 0.8733
1533/1875 [=======================>......] - ETA: 1s - loss: 0.4003 - acc: 0.8738
1543/1875 [=======================>......] - ETA: 1s - loss: 0.3988 - acc: 0.8742
1553/1875 [=======================>......] - ETA: 1s - loss: 0.3973 - acc: 0.8747
1563/1875 [========================>.....] - ETA: 1s - loss: 0.3958 - acc: 0.8752
1579/1875 [========================>.....] - ETA: 1s - loss: 0.3935 - acc: 0.8759
1596/1875 [========================>.....] - ETA: 1s - loss: 0.3911 - acc: 0.8767
1613/1875 [========================>.....] - ETA: 1s - loss: 0.3887 - acc: 0.8775
1629/1875 [=========================>....] - ETA: 1s - loss: 0.3865 - acc: 0.8782
1645/1875 [=========================>....] - ETA: 1s - loss: 0.3843 - acc: 0.8789
1662/1875 [=========================>....] - ETA: 1s - loss: 0.3821 - acc: 0.8796
1679/1875 [=========================>....] - ETA: 1s - loss: 0.3799 - acc: 0.8803
1695/1875 [==========================>...] - ETA: 0s - loss: 0.3778 - acc: 0.8810
1712/1875 [==========================>...] - ETA: 0s - loss: 0.3756 - acc: 0.8817
1728/1875 [==========================>...] - ETA: 0s - loss: 0.3736 - acc: 0.8823
1744/1875 [==========================>...] - ETA: 0s - loss: 0.3716 - acc: 0.8829
1760/1875 [===========================>..] - ETA: 0s - loss: 0.3697 - acc: 0.8836
1776/1875 [===========================>..] - ETA: 0s - loss: 0.3678 - acc: 0.8842
1793/1875 [===========================>..] - ETA: 0s - loss: 0.3658 - acc: 0.8848
1809/1875 [===========================>..] - ETA: 0s - loss: 0.3639 - acc: 0.8854
1825/1875 [============================>.] - ETA: 0s - loss: 0.3621 - acc: 0.8860
1841/1875 [============================>.] - ETA: 0s - loss: 0.3603 - acc: 0.8866
1858/1875 [============================>.] - ETA: 0s - loss: 0.3584 - acc: 0.8872
1875/1875 [==============================] - ETA: 0s - loss: 0.3565 - acc: 0.8878
1875/1875 [==============================] - 13s 5ms/step - loss: 0.3564 - acc: 0.8878
Epoch 2/5
1/1875 [..............................] - ETA: 12:55 - loss: 0.2051 - acc: 0.9375
11/1875 [..............................] - ETA: 9s - loss: 0.0763 - acc: 0.9769
22/1875 [..............................] - ETA: 9s - loss: 0.0737 - acc: 0.9791
33/1875 [..............................] - ETA: 8s - loss: 0.0669 - acc: 0.9817
44/1875 [..............................] - ETA: 8s - loss: 0.0643 - acc: 0.9826
54/1875 [..............................] - ETA: 8s - loss: 0.0624 - acc: 0.9831
65/1875 [>.............................] - ETA: 8s - loss: 0.0616 - acc: 0.9835
76/1875 [>.............................] - ETA: 8s - loss: 0.0613 - acc: 0.9836
86/1875 [>.............................] - ETA: 8s - loss: 0.0616 - acc: 0.9835
97/1875 [>.............................] - ETA: 8s - loss: 0.0618 - acc: 0.9835
108/1875 [>.............................] - ETA: 8s - loss: 0.0620 - acc: 0.9834
119/1875 [>.............................] - ETA: 8s - loss: 0.0622 - acc: 0.9833
129/1875 [=>............................] - ETA: 8s - loss: 0.0625 - acc: 0.9832
140/1875 [=>............................] - ETA: 8s - loss: 0.0626 - acc: 0.9831
151/1875 [=>............................] - ETA: 8s - loss: 0.0627 - acc: 0.9830
162/1875 [=>............................] - ETA: 8s - loss: 0.0628 - acc: 0.9829
172/1875 [=>............................] - ETA: 8s - loss: 0.0628 - acc: 0.9828
183/1875 [=>............................] - ETA: 8s - loss: 0.0627 - acc: 0.9828
194/1875 [==>...........................] - ETA: 8s - loss: 0.0626 - acc: 0.9828
205/1875 [==>...........................] - ETA: 8s - loss: 0.0625 - acc: 0.9827
215/1875 [==>...........................] - ETA: 8s - loss: 0.0624 - acc: 0.9827
225/1875 [==>...........................] - ETA: 8s - loss: 0.0623 - acc: 0.9827
235/1875 [==>...........................] - ETA: 8s - loss: 0.0622 - acc: 0.9827
245/1875 [==>...........................] - ETA: 7s - loss: 0.0621 - acc: 0.9827
255/1875 [===>..........................] - ETA: 7s - loss: 0.0620 - acc: 0.9827
266/1875 [===>..........................] - ETA: 7s - loss: 0.0619 - acc: 0.9827
277/1875 [===>..........................] - ETA: 7s - loss: 0.0618 - acc: 0.9827
288/1875 [===>..........................] - ETA: 7s - loss: 0.0617 - acc: 0.9827
299/1875 [===>..........................] - ETA: 7s - loss: 0.0616 - acc: 0.9827
310/1875 [===>..........................] - ETA: 7s - loss: 0.0615 - acc: 0.9827
321/1875 [====>.........................] - ETA: 7s - loss: 0.0614 - acc: 0.9827
332/1875 [====>.........................] - ETA: 7s - loss: 0.0613 - acc: 0.9827
342/1875 [====>.........................] - ETA: 7s - loss: 0.0612 - acc: 0.9827
353/1875 [====>.........................] - ETA: 7s - loss: 0.0611 - acc: 0.9827
364/1875 [====>.........................] - ETA: 7s - loss: 0.0610 - acc: 0.9827
375/1875 [=====>........................] - ETA: 7s - loss: 0.0610 - acc: 0.9827
386/1875 [=====>........................] - ETA: 7s - loss: 0.0609 - acc: 0.9827
398/1875 [=====>........................] - ETA: 7s - loss: 0.0608 - acc: 0.9826
410/1875 [=====>........................] - ETA: 7s - loss: 0.0607 - acc: 0.9826
421/1875 [=====>........................] - ETA: 7s - loss: 0.0606 - acc: 0.9826
432/1875 [=====>........................] - ETA: 6s - loss: 0.0605 - acc: 0.9827
444/1875 [======>.......................] - ETA: 6s - loss: 0.0603 - acc: 0.9827
456/1875 [======>.......................] - ETA: 6s - loss: 0.0602 - acc: 0.9827
467/1875 [======>.......................] - ETA: 6s - loss: 0.0601 - acc: 0.9827
478/1875 [======>.......................] - ETA: 6s - loss: 0.0600 - acc: 0.9827
489/1875 [======>.......................] - ETA: 6s - loss: 0.0599 - acc: 0.9827
500/1875 [=======>......................] - ETA: 6s - loss: 0.0598 - acc: 0.9827
511/1875 [=======>......................] - ETA: 6s - loss: 0.0597 - acc: 0.9828
521/1875 [=======>......................] - ETA: 6s - loss: 0.0596 - acc: 0.9828
532/1875 [=======>......................] - ETA: 6s - loss: 0.0595 - acc: 0.9828
543/1875 [=======>......................] - ETA: 6s - loss: 0.0594 - acc: 0.9828
554/1875 [=======>......................] - ETA: 6s - loss: 0.0593 - acc: 0.9828
565/1875 [========>.....................] - ETA: 6s - loss: 0.0592 - acc: 0.9828
577/1875 [========>.....................] - ETA: 6s - loss: 0.0592 - acc: 0.9828
589/1875 [========>.....................] - ETA: 6s - loss: 0.0591 - acc: 0.9828
601/1875 [========>.....................] - ETA: 6s - loss: 0.0590 - acc: 0.9828
612/1875 [========>.....................] - ETA: 6s - loss: 0.0589 - acc: 0.9829
624/1875 [========>.....................] - ETA: 5s - loss: 0.0588 - acc: 0.9829
636/1875 [=========>....................] - ETA: 5s - loss: 0.0587 - acc: 0.9829
648/1875 [=========>....................] - ETA: 5s - loss: 0.0586 - acc: 0.9829
659/1875 [=========>....................] - ETA: 5s - loss: 0.0585 - acc: 0.9829
670/1875 [=========>....................] - ETA: 5s - loss: 0.0584 - acc: 0.9830
681/1875 [=========>....................] - ETA: 5s - loss: 0.0583 - acc: 0.9830
693/1875 [==========>...................] - ETA: 5s - loss: 0.0582 - acc: 0.9830
704/1875 [==========>...................] - ETA: 5s - loss: 0.0581 - acc: 0.9830
715/1875 [==========>...................] - ETA: 5s - loss: 0.0581 - acc: 0.9830
727/1875 [==========>...................] - ETA: 5s - loss: 0.0580 - acc: 0.9831
739/1875 [==========>...................] - ETA: 5s - loss: 0.0579 - acc: 0.9831
750/1875 [===========>..................] - ETA: 5s - loss: 0.0578 - acc: 0.9831
761/1875 [===========>..................] - ETA: 5s - loss: 0.0578 - acc: 0.9831
772/1875 [===========>..................] - ETA: 5s - loss: 0.0577 - acc: 0.9831
783/1875 [===========>..................] - ETA: 5s - loss: 0.0576 - acc: 0.9832
794/1875 [===========>..................] - ETA: 5s - loss: 0.0576 - acc: 0.9832
806/1875 [===========>..................] - ETA: 5s - loss: 0.0575 - acc: 0.9832
817/1875 [============>.................] - ETA: 5s - loss: 0.0574 - acc: 0.9832
828/1875 [============>.................] - ETA: 4s - loss: 0.0574 - acc: 0.9832
839/1875 [============>.................] - ETA: 4s - loss: 0.0573 - acc: 0.9833
851/1875 [============>.................] - ETA: 4s - loss: 0.0572 - acc: 0.9833
863/1875 [============>.................] - ETA: 4s - loss: 0.0571 - acc: 0.9833
875/1875 [=============>................] - ETA: 4s - loss: 0.0571 - acc: 0.9833
886/1875 [=============>................] - ETA: 4s - loss: 0.0570 - acc: 0.9833
897/1875 [=============>................] - ETA: 4s - loss: 0.0570 - acc: 0.9833
909/1875 [=============>................] - ETA: 4s - loss: 0.0569 - acc: 0.9833
921/1875 [=============>................] - ETA: 4s - loss: 0.0568 - acc: 0.9834
932/1875 [=============>................] - ETA: 4s - loss: 0.0568 - acc: 0.9834
943/1875 [==============>...............] - ETA: 4s - loss: 0.0567 - acc: 0.9834
955/1875 [==============>...............] - ETA: 4s - loss: 0.0566 - acc: 0.9834
966/1875 [==============>...............] - ETA: 4s - loss: 0.0566 - acc: 0.9834
978/1875 [==============>...............] - ETA: 4s - loss: 0.0565 - acc: 0.9834
989/1875 [==============>...............] - ETA: 4s - loss: 0.0564 - acc: 0.9834
1001/1875 [===============>..............] - ETA: 4s - loss: 0.0564 - acc: 0.9835
1012/1875 [===============>..............] - ETA: 4s - loss: 0.0563 - acc: 0.9835
1023/1875 [===============>..............] - ETA: 3s - loss: 0.0562 - acc: 0.9835
1034/1875 [===============>..............] - ETA: 3s - loss: 0.0562 - acc: 0.9835
1046/1875 [===============>..............] - ETA: 3s - loss: 0.0561 - acc: 0.9835
1057/1875 [===============>..............] - ETA: 3s - loss: 0.0561 - acc: 0.9835
1068/1875 [================>.............] - ETA: 3s - loss: 0.0560 - acc: 0.9835
1079/1875 [================>.............] - ETA: 3s - loss: 0.0559 - acc: 0.9836
1090/1875 [================>.............] - ETA: 3s - loss: 0.0559 - acc: 0.9836
1101/1875 [================>.............] - ETA: 3s - loss: 0.0558 - acc: 0.9836
1113/1875 [================>.............] - ETA: 3s - loss: 0.0558 - acc: 0.9836
1125/1875 [=================>............] - ETA: 3s - loss: 0.0557 - acc: 0.9836
1137/1875 [=================>............] - ETA: 3s - loss: 0.0556 - acc: 0.9836
1148/1875 [=================>............] - ETA: 3s - loss: 0.0556 - acc: 0.9837
1159/1875 [=================>............] - ETA: 3s - loss: 0.0555 - acc: 0.9837
1171/1875 [=================>............] - ETA: 3s - loss: 0.0554 - acc: 0.9837
1183/1875 [=================>............] - ETA: 3s - loss: 0.0554 - acc: 0.9837
1195/1875 [==================>...........] - ETA: 3s - loss: 0.0553 - acc: 0.9837
1207/1875 [==================>...........] - ETA: 3s - loss: 0.0553 - acc: 0.9837
1219/1875 [==================>...........] - ETA: 3s - loss: 0.0552 - acc: 0.9837
1231/1875 [==================>...........] - ETA: 3s - loss: 0.0551 - acc: 0.9838
1242/1875 [==================>...........] - ETA: 2s - loss: 0.0551 - acc: 0.9838
1253/1875 [===================>..........] - ETA: 2s - loss: 0.0550 - acc: 0.9838
1264/1875 [===================>..........] - ETA: 2s - loss: 0.0550 - acc: 0.9838
1276/1875 [===================>..........] - ETA: 2s - loss: 0.0549 - acc: 0.9838
1287/1875 [===================>..........] - ETA: 2s - loss: 0.0549 - acc: 0.9838
1299/1875 [===================>..........] - ETA: 2s - loss: 0.0548 - acc: 0.9838
1311/1875 [===================>..........] - ETA: 2s - loss: 0.0548 - acc: 0.9839
1323/1875 [====================>.........] - ETA: 2s - loss: 0.0547 - acc: 0.9839
1334/1875 [====================>.........] - ETA: 2s - loss: 0.0547 - acc: 0.9839
1345/1875 [====================>.........] - ETA: 2s - loss: 0.0546 - acc: 0.9839
1357/1875 [====================>.........] - ETA: 2s - loss: 0.0546 - acc: 0.9839
1369/1875 [====================>.........] - ETA: 2s - loss: 0.0545 - acc: 0.9839
1380/1875 [=====================>........] - ETA: 2s - loss: 0.0545 - acc: 0.9839
1391/1875 [=====================>........] - ETA: 2s - loss: 0.0544 - acc: 0.9839
1402/1875 [=====================>........] - ETA: 2s - loss: 0.0544 - acc: 0.9839
1414/1875 [=====================>........] - ETA: 2s - loss: 0.0543 - acc: 0.9840
1426/1875 [=====================>........] - ETA: 2s - loss: 0.0543 - acc: 0.9840
1438/1875 [======================>.......] - ETA: 2s - loss: 0.0542 - acc: 0.9840
1450/1875 [======================>.......] - ETA: 1s - loss: 0.0542 - acc: 0.9840
1462/1875 [======================>.......] - ETA: 1s - loss: 0.0542 - acc: 0.9840
1474/1875 [======================>.......] - ETA: 1s - loss: 0.0541 - acc: 0.9840
1485/1875 [======================>.......] - ETA: 1s - loss: 0.0541 - acc: 0.9840
1496/1875 [======================>.......] - ETA: 1s - loss: 0.0540 - acc: 0.9840
1507/1875 [=======================>......] - ETA: 1s - loss: 0.0540 - acc: 0.9841
1518/1875 [=======================>......] - ETA: 1s - loss: 0.0539 - acc: 0.9841
1529/1875 [=======================>......] - ETA: 1s - loss: 0.0539 - acc: 0.9841
1539/1875 [=======================>......] - ETA: 1s - loss: 0.0539 - acc: 0.9841
1550/1875 [=======================>......] - ETA: 1s - loss: 0.0538 - acc: 0.9841
1562/1875 [=======================>......] - ETA: 1s - loss: 0.0538 - acc: 0.9841
1578/1875 [========================>.....] - ETA: 1s - loss: 0.0537 - acc: 0.9841
1595/1875 [========================>.....] - ETA: 1s - loss: 0.0536 - acc: 0.9841
1611/1875 [========================>.....] - ETA: 1s - loss: 0.0536 - acc: 0.9841
1627/1875 [=========================>....] - ETA: 1s - loss: 0.0535 - acc: 0.9842
1643/1875 [=========================>....] - ETA: 1s - loss: 0.0535 - acc: 0.9842
1660/1875 [=========================>....] - ETA: 0s - loss: 0.0534 - acc: 0.9842
1677/1875 [=========================>....] - ETA: 0s - loss: 0.0534 - acc: 0.9842
1693/1875 [==========================>...] - ETA: 0s - loss: 0.0533 - acc: 0.9842
1710/1875 [==========================>...] - ETA: 0s - loss: 0.0533 - acc: 0.9842
1727/1875 [==========================>...] - ETA: 0s - loss: 0.0532 - acc: 0.9842
1743/1875 [==========================>...] - ETA: 0s - loss: 0.0532 - acc: 0.9843
1759/1875 [===========================>..] - ETA: 0s - loss: 0.0531 - acc: 0.9843
1776/1875 [===========================>..] - ETA: 0s - loss: 0.0530 - acc: 0.9843
1793/1875 [===========================>..] - ETA: 0s - loss: 0.0530 - acc: 0.9843
1810/1875 [===========================>..] - ETA: 0s - loss: 0.0529 - acc: 0.9843
1827/1875 [============================>.] - ETA: 0s - loss: 0.0529 - acc: 0.9843
1844/1875 [============================>.] - ETA: 0s - loss: 0.0528 - acc: 0.9843
1861/1875 [============================>.] - ETA: 0s - loss: 0.0528 - acc: 0.9843
1875/1875 [==============================] - 9s 4ms/step - loss: 0.0528 - acc: 0.9843
Epoch 3/5
1/1875 [..............................] - ETA: 12:11 - loss: 0.0158 - acc: 1.0000
12/1875 [..............................] - ETA: 8s - loss: 0.0210 - acc: 0.9923
24/1875 [..............................] - ETA: 8s - loss: 0.0322 - acc: 0.9877
35/1875 [..............................] - ETA: 8s - loss: 0.0338 - acc: 0.9872
46/1875 [..............................] - ETA: 8s - loss: 0.0342 - acc: 0.9870
57/1875 [..............................] - ETA: 8s - loss: 0.0339 - acc: 0.9871
69/1875 [>.............................] - ETA: 8s - loss: 0.0330 - acc: 0.9875
81/1875 [>.............................] - ETA: 8s - loss: 0.0323 - acc: 0.9879
93/1875 [>.............................] - ETA: 8s - loss: 0.0318 - acc: 0.9882
105/1875 [>.............................] - ETA: 8s - loss: 0.0314 - acc: 0.9884
117/1875 [>.............................] - ETA: 7s - loss: 0.0313 - acc: 0.9886
129/1875 [=>............................] - ETA: 7s - loss: 0.0315 - acc: 0.9887
140/1875 [=>............................] - ETA: 7s - loss: 0.0315 - acc: 0.9888
152/1875 [=>............................] - ETA: 7s - loss: 0.0316 - acc: 0.9889
165/1875 [=>............................] - ETA: 7s - loss: 0.0316 - acc: 0.9890
177/1875 [=>............................] - ETA: 7s - loss: 0.0316 - acc: 0.9890
188/1875 [==>...........................] - ETA: 7s - loss: 0.0317 - acc: 0.9891
199/1875 [==>...........................] - ETA: 7s - loss: 0.0319 - acc: 0.9891
210/1875 [==>...........................] - ETA: 7s - loss: 0.0321 - acc: 0.9891
221/1875 [==>...........................] - ETA: 7s - loss: 0.0322 - acc: 0.9892
232/1875 [==>...........................] - ETA: 7s - loss: 0.0324 - acc: 0.9892
244/1875 [==>...........................] - ETA: 7s - loss: 0.0325 - acc: 0.9892
257/1875 [===>..........................] - ETA: 7s - loss: 0.0327 - acc: 0.9892
268/1875 [===>..........................] - ETA: 7s - loss: 0.0327 - acc: 0.9892
279/1875 [===>..........................] - ETA: 7s - loss: 0.0328 - acc: 0.9892
291/1875 [===>..........................] - ETA: 7s - loss: 0.0329 - acc: 0.9892
303/1875 [===>..........................] - ETA: 7s - loss: 0.0331 - acc: 0.9892
314/1875 [====>.........................] - ETA: 7s - loss: 0.0332 - acc: 0.9892
326/1875 [====>.........................] - ETA: 6s - loss: 0.0333 - acc: 0.9892
338/1875 [====>.........................] - ETA: 6s - loss: 0.0335 - acc: 0.9892
350/1875 [====>.........................] - ETA: 6s - loss: 0.0336 - acc: 0.9891
362/1875 [====>.........................] - ETA: 6s - loss: 0.0337 - acc: 0.9891
373/1875 [====>.........................] - ETA: 6s - loss: 0.0338 - acc: 0.9891
385/1875 [=====>........................] - ETA: 6s - loss: 0.0339 - acc: 0.9891
397/1875 [=====>........................] - ETA: 6s - loss: 0.0340 - acc: 0.9891
408/1875 [=====>........................] - ETA: 6s - loss: 0.0340 - acc: 0.9891
420/1875 [=====>........................] - ETA: 6s - loss: 0.0341 - acc: 0.9891
432/1875 [=====>........................] - ETA: 6s - loss: 0.0342 - acc: 0.9891
444/1875 [======>.......................] - ETA: 6s - loss: 0.0342 - acc: 0.9891
456/1875 [======>.......................] - ETA: 6s - loss: 0.0343 - acc: 0.9891
468/1875 [======>.......................] - ETA: 6s - loss: 0.0343 - acc: 0.9891
480/1875 [======>.......................] - ETA: 6s - loss: 0.0344 - acc: 0.9891
492/1875 [======>.......................] - ETA: 6s - loss: 0.0344 - acc: 0.9891
503/1875 [=======>......................] - ETA: 6s - loss: 0.0344 - acc: 0.9891
515/1875 [=======>......................] - ETA: 6s - loss: 0.0345 - acc: 0.9891
526/1875 [=======>......................] - ETA: 6s - loss: 0.0345 - acc: 0.9891
538/1875 [=======>......................] - ETA: 5s - loss: 0.0345 - acc: 0.9891
549/1875 [=======>......................] - ETA: 5s - loss: 0.0345 - acc: 0.9891
560/1875 [=======>......................] - ETA: 5s - loss: 0.0346 - acc: 0.9891
572/1875 [========>.....................] - ETA: 5s - loss: 0.0346 - acc: 0.9891
584/1875 [========>.....................] - ETA: 5s - loss: 0.0346 - acc: 0.9891
595/1875 [========>.....................] - ETA: 5s - loss: 0.0347 - acc: 0.9891
606/1875 [========>.....................] - ETA: 5s - loss: 0.0347 - acc: 0.9891
618/1875 [========>.....................] - ETA: 5s - loss: 0.0348 - acc: 0.9891
630/1875 [=========>....................] - ETA: 5s - loss: 0.0348 - acc: 0.9891
641/1875 [=========>....................] - ETA: 5s - loss: 0.0349 - acc: 0.9891
653/1875 [=========>....................] - ETA: 5s - loss: 0.0350 - acc: 0.9891
664/1875 [=========>....................] - ETA: 5s - loss: 0.0350 - acc: 0.9890
676/1875 [=========>....................] - ETA: 5s - loss: 0.0351 - acc: 0.9890
688/1875 [==========>...................] - ETA: 5s - loss: 0.0351 - acc: 0.9890
700/1875 [==========>...................] - ETA: 5s - loss: 0.0351 - acc: 0.9890
712/1875 [==========>...................] - ETA: 5s - loss: 0.0352 - acc: 0.9890
724/1875 [==========>...................] - ETA: 5s - loss: 0.0352 - acc: 0.9890
736/1875 [==========>...................] - ETA: 5s - loss: 0.0352 - acc: 0.9890
748/1875 [==========>...................] - ETA: 5s - loss: 0.0352 - acc: 0.9890
760/1875 [===========>..................] - ETA: 4s - loss: 0.0352 - acc: 0.9890
771/1875 [===========>..................] - ETA: 4s - loss: 0.0352 - acc: 0.9890
782/1875 [===========>..................] - ETA: 4s - loss: 0.0353 - acc: 0.9890
794/1875 [===========>..................] - ETA: 4s - loss: 0.0353 - acc: 0.9890
806/1875 [===========>..................] - ETA: 4s - loss: 0.0353 - acc: 0.9890
818/1875 [============>.................] - ETA: 4s - loss: 0.0353 - acc: 0.9890
830/1875 [============>.................] - ETA: 4s - loss: 0.0354 - acc: 0.9890
842/1875 [============>.................] - ETA: 4s - loss: 0.0354 - acc: 0.9890
854/1875 [============>.................] - ETA: 4s - loss: 0.0354 - acc: 0.9890
865/1875 [============>.................] - ETA: 4s - loss: 0.0354 - acc: 0.9890
876/1875 [=============>................] - ETA: 4s - loss: 0.0354 - acc: 0.9890
887/1875 [=============>................] - ETA: 4s - loss: 0.0354 - acc: 0.9890
899/1875 [=============>................] - ETA: 4s - loss: 0.0354 - acc: 0.9890
911/1875 [=============>................] - ETA: 4s - loss: 0.0355 - acc: 0.9890
923/1875 [=============>................] - ETA: 4s - loss: 0.0355 - acc: 0.9890
935/1875 [=============>................] - ETA: 4s - loss: 0.0355 - acc: 0.9890
947/1875 [==============>...............] - ETA: 4s - loss: 0.0355 - acc: 0.9890
958/1875 [==============>...............] - ETA: 4s - loss: 0.0355 - acc: 0.9890
970/1875 [==============>...............] - ETA: 4s - loss: 0.0355 - acc: 0.9890
982/1875 [==============>...............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
994/1875 [==============>...............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1005/1875 [===============>..............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1017/1875 [===============>..............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1029/1875 [===============>..............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1041/1875 [===============>..............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1053/1875 [===============>..............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1064/1875 [================>.............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1076/1875 [================>.............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1088/1875 [================>.............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1099/1875 [================>.............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1111/1875 [================>.............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1122/1875 [================>.............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1133/1875 [=================>............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1144/1875 [=================>............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1156/1875 [=================>............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1168/1875 [=================>............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1180/1875 [=================>............] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1192/1875 [==================>...........] - ETA: 3s - loss: 0.0355 - acc: 0.9890
1204/1875 [==================>...........] - ETA: 3s - loss: 0.0355 - acc: 0.9891
1216/1875 [==================>...........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1228/1875 [==================>...........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1240/1875 [==================>...........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1252/1875 [===================>..........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1263/1875 [===================>..........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1275/1875 [===================>..........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1287/1875 [===================>..........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1298/1875 [===================>..........] - ETA: 2s - loss: 0.0355 - acc: 0.9891
1310/1875 [===================>..........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1321/1875 [====================>.........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1332/1875 [====================>.........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1343/1875 [====================>.........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1354/1875 [====================>.........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1365/1875 [====================>.........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1377/1875 [=====================>........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1389/1875 [=====================>........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1401/1875 [=====================>........] - ETA: 2s - loss: 0.0354 - acc: 0.9891
1412/1875 [=====================>........] - ETA: 2s - loss: 0.0353 - acc: 0.9891
1423/1875 [=====================>........] - ETA: 2s - loss: 0.0353 - acc: 0.9891
1436/1875 [=====================>........] - ETA: 1s - loss: 0.0353 - acc: 0.9891
1448/1875 [======================>.......] - ETA: 1s - loss: 0.0353 - acc: 0.9891
1459/1875 [======================>.......] - ETA: 1s - loss: 0.0353 - acc: 0.9891
1470/1875 [======================>.......] - ETA: 1s - loss: 0.0353 - acc: 0.9891
1481/1875 [======================>.......] - ETA: 1s - loss: 0.0353 - acc: 0.9891
1493/1875 [======================>.......] - ETA: 1s - loss: 0.0353 - acc: 0.9891
1505/1875 [=======================>......] - ETA: 1s - loss: 0.0352 - acc: 0.9892
1516/1875 [=======================>......] - ETA: 1s - loss: 0.0352 - acc: 0.9892
1528/1875 [=======================>......] - ETA: 1s - loss: 0.0352 - acc: 0.9892
1540/1875 [=======================>......] - ETA: 1s - loss: 0.0352 - acc: 0.9892
1551/1875 [=======================>......] - ETA: 1s - loss: 0.0352 - acc: 0.9892
1563/1875 [========================>.....] - ETA: 1s - loss: 0.0352 - acc: 0.9892
1580/1875 [========================>.....] - ETA: 1s - loss: 0.0352 - acc: 0.9892
1596/1875 [========================>.....] - ETA: 1s - loss: 0.0351 - acc: 0.9892
1613/1875 [========================>.....] - ETA: 1s - loss: 0.0351 - acc: 0.9892
1630/1875 [=========================>....] - ETA: 1s - loss: 0.0351 - acc: 0.9892
1647/1875 [=========================>....] - ETA: 1s - loss: 0.0351 - acc: 0.9892
1664/1875 [=========================>....] - ETA: 0s - loss: 0.0350 - acc: 0.9892
1681/1875 [=========================>....] - ETA: 0s - loss: 0.0350 - acc: 0.9892
1698/1875 [==========================>...] - ETA: 0s - loss: 0.0350 - acc: 0.9892
1715/1875 [==========================>...] - ETA: 0s - loss: 0.0350 - acc: 0.9892
1731/1875 [==========================>...] - ETA: 0s - loss: 0.0350 - acc: 0.9892
1747/1875 [==========================>...] - ETA: 0s - loss: 0.0349 - acc: 0.9892
1763/1875 [===========================>..] - ETA: 0s - loss: 0.0349 - acc: 0.9892
1780/1875 [===========================>..] - ETA: 0s - loss: 0.0349 - acc: 0.9892
1796/1875 [===========================>..] - ETA: 0s - loss: 0.0349 - acc: 0.9893
1812/1875 [===========================>..] - ETA: 0s - loss: 0.0349 - acc: 0.9893
1829/1875 [============================>.] - ETA: 0s - loss: 0.0348 - acc: 0.9893
1846/1875 [============================>.] - ETA: 0s - loss: 0.0348 - acc: 0.9893
1862/1875 [============================>.] - ETA: 0s - loss: 0.0348 - acc: 0.9893
1875/1875 [==============================] - 8s 4ms/step - loss: 0.0348 - acc: 0.9893
Epoch 4/5
1/1875 [..............................] - ETA: 12:17 - loss: 0.0335 - acc: 1.0000
12/1875 [..............................] - ETA: 8s - loss: 0.0280 - acc: 0.9952
23/1875 [..............................] - ETA: 8s - loss: 0.0294 - acc: 0.9937
33/1875 [..............................] - ETA: 8s - loss: 0.0305 - acc: 0.9925
43/1875 [..............................] - ETA: 8s - loss: 0.0306 - acc: 0.9922
55/1875 [..............................] - ETA: 8s - loss: 0.0295 - acc: 0.9924
67/1875 [>.............................] - ETA: 8s - loss: 0.0292 - acc: 0.9923
79/1875 [>.............................] - ETA: 8s - loss: 0.0294 - acc: 0.9921
89/1875 [>.............................] - ETA: 8s - loss: 0.0293 - acc: 0.9921
100/1875 [>.............................] - ETA: 8s - loss: 0.0292 - acc: 0.9920
112/1875 [>.............................] - ETA: 8s - loss: 0.0291 - acc: 0.9919
124/1875 [>.............................] - ETA: 8s - loss: 0.0289 - acc: 0.9919
135/1875 [=>............................] - ETA: 8s - loss: 0.0288 - acc: 0.9918
146/1875 [=>............................] - ETA: 8s - loss: 0.0286 - acc: 0.9918
157/1875 [=>............................] - ETA: 8s - loss: 0.0284 - acc: 0.9917
168/1875 [=>............................] - ETA: 7s - loss: 0.0283 - acc: 0.9917
179/1875 [=>............................] - ETA: 7s - loss: 0.0283 - acc: 0.9916
190/1875 [==>...........................] - ETA: 7s - loss: 0.0282 - acc: 0.9916
202/1875 [==>...........................] - ETA: 7s - loss: 0.0281 - acc: 0.9916
214/1875 [==>...........................] - ETA: 7s - loss: 0.0280 - acc: 0.9916
226/1875 [==>...........................] - ETA: 7s - loss: 0.0280 - acc: 0.9915
238/1875 [==>...........................] - ETA: 7s - loss: 0.0279 - acc: 0.9915
249/1875 [==>...........................] - ETA: 7s - loss: 0.0279 - acc: 0.9915
260/1875 [===>..........................] - ETA: 7s - loss: 0.0279 - acc: 0.9915
271/1875 [===>..........................] - ETA: 7s - loss: 0.0278 - acc: 0.9915
283/1875 [===>..........................] - ETA: 7s - loss: 0.0278 - acc: 0.9914
295/1875 [===>..........................] - ETA: 7s - loss: 0.0277 - acc: 0.9914
306/1875 [===>..........................] - ETA: 7s - loss: 0.0277 - acc: 0.9914
317/1875 [====>.........................] - ETA: 7s - loss: 0.0277 - acc: 0.9914
329/1875 [====>.........................] - ETA: 7s - loss: 0.0277 - acc: 0.9914
341/1875 [====>.........................] - ETA: 7s - loss: 0.0277 - acc: 0.9914
352/1875 [====>.........................] - ETA: 7s - loss: 0.0277 - acc: 0.9914
363/1875 [====>.........................] - ETA: 6s - loss: 0.0276 - acc: 0.9914
375/1875 [=====>........................] - ETA: 6s - loss: 0.0276 - acc: 0.9914
387/1875 [=====>........................] - ETA: 6s - loss: 0.0276 - acc: 0.9914
398/1875 [=====>........................] - ETA: 6s - loss: 0.0277 - acc: 0.9913
409/1875 [=====>........................] - ETA: 6s - loss: 0.0277 - acc: 0.9913
421/1875 [=====>........................] - ETA: 6s - loss: 0.0277 - acc: 0.9913
433/1875 [=====>........................] - ETA: 6s - loss: 0.0278 - acc: 0.9913
444/1875 [======>.......................] - ETA: 6s - loss: 0.0278 - acc: 0.9913
457/1875 [======>.......................] - ETA: 6s - loss: 0.0278 - acc: 0.9913
469/1875 [======>.......................] - ETA: 6s - loss: 0.0278 - acc: 0.9913
481/1875 [======>.......................] - ETA: 6s - loss: 0.0279 - acc: 0.9912
493/1875 [======>.......................] - ETA: 6s - loss: 0.0279 - acc: 0.9912
505/1875 [=======>......................] - ETA: 6s - loss: 0.0279 - acc: 0.9912
518/1875 [=======>......................] - ETA: 6s - loss: 0.0280 - acc: 0.9912
530/1875 [=======>......................] - ETA: 6s - loss: 0.0280 - acc: 0.9912
542/1875 [=======>......................] - ETA: 6s - loss: 0.0280 - acc: 0.9912
553/1875 [=======>......................] - ETA: 5s - loss: 0.0280 - acc: 0.9912
565/1875 [========>.....................] - ETA: 5s - loss: 0.0280 - acc: 0.9912
576/1875 [========>.....................] - ETA: 5s - loss: 0.0280 - acc: 0.9912
588/1875 [========>.....................] - ETA: 5s - loss: 0.0280 - acc: 0.9912
600/1875 [========>.....................] - ETA: 5s - loss: 0.0280 - acc: 0.9912
612/1875 [========>.....................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
623/1875 [========>.....................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
634/1875 [=========>....................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
646/1875 [=========>....................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
658/1875 [=========>....................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
670/1875 [=========>....................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
682/1875 [=========>....................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
694/1875 [==========>...................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
706/1875 [==========>...................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
717/1875 [==========>...................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
729/1875 [==========>...................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
741/1875 [==========>...................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
753/1875 [===========>..................] - ETA: 5s - loss: 0.0280 - acc: 0.9911
764/1875 [===========>..................] - ETA: 5s - loss: 0.0279 - acc: 0.9911
776/1875 [===========>..................] - ETA: 4s - loss: 0.0279 - acc: 0.9911
788/1875 [===========>..................] - ETA: 4s - loss: 0.0279 - acc: 0.9911
800/1875 [===========>..................] - ETA: 4s - loss: 0.0279 - acc: 0.9911
811/1875 [===========>..................] - ETA: 4s - loss: 0.0279 - acc: 0.9911
823/1875 [============>.................] - ETA: 4s - loss: 0.0279 - acc: 0.9911
834/1875 [============>.................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
846/1875 [============>.................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
858/1875 [============>.................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
870/1875 [============>.................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
882/1875 [=============>................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
894/1875 [=============>................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
905/1875 [=============>................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
917/1875 [=============>................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
929/1875 [=============>................] - ETA: 4s - loss: 0.0278 - acc: 0.9911
941/1875 [==============>...............] - ETA: 4s - loss: 0.0278 - acc: 0.9911
952/1875 [==============>...............] - ETA: 4s - loss: 0.0278 - acc: 0.9911
964/1875 [==============>...............] - ETA: 4s - loss: 0.0278 - acc: 0.9911
976/1875 [==============>...............] - ETA: 4s - loss: 0.0278 - acc: 0.9911
987/1875 [==============>...............] - ETA: 3s - loss: 0.0278 - acc: 0.9911
999/1875 [==============>...............] - ETA: 3s - loss: 0.0278 - acc: 0.9911
1011/1875 [===============>..............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1023/1875 [===============>..............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1035/1875 [===============>..............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1047/1875 [===============>..............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1059/1875 [===============>..............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1072/1875 [================>.............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1084/1875 [================>.............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1095/1875 [================>.............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1107/1875 [================>.............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1119/1875 [================>.............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1131/1875 [=================>............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1142/1875 [=================>............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1153/1875 [=================>............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1165/1875 [=================>............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1176/1875 [=================>............] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1188/1875 [==================>...........] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1200/1875 [==================>...........] - ETA: 3s - loss: 0.0279 - acc: 0.9911
1211/1875 [==================>...........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1222/1875 [==================>...........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1233/1875 [==================>...........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1245/1875 [==================>...........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1257/1875 [===================>..........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1268/1875 [===================>..........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1280/1875 [===================>..........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1292/1875 [===================>..........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1304/1875 [===================>..........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1315/1875 [====================>.........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1327/1875 [====================>.........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1338/1875 [====================>.........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1350/1875 [====================>.........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1361/1875 [====================>.........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1373/1875 [====================>.........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1385/1875 [=====================>........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1397/1875 [=====================>........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1408/1875 [=====================>........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1419/1875 [=====================>........] - ETA: 2s - loss: 0.0279 - acc: 0.9911
1431/1875 [=====================>........] - ETA: 1s - loss: 0.0279 - acc: 0.9911
1443/1875 [======================>.......] - ETA: 1s - loss: 0.0279 - acc: 0.9911
1454/1875 [======================>.......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1466/1875 [======================>.......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1478/1875 [======================>.......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1489/1875 [======================>.......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1501/1875 [=======================>......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1513/1875 [=======================>......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1525/1875 [=======================>......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1537/1875 [=======================>......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1548/1875 [=======================>......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1560/1875 [=======================>......] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1573/1875 [========================>.....] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1590/1875 [========================>.....] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1607/1875 [========================>.....] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1624/1875 [========================>.....] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1641/1875 [=========================>....] - ETA: 1s - loss: 0.0278 - acc: 0.9911
1658/1875 [=========================>....] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1674/1875 [=========================>....] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1691/1875 [==========================>...] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1708/1875 [==========================>...] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1724/1875 [==========================>...] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1740/1875 [==========================>...] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1757/1875 [===========================>..] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1773/1875 [===========================>..] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1788/1875 [===========================>..] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1805/1875 [===========================>..] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1822/1875 [============================>.] - ETA: 0s - loss: 0.0277 - acc: 0.9911
1839/1875 [============================>.] - ETA: 0s - loss: 0.0276 - acc: 0.9911
1855/1875 [============================>.] - ETA: 0s - loss: 0.0276 - acc: 0.9911
1871/1875 [============================>.] - ETA: 0s - loss: 0.0276 - acc: 0.9911
1875/1875 [==============================] - 8s 4ms/step - loss: 0.0276 - acc: 0.9911
Epoch 5/5
1/1875 [..............................] - ETA: 12:05 - loss: 0.0032 - acc: 1.0000
12/1875 [..............................] - ETA: 9s - loss: 0.0191 - acc: 0.9894
24/1875 [..............................] - ETA: 8s - loss: 0.0195 - acc: 0.9894
35/1875 [..............................] - ETA: 8s - loss: 0.0180 - acc: 0.9906
47/1875 [..............................] - ETA: 8s - loss: 0.0172 - acc: 0.9912
58/1875 [..............................] - ETA: 8s - loss: 0.0194 - acc: 0.9914
69/1875 [>.............................] - ETA: 8s - loss: 0.0210 - acc: 0.9914
81/1875 [>.............................] - ETA: 8s - loss: 0.0218 - acc: 0.9916
93/1875 [>.............................] - ETA: 8s - loss: 0.0221 - acc: 0.9918
105/1875 [>.............................] - ETA: 8s - loss: 0.0222 - acc: 0.9919
117/1875 [>.............................] - ETA: 7s - loss: 0.0222 - acc: 0.9921
129/1875 [=>............................] - ETA: 7s - loss: 0.0221 - acc: 0.9922
141/1875 [=>............................] - ETA: 7s - loss: 0.0221 - acc: 0.9924
153/1875 [=>............................] - ETA: 7s - loss: 0.0219 - acc: 0.9925
164/1875 [=>............................] - ETA: 7s - loss: 0.0218 - acc: 0.9926
175/1875 [=>............................] - ETA: 7s - loss: 0.0218 - acc: 0.9927
187/1875 [=>............................] - ETA: 7s - loss: 0.0217 - acc: 0.9928
199/1875 [==>...........................] - ETA: 7s - loss: 0.0217 - acc: 0.9929
210/1875 [==>...........................] - ETA: 7s - loss: 0.0216 - acc: 0.9930
221/1875 [==>...........................] - ETA: 7s - loss: 0.0215 - acc: 0.9931
232/1875 [==>...........................] - ETA: 7s - loss: 0.0214 - acc: 0.9932
244/1875 [==>...........................] - ETA: 7s - loss: 0.0213 - acc: 0.9932
255/1875 [===>..........................] - ETA: 7s - loss: 0.0212 - acc: 0.9933
266/1875 [===>..........................] - ETA: 7s - loss: 0.0212 - acc: 0.9933
278/1875 [===>..........................] - ETA: 7s - loss: 0.0212 - acc: 0.9934
290/1875 [===>..........................] - ETA: 7s - loss: 0.0212 - acc: 0.9934
302/1875 [===>..........................] - ETA: 7s - loss: 0.0212 - acc: 0.9934
314/1875 [====>.........................] - ETA: 7s - loss: 0.0212 - acc: 0.9935
326/1875 [====>.........................] - ETA: 6s - loss: 0.0212 - acc: 0.9935
338/1875 [====>.........................] - ETA: 6s - loss: 0.0212 - acc: 0.9935
349/1875 [====>.........................] - ETA: 6s - loss: 0.0212 - acc: 0.9936
360/1875 [====>.........................] - ETA: 6s - loss: 0.0212 - acc: 0.9936
372/1875 [====>.........................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
383/1875 [=====>........................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
394/1875 [=====>........................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
406/1875 [=====>........................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
418/1875 [=====>........................] - ETA: 6s - loss: 0.0210 - acc: 0.9936
430/1875 [=====>........................] - ETA: 6s - loss: 0.0210 - acc: 0.9936
441/1875 [======>.......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
453/1875 [======>.......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
465/1875 [======>.......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
477/1875 [======>.......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
488/1875 [======>.......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
499/1875 [======>.......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
510/1875 [=======>......................] - ETA: 6s - loss: 0.0210 - acc: 0.9936
522/1875 [=======>......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
534/1875 [=======>......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
545/1875 [=======>......................] - ETA: 6s - loss: 0.0211 - acc: 0.9936
556/1875 [=======>......................] - ETA: 5s - loss: 0.0211 - acc: 0.9936
567/1875 [========>.....................] - ETA: 5s - loss: 0.0211 - acc: 0.9936
578/1875 [========>.....................] - ETA: 5s - loss: 0.0212 - acc: 0.9936
589/1875 [========>.....................] - ETA: 5s - loss: 0.0212 - acc: 0.9935
601/1875 [========>.....................] - ETA: 5s - loss: 0.0212 - acc: 0.9935
611/1875 [========>.....................] - ETA: 5s - loss: 0.0212 - acc: 0.9935
622/1875 [========>.....................] - ETA: 5s - loss: 0.0213 - acc: 0.9935
634/1875 [=========>....................] - ETA: 5s - loss: 0.0213 - acc: 0.9935
646/1875 [=========>....................] - ETA: 5s - loss: 0.0213 - acc: 0.9935
658/1875 [=========>....................] - ETA: 5s - loss: 0.0213 - acc: 0.9935
669/1875 [=========>....................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
680/1875 [=========>....................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
691/1875 [==========>...................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
702/1875 [==========>...................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
713/1875 [==========>...................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
725/1875 [==========>...................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
736/1875 [==========>...................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
747/1875 [==========>...................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
759/1875 [===========>..................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
772/1875 [===========>..................] - ETA: 5s - loss: 0.0214 - acc: 0.9935
784/1875 [===========>..................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
796/1875 [===========>..................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
808/1875 [===========>..................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
820/1875 [============>.................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
832/1875 [============>.................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
844/1875 [============>.................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
856/1875 [============>.................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
868/1875 [============>.................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
880/1875 [=============>................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
890/1875 [=============>................] - ETA: 4s - loss: 0.0214 - acc: 0.9935
901/1875 [=============>................] - ETA: 4s - loss: 0.0213 - acc: 0.9935
912/1875 [=============>................] - ETA: 4s - loss: 0.0213 - acc: 0.9935
924/1875 [=============>................] - ETA: 4s - loss: 0.0213 - acc: 0.9935
935/1875 [=============>................] - ETA: 4s - loss: 0.0213 - acc: 0.9935
946/1875 [==============>...............] - ETA: 4s - loss: 0.0213 - acc: 0.9935
958/1875 [==============>...............] - ETA: 4s - loss: 0.0213 - acc: 0.9935
970/1875 [==============>...............] - ETA: 4s - loss: 0.0213 - acc: 0.9935
981/1875 [==============>...............] - ETA: 4s - loss: 0.0213 - acc: 0.9935
993/1875 [==============>...............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1004/1875 [===============>..............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1015/1875 [===============>..............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1026/1875 [===============>..............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1038/1875 [===============>..............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1050/1875 [===============>..............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1061/1875 [===============>..............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1072/1875 [================>.............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1083/1875 [================>.............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1095/1875 [================>.............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1106/1875 [================>.............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1117/1875 [================>.............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1128/1875 [=================>............] - ETA: 3s - loss: 0.0214 - acc: 0.9935
1140/1875 [=================>............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1152/1875 [=================>............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1162/1875 [=================>............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1174/1875 [=================>............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1186/1875 [=================>............] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1197/1875 [==================>...........] - ETA: 3s - loss: 0.0213 - acc: 0.9935
1209/1875 [==================>...........] - ETA: 3s - loss: 0.0213 - acc: 0.9936
1220/1875 [==================>...........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1231/1875 [==================>...........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1243/1875 [==================>...........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1254/1875 [===================>..........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1266/1875 [===================>..........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1278/1875 [===================>..........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1290/1875 [===================>..........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1302/1875 [===================>..........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1313/1875 [====================>.........] - ETA: 2s - loss: 0.0213 - acc: 0.9936
1324/1875 [====================>.........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1335/1875 [====================>.........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1346/1875 [====================>.........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1358/1875 [====================>.........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1369/1875 [====================>.........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1381/1875 [=====================>........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1392/1875 [=====================>........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1403/1875 [=====================>........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1415/1875 [=====================>........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1426/1875 [=====================>........] - ETA: 2s - loss: 0.0212 - acc: 0.9936
1438/1875 [======================>.......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1450/1875 [======================>.......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1462/1875 [======================>.......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1474/1875 [======================>.......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1486/1875 [======================>.......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1498/1875 [======================>.......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1510/1875 [=======================>......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1521/1875 [=======================>......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1533/1875 [=======================>......] - ETA: 1s - loss: 0.0212 - acc: 0.9936
1545/1875 [=======================>......] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1556/1875 [=======================>......] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1566/1875 [========================>.....] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1582/1875 [========================>.....] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1598/1875 [========================>.....] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1615/1875 [========================>.....] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1631/1875 [=========================>....] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1647/1875 [=========================>....] - ETA: 1s - loss: 0.0211 - acc: 0.9937
1664/1875 [=========================>....] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1680/1875 [=========================>....] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1696/1875 [==========================>...] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1712/1875 [==========================>...] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1729/1875 [==========================>...] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1746/1875 [==========================>...] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1762/1875 [===========================>..] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1778/1875 [===========================>..] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1795/1875 [===========================>..] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1811/1875 [===========================>..] - ETA: 0s - loss: 0.0211 - acc: 0.9937
1828/1875 [============================>.] - ETA: 0s - loss: 0.0210 - acc: 0.9937
1845/1875 [============================>.] - ETA: 0s - loss: 0.0210 - acc: 0.9937
1862/1875 [============================>.] - ETA: 0s - loss: 0.0210 - acc: 0.9937
1875/1875 [==============================] - 8s 4ms/step - loss: 0.0210 - acc: 0.9937
<tensorflow.python.keras.callbacks.History at 0x7fa2901c7e48>
results = base_model.evaluate(test_dataset)
named_results = dict(zip(base_model.metrics_names, results))
print('\naccuracy:', named_results['acc'])
1/313 [..............................] - ETA: 2:34 - loss: 0.0051 - acc: 1.0000
19/313 [>.............................] - ETA: 0s - loss: 0.0402 - acc: 0.9934
38/313 [==>...........................] - ETA: 0s - loss: 0.0307 - acc: 0.9926
56/313 [====>.........................] - ETA: 0s - loss: 0.0306 - acc: 0.9927
75/313 [======>.......................] - ETA: 0s - loss: 0.0312 - acc: 0.9908
95/313 [========>.....................] - ETA: 0s - loss: 0.0339 - acc: 0.9898
114/313 [=========>....................] - ETA: 0s - loss: 0.0299 - acc: 0.9910
134/313 [===========>..................] - ETA: 0s - loss: 0.0293 - acc: 0.9909
154/313 [=============>................] - ETA: 0s - loss: 0.0347 - acc: 0.9903
173/313 [===============>..............] - ETA: 0s - loss: 0.0357 - acc: 0.9897
192/313 [=================>............] - ETA: 0s - loss: 0.0353 - acc: 0.9896
212/313 [===================>..........] - ETA: 0s - loss: 0.0354 - acc: 0.9898
232/313 [=====================>........] - ETA: 0s - loss: 0.0355 - acc: 0.9895
253/313 [=======================>......] - ETA: 0s - loss: 0.0363 - acc: 0.9895
274/313 [=========================>....] - ETA: 0s - loss: 0.0359 - acc: 0.9892
294/313 [===========================>..] - ETA: 0s - loss: 0.0353 - acc: 0.9892
313/313 [==============================] - ETA: 0s - loss: 0.0369 - acc: 0.9885
313/313 [==============================] - 1s 3ms/step - loss: 0.0369 - acc: 0.9885
accuracy: 0.9884999990463257

基本モデルがテストセットで 99% の精度を達成していることが分かります。下記の敵対的摂動下でのロバスト性では、モデルがどれだけロバストであるかを確認します。

敵対的正則化モデル

ここでは、NSL フレームワークを使用して、数行のコードで Keras モデルに敵対的トレーニングを組み込む方法を示します。基本モデルをラップして、トレーニング目的に敵対的正則化を含む新しい tf.Keras.Model を作成します。

まず最初に、ヘルパー関数 nsl.configs.make_adv_reg_config を使用して、関連するすべてのハイパーパラメータを含む構成オブジェクトを作成します。

adv_config = nsl.configs.make_adv_reg_config(
    multiplier=HPARAMS.adv_multiplier,
    adv_step_size=HPARAMS.adv_step_size,
    adv_grad_norm=HPARAMS.adv_grad_norm
)

これで AdversarialRegularization を使って基本モデルをラップすることができます。ここでは、既存の基本モデル(base_model)を後で比較に使用できるように、新しい基本モデル(base_adv_model)を作成します。

返される adv_model は tf.keras.Model のオブジェクトであり、そのトレーニング目的には敵対的損失の正則化項を含みます。この損失を計算するためには、モデルは通常の正規入力(特徴 image)に加えてラベル情報(特徴 label)にアクセスする必要があります。この理由から、データセットの例は変換してタプルからディクショナリに戻します。そして label_keys パラメータを介してどの特徴がラベル情報を含んでいるかをモデルに伝えます。

base_adv_model = build_base_model(HPARAMS)
adv_model = nsl.keras.AdversarialRegularization(
    base_adv_model,
    label_keys=[LABEL_INPUT_NAME],
    adv_config=adv_config
)

train_set_for_adv_model = train_dataset.map(convert_to_dictionaries)
test_set_for_adv_model = test_dataset.map(convert_to_dictionaries)

次に、敵対的正則化モデルをコンパイルしてトレーニングし、評価します。「損失ディクショナリに出力がありません」というような警告が出るかもしれませんが、これは adv_model が基本実装に依存せずトータルの損失を計算しているため、問題ありません。

adv_model.compile(optimizer='adam', loss='sparse_categorical_crossentropy',
                   metrics=['acc'])
adv_model.fit(train_set_for_adv_model, epochs=HPARAMS.epochs)
Epoch 1/5
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:AutoGraph could not transform <bound method Socket.send of <zmq.sugar.socket.Socket object at 0x7fa34d08c1e8>> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: <cyfunction Socket.send at 0x7fa34afa72a0> is not a module, class, method, function, traceback, frame, or code object
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert
WARNING:absl:Cannot perturb features dict_keys(['label'])WARNING:tensorflow:AutoGraph could not transform <bound method Socket.send of <zmq.sugar.socket.Socket object at 0x7fa34d08c1e8>> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: <cyfunction Socket.send at 0x7fa34afa72a0> is not a module, class, method, function, traceback, frame, or code object
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert
WARNING: AutoGraph could not transform <bound method Socket.send of <zmq.sugar.socket.Socket object at 0x7fa34d08c1e8>> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: <cyfunction Socket.send at 0x7fa34afa72a0> is not a module, class, method, function, traceback, frame, or code object
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert

WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
1/1875 [..............................] - ETA: 3:04:20 - loss: 2.7868 - sparse_categorical_crossentropy: 2.3079 - sparse_categorical_accuracy: 0.1250 - scaled_adversarial_loss: 0.4789
9/1875 [..............................] - ETA: 11s - loss: 2.7523 - sparse_categorical_crossentropy: 2.2779 - sparse_categorical_accuracy: 0.1698 - scaled_adversarial_loss: 0.4744
18/1875 [..............................] - ETA: 11s - loss: 2.6923 - sparse_categorical_crossentropy: 2.2222 - sparse_categorical_accuracy: 0.2411 - scaled_adversarial_loss: 0.4701
26/1875 [..............................] - ETA: 11s - loss: 2.6145 - sparse_categorical_crossentropy: 2.1470 - sparse_categorical_accuracy: 0.2858 - scaled_adversarial_loss: 0.4675
35/1875 [..............................] - ETA: 11s - loss: 2.5210 - sparse_categorical_crossentropy: 2.0538 - sparse_categorical_accuracy: 0.3299 - scaled_adversarial_loss: 0.4671
43/1875 [..............................] - ETA: 11s - loss: 2.4381 - sparse_categorical_crossentropy: 1.9704 - sparse_categorical_accuracy: 0.3638 - scaled_adversarial_loss: 0.4676
51/1875 [..............................] - ETA: 11s - loss: 2.3584 - sparse_categorical_crossentropy: 1.8909 - sparse_categorical_accuracy: 0.3936 - scaled_adversarial_loss: 0.4674
59/1875 [..............................] - ETA: 11s - loss: 2.2827 - sparse_categorical_crossentropy: 1.8165 - sparse_categorical_accuracy: 0.4203 - scaled_adversarial_loss: 0.4662
67/1875 [>.............................] - ETA: 11s - loss: 2.2116 - sparse_categorical_crossentropy: 1.7474 - sparse_categorical_accuracy: 0.4444 - scaled_adversarial_loss: 0.4641
75/1875 [>.............................] - ETA: 11s - loss: 2.1439 - sparse_categorical_crossentropy: 1.6825 - sparse_categorical_accuracy: 0.4669 - scaled_adversarial_loss: 0.4614
83/1875 [>.............................] - ETA: 11s - loss: 2.0809 - sparse_categorical_crossentropy: 1.6224 - sparse_categorical_accuracy: 0.4876 - scaled_adversarial_loss: 0.4585
91/1875 [>.............................] - ETA: 11s - loss: 2.0227 - sparse_categorical_crossentropy: 1.5671 - sparse_categorical_accuracy: 0.5064 - scaled_adversarial_loss: 0.4555
99/1875 [>.............................] - ETA: 11s - loss: 1.9691 - sparse_categorical_crossentropy: 1.5165 - sparse_categorical_accuracy: 0.5235 - scaled_adversarial_loss: 0.4527
107/1875 [>.............................] - ETA: 11s - loss: 1.9196 - sparse_categorical_crossentropy: 1.4698 - sparse_categorical_accuracy: 0.5392 - scaled_adversarial_loss: 0.4498
115/1875 [>.............................] - ETA: 11s - loss: 1.8737 - sparse_categorical_crossentropy: 1.4269 - sparse_categorical_accuracy: 0.5536 - scaled_adversarial_loss: 0.4468
123/1875 [>.............................] - ETA: 11s - loss: 1.8312 - sparse_categorical_crossentropy: 1.3872 - sparse_categorical_accuracy: 0.5668 - scaled_adversarial_loss: 0.4440
131/1875 [=>............................] - ETA: 11s - loss: 1.7912 - sparse_categorical_crossentropy: 1.3502 - sparse_categorical_accuracy: 0.5791 - scaled_adversarial_loss: 0.4411
140/1875 [=>............................] - ETA: 11s - loss: 1.7490 - sparse_categorical_crossentropy: 1.3113 - sparse_categorical_accuracy: 0.5919 - scaled_adversarial_loss: 0.4377
148/1875 [=>............................] - ETA: 11s - loss: 1.7135 - sparse_categorical_crossentropy: 1.2789 - sparse_categorical_accuracy: 0.6026 - scaled_adversarial_loss: 0.4347
156/1875 [=>............................] - ETA: 11s - loss: 1.6799 - sparse_categorical_crossentropy: 1.2483 - sparse_categorical_accuracy: 0.6126 - scaled_adversarial_loss: 0.4316
164/1875 [=>............................] - ETA: 11s - loss: 1.6482 - sparse_categorical_crossentropy: 1.2197 - sparse_categorical_accuracy: 0.6219 - scaled_adversarial_loss: 0.4285
172/1875 [=>............................] - ETA: 11s - loss: 1.6184 - sparse_categorical_crossentropy: 1.1928 - sparse_categorical_accuracy: 0.6306 - scaled_adversarial_loss: 0.4256
180/1875 [=>............................] - ETA: 11s - loss: 1.5900 - sparse_categorical_crossentropy: 1.1673 - sparse_categorical_accuracy: 0.6389 - scaled_adversarial_loss: 0.4226
188/1875 [==>...........................] - ETA: 11s - loss: 1.5630 - sparse_categorical_crossentropy: 1.1433 - sparse_categorical_accuracy: 0.6466 - scaled_adversarial_loss: 0.4198
196/1875 [==>...........................] - ETA: 10s - loss: 1.5375 - sparse_categorical_crossentropy: 1.1205 - sparse_categorical_accuracy: 0.6540 - scaled_adversarial_loss: 0.4170
205/1875 [==>...........................] - ETA: 10s - loss: 1.5101 - sparse_categorical_crossentropy: 1.0962 - sparse_categorical_accuracy: 0.6618 - scaled_adversarial_loss: 0.4139
213/1875 [==>...........................] - ETA: 10s - loss: 1.4870 - sparse_categorical_crossentropy: 1.0758 - sparse_categorical_accuracy: 0.6683 - scaled_adversarial_loss: 0.4112
221/1875 [==>...........................] - ETA: 10s - loss: 1.4648 - sparse_categorical_crossentropy: 1.0562 - sparse_categorical_accuracy: 0.6746 - scaled_adversarial_loss: 0.4086
229/1875 [==>...........................] - ETA: 10s - loss: 1.4436 - sparse_categorical_crossentropy: 1.0376 - sparse_categorical_accuracy: 0.6805 - scaled_adversarial_loss: 0.4060
237/1875 [==>...........................] - ETA: 10s - loss: 1.4234 - sparse_categorical_crossentropy: 1.0198 - sparse_categorical_accuracy: 0.6862 - scaled_adversarial_loss: 0.4035
245/1875 [==>...........................] - ETA: 10s - loss: 1.4038 - sparse_categorical_crossentropy: 1.0028 - sparse_categorical_accuracy: 0.6917 - scaled_adversarial_loss: 0.4010
253/1875 [===>..........................] - ETA: 10s - loss: 1.3851 - sparse_categorical_crossentropy: 0.9865 - sparse_categorical_accuracy: 0.6969 - scaled_adversarial_loss: 0.3986
261/1875 [===>..........................] - ETA: 10s - loss: 1.3671 - sparse_categorical_crossentropy: 0.9709 - sparse_categorical_accuracy: 0.7019 - scaled_adversarial_loss: 0.3962
269/1875 [===>..........................] - ETA: 10s - loss: 1.3498 - sparse_categorical_crossentropy: 0.9559 - sparse_categorical_accuracy: 0.7067 - scaled_adversarial_loss: 0.3939
277/1875 [===>..........................] - ETA: 10s - loss: 1.3332 - sparse_categorical_crossentropy: 0.9416 - sparse_categorical_accuracy: 0.7113 - scaled_adversarial_loss: 0.3916
285/1875 [===>..........................] - ETA: 10s - loss: 1.3171 - sparse_categorical_crossentropy: 0.9278 - sparse_categorical_accuracy: 0.7157 - scaled_adversarial_loss: 0.3894
294/1875 [===>..........................] - ETA: 10s - loss: 1.2997 - sparse_categorical_crossentropy: 0.9128 - sparse_categorical_accuracy: 0.7205 - scaled_adversarial_loss: 0.3869
303/1875 [===>..........................] - ETA: 10s - loss: 1.2829 - sparse_categorical_crossentropy: 0.8985 - sparse_categorical_accuracy: 0.7250 - scaled_adversarial_loss: 0.3844
310/1875 [===>..........................] - ETA: 10s - loss: 1.2703 - sparse_categorical_crossentropy: 0.8877 - sparse_categorical_accuracy: 0.7285 - scaled_adversarial_loss: 0.3826
318/1875 [====>.........................] - ETA: 10s - loss: 1.2563 - sparse_categorical_crossentropy: 0.8758 - sparse_categorical_accuracy: 0.7322 - scaled_adversarial_loss: 0.3805
326/1875 [====>.........................] - ETA: 10s - loss: 1.2428 - sparse_categorical_crossentropy: 0.8644 - sparse_categorical_accuracy: 0.7359 - scaled_adversarial_loss: 0.3785
334/1875 [====>.........................] - ETA: 9s - loss: 1.2297 - sparse_categorical_crossentropy: 0.8533 - sparse_categorical_accuracy: 0.7394 - scaled_adversarial_loss: 0.3764
342/1875 [====>.........................] - ETA: 9s - loss: 1.2170 - sparse_categorical_crossentropy: 0.8425 - sparse_categorical_accuracy: 0.7428 - scaled_adversarial_loss: 0.3745
350/1875 [====>.........................] - ETA: 9s - loss: 1.2047 - sparse_categorical_crossentropy: 0.8322 - sparse_categorical_accuracy: 0.7461 - scaled_adversarial_loss: 0.3726
358/1875 [====>.........................] - ETA: 9s - loss: 1.1928 - sparse_categorical_crossentropy: 0.8221 - sparse_categorical_accuracy: 0.7492 - scaled_adversarial_loss: 0.3707
366/1875 [====>.........................] - ETA: 9s - loss: 1.1812 - sparse_categorical_crossentropy: 0.8123 - sparse_categorical_accuracy: 0.7523 - scaled_adversarial_loss: 0.3688
374/1875 [====>.........................] - ETA: 9s - loss: 1.1699 - sparse_categorical_crossentropy: 0.8029 - sparse_categorical_accuracy: 0.7553 - scaled_adversarial_loss: 0.3670
382/1875 [=====>........................] - ETA: 9s - loss: 1.1589 - sparse_categorical_crossentropy: 0.7937 - sparse_categorical_accuracy: 0.7582 - scaled_adversarial_loss: 0.3652
390/1875 [=====>........................] - ETA: 9s - loss: 1.1483 - sparse_categorical_crossentropy: 0.7848 - sparse_categorical_accuracy: 0.7610 - scaled_adversarial_loss: 0.3635
398/1875 [=====>........................] - ETA: 9s - loss: 1.1379 - sparse_categorical_crossentropy: 0.7762 - sparse_categorical_accuracy: 0.7637 - scaled_adversarial_loss: 0.3618
406/1875 [=====>........................] - ETA: 9s - loss: 1.1279 - sparse_categorical_crossentropy: 0.7678 - sparse_categorical_accuracy: 0.7664 - scaled_adversarial_loss: 0.3601
414/1875 [=====>........................] - ETA: 9s - loss: 1.1180 - sparse_categorical_crossentropy: 0.7596 - sparse_categorical_accuracy: 0.7689 - scaled_adversarial_loss: 0.3584
423/1875 [=====>........................] - ETA: 9s - loss: 1.1074 - sparse_categorical_crossentropy: 0.7507 - sparse_categorical_accuracy: 0.7717 - scaled_adversarial_loss: 0.3566
431/1875 [=====>........................] - ETA: 9s - loss: 1.0981 - sparse_categorical_crossentropy: 0.7431 - sparse_categorical_accuracy: 0.7741 - scaled_adversarial_loss: 0.3550
439/1875 [======>.......................] - ETA: 9s - loss: 1.0891 - sparse_categorical_crossentropy: 0.7356 - sparse_categorical_accuracy: 0.7765 - scaled_adversarial_loss: 0.3535
448/1875 [======>.......................] - ETA: 9s - loss: 1.0792 - sparse_categorical_crossentropy: 0.7274 - sparse_categorical_accuracy: 0.7791 - scaled_adversarial_loss: 0.3518
457/1875 [======>.......................] - ETA: 9s - loss: 1.0695 - sparse_categorical_crossentropy: 0.7195 - sparse_categorical_accuracy: 0.7816 - scaled_adversarial_loss: 0.3501
465/1875 [======>.......................] - ETA: 9s - loss: 1.0612 - sparse_categorical_crossentropy: 0.7126 - sparse_categorical_accuracy: 0.7837 - scaled_adversarial_loss: 0.3486
473/1875 [======>.......................] - ETA: 9s - loss: 1.0530 - sparse_categorical_crossentropy: 0.7059 - sparse_categorical_accuracy: 0.7858 - scaled_adversarial_loss: 0.3471
482/1875 [======>.......................] - ETA: 9s - loss: 1.0441 - sparse_categorical_crossentropy: 0.6986 - sparse_categorical_accuracy: 0.7881 - scaled_adversarial_loss: 0.3455
491/1875 [======>.......................] - ETA: 8s - loss: 1.0354 - sparse_categorical_crossentropy: 0.6914 - sparse_categorical_accuracy: 0.7903 - scaled_adversarial_loss: 0.3439
499/1875 [======>.......................] - ETA: 8s - loss: 1.0278 - sparse_categorical_crossentropy: 0.6852 - sparse_categorical_accuracy: 0.7923 - scaled_adversarial_loss: 0.3426
507/1875 [=======>......................] - ETA: 8s - loss: 1.0204 - sparse_categorical_crossentropy: 0.6792 - sparse_categorical_accuracy: 0.7941 - scaled_adversarial_loss: 0.3412
516/1875 [=======>......................] - ETA: 8s - loss: 1.0123 - sparse_categorical_crossentropy: 0.6726 - sparse_categorical_accuracy: 0.7962 - scaled_adversarial_loss: 0.3397
524/1875 [=======>......................] - ETA: 8s - loss: 1.0053 - sparse_categorical_crossentropy: 0.6669 - sparse_categorical_accuracy: 0.7980 - scaled_adversarial_loss: 0.3384
532/1875 [=======>......................] - ETA: 8s - loss: 0.9984 - sparse_categorical_crossentropy: 0.6613 - sparse_categorical_accuracy: 0.7997 - scaled_adversarial_loss: 0.3371
541/1875 [=======>......................] - ETA: 8s - loss: 0.9908 - sparse_categorical_crossentropy: 0.6551 - sparse_categorical_accuracy: 0.8017 - scaled_adversarial_loss: 0.3357
549/1875 [=======>......................] - ETA: 8s - loss: 0.9842 - sparse_categorical_crossentropy: 0.6497 - sparse_categorical_accuracy: 0.8033 - scaled_adversarial_loss: 0.3345
557/1875 [=======>......................] - ETA: 8s - loss: 0.9777 - sparse_categorical_crossentropy: 0.6445 - sparse_categorical_accuracy: 0.8050 - scaled_adversarial_loss: 0.3332
565/1875 [========>.....................] - ETA: 8s - loss: 0.9714 - sparse_categorical_crossentropy: 0.6393 - sparse_categorical_accuracy: 0.8066 - scaled_adversarial_loss: 0.3320
573/1875 [========>.....................] - ETA: 8s - loss: 0.9652 - sparse_categorical_crossentropy: 0.6343 - sparse_categorical_accuracy: 0.8081 - scaled_adversarial_loss: 0.3309
582/1875 [========>.....................] - ETA: 8s - loss: 0.9583 - sparse_categorical_crossentropy: 0.6288 - sparse_categorical_accuracy: 0.8099 - scaled_adversarial_loss: 0.3295
590/1875 [========>.....................] - ETA: 8s - loss: 0.9523 - sparse_categorical_crossentropy: 0.6239 - sparse_categorical_accuracy: 0.8114 - scaled_adversarial_loss: 0.3284
598/1875 [========>.....................] - ETA: 8s - loss: 0.9465 - sparse_categorical_crossentropy: 0.6192 - sparse_categorical_accuracy: 0.8128 - scaled_adversarial_loss: 0.3272
606/1875 [========>.....................] - ETA: 8s - loss: 0.9407 - sparse_categorical_crossentropy: 0.6146 - sparse_categorical_accuracy: 0.8143 - scaled_adversarial_loss: 0.3261
614/1875 [========>.....................] - ETA: 8s - loss: 0.9351 - sparse_categorical_crossentropy: 0.6100 - sparse_categorical_accuracy: 0.8157 - scaled_adversarial_loss: 0.3250
622/1875 [========>.....................] - ETA: 8s - loss: 0.9295 - sparse_categorical_crossentropy: 0.6056 - sparse_categorical_accuracy: 0.8171 - scaled_adversarial_loss: 0.3239
630/1875 [=========>....................] - ETA: 8s - loss: 0.9241 - sparse_categorical_crossentropy: 0.6012 - sparse_categorical_accuracy: 0.8184 - scaled_adversarial_loss: 0.3229
639/1875 [=========>....................] - ETA: 7s - loss: 0.9181 - sparse_categorical_crossentropy: 0.5964 - sparse_categorical_accuracy: 0.8199 - scaled_adversarial_loss: 0.3217
648/1875 [=========>....................] - ETA: 7s - loss: 0.9122 - sparse_categorical_crossentropy: 0.5917 - sparse_categorical_accuracy: 0.8214 - scaled_adversarial_loss: 0.3205
656/1875 [=========>....................] - ETA: 7s - loss: 0.9070 - sparse_categorical_crossentropy: 0.5876 - sparse_categorical_accuracy: 0.8227 - scaled_adversarial_loss: 0.3194
664/1875 [=========>....................] - ETA: 7s - loss: 0.9019 - sparse_categorical_crossentropy: 0.5835 - sparse_categorical_accuracy: 0.8239 - scaled_adversarial_loss: 0.3184
672/1875 [=========>....................] - ETA: 7s - loss: 0.8969 - sparse_categorical_crossentropy: 0.5795 - sparse_categorical_accuracy: 0.8251 - scaled_adversarial_loss: 0.3174
680/1875 [=========>....................] - ETA: 7s - loss: 0.8920 - sparse_categorical_crossentropy: 0.5756 - sparse_categorical_accuracy: 0.8263 - scaled_adversarial_loss: 0.3164
688/1875 [==========>...................] - ETA: 7s - loss: 0.8872 - sparse_categorical_crossentropy: 0.5718 - sparse_categorical_accuracy: 0.8275 - scaled_adversarial_loss: 0.3154
696/1875 [==========>...................] - ETA: 7s - loss: 0.8825 - sparse_categorical_crossentropy: 0.5680 - sparse_categorical_accuracy: 0.8287 - scaled_adversarial_loss: 0.3144
704/1875 [==========>...................] - ETA: 7s - loss: 0.8778 - sparse_categorical_crossentropy: 0.5643 - sparse_categorical_accuracy: 0.8298 - scaled_adversarial_loss: 0.3135
712/1875 [==========>...................] - ETA: 7s - loss: 0.8732 - sparse_categorical_crossentropy: 0.5607 - sparse_categorical_accuracy: 0.8309 - scaled_adversarial_loss: 0.3125
720/1875 [==========>...................] - ETA: 7s - loss: 0.8687 - sparse_categorical_crossentropy: 0.5571 - sparse_categorical_accuracy: 0.8320 - scaled_adversarial_loss: 0.3115
728/1875 [==========>...................] - ETA: 7s - loss: 0.8642 - sparse_categorical_crossentropy: 0.5536 - sparse_categorical_accuracy: 0.8331 - scaled_adversarial_loss: 0.3106
736/1875 [==========>...................] - ETA: 7s - loss: 0.8598 - sparse_categorical_crossentropy: 0.5501 - sparse_categorical_accuracy: 0.8342 - scaled_adversarial_loss: 0.3097
745/1875 [==========>...................] - ETA: 7s - loss: 0.8550 - sparse_categorical_crossentropy: 0.5463 - sparse_categorical_accuracy: 0.8354 - scaled_adversarial_loss: 0.3087
753/1875 [===========>..................] - ETA: 7s - loss: 0.8507 - sparse_categorical_crossentropy: 0.5430 - sparse_categorical_accuracy: 0.8364 - scaled_adversarial_loss: 0.3078
761/1875 [===========>..................] - ETA: 7s - loss: 0.8465 - sparse_categorical_crossentropy: 0.5397 - sparse_categorical_accuracy: 0.8374 - scaled_adversarial_loss: 0.3069
770/1875 [===========>..................] - ETA: 7s - loss: 0.8419 - sparse_categorical_crossentropy: 0.5360 - sparse_categorical_accuracy: 0.8385 - scaled_adversarial_loss: 0.3059
778/1875 [===========>..................] - ETA: 7s - loss: 0.8378 - sparse_categorical_crossentropy: 0.5328 - sparse_categorical_accuracy: 0.8395 - scaled_adversarial_loss: 0.3050
786/1875 [===========>..................] - ETA: 7s - loss: 0.8339 - sparse_categorical_crossentropy: 0.5297 - sparse_categorical_accuracy: 0.8405 - scaled_adversarial_loss: 0.3041
794/1875 [===========>..................] - ETA: 6s - loss: 0.8299 - sparse_categorical_crossentropy: 0.5266 - sparse_categorical_accuracy: 0.8414 - scaled_adversarial_loss: 0.3033
802/1875 [===========>..................] - ETA: 6s - loss: 0.8261 - sparse_categorical_crossentropy: 0.5236 - sparse_categorical_accuracy: 0.8424 - scaled_adversarial_loss: 0.3024
810/1875 [===========>..................] - ETA: 6s - loss: 0.8222 - sparse_categorical_crossentropy: 0.5206 - sparse_categorical_accuracy: 0.8433 - scaled_adversarial_loss: 0.3016
818/1875 [============>.................] - ETA: 6s - loss: 0.8185 - sparse_categorical_crossentropy: 0.5177 - sparse_categorical_accuracy: 0.8442 - scaled_adversarial_loss: 0.3008
827/1875 [============>.................] - ETA: 6s - loss: 0.8143 - sparse_categorical_crossentropy: 0.5144 - sparse_categorical_accuracy: 0.8452 - scaled_adversarial_loss: 0.2999
836/1875 [============>.................] - ETA: 6s - loss: 0.8102 - sparse_categorical_crossentropy: 0.5112 - sparse_categorical_accuracy: 0.8462 - scaled_adversarial_loss: 0.2990
844/1875 [============>.................] - ETA: 6s - loss: 0.8066 - sparse_categorical_crossentropy: 0.5084 - sparse_categorical_accuracy: 0.8470 - scaled_adversarial_loss: 0.2982
852/1875 [============>.................] - ETA: 6s - loss: 0.8030 - sparse_categorical_crossentropy: 0.5056 - sparse_categorical_accuracy: 0.8479 - scaled_adversarial_loss: 0.2974
860/1875 [============>.................] - ETA: 6s - loss: 0.7995 - sparse_categorical_crossentropy: 0.5029 - sparse_categorical_accuracy: 0.8487 - scaled_adversarial_loss: 0.2966
868/1875 [============>.................] - ETA: 6s - loss: 0.7961 - sparse_categorical_crossentropy: 0.5002 - sparse_categorical_accuracy: 0.8495 - scaled_adversarial_loss: 0.2958
876/1875 [=============>................] - ETA: 6s - loss: 0.7927 - sparse_categorical_crossentropy: 0.4976 - sparse_categorical_accuracy: 0.8503 - scaled_adversarial_loss: 0.2951
884/1875 [=============>................] - ETA: 6s - loss: 0.7893 - sparse_categorical_crossentropy: 0.4950 - sparse_categorical_accuracy: 0.8511 - scaled_adversarial_loss: 0.2943
892/1875 [=============>................] - ETA: 6s - loss: 0.7860 - sparse_categorical_crossentropy: 0.4924 - sparse_categorical_accuracy: 0.8519 - scaled_adversarial_loss: 0.2936
900/1875 [=============>................] - ETA: 6s - loss: 0.7827 - sparse_categorical_crossentropy: 0.4899 - sparse_categorical_accuracy: 0.8527 - scaled_adversarial_loss: 0.2928
908/1875 [=============>................] - ETA: 6s - loss: 0.7795 - sparse_categorical_crossentropy: 0.4874 - sparse_categorical_accuracy: 0.8535 - scaled_adversarial_loss: 0.2921
916/1875 [=============>................] - ETA: 6s - loss: 0.7763 - sparse_categorical_crossentropy: 0.4849 - sparse_categorical_accuracy: 0.8542 - scaled_adversarial_loss: 0.2914
924/1875 [=============>................] - ETA: 6s - loss: 0.7731 - sparse_categorical_crossentropy: 0.4825 - sparse_categorical_accuracy: 0.8550 - scaled_adversarial_loss: 0.2907
932/1875 [=============>................] - ETA: 6s - loss: 0.7700 - sparse_categorical_crossentropy: 0.4801 - sparse_categorical_accuracy: 0.8557 - scaled_adversarial_loss: 0.2900
940/1875 [==============>...............] - ETA: 6s - loss: 0.7669 - sparse_categorical_crossentropy: 0.4777 - sparse_categorical_accuracy: 0.8564 - scaled_adversarial_loss: 0.2893
948/1875 [==============>...............] - ETA: 5s - loss: 0.7639 - sparse_categorical_crossentropy: 0.4753 - sparse_categorical_accuracy: 0.8572 - scaled_adversarial_loss: 0.2886
956/1875 [==============>...............] - ETA: 5s - loss: 0.7609 - sparse_categorical_crossentropy: 0.4730 - sparse_categorical_accuracy: 0.8579 - scaled_adversarial_loss: 0.2879
964/1875 [==============>...............] - ETA: 5s - loss: 0.7580 - sparse_categorical_crossentropy: 0.4708 - sparse_categorical_accuracy: 0.8586 - scaled_adversarial_loss: 0.2872
972/1875 [==============>...............] - ETA: 5s - loss: 0.7550 - sparse_categorical_crossentropy: 0.4685 - sparse_categorical_accuracy: 0.8592 - scaled_adversarial_loss: 0.2865
980/1875 [==============>...............] - ETA: 5s - loss: 0.7521 - sparse_categorical_crossentropy: 0.4663 - sparse_categorical_accuracy: 0.8599 - scaled_adversarial_loss: 0.2859
988/1875 [==============>...............] - ETA: 5s - loss: 0.7493 - sparse_categorical_crossentropy: 0.4641 - sparse_categorical_accuracy: 0.8606 - scaled_adversarial_loss: 0.2852
996/1875 [==============>...............] - ETA: 5s - loss: 0.7464 - sparse_categorical_crossentropy: 0.4619 - sparse_categorical_accuracy: 0.8613 - scaled_adversarial_loss: 0.2845
1004/1875 [===============>..............] - ETA: 5s - loss: 0.7436 - sparse_categorical_crossentropy: 0.4598 - sparse_categorical_accuracy: 0.8619 - scaled_adversarial_loss: 0.2839
1012/1875 [===============>..............] - ETA: 5s - loss: 0.7409 - sparse_categorical_crossentropy: 0.4577 - sparse_categorical_accuracy: 0.8626 - scaled_adversarial_loss: 0.2832
1020/1875 [===============>..............] - ETA: 5s - loss: 0.7381 - sparse_categorical_crossentropy: 0.4556 - sparse_categorical_accuracy: 0.8632 - scaled_adversarial_loss: 0.2826
1027/1875 [===============>..............] - ETA: 5s - loss: 0.7358 - sparse_categorical_crossentropy: 0.4538 - sparse_categorical_accuracy: 0.8637 - scaled_adversarial_loss: 0.2820
1035/1875 [===============>..............] - ETA: 5s - loss: 0.7331 - sparse_categorical_crossentropy: 0.4517 - sparse_categorical_accuracy: 0.8644 - scaled_adversarial_loss: 0.2814
1043/1875 [===============>..............] - ETA: 5s - loss: 0.7305 - sparse_categorical_crossentropy: 0.4497 - sparse_categorical_accuracy: 0.8650 - scaled_adversarial_loss: 0.2808
1051/1875 [===============>..............] - ETA: 5s - loss: 0.7278 - sparse_categorical_crossentropy: 0.4477 - sparse_categorical_accuracy: 0.8656 - scaled_adversarial_loss: 0.2801
1059/1875 [===============>..............] - ETA: 5s - loss: 0.7253 - sparse_categorical_crossentropy: 0.4457 - sparse_categorical_accuracy: 0.8662 - scaled_adversarial_loss: 0.2795
1067/1875 [================>.............] - ETA: 5s - loss: 0.7227 - sparse_categorical_crossentropy: 0.4438 - sparse_categorical_accuracy: 0.8668 - scaled_adversarial_loss: 0.2789
1075/1875 [================>.............] - ETA: 5s - loss: 0.7202 - sparse_categorical_crossentropy: 0.4419 - sparse_categorical_accuracy: 0.8674 - scaled_adversarial_loss: 0.2783
1083/1875 [================>.............] - ETA: 5s - loss: 0.7177 - sparse_categorical_crossentropy: 0.4400 - sparse_categorical_accuracy: 0.8679 - scaled_adversarial_loss: 0.2777
1091/1875 [================>.............] - ETA: 5s - loss: 0.7152 - sparse_categorical_crossentropy: 0.4381 - sparse_categorical_accuracy: 0.8685 - scaled_adversarial_loss: 0.2771
1099/1875 [================>.............] - ETA: 5s - loss: 0.7128 - sparse_categorical_crossentropy: 0.4362 - sparse_categorical_accuracy: 0.8691 - scaled_adversarial_loss: 0.2765
1107/1875 [================>.............] - ETA: 4s - loss: 0.7103 - sparse_categorical_crossentropy: 0.4344 - sparse_categorical_accuracy: 0.8696 - scaled_adversarial_loss: 0.2759
1115/1875 [================>.............] - ETA: 4s - loss: 0.7079 - sparse_categorical_crossentropy: 0.4326 - sparse_categorical_accuracy: 0.8702 - scaled_adversarial_loss: 0.2754
1123/1875 [================>.............] - ETA: 4s - loss: 0.7056 - sparse_categorical_crossentropy: 0.4308 - sparse_categorical_accuracy: 0.8707 - scaled_adversarial_loss: 0.2748
1131/1875 [=================>............] - ETA: 4s - loss: 0.7032 - sparse_categorical_crossentropy: 0.4290 - sparse_categorical_accuracy: 0.8713 - scaled_adversarial_loss: 0.2742
1139/1875 [=================>............] - ETA: 4s - loss: 0.7009 - sparse_categorical_crossentropy: 0.4273 - sparse_categorical_accuracy: 0.8718 - scaled_adversarial_loss: 0.2737
1147/1875 [=================>............] - ETA: 4s - loss: 0.6986 - sparse_categorical_crossentropy: 0.4255 - sparse_categorical_accuracy: 0.8723 - scaled_adversarial_loss: 0.2731
1155/1875 [=================>............] - ETA: 4s - loss: 0.6963 - sparse_categorical_crossentropy: 0.4238 - sparse_categorical_accuracy: 0.8729 - scaled_adversarial_loss: 0.2725
1163/1875 [=================>............] - ETA: 4s - loss: 0.6941 - sparse_categorical_crossentropy: 0.4221 - sparse_categorical_accuracy: 0.8734 - scaled_adversarial_loss: 0.2720
1171/1875 [=================>............] - ETA: 4s - loss: 0.6918 - sparse_categorical_crossentropy: 0.4204 - sparse_categorical_accuracy: 0.8739 - scaled_adversarial_loss: 0.2714
1179/1875 [=================>............] - ETA: 4s - loss: 0.6896 - sparse_categorical_crossentropy: 0.4187 - sparse_categorical_accuracy: 0.8744 - scaled_adversarial_loss: 0.2709
1187/1875 [=================>............] - ETA: 4s - loss: 0.6874 - sparse_categorical_crossentropy: 0.4171 - sparse_categorical_accuracy: 0.8749 - scaled_adversarial_loss: 0.2703
1195/1875 [==================>...........] - ETA: 4s - loss: 0.6853 - sparse_categorical_crossentropy: 0.4155 - sparse_categorical_accuracy: 0.8754 - scaled_adversarial_loss: 0.2698
1203/1875 [==================>...........] - ETA: 4s - loss: 0.6831 - sparse_categorical_crossentropy: 0.4138 - sparse_categorical_accuracy: 0.8759 - scaled_adversarial_loss: 0.2693
1211/1875 [==================>...........] - ETA: 4s - loss: 0.6810 - sparse_categorical_crossentropy: 0.4122 - sparse_categorical_accuracy: 0.8764 - scaled_adversarial_loss: 0.2688
1219/1875 [==================>...........] - ETA: 4s - loss: 0.6789 - sparse_categorical_crossentropy: 0.4107 - sparse_categorical_accuracy: 0.8769 - scaled_adversarial_loss: 0.2682
1227/1875 [==================>...........] - ETA: 4s - loss: 0.6768 - sparse_categorical_crossentropy: 0.4091 - sparse_categorical_accuracy: 0.8773 - scaled_adversarial_loss: 0.2677
1235/1875 [==================>...........] - ETA: 4s - loss: 0.6747 - sparse_categorical_crossentropy: 0.4076 - sparse_categorical_accuracy: 0.8778 - scaled_adversarial_loss: 0.2672
1243/1875 [==================>...........] - ETA: 4s - loss: 0.6727 - sparse_categorical_crossentropy: 0.4060 - sparse_categorical_accuracy: 0.8783 - scaled_adversarial_loss: 0.2667
1251/1875 [===================>..........] - ETA: 4s - loss: 0.6707 - sparse_categorical_crossentropy: 0.4045 - sparse_categorical_accuracy: 0.8787 - scaled_adversarial_loss: 0.2662
1260/1875 [===================>..........] - ETA: 3s - loss: 0.6684 - sparse_categorical_crossentropy: 0.4028 - sparse_categorical_accuracy: 0.8792 - scaled_adversarial_loss: 0.2656
1269/1875 [===================>..........] - ETA: 3s - loss: 0.6662 - sparse_categorical_crossentropy: 0.4012 - sparse_categorical_accuracy: 0.8797 - scaled_adversarial_loss: 0.2651
1277/1875 [===================>..........] - ETA: 3s - loss: 0.6642 - sparse_categorical_crossentropy: 0.3997 - sparse_categorical_accuracy: 0.8802 - scaled_adversarial_loss: 0.2646
1285/1875 [===================>..........] - ETA: 3s - loss: 0.6623 - sparse_categorical_crossentropy: 0.3982 - sparse_categorical_accuracy: 0.8806 - scaled_adversarial_loss: 0.2641
1293/1875 [===================>..........] - ETA: 3s - loss: 0.6604 - sparse_categorical_crossentropy: 0.3968 - sparse_categorical_accuracy: 0.8811 - scaled_adversarial_loss: 0.2636
1301/1875 [===================>..........] - ETA: 3s - loss: 0.6585 - sparse_categorical_crossentropy: 0.3954 - sparse_categorical_accuracy: 0.8815 - scaled_adversarial_loss: 0.2631
1309/1875 [===================>..........] - ETA: 3s - loss: 0.6566 - sparse_categorical_crossentropy: 0.3939 - sparse_categorical_accuracy: 0.8819 - scaled_adversarial_loss: 0.2626
1317/1875 [====================>.........] - ETA: 3s - loss: 0.6547 - sparse_categorical_crossentropy: 0.3925 - sparse_categorical_accuracy: 0.8823 - scaled_adversarial_loss: 0.2621
1325/1875 [====================>.........] - ETA: 3s - loss: 0.6528 - sparse_categorical_crossentropy: 0.3912 - sparse_categorical_accuracy: 0.8828 - scaled_adversarial_loss: 0.2617
1333/1875 [====================>.........] - ETA: 3s - loss: 0.6510 - sparse_categorical_crossentropy: 0.3898 - sparse_categorical_accuracy: 0.8832 - scaled_adversarial_loss: 0.2612
1341/1875 [====================>.........] - ETA: 3s - loss: 0.6491 - sparse_categorical_crossentropy: 0.3884 - sparse_categorical_accuracy: 0.8836 - scaled_adversarial_loss: 0.2607
1349/1875 [====================>.........] - ETA: 3s - loss: 0.6473 - sparse_categorical_crossentropy: 0.3871 - sparse_categorical_accuracy: 0.8840 - scaled_adversarial_loss: 0.2602
1357/1875 [====================>.........] - ETA: 3s - loss: 0.6455 - sparse_categorical_crossentropy: 0.3857 - sparse_categorical_accuracy: 0.8844 - scaled_adversarial_loss: 0.2598
1366/1875 [====================>.........] - ETA: 3s - loss: 0.6435 - sparse_categorical_crossentropy: 0.3842 - sparse_categorical_accuracy: 0.8849 - scaled_adversarial_loss: 0.2593
1374/1875 [====================>.........] - ETA: 3s - loss: 0.6417 - sparse_categorical_crossentropy: 0.3829 - sparse_categorical_accuracy: 0.8853 - scaled_adversarial_loss: 0.2588
1382/1875 [=====================>........] - ETA: 3s - loss: 0.6400 - sparse_categorical_crossentropy: 0.3816 - sparse_categorical_accuracy: 0.8856 - scaled_adversarial_loss: 0.2584
1390/1875 [=====================>........] - ETA: 3s - loss: 0.6383 - sparse_categorical_crossentropy: 0.3803 - sparse_categorical_accuracy: 0.8860 - scaled_adversarial_loss: 0.2579
1398/1875 [=====================>........] - ETA: 3s - loss: 0.6365 - sparse_categorical_crossentropy: 0.3791 - sparse_categorical_accuracy: 0.8864 - scaled_adversarial_loss: 0.2575
1406/1875 [=====================>........] - ETA: 3s - loss: 0.6348 - sparse_categorical_crossentropy: 0.3778 - sparse_categorical_accuracy: 0.8868 - scaled_adversarial_loss: 0.2570
1414/1875 [=====================>........] - ETA: 2s - loss: 0.6331 - sparse_categorical_crossentropy: 0.3765 - sparse_categorical_accuracy: 0.8872 - scaled_adversarial_loss: 0.2566
1422/1875 [=====================>........] - ETA: 2s - loss: 0.6315 - sparse_categorical_crossentropy: 0.3753 - sparse_categorical_accuracy: 0.8876 - scaled_adversarial_loss: 0.2561
1430/1875 [=====================>........] - ETA: 2s - loss: 0.6298 - sparse_categorical_crossentropy: 0.3741 - sparse_categorical_accuracy: 0.8879 - scaled_adversarial_loss: 0.2557
1437/1875 [=====================>........] - ETA: 2s - loss: 0.6283 - sparse_categorical_crossentropy: 0.3730 - sparse_categorical_accuracy: 0.8882 - scaled_adversarial_loss: 0.2553
1445/1875 [======================>.......] - ETA: 2s - loss: 0.6267 - sparse_categorical_crossentropy: 0.3718 - sparse_categorical_accuracy: 0.8886 - scaled_adversarial_loss: 0.2549
1453/1875 [======================>.......] - ETA: 2s - loss: 0.6251 - sparse_categorical_crossentropy: 0.3706 - sparse_categorical_accuracy: 0.8890 - scaled_adversarial_loss: 0.2545
1462/1875 [======================>.......] - ETA: 2s - loss: 0.6233 - sparse_categorical_crossentropy: 0.3693 - sparse_categorical_accuracy: 0.8894 - scaled_adversarial_loss: 0.2540
1470/1875 [======================>.......] - ETA: 2s - loss: 0.6217 - sparse_categorical_crossentropy: 0.3681 - sparse_categorical_accuracy: 0.8897 - scaled_adversarial_loss: 0.2536
1478/1875 [======================>.......] - ETA: 2s - loss: 0.6201 - sparse_categorical_crossentropy: 0.3669 - sparse_categorical_accuracy: 0.8901 - scaled_adversarial_loss: 0.2532
1486/1875 [======================>.......] - ETA: 2s - loss: 0.6185 - sparse_categorical_crossentropy: 0.3658 - sparse_categorical_accuracy: 0.8904 - scaled_adversarial_loss: 0.2528
1494/1875 [======================>.......] - ETA: 2s - loss: 0.6169 - sparse_categorical_crossentropy: 0.3646 - sparse_categorical_accuracy: 0.8908 - scaled_adversarial_loss: 0.2523
1502/1875 [=======================>......] - ETA: 2s - loss: 0.6154 - sparse_categorical_crossentropy: 0.3635 - sparse_categorical_accuracy: 0.8911 - scaled_adversarial_loss: 0.2519
1511/1875 [=======================>......] - ETA: 2s - loss: 0.6136 - sparse_categorical_crossentropy: 0.3622 - sparse_categorical_accuracy: 0.8915 - scaled_adversarial_loss: 0.2515
1519/1875 [=======================>......] - ETA: 2s - loss: 0.6121 - sparse_categorical_crossentropy: 0.3611 - sparse_categorical_accuracy: 0.8919 - scaled_adversarial_loss: 0.2511
1527/1875 [=======================>......] - ETA: 2s - loss: 0.6106 - sparse_categorical_crossentropy: 0.3599 - sparse_categorical_accuracy: 0.8922 - scaled_adversarial_loss: 0.2507
1536/1875 [=======================>......] - ETA: 2s - loss: 0.6089 - sparse_categorical_crossentropy: 0.3587 - sparse_categorical_accuracy: 0.8926 - scaled_adversarial_loss: 0.2502
1545/1875 [=======================>......] - ETA: 2s - loss: 0.6072 - sparse_categorical_crossentropy: 0.3575 - sparse_categorical_accuracy: 0.8929 - scaled_adversarial_loss: 0.2498
1553/1875 [=======================>......] - ETA: 2s - loss: 0.6057 - sparse_categorical_crossentropy: 0.3564 - sparse_categorical_accuracy: 0.8933 - scaled_adversarial_loss: 0.2494
1562/1875 [=======================>......] - ETA: 2s - loss: 0.6041 - sparse_categorical_crossentropy: 0.3552 - sparse_categorical_accuracy: 0.8936 - scaled_adversarial_loss: 0.2489
1571/1875 [========================>.....] - ETA: 1s - loss: 0.6025 - sparse_categorical_crossentropy: 0.3540 - sparse_categorical_accuracy: 0.8940 - scaled_adversarial_loss: 0.2485
1581/1875 [========================>.....] - ETA: 1s - loss: 0.6007 - sparse_categorical_crossentropy: 0.3527 - sparse_categorical_accuracy: 0.8944 - scaled_adversarial_loss: 0.2480
1591/1875 [========================>.....] - ETA: 1s - loss: 0.5989 - sparse_categorical_crossentropy: 0.3513 - sparse_categorical_accuracy: 0.8948 - scaled_adversarial_loss: 0.2475
1602/1875 [========================>.....] - ETA: 1s - loss: 0.5969 - sparse_categorical_crossentropy: 0.3499 - sparse_categorical_accuracy: 0.8952 - scaled_adversarial_loss: 0.2470
1612/1875 [========================>.....] - ETA: 1s - loss: 0.5952 - sparse_categorical_crossentropy: 0.3486 - sparse_categorical_accuracy: 0.8956 - scaled_adversarial_loss: 0.2465
1623/1875 [========================>.....] - ETA: 1s - loss: 0.5932 - sparse_categorical_crossentropy: 0.3473 - sparse_categorical_accuracy: 0.8960 - scaled_adversarial_loss: 0.2460
1634/1875 [=========================>....] - ETA: 1s - loss: 0.5914 - sparse_categorical_crossentropy: 0.3459 - sparse_categorical_accuracy: 0.8964 - scaled_adversarial_loss: 0.2455
1644/1875 [=========================>....] - ETA: 1s - loss: 0.5897 - sparse_categorical_crossentropy: 0.3446 - sparse_categorical_accuracy: 0.8968 - scaled_adversarial_loss: 0.2450
1654/1875 [=========================>....] - ETA: 1s - loss: 0.5880 - sparse_categorical_crossentropy: 0.3434 - sparse_categorical_accuracy: 0.8972 - scaled_adversarial_loss: 0.2446
1664/1875 [=========================>....] - ETA: 1s - loss: 0.5863 - sparse_categorical_crossentropy: 0.3422 - sparse_categorical_accuracy: 0.8976 - scaled_adversarial_loss: 0.2441
1674/1875 [=========================>....] - ETA: 1s - loss: 0.5846 - sparse_categorical_crossentropy: 0.3410 - sparse_categorical_accuracy: 0.8979 - scaled_adversarial_loss: 0.2436
1684/1875 [=========================>....] - ETA: 1s - loss: 0.5830 - sparse_categorical_crossentropy: 0.3398 - sparse_categorical_accuracy: 0.8983 - scaled_adversarial_loss: 0.2432
1695/1875 [==========================>...] - ETA: 1s - loss: 0.5812 - sparse_categorical_crossentropy: 0.3385 - sparse_categorical_accuracy: 0.8987 - scaled_adversarial_loss: 0.2427
1705/1875 [==========================>...] - ETA: 1s - loss: 0.5796 - sparse_categorical_crossentropy: 0.3373 - sparse_categorical_accuracy: 0.8990 - scaled_adversarial_loss: 0.2423
1715/1875 [==========================>...] - ETA: 1s - loss: 0.5780 - sparse_categorical_crossentropy: 0.3361 - sparse_categorical_accuracy: 0.8994 - scaled_adversarial_loss: 0.2418
1725/1875 [==========================>...] - ETA: 0s - loss: 0.5764 - sparse_categorical_crossentropy: 0.3350 - sparse_categorical_accuracy: 0.8997 - scaled_adversarial_loss: 0.2414
1735/1875 [==========================>...] - ETA: 0s - loss: 0.5748 - sparse_categorical_crossentropy: 0.3338 - sparse_categorical_accuracy: 0.9001 - scaled_adversarial_loss: 0.2409
1744/1875 [==========================>...] - ETA: 0s - loss: 0.5734 - sparse_categorical_crossentropy: 0.3328 - sparse_categorical_accuracy: 0.9004 - scaled_adversarial_loss: 0.2406
1753/1875 [===========================>..] - ETA: 0s - loss: 0.5720 - sparse_categorical_crossentropy: 0.3318 - sparse_categorical_accuracy: 0.9007 - scaled_adversarial_loss: 0.2402
1762/1875 [===========================>..] - ETA: 0s - loss: 0.5706 - sparse_categorical_crossentropy: 0.3308 - sparse_categorical_accuracy: 0.9010 - scaled_adversarial_loss: 0.2398
1770/1875 [===========================>..] - ETA: 0s - loss: 0.5694 - sparse_categorical_crossentropy: 0.3299 - sparse_categorical_accuracy: 0.9012 - scaled_adversarial_loss: 0.2394
1778/1875 [===========================>..] - ETA: 0s - loss: 0.5682 - sparse_categorical_crossentropy: 0.3291 - sparse_categorical_accuracy: 0.9015 - scaled_adversarial_loss: 0.2391
1787/1875 [===========================>..] - ETA: 0s - loss: 0.5668 - sparse_categorical_crossentropy: 0.3281 - sparse_categorical_accuracy: 0.9018 - scaled_adversarial_loss: 0.2387
1796/1875 [===========================>..] - ETA: 0s - loss: 0.5655 - sparse_categorical_crossentropy: 0.3271 - sparse_categorical_accuracy: 0.9021 - scaled_adversarial_loss: 0.2384
1806/1875 [===========================>..] - ETA: 0s - loss: 0.5640 - sparse_categorical_crossentropy: 0.3260 - sparse_categorical_accuracy: 0.9024 - scaled_adversarial_loss: 0.2379
1815/1875 [============================>.] - ETA: 0s - loss: 0.5627 - sparse_categorical_crossentropy: 0.3251 - sparse_categorical_accuracy: 0.9027 - scaled_adversarial_loss: 0.2376
1824/1875 [============================>.] - ETA: 0s - loss: 0.5613 - sparse_categorical_crossentropy: 0.3241 - sparse_categorical_accuracy: 0.9030 - scaled_adversarial_loss: 0.2372
1832/1875 [============================>.] - ETA: 0s - loss: 0.5602 - sparse_categorical_crossentropy: 0.3233 - sparse_categorical_accuracy: 0.9032 - scaled_adversarial_loss: 0.2369
1840/1875 [============================>.] - ETA: 0s - loss: 0.5590 - sparse_categorical_crossentropy: 0.3225 - sparse_categorical_accuracy: 0.9035 - scaled_adversarial_loss: 0.2366
1849/1875 [============================>.] - ETA: 0s - loss: 0.5577 - sparse_categorical_crossentropy: 0.3216 - sparse_categorical_accuracy: 0.9038 - scaled_adversarial_loss: 0.2362
1859/1875 [============================>.] - ETA: 0s - loss: 0.5563 - sparse_categorical_crossentropy: 0.3205 - sparse_categorical_accuracy: 0.9041 - scaled_adversarial_loss: 0.2358
1868/1875 [============================>.] - ETA: 0s - loss: 0.5551 - sparse_categorical_crossentropy: 0.3196 - sparse_categorical_accuracy: 0.9043 - scaled_adversarial_loss: 0.2354
1875/1875 [==============================] - 18s 6ms/step - loss: 0.5539 - sparse_categorical_crossentropy: 0.3188 - sparse_categorical_accuracy: 0.9046 - scaled_adversarial_loss: 0.2351
Epoch 2/5
1/1875 [..............................] - ETA: 13:28 - loss: 0.0638 - sparse_categorical_crossentropy: 0.0135 - sparse_categorical_accuracy: 1.0000 - scaled_adversarial_loss: 0.0503
8/1875 [..............................] - ETA: 14s - loss: 0.1413 - sparse_categorical_crossentropy: 0.0523 - sparse_categorical_accuracy: 0.9759 - scaled_adversarial_loss: 0.0890
15/1875 [..............................] - ETA: 14s - loss: 0.1574 - sparse_categorical_crossentropy: 0.0564 - sparse_categorical_accuracy: 0.9769 - scaled_adversarial_loss: 0.1011
22/1875 [..............................] - ETA: 13s - loss: 0.1618 - sparse_categorical_crossentropy: 0.0578 - sparse_categorical_accuracy: 0.9776 - scaled_adversarial_loss: 0.1040
30/1875 [..............................] - ETA: 13s - loss: 0.1597 - sparse_categorical_crossentropy: 0.0563 - sparse_categorical_accuracy: 0.9790 - scaled_adversarial_loss: 0.1034
37/1875 [..............................] - ETA: 13s - loss: 0.1580 - sparse_categorical_crossentropy: 0.0549 - sparse_categorical_accuracy: 0.9801 - scaled_adversarial_loss: 0.1031
44/1875 [..............................] - ETA: 13s - loss: 0.1561 - sparse_categorical_crossentropy: 0.0533 - sparse_categorical_accuracy: 0.9812 - scaled_adversarial_loss: 0.1028
51/1875 [..............................] - ETA: 13s - loss: 0.1560 - sparse_categorical_crossentropy: 0.0528 - sparse_categorical_accuracy: 0.9818 - scaled_adversarial_loss: 0.1032
58/1875 [..............................] - ETA: 13s - loss: 0.1563 - sparse_categorical_crossentropy: 0.0524 - sparse_categorical_accuracy: 0.9822 - scaled_adversarial_loss: 0.1038
66/1875 [>.............................] - ETA: 13s - loss: 0.1561 - sparse_categorical_crossentropy: 0.0520 - sparse_categorical_accuracy: 0.9826 - scaled_adversarial_loss: 0.1042
74/1875 [>.............................] - ETA: 13s - loss: 0.1556 - sparse_categorical_crossentropy: 0.0514 - sparse_categorical_accuracy: 0.9830 - scaled_adversarial_loss: 0.1042
82/1875 [>.............................] - ETA: 13s - loss: 0.1550 - sparse_categorical_crossentropy: 0.0509 - sparse_categorical_accuracy: 0.9833 - scaled_adversarial_loss: 0.1041
90/1875 [>.............................] - ETA: 12s - loss: 0.1546 - sparse_categorical_crossentropy: 0.0508 - sparse_categorical_accuracy: 0.9836 - scaled_adversarial_loss: 0.1038
97/1875 [>.............................] - ETA: 13s - loss: 0.1544 - sparse_categorical_crossentropy: 0.0508 - sparse_categorical_accuracy: 0.9838 - scaled_adversarial_loss: 0.1036
104/1875 [>.............................] - ETA: 12s - loss: 0.1543 - sparse_categorical_crossentropy: 0.0510 - sparse_categorical_accuracy: 0.9839 - scaled_adversarial_loss: 0.1034
112/1875 [>.............................] - ETA: 12s - loss: 0.1542 - sparse_categorical_crossentropy: 0.0510 - sparse_categorical_accuracy: 0.9840 - scaled_adversarial_loss: 0.1031
120/1875 [>.............................] - ETA: 12s - loss: 0.1538 - sparse_categorical_crossentropy: 0.0510 - sparse_categorical_accuracy: 0.9842 - scaled_adversarial_loss: 0.1028
128/1875 [=>............................] - ETA: 12s - loss: 0.1534 - sparse_categorical_crossentropy: 0.0509 - sparse_categorical_accuracy: 0.9843 - scaled_adversarial_loss: 0.1024
136/1875 [=>............................] - ETA: 12s - loss: 0.1530 - sparse_categorical_crossentropy: 0.0509 - sparse_categorical_accuracy: 0.9845 - scaled_adversarial_loss: 0.1021
143/1875 [=>............................] - ETA: 12s - loss: 0.1527 - sparse_categorical_crossentropy: 0.0509 - sparse_categorical_accuracy: 0.9845 - scaled_adversarial_loss: 0.1018
150/1875 [=>............................] - ETA: 12s - loss: 0.1524 - sparse_categorical_crossentropy: 0.0508 - sparse_categorical_accuracy: 0.9846 - scaled_adversarial_loss: 0.1016
157/1875 [=>............................] - ETA: 12s - loss: 0.1521 - sparse_categorical_crossentropy: 0.0508 - sparse_categorical_accuracy: 0.9847 - scaled_adversarial_loss: 0.1013
165/1875 [=>............................] - ETA: 12s - loss: 0.1517 - sparse_categorical_crossentropy: 0.0507 - sparse_categorical_accuracy: 0.9847 - scaled_adversarial_loss: 0.1009
173/1875 [=>............................] - ETA: 12s - loss: 0.1514 - sparse_categorical_crossentropy: 0.0507 - sparse_categorical_accuracy: 0.9848 - scaled_adversarial_loss: 0.1007
181/1875 [=>............................] - ETA: 12s - loss: 0.1511 - sparse_categorical_crossentropy: 0.0507 - sparse_categorical_accuracy: 0.9848 - scaled_adversarial_loss: 0.1004
189/1875 [==>...........................] - ETA: 12s - loss: 0.1508 - sparse_categorical_crossentropy: 0.0507 - sparse_categorical_accuracy: 0.9849 - scaled_adversarial_loss: 0.1002
196/1875 [==>...........................] - ETA: 12s - loss: 0.1505 - sparse_categorical_crossentropy: 0.0506 - sparse_categorical_accuracy: 0.9849 - scaled_adversarial_loss: 0.1000
203/1875 [==>...........................] - ETA: 12s - loss: 0.1503 - sparse_categorical_crossentropy: 0.0505 - sparse_categorical_accuracy: 0.9850 - scaled_adversarial_loss: 0.0998
211/1875 [==>...........................] - ETA: 12s - loss: 0.1499 - sparse_categorical_crossentropy: 0.0504 - sparse_categorical_accuracy: 0.9850 - scaled_adversarial_loss: 0.0995
219/1875 [==>...........................] - ETA: 11s - loss: 0.1496 - sparse_categorical_crossentropy: 0.0503 - sparse_categorical_accuracy: 0.9851 - scaled_adversarial_loss: 0.0993
226/1875 [==>...........................] - ETA: 11s - loss: 0.1493 - sparse_categorical_crossentropy: 0.0502 - sparse_categorical_accuracy: 0.9851 - scaled_adversarial_loss: 0.0991
233/1875 [==>...........................] - ETA: 11s - loss: 0.1490 - sparse_categorical_crossentropy: 0.0501 - sparse_categorical_accuracy: 0.9852 - scaled_adversarial_loss: 0.0989
240/1875 [==>...........................] - ETA: 11s - loss: 0.1486 - sparse_categorical_crossentropy: 0.0499 - sparse_categorical_accuracy: 0.9852 - scaled_adversarial_loss: 0.0987
247/1875 [==>...........................] - ETA: 11s - loss: 0.1484 - sparse_categorical_crossentropy: 0.0498 - sparse_categorical_accuracy: 0.9853 - scaled_adversarial_loss: 0.0985
254/1875 [===>..........................] - ETA: 11s - loss: 0.1481 - sparse_categorical_crossentropy: 0.0497 - sparse_categorical_accuracy: 0.9853 - scaled_adversarial_loss: 0.0984
262/1875 [===>..........................] - ETA: 11s - loss: 0.1478 - sparse_categorical_crossentropy: 0.0496 - sparse_categorical_accuracy: 0.9854 - scaled_adversarial_loss: 0.0982
269/1875 [===>..........................] - ETA: 11s - loss: 0.1475 - sparse_categorical_crossentropy: 0.0495 - sparse_categorical_accuracy: 0.9854 - scaled_adversarial_loss: 0.0980
277/1875 [===>..........................] - ETA: 11s - loss: 0.1473 - sparse_categorical_crossentropy: 0.0495 - sparse_categorical_accuracy: 0.9854 - scaled_adversarial_loss: 0.0979
285/1875 [===>..........................] - ETA: 11s - loss: 0.1471 - sparse_categorical_crossentropy: 0.0494 - sparse_categorical_accuracy: 0.9854 - scaled_adversarial_loss: 0.0977
292/1875 [===>..........................] - ETA: 11s - loss: 0.1469 - sparse_categorical_crossentropy: 0.0493 - sparse_categorical_accuracy: 0.9854 - scaled_adversarial_loss: 0.0976
299/1875 [===>..........................] - ETA: 11s - loss: 0.1467 - sparse_categorical_crossentropy: 0.0492 - sparse_categorical_accuracy: 0.9855 - scaled_adversarial_loss: 0.0974
307/1875 [===>..........................] - ETA: 11s - loss: 0.1465 - sparse_categorical_crossentropy: 0.0492 - sparse_categorical_accuracy: 0.9855 - scaled_adversarial_loss: 0.0973
315/1875 [====>.........................] - ETA: 11s - loss: 0.1463 - sparse_categorical_crossentropy: 0.0491 - sparse_categorical_accuracy: 0.9855 - scaled_adversarial_loss: 0.0972
322/1875 [====>.........................] - ETA: 11s - loss: 0.1461 - sparse_categorical_crossentropy: 0.0490 - sparse_categorical_accuracy: 0.9855 - scaled_adversarial_loss: 0.0971
330/1875 [====>.........................] - ETA: 11s - loss: 0.1459 - sparse_categorical_crossentropy: 0.0490 - sparse_categorical_accuracy: 0.9855 - scaled_adversarial_loss: 0.0969
337/1875 [====>.........................] - ETA: 11s - loss: 0.1457 - sparse_categorical_crossentropy: 0.0489 - sparse_categorical_accuracy: 0.9855 - scaled_adversarial_loss: 0.0968
344/1875 [====>.........................] - ETA: 11s - loss: 0.1456 - sparse_categorical_crossentropy: 0.0488 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0967
351/1875 [====>.........................] - ETA: 11s - loss: 0.1454 - sparse_categorical_crossentropy: 0.0488 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0966
359/1875 [====>.........................] - ETA: 10s - loss: 0.1453 - sparse_categorical_crossentropy: 0.0487 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0965
366/1875 [====>.........................] - ETA: 10s - loss: 0.1451 - sparse_categorical_crossentropy: 0.0487 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0965
374/1875 [====>.........................] - ETA: 10s - loss: 0.1450 - sparse_categorical_crossentropy: 0.0486 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0963
381/1875 [=====>........................] - ETA: 10s - loss: 0.1448 - sparse_categorical_crossentropy: 0.0486 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0963
388/1875 [=====>........................] - ETA: 10s - loss: 0.1447 - sparse_categorical_crossentropy: 0.0485 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0962
395/1875 [=====>........................] - ETA: 10s - loss: 0.1446 - sparse_categorical_crossentropy: 0.0485 - sparse_categorical_accuracy: 0.9856 - scaled_adversarial_loss: 0.0961
403/1875 [=====>........................] - ETA: 10s - loss: 0.1444 - sparse_categorical_crossentropy: 0.0485 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0960
411/1875 [=====>........................] - ETA: 10s - loss: 0.1443 - sparse_categorical_crossentropy: 0.0484 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0959
419/1875 [=====>........................] - ETA: 10s - loss: 0.1441 - sparse_categorical_crossentropy: 0.0484 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0958
427/1875 [=====>........................] - ETA: 10s - loss: 0.1440 - sparse_categorical_crossentropy: 0.0483 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0957
434/1875 [=====>........................] - ETA: 10s - loss: 0.1439 - sparse_categorical_crossentropy: 0.0483 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0956
441/1875 [======>.......................] - ETA: 10s - loss: 0.1438 - sparse_categorical_crossentropy: 0.0483 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0955
448/1875 [======>.......................] - ETA: 10s - loss: 0.1437 - sparse_categorical_crossentropy: 0.0482 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0955
455/1875 [======>.......................] - ETA: 10s - loss: 0.1436 - sparse_categorical_crossentropy: 0.0482 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0954
462/1875 [======>.......................] - ETA: 10s - loss: 0.1435 - sparse_categorical_crossentropy: 0.0482 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0953
469/1875 [======>.......................] - ETA: 10s - loss: 0.1434 - sparse_categorical_crossentropy: 0.0481 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0953
477/1875 [======>.......................] - ETA: 10s - loss: 0.1433 - sparse_categorical_crossentropy: 0.0481 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0952
484/1875 [======>.......................] - ETA: 10s - loss: 0.1432 - sparse_categorical_crossentropy: 0.0481 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0951
491/1875 [======>.......................] - ETA: 10s - loss: 0.1431 - sparse_categorical_crossentropy: 0.0480 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0950
498/1875 [======>.......................] - ETA: 10s - loss: 0.1429 - sparse_categorical_crossentropy: 0.0480 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0950
505/1875 [=======>......................] - ETA: 9s - loss: 0.1428 - sparse_categorical_crossentropy: 0.0480 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0949
512/1875 [=======>......................] - ETA: 9s - loss: 0.1427 - sparse_categorical_crossentropy: 0.0479 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0948
519/1875 [=======>......................] - ETA: 9s - loss: 0.1426 - sparse_categorical_crossentropy: 0.0479 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0947
526/1875 [=======>......................] - ETA: 9s - loss: 0.1425 - sparse_categorical_crossentropy: 0.0479 - sparse_categorical_accuracy: 0.9857 - scaled_adversarial_loss: 0.0947
533/1875 [=======>......................] - ETA: 9s - loss: 0.1424 - sparse_categorical_crossentropy: 0.0478 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0946
540/1875 [=======>......................] - ETA: 9s - loss: 0.1424 - sparse_categorical_crossentropy: 0.0478 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0946
547/1875 [=======>......................] - ETA: 9s - loss: 0.1423 - sparse_categorical_crossentropy: 0.0478 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0945
554/1875 [=======>......................] - ETA: 9s - loss: 0.1422 - sparse_categorical_crossentropy: 0.0477 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0944
561/1875 [=======>......................] - ETA: 9s - loss: 0.1421 - sparse_categorical_crossentropy: 0.0477 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0944
569/1875 [========>.....................] - ETA: 9s - loss: 0.1419 - sparse_categorical_crossentropy: 0.0476 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0943
576/1875 [========>.....................] - ETA: 9s - loss: 0.1418 - sparse_categorical_crossentropy: 0.0476 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0942
583/1875 [========>.....................] - ETA: 9s - loss: 0.1417 - sparse_categorical_crossentropy: 0.0476 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0942
590/1875 [========>.....................] - ETA: 9s - loss: 0.1416 - sparse_categorical_crossentropy: 0.0475 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0941
598/1875 [========>.....................] - ETA: 9s - loss: 0.1415 - sparse_categorical_crossentropy: 0.0475 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0940
606/1875 [========>.....................] - ETA: 9s - loss: 0.1414 - sparse_categorical_crossentropy: 0.0474 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0939
614/1875 [========>.....................] - ETA: 9s - loss: 0.1412 - sparse_categorical_crossentropy: 0.0474 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0939
621/1875 [========>.....................] - ETA: 9s - loss: 0.1411 - sparse_categorical_crossentropy: 0.0473 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0938
628/1875 [=========>....................] - ETA: 9s - loss: 0.1410 - sparse_categorical_crossentropy: 0.0473 - sparse_categorical_accuracy: 0.9858 - scaled_adversarial_loss: 0.0937
635/1875 [=========>....................] - ETA: 9s - loss: 0.1409 - sparse_categorical_crossentropy: 0.0473 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0937
643/1875 [=========>....................] - ETA: 8s - loss: 0.1408 - sparse_categorical_crossentropy: 0.0472 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0936
650/1875 [=========>....................] - ETA: 8s - loss: 0.1407 - sparse_categorical_crossentropy: 0.0472 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0935
658/1875 [=========>....................] - ETA: 8s - loss: 0.1406 - sparse_categorical_crossentropy: 0.0471 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0934
666/1875 [=========>....................] - ETA: 8s - loss: 0.1405 - sparse_categorical_crossentropy: 0.0471 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0934
673/1875 [=========>....................] - ETA: 8s - loss: 0.1404 - sparse_categorical_crossentropy: 0.0471 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0933
680/1875 [=========>....................] - ETA: 8s - loss: 0.1403 - sparse_categorical_crossentropy: 0.0470 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0932
687/1875 [=========>....................] - ETA: 8s - loss: 0.1402 - sparse_categorical_crossentropy: 0.0470 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0932
695/1875 [==========>...................] - ETA: 8s - loss: 0.1400 - sparse_categorical_crossentropy: 0.0469 - sparse_categorical_accuracy: 0.9859 - scaled_adversarial_loss: 0.0931
702/1875 [==========>...................] - ETA: 8s - loss: 0.1400 - sparse_categorical_crossentropy: 0.0469 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0930
710/1875 [==========>...................] - ETA: 8s - loss: 0.1398 - sparse_categorical_crossentropy: 0.0469 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0930
718/1875 [==========>...................] - ETA: 8s - loss: 0.1397 - sparse_categorical_crossentropy: 0.0468 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0929
725/1875 [==========>...................] - ETA: 8s - loss: 0.1396 - sparse_categorical_crossentropy: 0.0468 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0928
732/1875 [==========>...................] - ETA: 8s - loss: 0.1395 - sparse_categorical_crossentropy: 0.0468 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0928
739/1875 [==========>...................] - ETA: 8s - loss: 0.1394 - sparse_categorical_crossentropy: 0.0467 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0927
746/1875 [==========>...................] - ETA: 8s - loss: 0.1394 - sparse_categorical_crossentropy: 0.0467 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0927
753/1875 [===========>..................] - ETA: 8s - loss: 0.1393 - sparse_categorical_crossentropy: 0.0466 - sparse_categorical_accuracy: 0.9860 - scaled_adversarial_loss: 0.0926
760/1875 [===========>..................] - ETA: 8s - loss: 0.1392 - sparse_categorical_crossentropy: 0.0466 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0926
767/1875 [===========>..................] - ETA: 8s - loss: 0.1391 - sparse_categorical_crossentropy: 0.0466 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0925
774/1875 [===========>..................] - ETA: 8s - loss: 0.1390 - sparse_categorical_crossentropy: 0.0465 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0925
781/1875 [===========>..................] - ETA: 7s - loss: 0.1389 - sparse_categorical_crossentropy: 0.0465 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0924
788/1875 [===========>..................] - ETA: 7s - loss: 0.1388 - sparse_categorical_crossentropy: 0.0465 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0923
796/1875 [===========>..................] - ETA: 7s - loss: 0.1387 - sparse_categorical_crossentropy: 0.0465 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0923
803/1875 [===========>..................] - ETA: 7s - loss: 0.1387 - sparse_categorical_crossentropy: 0.0464 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0922
811/1875 [===========>..................] - ETA: 7s - loss: 0.1386 - sparse_categorical_crossentropy: 0.0464 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0922
818/1875 [============>.................] - ETA: 7s - loss: 0.1385 - sparse_categorical_crossentropy: 0.0464 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0921
825/1875 [============>.................] - ETA: 7s - loss: 0.1384 - sparse_categorical_crossentropy: 0.0464 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0921
833/1875 [============>.................] - ETA: 7s - loss: 0.1384 - sparse_categorical_crossentropy: 0.0463 - sparse_categorical_accuracy: 0.9861 - scaled_adversarial_loss: 0.0920
840/1875 [============>.................] - ETA: 7s - loss: 0.1383 - sparse_categorical_crossentropy: 0.0463 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0920
848/1875 [============>.................] - ETA: 7s - loss: 0.1382 - sparse_categorical_crossentropy: 0.0463 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0919
856/1875 [============>.................] - ETA: 7s - loss: 0.1381 - sparse_categorical_crossentropy: 0.0462 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0919
863/1875 [============>.................] - ETA: 7s - loss: 0.1380 - sparse_categorical_crossentropy: 0.0462 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0918
870/1875 [============>.................] - ETA: 7s - loss: 0.1380 - sparse_categorical_crossentropy: 0.0462 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0918
877/1875 [=============>................] - ETA: 7s - loss: 0.1379 - sparse_categorical_crossentropy: 0.0462 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0917
884/1875 [=============>................] - ETA: 7s - loss: 0.1378 - sparse_categorical_crossentropy: 0.0461 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0917
891/1875 [=============>................] - ETA: 7s - loss: 0.1378 - sparse_categorical_crossentropy: 0.0461 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0916
899/1875 [=============>................] - ETA: 7s - loss: 0.1377 - sparse_categorical_crossentropy: 0.0461 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0916
907/1875 [=============>................] - ETA: 7s - loss: 0.1376 - sparse_categorical_crossentropy: 0.0461 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0915
914/1875 [=============>................] - ETA: 7s - loss: 0.1375 - sparse_categorical_crossentropy: 0.0460 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0915
921/1875 [=============>................] - ETA: 6s - loss: 0.1375 - sparse_categorical_crossentropy: 0.0460 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0915
928/1875 [=============>................] - ETA: 6s - loss: 0.1374 - sparse_categorical_crossentropy: 0.0460 - sparse_categorical_accuracy: 0.9862 - scaled_adversarial_loss: 0.0914
935/1875 [=============>................] - ETA: 6s - loss: 0.1374 - sparse_categorical_crossentropy: 0.0460 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0914
943/1875 [==============>...............] - ETA: 6s - loss: 0.1373 - sparse_categorical_crossentropy: 0.0460 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0913
951/1875 [==============>...............] - ETA: 6s - loss: 0.1372 - sparse_categorical_crossentropy: 0.0459 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0913
959/1875 [==============>...............] - ETA: 6s - loss: 0.1372 - sparse_categorical_crossentropy: 0.0459 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0912
966/1875 [==============>...............] - ETA: 6s - loss: 0.1371 - sparse_categorical_crossentropy: 0.0459 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0912
973/1875 [==============>...............] - ETA: 6s - loss: 0.1370 - sparse_categorical_crossentropy: 0.0459 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0912
980/1875 [==============>...............] - ETA: 6s - loss: 0.1370 - sparse_categorical_crossentropy: 0.0459 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0911
988/1875 [==============>...............] - ETA: 6s - loss: 0.1369 - sparse_categorical_crossentropy: 0.0458 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0911
995/1875 [==============>...............] - ETA: 6s - loss: 0.1369 - sparse_categorical_crossentropy: 0.0458 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0910
1003/1875 [===============>..............] - ETA: 6s - loss: 0.1368 - sparse_categorical_crossentropy: 0.0458 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0910
1010/1875 [===============>..............] - ETA: 6s - loss: 0.1367 - sparse_categorical_crossentropy: 0.0458 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0910
1017/1875 [===============>..............] - ETA: 6s - loss: 0.1367 - sparse_categorical_crossentropy: 0.0458 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0909
1024/1875 [===============>..............] - ETA: 6s - loss: 0.1366 - sparse_categorical_crossentropy: 0.0458 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0909
1031/1875 [===============>..............] - ETA: 6s - loss: 0.1366 - sparse_categorical_crossentropy: 0.0457 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0909
1039/1875 [===============>..............] - ETA: 6s - loss: 0.1365 - sparse_categorical_crossentropy: 0.0457 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0908
1047/1875 [===============>..............] - ETA: 6s - loss: 0.1365 - sparse_categorical_crossentropy: 0.0457 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0908
1055/1875 [===============>..............] - ETA: 5s - loss: 0.1364 - sparse_categorical_crossentropy: 0.0457 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0907
1062/1875 [===============>..............] - ETA: 5s - loss: 0.1364 - sparse_categorical_crossentropy: 0.0457 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0907
1069/1875 [================>.............] - ETA: 5s - loss: 0.1363 - sparse_categorical_crossentropy: 0.0457 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0907
1077/1875 [================>.............] - ETA: 5s - loss: 0.1363 - sparse_categorical_crossentropy: 0.0457 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0906
1084/1875 [================>.............] - ETA: 5s - loss: 0.1363 - sparse_categorical_crossentropy: 0.0456 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0906
1092/1875 [================>.............] - ETA: 5s - loss: 0.1362 - sparse_categorical_crossentropy: 0.0456 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0906
1099/1875 [================>.............] - ETA: 5s - loss: 0.1362 - sparse_categorical_crossentropy: 0.0456 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0906
1106/1875 [================>.............] - ETA: 5s - loss: 0.1361 - sparse_categorical_crossentropy: 0.0456 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0905
1113/1875 [================>.............] - ETA: 5s - loss: 0.1361 - sparse_categorical_crossentropy: 0.0456 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0905
1120/1875 [================>.............] - ETA: 5s - loss: 0.1360 - sparse_categorical_crossentropy: 0.0456 - sparse_categorical_accuracy: 0.9863 - scaled_adversarial_loss: 0.0905
1127/1875 [=================>............] - ETA: 5s - loss: 0.1360 - sparse_categorical_crossentropy: 0.0455 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0904
1134/1875 [=================>............] - ETA: 5s - loss: 0.1359 - sparse_categorical_crossentropy: 0.0455 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0904
1141/1875 [=================>............] - ETA: 5s - loss: 0.1359 - sparse_categorical_crossentropy: 0.0455 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0904
1149/1875 [=================>............] - ETA: 5s - loss: 0.1358 - sparse_categorical_crossentropy: 0.0455 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0903
1156/1875 [=================>............] - ETA: 5s - loss: 0.1358 - sparse_categorical_crossentropy: 0.0455 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0903
1163/1875 [=================>............] - ETA: 5s - loss: 0.1357 - sparse_categorical_crossentropy: 0.0455 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0903
1170/1875 [=================>............] - ETA: 5s - loss: 0.1357 - sparse_categorical_crossentropy: 0.0454 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0902
1178/1875 [=================>............] - ETA: 5s - loss: 0.1356 - sparse_categorical_crossentropy: 0.0454 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0902
1185/1875 [=================>............] - ETA: 5s - loss: 0.1356 - sparse_categorical_crossentropy: 0.0454 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0901
1193/1875 [==================>...........] - ETA: 4s - loss: 0.1355 - sparse_categorical_crossentropy: 0.0454 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0901
1201/1875 [==================>...........] - ETA: 4s - loss: 0.1354 - sparse_categorical_crossentropy: 0.0454 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0901
1208/1875 [==================>...........] - ETA: 4s - loss: 0.1354 - sparse_categorical_crossentropy: 0.0454 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0900
1215/1875 [==================>...........] - ETA: 4s - loss: 0.1353 - sparse_categorical_crossentropy: 0.0453 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0900
1222/1875 [==================>...........] - ETA: 4s - loss: 0.1353 - sparse_categorical_crossentropy: 0.0453 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0900
1229/1875 [==================>...........] - ETA: 4s - loss: 0.1352 - sparse_categorical_crossentropy: 0.0453 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0899
1236/1875 [==================>...........] - ETA: 4s - loss: 0.1352 - sparse_categorical_crossentropy: 0.0453 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0899
1243/1875 [==================>...........] - ETA: 4s - loss: 0.1351 - sparse_categorical_crossentropy: 0.0453 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0899
1250/1875 [===================>..........] - ETA: 4s - loss: 0.1351 - sparse_categorical_crossentropy: 0.0453 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0898
1257/1875 [===================>..........] - ETA: 4s - loss: 0.1351 - sparse_categorical_crossentropy: 0.0453 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0898
1264/1875 [===================>..........] - ETA: 4s - loss: 0.1350 - sparse_categorical_crossentropy: 0.0452 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0898
1272/1875 [===================>..........] - ETA: 4s - loss: 0.1349 - sparse_categorical_crossentropy: 0.0452 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0897
1281/1875 [===================>..........] - ETA: 4s - loss: 0.1349 - sparse_categorical_crossentropy: 0.0452 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0897
1289/1875 [===================>..........] - ETA: 4s - loss: 0.1348 - sparse_categorical_crossentropy: 0.0452 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0896
1297/1875 [===================>..........] - ETA: 4s - loss: 0.1348 - sparse_categorical_crossentropy: 0.0452 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0896
1305/1875 [===================>..........] - ETA: 4s - loss: 0.1347 - sparse_categorical_crossentropy: 0.0451 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0896
1312/1875 [===================>..........] - ETA: 4s - loss: 0.1346 - sparse_categorical_crossentropy: 0.0451 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0895
1320/1875 [====================>.........] - ETA: 4s - loss: 0.1346 - sparse_categorical_crossentropy: 0.0451 - sparse_categorical_accuracy: 0.9864 - scaled_adversarial_loss: 0.0895
1328/1875 [====================>.........] - ETA: 3s - loss: 0.1345 - sparse_categorical_crossentropy: 0.0451 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0894
1336/1875 [====================>.........] - ETA: 3s - loss: 0.1345 - sparse_categorical_crossentropy: 0.0451 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0894
1344/1875 [====================>.........] - ETA: 3s - loss: 0.1344 - sparse_categorical_crossentropy: 0.0450 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0894
1352/1875 [====================>.........] - ETA: 3s - loss: 0.1344 - sparse_categorical_crossentropy: 0.0450 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0893
1360/1875 [====================>.........] - ETA: 3s - loss: 0.1343 - sparse_categorical_crossentropy: 0.0450 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0893
1368/1875 [====================>.........] - ETA: 3s - loss: 0.1342 - sparse_categorical_crossentropy: 0.0450 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0892
1376/1875 [=====================>........] - ETA: 3s - loss: 0.1342 - sparse_categorical_crossentropy: 0.0450 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0892
1384/1875 [=====================>........] - ETA: 3s - loss: 0.1341 - sparse_categorical_crossentropy: 0.0449 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0892
1392/1875 [=====================>........] - ETA: 3s - loss: 0.1341 - sparse_categorical_crossentropy: 0.0449 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0891
1400/1875 [=====================>........] - ETA: 3s - loss: 0.1340 - sparse_categorical_crossentropy: 0.0449 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0891
1408/1875 [=====================>........] - ETA: 3s - loss: 0.1339 - sparse_categorical_crossentropy: 0.0449 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0891
1416/1875 [=====================>........] - ETA: 3s - loss: 0.1339 - sparse_categorical_crossentropy: 0.0449 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0890
1424/1875 [=====================>........] - ETA: 3s - loss: 0.1338 - sparse_categorical_crossentropy: 0.0448 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0890
1432/1875 [=====================>........] - ETA: 3s - loss: 0.1338 - sparse_categorical_crossentropy: 0.0448 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0889
1440/1875 [======================>.......] - ETA: 3s - loss: 0.1337 - sparse_categorical_crossentropy: 0.0448 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0889
1449/1875 [======================>.......] - ETA: 3s - loss: 0.1336 - sparse_categorical_crossentropy: 0.0448 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0889
1457/1875 [======================>.......] - ETA: 3s - loss: 0.1336 - sparse_categorical_crossentropy: 0.0448 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0888
1465/1875 [======================>.......] - ETA: 2s - loss: 0.1335 - sparse_categorical_crossentropy: 0.0447 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0888
1473/1875 [======================>.......] - ETA: 2s - loss: 0.1335 - sparse_categorical_crossentropy: 0.0447 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0887
1481/1875 [======================>.......] - ETA: 2s - loss: 0.1334 - sparse_categorical_crossentropy: 0.0447 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0887
1489/1875 [======================>.......] - ETA: 2s - loss: 0.1334 - sparse_categorical_crossentropy: 0.0447 - sparse_categorical_accuracy: 0.9865 - scaled_adversarial_loss: 0.0887
1497/1875 [======================>.......] - ETA: 2s - loss: 0.1333 - sparse_categorical_crossentropy: 0.0447 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0886
1506/1875 [=======================>......] - ETA: 2s - loss: 0.1332 - sparse_categorical_crossentropy: 0.0446 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0886
1514/1875 [=======================>......] - ETA: 2s - loss: 0.1332 - sparse_categorical_crossentropy: 0.0446 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0885
1522/1875 [=======================>......] - ETA: 2s - loss: 0.1331 - sparse_categorical_crossentropy: 0.0446 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0885
1530/1875 [=======================>......] - ETA: 2s - loss: 0.1331 - sparse_categorical_crossentropy: 0.0446 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0885
1538/1875 [=======================>......] - ETA: 2s - loss: 0.1330 - sparse_categorical_crossentropy: 0.0446 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0884
1546/1875 [=======================>......] - ETA: 2s - loss: 0.1329 - sparse_categorical_crossentropy: 0.0445 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0884
1555/1875 [=======================>......] - ETA: 2s - loss: 0.1329 - sparse_categorical_crossentropy: 0.0445 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0884
1563/1875 [========================>.....] - ETA: 2s - loss: 0.1328 - sparse_categorical_crossentropy: 0.0445 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0883
1572/1875 [========================>.....] - ETA: 2s - loss: 0.1328 - sparse_categorical_crossentropy: 0.0445 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0883
1582/1875 [========================>.....] - ETA: 2s - loss: 0.1327 - sparse_categorical_crossentropy: 0.0445 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0882
1592/1875 [========================>.....] - ETA: 2s - loss: 0.1326 - sparse_categorical_crossentropy: 0.0444 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0882
1601/1875 [========================>.....] - ETA: 1s - loss: 0.1326 - sparse_categorical_crossentropy: 0.0444 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0881
1611/1875 [========================>.....] - ETA: 1s - loss: 0.1325 - sparse_categorical_crossentropy: 0.0444 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0881
1621/1875 [========================>.....] - ETA: 1s - loss: 0.1324 - sparse_categorical_crossentropy: 0.0444 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0881
1631/1875 [=========================>....] - ETA: 1s - loss: 0.1324 - sparse_categorical_crossentropy: 0.0443 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0880
1641/1875 [=========================>....] - ETA: 1s - loss: 0.1323 - sparse_categorical_crossentropy: 0.0443 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0880
1650/1875 [=========================>....] - ETA: 1s - loss: 0.1322 - sparse_categorical_crossentropy: 0.0443 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0879
1660/1875 [=========================>....] - ETA: 1s - loss: 0.1322 - sparse_categorical_crossentropy: 0.0443 - sparse_categorical_accuracy: 0.9866 - scaled_adversarial_loss: 0.0879
1670/1875 [=========================>....] - ETA: 1s - loss: 0.1321 - sparse_categorical_crossentropy: 0.0443 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0878
1680/1875 [=========================>....] - ETA: 1s - loss: 0.1320 - sparse_categorical_crossentropy: 0.0442 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0878
1690/1875 [==========================>...] - ETA: 1s - loss: 0.1320 - sparse_categorical_crossentropy: 0.0442 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0878
1701/1875 [==========================>...] - ETA: 1s - loss: 0.1319 - sparse_categorical_crossentropy: 0.0442 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0877
1711/1875 [==========================>...] - ETA: 1s - loss: 0.1319 - sparse_categorical_crossentropy: 0.0442 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0877
1721/1875 [==========================>...] - ETA: 1s - loss: 0.1318 - sparse_categorical_crossentropy: 0.0442 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0876
1731/1875 [==========================>...] - ETA: 1s - loss: 0.1317 - sparse_categorical_crossentropy: 0.0441 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0876
1742/1875 [==========================>...] - ETA: 0s - loss: 0.1317 - sparse_categorical_crossentropy: 0.0441 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0876
1753/1875 [===========================>..] - ETA: 0s - loss: 0.1316 - sparse_categorical_crossentropy: 0.0441 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0875
1763/1875 [===========================>..] - ETA: 0s - loss: 0.1315 - sparse_categorical_crossentropy: 0.0441 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0875
1773/1875 [===========================>..] - ETA: 0s - loss: 0.1315 - sparse_categorical_crossentropy: 0.0440 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0874
1783/1875 [===========================>..] - ETA: 0s - loss: 0.1314 - sparse_categorical_crossentropy: 0.0440 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0874
1793/1875 [===========================>..] - ETA: 0s - loss: 0.1313 - sparse_categorical_crossentropy: 0.0440 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0873
1804/1875 [===========================>..] - ETA: 0s - loss: 0.1313 - sparse_categorical_crossentropy: 0.0440 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0873
1814/1875 [============================>.] - ETA: 0s - loss: 0.1312 - sparse_categorical_crossentropy: 0.0440 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0873
1824/1875 [============================>.] - ETA: 0s - loss: 0.1312 - sparse_categorical_crossentropy: 0.0439 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0872
1834/1875 [============================>.] - ETA: 0s - loss: 0.1311 - sparse_categorical_crossentropy: 0.0439 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0872
1843/1875 [============================>.] - ETA: 0s - loss: 0.1310 - sparse_categorical_crossentropy: 0.0439 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0871
1853/1875 [============================>.] - ETA: 0s - loss: 0.1310 - sparse_categorical_crossentropy: 0.0439 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0871
1863/1875 [============================>.] - ETA: 0s - loss: 0.1309 - sparse_categorical_crossentropy: 0.0439 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0871
1873/1875 [============================>.] - ETA: 0s - loss: 0.1309 - sparse_categorical_crossentropy: 0.0438 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0870
1875/1875 [==============================] - 13s 7ms/step - loss: 0.1308 - sparse_categorical_crossentropy: 0.0438 - sparse_categorical_accuracy: 0.9867 - scaled_adversarial_loss: 0.0870
Epoch 3/5
1/1875 [..............................] - ETA: 12:16 - loss: 0.1308 - sparse_categorical_crossentropy: 0.0635 - sparse_categorical_accuracy: 0.9688 - scaled_adversarial_loss: 0.0673
9/1875 [..............................] - ETA: 12s - loss: 0.0987 - sparse_categorical_crossentropy: 0.0335 - sparse_categorical_accuracy: 0.9879 - scaled_adversarial_loss: 0.0652
16/1875 [..............................] - ETA: 13s - loss: 0.1029 - sparse_categorical_crossentropy: 0.0320 - sparse_categorical_accuracy: 0.9893 - scaled_adversarial_loss: 0.0709
23/1875 [..............................] - ETA: 13s - loss: 0.1016 - sparse_categorical_crossentropy: 0.0303 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0714
31/1875 [..............................] - ETA: 12s - loss: 0.1006 - sparse_categorical_crossentropy: 0.0292 - sparse_categorical_accuracy: 0.9906 - scaled_adversarial_loss: 0.0715
39/1875 [..............................] - ETA: 12s - loss: 0.0985 - sparse_categorical_crossentropy: 0.0280 - sparse_categorical_accuracy: 0.9910 - scaled_adversarial_loss: 0.0705
47/1875 [..............................] - ETA: 12s - loss: 0.0975 - sparse_categorical_crossentropy: 0.0275 - sparse_categorical_accuracy: 0.9911 - scaled_adversarial_loss: 0.0701
55/1875 [..............................] - ETA: 12s - loss: 0.0994 - sparse_categorical_crossentropy: 0.0289 - sparse_categorical_accuracy: 0.9909 - scaled_adversarial_loss: 0.0704
63/1875 [>.............................] - ETA: 12s - loss: 0.1009 - sparse_categorical_crossentropy: 0.0302 - sparse_categorical_accuracy: 0.9907 - scaled_adversarial_loss: 0.0707
71/1875 [>.............................] - ETA: 12s - loss: 0.1018 - sparse_categorical_crossentropy: 0.0311 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0707
79/1875 [>.............................] - ETA: 12s - loss: 0.1024 - sparse_categorical_crossentropy: 0.0318 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0706
88/1875 [>.............................] - ETA: 12s - loss: 0.1025 - sparse_categorical_crossentropy: 0.0322 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0703
96/1875 [>.............................] - ETA: 12s - loss: 0.1026 - sparse_categorical_crossentropy: 0.0325 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0701
105/1875 [>.............................] - ETA: 11s - loss: 0.1024 - sparse_categorical_crossentropy: 0.0326 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0698
113/1875 [>.............................] - ETA: 11s - loss: 0.1021 - sparse_categorical_crossentropy: 0.0327 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0694
121/1875 [>.............................] - ETA: 11s - loss: 0.1017 - sparse_categorical_crossentropy: 0.0326 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0691
129/1875 [=>............................] - ETA: 11s - loss: 0.1012 - sparse_categorical_crossentropy: 0.0325 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0687
138/1875 [=>............................] - ETA: 11s - loss: 0.1008 - sparse_categorical_crossentropy: 0.0325 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0684
147/1875 [=>............................] - ETA: 11s - loss: 0.1005 - sparse_categorical_crossentropy: 0.0324 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0681
155/1875 [=>............................] - ETA: 11s - loss: 0.1002 - sparse_categorical_crossentropy: 0.0324 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0679
163/1875 [=>............................] - ETA: 11s - loss: 0.1000 - sparse_categorical_crossentropy: 0.0323 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0677
170/1875 [=>............................] - ETA: 11s - loss: 0.0998 - sparse_categorical_crossentropy: 0.0323 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0675
178/1875 [=>............................] - ETA: 11s - loss: 0.0997 - sparse_categorical_crossentropy: 0.0323 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0674
186/1875 [=>............................] - ETA: 11s - loss: 0.0996 - sparse_categorical_crossentropy: 0.0323 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0673
195/1875 [==>...........................] - ETA: 11s - loss: 0.0994 - sparse_categorical_crossentropy: 0.0322 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0671
203/1875 [==>...........................] - ETA: 11s - loss: 0.0992 - sparse_categorical_crossentropy: 0.0322 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0670
211/1875 [==>...........................] - ETA: 11s - loss: 0.0990 - sparse_categorical_crossentropy: 0.0321 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0669
219/1875 [==>...........................] - ETA: 11s - loss: 0.0988 - sparse_categorical_crossentropy: 0.0321 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0668
227/1875 [==>...........................] - ETA: 11s - loss: 0.0986 - sparse_categorical_crossentropy: 0.0320 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0666
235/1875 [==>...........................] - ETA: 10s - loss: 0.0985 - sparse_categorical_crossentropy: 0.0320 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0665
243/1875 [==>...........................] - ETA: 10s - loss: 0.0983 - sparse_categorical_crossentropy: 0.0319 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0664
252/1875 [===>..........................] - ETA: 10s - loss: 0.0981 - sparse_categorical_crossentropy: 0.0318 - sparse_categorical_accuracy: 0.9899 - scaled_adversarial_loss: 0.0662
260/1875 [===>..........................] - ETA: 10s - loss: 0.0979 - sparse_categorical_crossentropy: 0.0318 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0661
268/1875 [===>..........................] - ETA: 10s - loss: 0.0977 - sparse_categorical_crossentropy: 0.0317 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0660
276/1875 [===>..........................] - ETA: 10s - loss: 0.0976 - sparse_categorical_crossentropy: 0.0316 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0659
284/1875 [===>..........................] - ETA: 10s - loss: 0.0974 - sparse_categorical_crossentropy: 0.0316 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0658
292/1875 [===>..........................] - ETA: 10s - loss: 0.0972 - sparse_categorical_crossentropy: 0.0315 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0657
300/1875 [===>..........................] - ETA: 10s - loss: 0.0970 - sparse_categorical_crossentropy: 0.0314 - sparse_categorical_accuracy: 0.9900 - scaled_adversarial_loss: 0.0656
308/1875 [===>..........................] - ETA: 10s - loss: 0.0968 - sparse_categorical_crossentropy: 0.0313 - sparse_categorical_accuracy: 0.9901 - scaled_adversarial_loss: 0.0654
316/1875 [====>.........................] - ETA: 10s - loss: 0.0966 - sparse_categorical_crossentropy: 0.0312 - sparse_categorical_accuracy: 0.9901 - scaled_adversarial_loss: 0.0653
324/1875 [====>.........................] - ETA: 10s - loss: 0.0963 - sparse_categorical_crossentropy: 0.0311 - sparse_categorical_accuracy: 0.9901 - scaled_adversarial_loss: 0.0652
332/1875 [====>.........................] - ETA: 10s - loss: 0.0961 - sparse_categorical_crossentropy: 0.0311 - sparse_categorical_accuracy: 0.9901 - scaled_adversarial_loss: 0.0651
340/1875 [====>.........................] - ETA: 10s - loss: 0.0959 - sparse_categorical_crossentropy: 0.0310 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0649
348/1875 [====>.........................] - ETA: 10s - loss: 0.0957 - sparse_categorical_crossentropy: 0.0309 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0648
356/1875 [====>.........................] - ETA: 10s - loss: 0.0956 - sparse_categorical_crossentropy: 0.0308 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0647
364/1875 [====>.........................] - ETA: 10s - loss: 0.0954 - sparse_categorical_crossentropy: 0.0307 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0646
372/1875 [====>.........................] - ETA: 9s - loss: 0.0952 - sparse_categorical_crossentropy: 0.0307 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0645
380/1875 [=====>........................] - ETA: 9s - loss: 0.0950 - sparse_categorical_crossentropy: 0.0306 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0644
388/1875 [=====>........................] - ETA: 9s - loss: 0.0949 - sparse_categorical_crossentropy: 0.0306 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0643
396/1875 [=====>........................] - ETA: 9s - loss: 0.0947 - sparse_categorical_crossentropy: 0.0305 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0642
405/1875 [=====>........................] - ETA: 9s - loss: 0.0946 - sparse_categorical_crossentropy: 0.0304 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0642
414/1875 [=====>........................] - ETA: 9s - loss: 0.0945 - sparse_categorical_crossentropy: 0.0304 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0641
423/1875 [=====>........................] - ETA: 9s - loss: 0.0944 - sparse_categorical_crossentropy: 0.0304 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0640
431/1875 [=====>........................] - ETA: 9s - loss: 0.0943 - sparse_categorical_crossentropy: 0.0303 - sparse_categorical_accuracy: 0.9903 - scaled_adversarial_loss: 0.0640
439/1875 [======>.......................] - ETA: 9s - loss: 0.0943 - sparse_categorical_crossentropy: 0.0303 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0640
447/1875 [======>.......................] - ETA: 9s - loss: 0.0942 - sparse_categorical_crossentropy: 0.0303 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0639
456/1875 [======>.......................] - ETA: 9s - loss: 0.0941 - sparse_categorical_crossentropy: 0.0303 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0639
464/1875 [======>.......................] - ETA: 9s - loss: 0.0940 - sparse_categorical_crossentropy: 0.0302 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0638
472/1875 [======>.......................] - ETA: 9s - loss: 0.0940 - sparse_categorical_crossentropy: 0.0302 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0638
480/1875 [======>.......................] - ETA: 9s - loss: 0.0939 - sparse_categorical_crossentropy: 0.0302 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0637
488/1875 [======>.......................] - ETA: 9s - loss: 0.0939 - sparse_categorical_crossentropy: 0.0302 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0637
495/1875 [======>.......................] - ETA: 9s - loss: 0.0938 - sparse_categorical_crossentropy: 0.0301 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0637
503/1875 [=======>......................] - ETA: 9s - loss: 0.0937 - sparse_categorical_crossentropy: 0.0301 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0636
512/1875 [=======>......................] - ETA: 8s - loss: 0.0937 - sparse_categorical_crossentropy: 0.0301 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0636
520/1875 [=======>......................] - ETA: 8s - loss: 0.0937 - sparse_categorical_crossentropy: 0.0301 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0636
528/1875 [=======>......................] - ETA: 8s - loss: 0.0936 - sparse_categorical_crossentropy: 0.0301 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0635
536/1875 [=======>......................] - ETA: 8s - loss: 0.0936 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0635
544/1875 [=======>......................] - ETA: 8s - loss: 0.0935 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0635
551/1875 [=======>......................] - ETA: 8s - loss: 0.0935 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0634
559/1875 [=======>......................] - ETA: 8s - loss: 0.0934 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0634
567/1875 [========>.....................] - ETA: 8s - loss: 0.0934 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0634
575/1875 [========>.....................] - ETA: 8s - loss: 0.0934 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0634
583/1875 [========>.....................] - ETA: 8s - loss: 0.0933 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0633
591/1875 [========>.....................] - ETA: 8s - loss: 0.0933 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0633
599/1875 [========>.....................] - ETA: 8s - loss: 0.0932 - sparse_categorical_crossentropy: 0.0300 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0633
607/1875 [========>.....................] - ETA: 8s - loss: 0.0932 - sparse_categorical_crossentropy: 0.0299 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0633
616/1875 [========>.....................] - ETA: 8s - loss: 0.0932 - sparse_categorical_crossentropy: 0.0299 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0633
625/1875 [=========>....................] - ETA: 8s - loss: 0.0932 - sparse_categorical_crossentropy: 0.0299 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0632
633/1875 [=========>....................] - ETA: 8s - loss: 0.0931 - sparse_categorical_crossentropy: 0.0299 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0632
641/1875 [=========>....................] - ETA: 8s - loss: 0.0931 - sparse_categorical_crossentropy: 0.0299 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0632
648/1875 [=========>....................] - ETA: 8s - loss: 0.0931 - sparse_categorical_crossentropy: 0.0299 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0632
656/1875 [=========>....................] - ETA: 8s - loss: 0.0930 - sparse_categorical_crossentropy: 0.0299 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0632
665/1875 [=========>....................] - ETA: 7s - loss: 0.0930 - sparse_categorical_crossentropy: 0.0298 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0632
674/1875 [=========>....................] - ETA: 7s - loss: 0.0930 - sparse_categorical_crossentropy: 0.0298 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0631
682/1875 [=========>....................] - ETA: 7s - loss: 0.0929 - sparse_categorical_crossentropy: 0.0298 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0631
690/1875 [==========>...................] - ETA: 7s - loss: 0.0929 - sparse_categorical_crossentropy: 0.0298 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0631
698/1875 [==========>...................] - ETA: 7s - loss: 0.0928 - sparse_categorical_crossentropy: 0.0298 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0631
706/1875 [==========>...................] - ETA: 7s - loss: 0.0928 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0631
714/1875 [==========>...................] - ETA: 7s - loss: 0.0928 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0630
722/1875 [==========>...................] - ETA: 7s - loss: 0.0927 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0630
730/1875 [==========>...................] - ETA: 7s - loss: 0.0927 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0630
738/1875 [==========>...................] - ETA: 7s - loss: 0.0927 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0630
746/1875 [==========>...................] - ETA: 7s - loss: 0.0926 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0630
754/1875 [===========>..................] - ETA: 7s - loss: 0.0926 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0629
762/1875 [===========>..................] - ETA: 7s - loss: 0.0925 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0629
771/1875 [===========>..................] - ETA: 7s - loss: 0.0925 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0629
779/1875 [===========>..................] - ETA: 7s - loss: 0.0925 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0629
788/1875 [===========>..................] - ETA: 7s - loss: 0.0924 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0628
796/1875 [===========>..................] - ETA: 7s - loss: 0.0924 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0628
803/1875 [===========>..................] - ETA: 7s - loss: 0.0924 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0628
810/1875 [===========>..................] - ETA: 7s - loss: 0.0923 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0628
818/1875 [============>.................] - ETA: 6s - loss: 0.0923 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0628
826/1875 [============>.................] - ETA: 6s - loss: 0.0923 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
835/1875 [============>.................] - ETA: 6s - loss: 0.0923 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
843/1875 [============>.................] - ETA: 6s - loss: 0.0923 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
851/1875 [============>.................] - ETA: 6s - loss: 0.0923 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
858/1875 [============>.................] - ETA: 6s - loss: 0.0923 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
866/1875 [============>.................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
874/1875 [============>.................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
882/1875 [=============>................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0627
891/1875 [=============>................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0626
900/1875 [=============>................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0626
908/1875 [=============>................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0626
916/1875 [=============>................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0626
924/1875 [=============>................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0626
932/1875 [=============>................] - ETA: 6s - loss: 0.0922 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0626
940/1875 [==============>...............] - ETA: 6s - loss: 0.0921 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0625
948/1875 [==============>...............] - ETA: 6s - loss: 0.0921 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0625
956/1875 [==============>...............] - ETA: 6s - loss: 0.0921 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0625
964/1875 [==============>...............] - ETA: 5s - loss: 0.0921 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0625
972/1875 [==============>...............] - ETA: 5s - loss: 0.0921 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0625
980/1875 [==============>...............] - ETA: 5s - loss: 0.0921 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0625
988/1875 [==============>...............] - ETA: 5s - loss: 0.0921 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0625
996/1875 [==============>...............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0624
1005/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0624
1013/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0624
1021/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0624
1029/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0624
1037/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0624
1045/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0623
1053/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0623
1062/1875 [===============>..............] - ETA: 5s - loss: 0.0920 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0623
1070/1875 [================>.............] - ETA: 5s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0623
1078/1875 [================>.............] - ETA: 5s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0623
1086/1875 [================>.............] - ETA: 5s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0623
1095/1875 [================>.............] - ETA: 5s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0622
1103/1875 [================>.............] - ETA: 5s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0622
1111/1875 [================>.............] - ETA: 5s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0622
1119/1875 [================>.............] - ETA: 4s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0622
1127/1875 [=================>............] - ETA: 4s - loss: 0.0919 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0622
1135/1875 [=================>............] - ETA: 4s - loss: 0.0918 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0622
1143/1875 [=================>............] - ETA: 4s - loss: 0.0918 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0622
1151/1875 [=================>............] - ETA: 4s - loss: 0.0918 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0621
1159/1875 [=================>............] - ETA: 4s - loss: 0.0918 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0621
1168/1875 [=================>............] - ETA: 4s - loss: 0.0918 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0621
1176/1875 [=================>............] - ETA: 4s - loss: 0.0918 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0621
1184/1875 [=================>............] - ETA: 4s - loss: 0.0917 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0621
1192/1875 [==================>...........] - ETA: 4s - loss: 0.0917 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0621
1201/1875 [==================>...........] - ETA: 4s - loss: 0.0917 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0620
1209/1875 [==================>...........] - ETA: 4s - loss: 0.0917 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0620
1218/1875 [==================>...........] - ETA: 4s - loss: 0.0917 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0620
1226/1875 [==================>...........] - ETA: 4s - loss: 0.0917 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0620
1234/1875 [==================>...........] - ETA: 4s - loss: 0.0917 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0620
1242/1875 [==================>...........] - ETA: 4s - loss: 0.0916 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0619
1250/1875 [===================>..........] - ETA: 4s - loss: 0.0916 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0619
1258/1875 [===================>..........] - ETA: 4s - loss: 0.0916 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0619
1266/1875 [===================>..........] - ETA: 3s - loss: 0.0916 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0619
1274/1875 [===================>..........] - ETA: 3s - loss: 0.0916 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0619
1282/1875 [===================>..........] - ETA: 3s - loss: 0.0916 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0619
1290/1875 [===================>..........] - ETA: 3s - loss: 0.0915 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0618
1298/1875 [===================>..........] - ETA: 3s - loss: 0.0915 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0618
1307/1875 [===================>..........] - ETA: 3s - loss: 0.0915 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0618
1315/1875 [====================>.........] - ETA: 3s - loss: 0.0915 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0618
1323/1875 [====================>.........] - ETA: 3s - loss: 0.0915 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0618
1331/1875 [====================>.........] - ETA: 3s - loss: 0.0914 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0617
1339/1875 [====================>.........] - ETA: 3s - loss: 0.0914 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0617
1347/1875 [====================>.........] - ETA: 3s - loss: 0.0914 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0617
1355/1875 [====================>.........] - ETA: 3s - loss: 0.0914 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0617
1364/1875 [====================>.........] - ETA: 3s - loss: 0.0914 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0617
1373/1875 [====================>.........] - ETA: 3s - loss: 0.0914 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0616
1381/1875 [=====================>........] - ETA: 3s - loss: 0.0913 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0616
1389/1875 [=====================>........] - ETA: 3s - loss: 0.0913 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0616
1397/1875 [=====================>........] - ETA: 3s - loss: 0.0913 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0616
1406/1875 [=====================>........] - ETA: 3s - loss: 0.0913 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0616
1415/1875 [=====================>........] - ETA: 3s - loss: 0.0913 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0616
1423/1875 [=====================>........] - ETA: 2s - loss: 0.0913 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0615
1432/1875 [=====================>........] - ETA: 2s - loss: 0.0912 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0615
1440/1875 [======================>.......] - ETA: 2s - loss: 0.0912 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0615
1448/1875 [======================>.......] - ETA: 2s - loss: 0.0912 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0615
1456/1875 [======================>.......] - ETA: 2s - loss: 0.0912 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0615
1465/1875 [======================>.......] - ETA: 2s - loss: 0.0912 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0615
1473/1875 [======================>.......] - ETA: 2s - loss: 0.0912 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0614
1482/1875 [======================>.......] - ETA: 2s - loss: 0.0912 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0614
1491/1875 [======================>.......] - ETA: 2s - loss: 0.0911 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0614
1499/1875 [======================>.......] - ETA: 2s - loss: 0.0911 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0614
1507/1875 [=======================>......] - ETA: 2s - loss: 0.0911 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0614
1516/1875 [=======================>......] - ETA: 2s - loss: 0.0911 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0614
1525/1875 [=======================>......] - ETA: 2s - loss: 0.0911 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0613
1533/1875 [=======================>......] - ETA: 2s - loss: 0.0911 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0613
1541/1875 [=======================>......] - ETA: 2s - loss: 0.0910 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0613
1549/1875 [=======================>......] - ETA: 2s - loss: 0.0910 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0613
1557/1875 [=======================>......] - ETA: 2s - loss: 0.0910 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0613
1564/1875 [========================>.....] - ETA: 2s - loss: 0.0910 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0612
1575/1875 [========================>.....] - ETA: 1s - loss: 0.0910 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0612
1586/1875 [========================>.....] - ETA: 1s - loss: 0.0909 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0612
1596/1875 [========================>.....] - ETA: 1s - loss: 0.0909 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0612
1606/1875 [========================>.....] - ETA: 1s - loss: 0.0909 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0612
1616/1875 [========================>.....] - ETA: 1s - loss: 0.0909 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0611
1626/1875 [=========================>....] - ETA: 1s - loss: 0.0908 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9904 - scaled_adversarial_loss: 0.0611
1637/1875 [=========================>....] - ETA: 1s - loss: 0.0908 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0611
1648/1875 [=========================>....] - ETA: 1s - loss: 0.0908 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0610
1659/1875 [=========================>....] - ETA: 1s - loss: 0.0907 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0610
1670/1875 [=========================>....] - ETA: 1s - loss: 0.0907 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0610
1680/1875 [=========================>....] - ETA: 1s - loss: 0.0907 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0610
1689/1875 [==========================>...] - ETA: 1s - loss: 0.0907 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0609
1699/1875 [==========================>...] - ETA: 1s - loss: 0.0906 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0609
1710/1875 [==========================>...] - ETA: 1s - loss: 0.0906 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0609
1720/1875 [==========================>...] - ETA: 0s - loss: 0.0906 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0609
1730/1875 [==========================>...] - ETA: 0s - loss: 0.0905 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0608
1740/1875 [==========================>...] - ETA: 0s - loss: 0.0905 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0608
1750/1875 [===========================>..] - ETA: 0s - loss: 0.0905 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0608
1760/1875 [===========================>..] - ETA: 0s - loss: 0.0904 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0608
1770/1875 [===========================>..] - ETA: 0s - loss: 0.0904 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0607
1780/1875 [===========================>..] - ETA: 0s - loss: 0.0904 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0607
1791/1875 [===========================>..] - ETA: 0s - loss: 0.0903 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0607
1802/1875 [===========================>..] - ETA: 0s - loss: 0.0903 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0606
1812/1875 [===========================>..] - ETA: 0s - loss: 0.0903 - sparse_categorical_crossentropy: 0.0297 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0606
1822/1875 [============================>.] - ETA: 0s - loss: 0.0902 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0606
1832/1875 [============================>.] - ETA: 0s - loss: 0.0902 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0606
1842/1875 [============================>.] - ETA: 0s - loss: 0.0902 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0605
1852/1875 [============================>.] - ETA: 0s - loss: 0.0901 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0605
1862/1875 [============================>.] - ETA: 0s - loss: 0.0901 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0605
1872/1875 [============================>.] - ETA: 0s - loss: 0.0901 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0604
1875/1875 [==============================] - 12s 6ms/step - loss: 0.0901 - sparse_categorical_crossentropy: 0.0296 - sparse_categorical_accuracy: 0.9905 - scaled_adversarial_loss: 0.0604
Epoch 4/5
1/1875 [..............................] - ETA: 12:43 - loss: 0.1893 - sparse_categorical_crossentropy: 0.1333 - sparse_categorical_accuracy: 0.9688 - scaled_adversarial_loss: 0.0560
9/1875 [..............................] - ETA: 12s - loss: 0.0837 - sparse_categorical_crossentropy: 0.0479 - sparse_categorical_accuracy: 0.9902 - scaled_adversarial_loss: 0.0358
17/1875 [..............................] - ETA: 12s - loss: 0.0660 - sparse_categorical_crossentropy: 0.0341 - sparse_categorical_accuracy: 0.9935 - scaled_adversarial_loss: 0.0319
25/1875 [..............................] - ETA: 12s - loss: 0.0581 - sparse_categorical_crossentropy: 0.0290 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0291
33/1875 [..............................] - ETA: 12s - loss: 0.0539 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9949 - scaled_adversarial_loss: 0.0278
42/1875 [..............................] - ETA: 12s - loss: 0.0549 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9950 - scaled_adversarial_loss: 0.0296
50/1875 [..............................] - ETA: 12s - loss: 0.0565 - sparse_categorical_crossentropy: 0.0257 - sparse_categorical_accuracy: 0.9948 - scaled_adversarial_loss: 0.0307
58/1875 [..............................] - ETA: 12s - loss: 0.0578 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0317
66/1875 [>.............................] - ETA: 11s - loss: 0.0590 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0328
74/1875 [>.............................] - ETA: 11s - loss: 0.0593 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0333
82/1875 [>.............................] - ETA: 11s - loss: 0.0595 - sparse_categorical_crossentropy: 0.0258 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0336
90/1875 [>.............................] - ETA: 11s - loss: 0.0595 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0339
98/1875 [>.............................] - ETA: 11s - loss: 0.0595 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0341
106/1875 [>.............................] - ETA: 11s - loss: 0.0598 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0344
114/1875 [>.............................] - ETA: 11s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0349
122/1875 [>.............................] - ETA: 11s - loss: 0.0608 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9940 - scaled_adversarial_loss: 0.0352
130/1875 [=>............................] - ETA: 11s - loss: 0.0612 - sparse_categorical_crossentropy: 0.0257 - sparse_categorical_accuracy: 0.9938 - scaled_adversarial_loss: 0.0355
138/1875 [=>............................] - ETA: 11s - loss: 0.0615 - sparse_categorical_crossentropy: 0.0258 - sparse_categorical_accuracy: 0.9937 - scaled_adversarial_loss: 0.0358
146/1875 [=>............................] - ETA: 11s - loss: 0.0618 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9936 - scaled_adversarial_loss: 0.0359
154/1875 [=>............................] - ETA: 11s - loss: 0.0620 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9935 - scaled_adversarial_loss: 0.0361
162/1875 [=>............................] - ETA: 11s - loss: 0.0622 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9934 - scaled_adversarial_loss: 0.0362
170/1875 [=>............................] - ETA: 11s - loss: 0.0624 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9933 - scaled_adversarial_loss: 0.0363
178/1875 [=>............................] - ETA: 11s - loss: 0.0625 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9932 - scaled_adversarial_loss: 0.0364
186/1875 [=>............................] - ETA: 11s - loss: 0.0626 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9932 - scaled_adversarial_loss: 0.0365
194/1875 [==>...........................] - ETA: 11s - loss: 0.0627 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9931 - scaled_adversarial_loss: 0.0366
202/1875 [==>...........................] - ETA: 11s - loss: 0.0628 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9931 - scaled_adversarial_loss: 0.0367
209/1875 [==>...........................] - ETA: 11s - loss: 0.0629 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9931 - scaled_adversarial_loss: 0.0368
217/1875 [==>...........................] - ETA: 10s - loss: 0.0629 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9930 - scaled_adversarial_loss: 0.0368
225/1875 [==>...........................] - ETA: 10s - loss: 0.0630 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9930 - scaled_adversarial_loss: 0.0368
233/1875 [==>...........................] - ETA: 10s - loss: 0.0631 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9930 - scaled_adversarial_loss: 0.0369
241/1875 [==>...........................] - ETA: 10s - loss: 0.0632 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9930 - scaled_adversarial_loss: 0.0371
249/1875 [==>...........................] - ETA: 10s - loss: 0.0634 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9929 - scaled_adversarial_loss: 0.0372
257/1875 [===>..........................] - ETA: 10s - loss: 0.0636 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9929 - scaled_adversarial_loss: 0.0374
264/1875 [===>..........................] - ETA: 10s - loss: 0.0637 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9929 - scaled_adversarial_loss: 0.0375
272/1875 [===>..........................] - ETA: 10s - loss: 0.0638 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9928 - scaled_adversarial_loss: 0.0376
280/1875 [===>..........................] - ETA: 10s - loss: 0.0640 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9928 - scaled_adversarial_loss: 0.0377
288/1875 [===>..........................] - ETA: 10s - loss: 0.0642 - sparse_categorical_crossentropy: 0.0263 - sparse_categorical_accuracy: 0.9928 - scaled_adversarial_loss: 0.0379
296/1875 [===>..........................] - ETA: 10s - loss: 0.0643 - sparse_categorical_crossentropy: 0.0263 - sparse_categorical_accuracy: 0.9927 - scaled_adversarial_loss: 0.0380
304/1875 [===>..........................] - ETA: 10s - loss: 0.0644 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9927 - scaled_adversarial_loss: 0.0382
311/1875 [===>..........................] - ETA: 10s - loss: 0.0645 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9927 - scaled_adversarial_loss: 0.0383
318/1875 [====>.........................] - ETA: 10s - loss: 0.0646 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9927 - scaled_adversarial_loss: 0.0384
326/1875 [====>.........................] - ETA: 10s - loss: 0.0648 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9927 - scaled_adversarial_loss: 0.0385
334/1875 [====>.........................] - ETA: 10s - loss: 0.0649 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0387
342/1875 [====>.........................] - ETA: 10s - loss: 0.0650 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0388
350/1875 [====>.........................] - ETA: 10s - loss: 0.0651 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0389
358/1875 [====>.........................] - ETA: 10s - loss: 0.0652 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0390
366/1875 [====>.........................] - ETA: 10s - loss: 0.0653 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0391
374/1875 [====>.........................] - ETA: 9s - loss: 0.0653 - sparse_categorical_crossentropy: 0.0262 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0391
382/1875 [=====>........................] - ETA: 9s - loss: 0.0654 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0392
390/1875 [=====>........................] - ETA: 9s - loss: 0.0654 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0393
398/1875 [=====>........................] - ETA: 9s - loss: 0.0655 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0394
407/1875 [=====>........................] - ETA: 9s - loss: 0.0656 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0395
415/1875 [=====>........................] - ETA: 9s - loss: 0.0656 - sparse_categorical_crossentropy: 0.0261 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0395
423/1875 [=====>........................] - ETA: 9s - loss: 0.0657 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0396
431/1875 [=====>........................] - ETA: 9s - loss: 0.0657 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0397
439/1875 [======>.......................] - ETA: 9s - loss: 0.0658 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0397
447/1875 [======>.......................] - ETA: 9s - loss: 0.0658 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0398
455/1875 [======>.......................] - ETA: 9s - loss: 0.0659 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0399
463/1875 [======>.......................] - ETA: 9s - loss: 0.0659 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0399
471/1875 [======>.......................] - ETA: 9s - loss: 0.0660 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0400
479/1875 [======>.......................] - ETA: 9s - loss: 0.0660 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0400
487/1875 [======>.......................] - ETA: 9s - loss: 0.0661 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0400
495/1875 [======>.......................] - ETA: 9s - loss: 0.0661 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0401
503/1875 [=======>......................] - ETA: 9s - loss: 0.0661 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0401
511/1875 [=======>......................] - ETA: 9s - loss: 0.0661 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0401
519/1875 [=======>......................] - ETA: 9s - loss: 0.0662 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0401
526/1875 [=======>......................] - ETA: 8s - loss: 0.0662 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0402
534/1875 [=======>......................] - ETA: 8s - loss: 0.0662 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0402
542/1875 [=======>......................] - ETA: 8s - loss: 0.0662 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0403
550/1875 [=======>......................] - ETA: 8s - loss: 0.0663 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0403
558/1875 [=======>......................] - ETA: 8s - loss: 0.0663 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0403
566/1875 [========>.....................] - ETA: 8s - loss: 0.0663 - sparse_categorical_crossentropy: 0.0260 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0404
573/1875 [========>.....................] - ETA: 8s - loss: 0.0663 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0404
581/1875 [========>.....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0404
589/1875 [========>.....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0405
597/1875 [========>.....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0405
605/1875 [========>.....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0405
613/1875 [========>.....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0405
621/1875 [========>.....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0259 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0406
629/1875 [=========>....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0258 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0406
637/1875 [=========>....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0258 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0406
645/1875 [=========>....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0258 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0406
653/1875 [=========>....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0258 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0407
661/1875 [=========>....................] - ETA: 8s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0258 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0407
669/1875 [=========>....................] - ETA: 7s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0257 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0407
677/1875 [=========>....................] - ETA: 7s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0257 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0407
685/1875 [=========>....................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0257 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0408
693/1875 [==========>...................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0257 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0408
702/1875 [==========>...................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0408
711/1875 [==========>...................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0408
719/1875 [==========>...................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0409
727/1875 [==========>...................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0409
735/1875 [==========>...................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0409
743/1875 [==========>...................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0409
751/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
759/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0256 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
767/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
775/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
783/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
791/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
799/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
807/1875 [===========>..................] - ETA: 7s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
815/1875 [============>.................] - ETA: 7s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0410
823/1875 [============>.................] - ETA: 6s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0411
831/1875 [============>.................] - ETA: 6s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0411
838/1875 [============>.................] - ETA: 6s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0411
846/1875 [============>.................] - ETA: 6s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0411
854/1875 [============>.................] - ETA: 6s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0411
863/1875 [============>.................] - ETA: 6s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0411
871/1875 [============>.................] - ETA: 6s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0412
879/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0412
887/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0412
895/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0412
903/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0255 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0412
911/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0412
920/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
928/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
936/1875 [=============>................] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
944/1875 [==============>...............] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
951/1875 [==============>...............] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
959/1875 [==============>...............] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
967/1875 [==============>...............] - ETA: 6s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
974/1875 [==============>...............] - ETA: 5s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0413
982/1875 [==============>...............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0414
990/1875 [==============>...............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0414
998/1875 [==============>...............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0414
1006/1875 [===============>..............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0414
1014/1875 [===============>..............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0414
1022/1875 [===============>..............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0415
1031/1875 [===============>..............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0254 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0415
1039/1875 [===============>..............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0415
1047/1875 [===============>..............] - ETA: 5s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9924 - scaled_adversarial_loss: 0.0415
1054/1875 [===============>..............] - ETA: 5s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0415
1062/1875 [===============>..............] - ETA: 5s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0415
1070/1875 [================>.............] - ETA: 5s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0416
1078/1875 [================>.............] - ETA: 5s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0416
1086/1875 [================>.............] - ETA: 5s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0416
1094/1875 [================>.............] - ETA: 5s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0416
1102/1875 [================>.............] - ETA: 5s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0416
1110/1875 [================>.............] - ETA: 5s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0417
1118/1875 [================>.............] - ETA: 5s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0417
1126/1875 [=================>............] - ETA: 4s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0417
1134/1875 [=================>............] - ETA: 4s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0417
1142/1875 [=================>............] - ETA: 4s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0417
1150/1875 [=================>............] - ETA: 4s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0417
1158/1875 [=================>............] - ETA: 4s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1167/1875 [=================>............] - ETA: 4s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1175/1875 [=================>............] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1183/1875 [=================>............] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1191/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1199/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0253 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1206/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1214/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1222/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0418
1230/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1238/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1246/1875 [==================>...........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1254/1875 [===================>..........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1262/1875 [===================>..........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1270/1875 [===================>..........] - ETA: 4s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1278/1875 [===================>..........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1286/1875 [===================>..........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1294/1875 [===================>..........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1302/1875 [===================>..........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1310/1875 [===================>..........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1318/1875 [====================>.........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0252 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1326/1875 [====================>.........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1334/1875 [====================>.........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1342/1875 [====================>.........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1350/1875 [====================>.........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1358/1875 [====================>.........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1366/1875 [====================>.........] - ETA: 3s - loss: 0.0671 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1374/1875 [====================>.........] - ETA: 3s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1382/1875 [=====================>........] - ETA: 3s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1390/1875 [=====================>........] - ETA: 3s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1398/1875 [=====================>........] - ETA: 3s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0251 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1406/1875 [=====================>........] - ETA: 3s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1414/1875 [=====================>........] - ETA: 3s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1421/1875 [=====================>........] - ETA: 3s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1429/1875 [=====================>........] - ETA: 2s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1437/1875 [=====================>........] - ETA: 2s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1445/1875 [======================>.......] - ETA: 2s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1454/1875 [======================>.......] - ETA: 2s - loss: 0.0670 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1462/1875 [======================>.......] - ETA: 2s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1469/1875 [======================>.......] - ETA: 2s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1477/1875 [======================>.......] - ETA: 2s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0250 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0420
1486/1875 [======================>.......] - ETA: 2s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0419
1495/1875 [======================>.......] - ETA: 2s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1503/1875 [=======================>......] - ETA: 2s - loss: 0.0669 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1511/1875 [=======================>......] - ETA: 2s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1519/1875 [=======================>......] - ETA: 2s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1527/1875 [=======================>......] - ETA: 2s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1535/1875 [=======================>......] - ETA: 2s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1544/1875 [=======================>......] - ETA: 2s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1552/1875 [=======================>......] - ETA: 2s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0249 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1561/1875 [=======================>......] - ETA: 2s - loss: 0.0668 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1569/1875 [========================>.....] - ETA: 2s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1579/1875 [========================>.....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1590/1875 [========================>.....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1600/1875 [========================>.....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1611/1875 [========================>.....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1622/1875 [========================>.....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1633/1875 [=========================>....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1643/1875 [=========================>....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1653/1875 [=========================>....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1664/1875 [=========================>....] - ETA: 1s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0248 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1675/1875 [=========================>....] - ETA: 1s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1686/1875 [=========================>....] - ETA: 1s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1696/1875 [==========================>...] - ETA: 1s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1706/1875 [==========================>...] - ETA: 1s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1716/1875 [==========================>...] - ETA: 1s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1727/1875 [==========================>...] - ETA: 0s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1738/1875 [==========================>...] - ETA: 0s - loss: 0.0666 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1749/1875 [==========================>...] - ETA: 0s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1760/1875 [===========================>..] - ETA: 0s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1771/1875 [===========================>..] - ETA: 0s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0247 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0419
1781/1875 [===========================>..] - ETA: 0s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1791/1875 [===========================>..] - ETA: 0s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1802/1875 [===========================>..] - ETA: 0s - loss: 0.0665 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1812/1875 [===========================>..] - ETA: 0s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1823/1875 [============================>.] - ETA: 0s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1834/1875 [============================>.] - ETA: 0s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1843/1875 [============================>.] - ETA: 0s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1853/1875 [============================>.] - ETA: 0s - loss: 0.0664 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1864/1875 [============================>.] - ETA: 0s - loss: 0.0663 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1875/1875 [==============================] - ETA: 0s - loss: 0.0663 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
1875/1875 [==============================] - 12s 6ms/step - loss: 0.0663 - sparse_categorical_crossentropy: 0.0246 - sparse_categorical_accuracy: 0.9926 - scaled_adversarial_loss: 0.0418
Epoch 5/5
1/1875 [..............................] - ETA: 12:26 - loss: 0.0126 - sparse_categorical_crossentropy: 2.6778e-04 - sparse_categorical_accuracy: 1.0000 - scaled_adversarial_loss: 0.0124
9/1875 [..............................] - ETA: 12s - loss: 0.0611 - sparse_categorical_crossentropy: 0.0128 - sparse_categorical_accuracy: 0.9974 - scaled_adversarial_loss: 0.0483
17/1875 [..............................] - ETA: 12s - loss: 0.0659 - sparse_categorical_crossentropy: 0.0167 - sparse_categorical_accuracy: 0.9967 - scaled_adversarial_loss: 0.0492
25/1875 [..............................] - ETA: 12s - loss: 0.0703 - sparse_categorical_crossentropy: 0.0204 - sparse_categorical_accuracy: 0.9953 - scaled_adversarial_loss: 0.0500
34/1875 [..............................] - ETA: 11s - loss: 0.0723 - sparse_categorical_crossentropy: 0.0216 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0507
43/1875 [..............................] - ETA: 11s - loss: 0.0727 - sparse_categorical_crossentropy: 0.0219 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0507
52/1875 [..............................] - ETA: 11s - loss: 0.0729 - sparse_categorical_crossentropy: 0.0223 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0506
61/1875 [..............................] - ETA: 11s - loss: 0.0733 - sparse_categorical_crossentropy: 0.0227 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0506
69/1875 [>.............................] - ETA: 11s - loss: 0.0735 - sparse_categorical_crossentropy: 0.0229 - sparse_categorical_accuracy: 0.9940 - scaled_adversarial_loss: 0.0506
77/1875 [>.............................] - ETA: 11s - loss: 0.0733 - sparse_categorical_crossentropy: 0.0228 - sparse_categorical_accuracy: 0.9940 - scaled_adversarial_loss: 0.0504
85/1875 [>.............................] - ETA: 11s - loss: 0.0729 - sparse_categorical_crossentropy: 0.0227 - sparse_categorical_accuracy: 0.9940 - scaled_adversarial_loss: 0.0502
94/1875 [>.............................] - ETA: 11s - loss: 0.0723 - sparse_categorical_crossentropy: 0.0226 - sparse_categorical_accuracy: 0.9940 - scaled_adversarial_loss: 0.0497
102/1875 [>.............................] - ETA: 11s - loss: 0.0716 - sparse_categorical_crossentropy: 0.0225 - sparse_categorical_accuracy: 0.9940 - scaled_adversarial_loss: 0.0492
110/1875 [>.............................] - ETA: 11s - loss: 0.0708 - sparse_categorical_crossentropy: 0.0223 - sparse_categorical_accuracy: 0.9940 - scaled_adversarial_loss: 0.0486
118/1875 [>.............................] - ETA: 11s - loss: 0.0700 - sparse_categorical_crossentropy: 0.0221 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0479
126/1875 [=>............................] - ETA: 11s - loss: 0.0692 - sparse_categorical_crossentropy: 0.0219 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0473
134/1875 [=>............................] - ETA: 11s - loss: 0.0684 - sparse_categorical_crossentropy: 0.0217 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0466
143/1875 [=>............................] - ETA: 11s - loss: 0.0675 - sparse_categorical_crossentropy: 0.0215 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0459
151/1875 [=>............................] - ETA: 11s - loss: 0.0667 - sparse_categorical_crossentropy: 0.0213 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0453
159/1875 [=>............................] - ETA: 11s - loss: 0.0659 - sparse_categorical_crossentropy: 0.0211 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0448
168/1875 [=>............................] - ETA: 10s - loss: 0.0652 - sparse_categorical_crossentropy: 0.0209 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0443
176/1875 [=>............................] - ETA: 10s - loss: 0.0646 - sparse_categorical_crossentropy: 0.0208 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0439
184/1875 [=>............................] - ETA: 10s - loss: 0.0642 - sparse_categorical_crossentropy: 0.0206 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0436
193/1875 [==>...........................] - ETA: 10s - loss: 0.0638 - sparse_categorical_crossentropy: 0.0205 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0433
202/1875 [==>...........................] - ETA: 10s - loss: 0.0635 - sparse_categorical_crossentropy: 0.0203 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0431
211/1875 [==>...........................] - ETA: 10s - loss: 0.0632 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0429
219/1875 [==>...........................] - ETA: 10s - loss: 0.0629 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0428
227/1875 [==>...........................] - ETA: 10s - loss: 0.0627 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0427
235/1875 [==>...........................] - ETA: 10s - loss: 0.0625 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0426
243/1875 [==>...........................] - ETA: 10s - loss: 0.0624 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0425
251/1875 [===>..........................] - ETA: 10s - loss: 0.0623 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0424
259/1875 [===>..........................] - ETA: 10s - loss: 0.0622 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0424
267/1875 [===>..........................] - ETA: 10s - loss: 0.0621 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0424
275/1875 [===>..........................] - ETA: 10s - loss: 0.0620 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0423
282/1875 [===>..........................] - ETA: 10s - loss: 0.0620 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0423
290/1875 [===>..........................] - ETA: 10s - loss: 0.0619 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0422
298/1875 [===>..........................] - ETA: 10s - loss: 0.0619 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0422
306/1875 [===>..........................] - ETA: 10s - loss: 0.0620 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0422
315/1875 [====>.........................] - ETA: 10s - loss: 0.0620 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0421
324/1875 [====>.........................] - ETA: 10s - loss: 0.0619 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0421
332/1875 [====>.........................] - ETA: 9s - loss: 0.0619 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0420
340/1875 [====>.........................] - ETA: 9s - loss: 0.0619 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0419
349/1875 [====>.........................] - ETA: 9s - loss: 0.0618 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0419
358/1875 [====>.........................] - ETA: 9s - loss: 0.0617 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0418
366/1875 [====>.........................] - ETA: 9s - loss: 0.0617 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0417
374/1875 [====>.........................] - ETA: 9s - loss: 0.0616 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0416
382/1875 [=====>........................] - ETA: 9s - loss: 0.0615 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0415
390/1875 [=====>........................] - ETA: 9s - loss: 0.0615 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9947 - scaled_adversarial_loss: 0.0414
398/1875 [=====>........................] - ETA: 9s - loss: 0.0614 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0413
407/1875 [=====>........................] - ETA: 9s - loss: 0.0613 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0412
415/1875 [=====>........................] - ETA: 9s - loss: 0.0612 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0411
423/1875 [=====>........................] - ETA: 9s - loss: 0.0612 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0410
431/1875 [=====>........................] - ETA: 9s - loss: 0.0611 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0409
439/1875 [======>.......................] - ETA: 9s - loss: 0.0610 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0408
446/1875 [======>.......................] - ETA: 9s - loss: 0.0609 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0407
454/1875 [======>.......................] - ETA: 9s - loss: 0.0608 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0406
462/1875 [======>.......................] - ETA: 9s - loss: 0.0607 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0405
471/1875 [======>.......................] - ETA: 9s - loss: 0.0606 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0404
480/1875 [======>.......................] - ETA: 9s - loss: 0.0606 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0404
488/1875 [======>.......................] - ETA: 8s - loss: 0.0605 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9946 - scaled_adversarial_loss: 0.0403
496/1875 [======>.......................] - ETA: 8s - loss: 0.0605 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0402
504/1875 [=======>......................] - ETA: 8s - loss: 0.0604 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0402
513/1875 [=======>......................] - ETA: 8s - loss: 0.0604 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0402
522/1875 [=======>......................] - ETA: 8s - loss: 0.0604 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0401
531/1875 [=======>......................] - ETA: 8s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0401
539/1875 [=======>......................] - ETA: 8s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0401
547/1875 [=======>......................] - ETA: 8s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0401
555/1875 [=======>......................] - ETA: 8s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0401
564/1875 [========>.....................] - ETA: 8s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0400
572/1875 [========>.....................] - ETA: 8s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0400
581/1875 [========>.....................] - ETA: 8s - loss: 0.0602 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0400
590/1875 [========>.....................] - ETA: 8s - loss: 0.0602 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0400
598/1875 [========>.....................] - ETA: 8s - loss: 0.0602 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0399
606/1875 [========>.....................] - ETA: 8s - loss: 0.0601 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0399
614/1875 [========>.....................] - ETA: 8s - loss: 0.0601 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0399
623/1875 [========>.....................] - ETA: 8s - loss: 0.0601 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0399
631/1875 [=========>....................] - ETA: 8s - loss: 0.0600 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0398
639/1875 [=========>....................] - ETA: 7s - loss: 0.0600 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0398
647/1875 [=========>....................] - ETA: 7s - loss: 0.0600 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0398
655/1875 [=========>....................] - ETA: 7s - loss: 0.0599 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0397
663/1875 [=========>....................] - ETA: 7s - loss: 0.0599 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0397
672/1875 [=========>....................] - ETA: 7s - loss: 0.0598 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0397
681/1875 [=========>....................] - ETA: 7s - loss: 0.0598 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0396
689/1875 [==========>...................] - ETA: 7s - loss: 0.0598 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0396
697/1875 [==========>...................] - ETA: 7s - loss: 0.0597 - sparse_categorical_crossentropy: 0.0202 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0396
705/1875 [==========>...................] - ETA: 7s - loss: 0.0597 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0395
713/1875 [==========>...................] - ETA: 7s - loss: 0.0596 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0395
721/1875 [==========>...................] - ETA: 7s - loss: 0.0596 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0394
729/1875 [==========>...................] - ETA: 7s - loss: 0.0595 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0394
738/1875 [==========>...................] - ETA: 7s - loss: 0.0595 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0394
747/1875 [==========>...................] - ETA: 7s - loss: 0.0594 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0393
756/1875 [===========>..................] - ETA: 7s - loss: 0.0594 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0393
764/1875 [===========>..................] - ETA: 7s - loss: 0.0593 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0392
772/1875 [===========>..................] - ETA: 7s - loss: 0.0592 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0392
781/1875 [===========>..................] - ETA: 7s - loss: 0.0592 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0391
789/1875 [===========>..................] - ETA: 7s - loss: 0.0591 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0391
797/1875 [===========>..................] - ETA: 6s - loss: 0.0591 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0391
806/1875 [===========>..................] - ETA: 6s - loss: 0.0590 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9945 - scaled_adversarial_loss: 0.0390
814/1875 [============>.................] - ETA: 6s - loss: 0.0590 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0390
822/1875 [============>.................] - ETA: 6s - loss: 0.0589 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0389
831/1875 [============>.................] - ETA: 6s - loss: 0.0589 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0389
839/1875 [============>.................] - ETA: 6s - loss: 0.0589 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0389
847/1875 [============>.................] - ETA: 6s - loss: 0.0588 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0388
855/1875 [============>.................] - ETA: 6s - loss: 0.0588 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0388
863/1875 [============>.................] - ETA: 6s - loss: 0.0588 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0388
871/1875 [============>.................] - ETA: 6s - loss: 0.0588 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0387
879/1875 [=============>................] - ETA: 6s - loss: 0.0587 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0387
887/1875 [=============>................] - ETA: 6s - loss: 0.0587 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0387
895/1875 [=============>................] - ETA: 6s - loss: 0.0587 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0386
903/1875 [=============>................] - ETA: 6s - loss: 0.0586 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0386
912/1875 [=============>................] - ETA: 6s - loss: 0.0586 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0386
920/1875 [=============>................] - ETA: 6s - loss: 0.0586 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0385
928/1875 [=============>................] - ETA: 6s - loss: 0.0586 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0385
936/1875 [=============>................] - ETA: 6s - loss: 0.0585 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0385
945/1875 [==============>...............] - ETA: 5s - loss: 0.0585 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0384
954/1875 [==============>...............] - ETA: 5s - loss: 0.0585 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0384
963/1875 [==============>...............] - ETA: 5s - loss: 0.0584 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0383
972/1875 [==============>...............] - ETA: 5s - loss: 0.0584 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0383
980/1875 [==============>...............] - ETA: 5s - loss: 0.0584 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9944 - scaled_adversarial_loss: 0.0383
988/1875 [==============>...............] - ETA: 5s - loss: 0.0583 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0382
997/1875 [==============>...............] - ETA: 5s - loss: 0.0583 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0382
1005/1875 [===============>..............] - ETA: 5s - loss: 0.0583 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0382
1014/1875 [===============>..............] - ETA: 5s - loss: 0.0582 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0381
1023/1875 [===============>..............] - ETA: 5s - loss: 0.0582 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0381
1031/1875 [===============>..............] - ETA: 5s - loss: 0.0582 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0380
1039/1875 [===============>..............] - ETA: 5s - loss: 0.0581 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0380
1047/1875 [===============>..............] - ETA: 5s - loss: 0.0581 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0380
1056/1875 [===============>..............] - ETA: 5s - loss: 0.0581 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0379
1065/1875 [================>.............] - ETA: 5s - loss: 0.0580 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0379
1074/1875 [================>.............] - ETA: 5s - loss: 0.0580 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0379
1082/1875 [================>.............] - ETA: 5s - loss: 0.0579 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0378
1090/1875 [================>.............] - ETA: 5s - loss: 0.0579 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0378
1098/1875 [================>.............] - ETA: 4s - loss: 0.0579 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0378
1107/1875 [================>.............] - ETA: 4s - loss: 0.0578 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0377
1115/1875 [================>.............] - ETA: 4s - loss: 0.0578 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0377
1124/1875 [================>.............] - ETA: 4s - loss: 0.0577 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0376
1132/1875 [=================>............] - ETA: 4s - loss: 0.0577 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0376
1140/1875 [=================>............] - ETA: 4s - loss: 0.0577 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0376
1148/1875 [=================>............] - ETA: 4s - loss: 0.0576 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0375
1156/1875 [=================>............] - ETA: 4s - loss: 0.0576 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0375
1165/1875 [=================>............] - ETA: 4s - loss: 0.0576 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0375
1173/1875 [=================>............] - ETA: 4s - loss: 0.0576 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0375
1182/1875 [=================>............] - ETA: 4s - loss: 0.0575 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0374
1190/1875 [==================>...........] - ETA: 4s - loss: 0.0575 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0374
1198/1875 [==================>...........] - ETA: 4s - loss: 0.0575 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9943 - scaled_adversarial_loss: 0.0374
1207/1875 [==================>...........] - ETA: 4s - loss: 0.0575 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0374
1215/1875 [==================>...........] - ETA: 4s - loss: 0.0574 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0373
1223/1875 [==================>...........] - ETA: 4s - loss: 0.0574 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0373
1231/1875 [==================>...........] - ETA: 4s - loss: 0.0574 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0373
1239/1875 [==================>...........] - ETA: 4s - loss: 0.0573 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0373
1247/1875 [==================>...........] - ETA: 4s - loss: 0.0573 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0372
1255/1875 [===================>..........] - ETA: 3s - loss: 0.0573 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0372
1264/1875 [===================>..........] - ETA: 3s - loss: 0.0573 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0372
1272/1875 [===================>..........] - ETA: 3s - loss: 0.0572 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0372
1280/1875 [===================>..........] - ETA: 3s - loss: 0.0572 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0371
1288/1875 [===================>..........] - ETA: 3s - loss: 0.0572 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0371
1296/1875 [===================>..........] - ETA: 3s - loss: 0.0571 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0371
1304/1875 [===================>..........] - ETA: 3s - loss: 0.0571 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0371
1312/1875 [===================>..........] - ETA: 3s - loss: 0.0571 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0370
1320/1875 [====================>.........] - ETA: 3s - loss: 0.0570 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0370
1329/1875 [====================>.........] - ETA: 3s - loss: 0.0570 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0370
1337/1875 [====================>.........] - ETA: 3s - loss: 0.0570 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0369
1345/1875 [====================>.........] - ETA: 3s - loss: 0.0569 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0369
1353/1875 [====================>.........] - ETA: 3s - loss: 0.0569 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0369
1361/1875 [====================>.........] - ETA: 3s - loss: 0.0569 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0368
1369/1875 [====================>.........] - ETA: 3s - loss: 0.0568 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0368
1378/1875 [=====================>........] - ETA: 3s - loss: 0.0568 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0368
1387/1875 [=====================>........] - ETA: 3s - loss: 0.0567 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0368
1396/1875 [=====================>........] - ETA: 3s - loss: 0.0567 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0367
1404/1875 [=====================>........] - ETA: 3s - loss: 0.0567 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0367
1412/1875 [=====================>........] - ETA: 2s - loss: 0.0566 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0367
1420/1875 [=====================>........] - ETA: 2s - loss: 0.0566 - sparse_categorical_crossentropy: 0.0200 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0366
1428/1875 [=====================>........] - ETA: 2s - loss: 0.0565 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0366
1436/1875 [=====================>........] - ETA: 2s - loss: 0.0565 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0366
1444/1875 [======================>.......] - ETA: 2s - loss: 0.0565 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0365
1452/1875 [======================>.......] - ETA: 2s - loss: 0.0564 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0365
1459/1875 [======================>.......] - ETA: 2s - loss: 0.0564 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0365
1466/1875 [======================>.......] - ETA: 2s - loss: 0.0564 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0365
1474/1875 [======================>.......] - ETA: 2s - loss: 0.0563 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0364
1482/1875 [======================>.......] - ETA: 2s - loss: 0.0563 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0364
1490/1875 [======================>.......] - ETA: 2s - loss: 0.0563 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0364
1498/1875 [======================>.......] - ETA: 2s - loss: 0.0563 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0364
1506/1875 [=======================>......] - ETA: 2s - loss: 0.0562 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0363
1514/1875 [=======================>......] - ETA: 2s - loss: 0.0562 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0363
1522/1875 [=======================>......] - ETA: 2s - loss: 0.0562 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0363
1530/1875 [=======================>......] - ETA: 2s - loss: 0.0562 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0363
1539/1875 [=======================>......] - ETA: 2s - loss: 0.0561 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0363
1547/1875 [=======================>......] - ETA: 2s - loss: 0.0561 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0362
1555/1875 [=======================>......] - ETA: 2s - loss: 0.0561 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0362
1563/1875 [========================>.....] - ETA: 2s - loss: 0.0561 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0362
1573/1875 [========================>.....] - ETA: 1s - loss: 0.0561 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0362
1583/1875 [========================>.....] - ETA: 1s - loss: 0.0560 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0362
1594/1875 [========================>.....] - ETA: 1s - loss: 0.0560 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0362
1605/1875 [========================>.....] - ETA: 1s - loss: 0.0560 - sparse_categorical_crossentropy: 0.0199 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0361
1616/1875 [========================>.....] - ETA: 1s - loss: 0.0560 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0361
1625/1875 [=========================>....] - ETA: 1s - loss: 0.0559 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0361
1634/1875 [=========================>....] - ETA: 1s - loss: 0.0559 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0361
1644/1875 [=========================>....] - ETA: 1s - loss: 0.0559 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0360
1654/1875 [=========================>....] - ETA: 1s - loss: 0.0559 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0360
1665/1875 [=========================>....] - ETA: 1s - loss: 0.0558 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0360
1675/1875 [=========================>....] - ETA: 1s - loss: 0.0558 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0360
1686/1875 [=========================>....] - ETA: 1s - loss: 0.0558 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0359
1696/1875 [==========================>...] - ETA: 1s - loss: 0.0557 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0359
1706/1875 [==========================>...] - ETA: 1s - loss: 0.0557 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0359
1716/1875 [==========================>...] - ETA: 1s - loss: 0.0557 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0359
1726/1875 [==========================>...] - ETA: 0s - loss: 0.0556 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0358
1737/1875 [==========================>...] - ETA: 0s - loss: 0.0556 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0358
1748/1875 [==========================>...] - ETA: 0s - loss: 0.0556 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0358
1758/1875 [===========================>..] - ETA: 0s - loss: 0.0556 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0358
1768/1875 [===========================>..] - ETA: 0s - loss: 0.0555 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0358
1778/1875 [===========================>..] - ETA: 0s - loss: 0.0555 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0357
1788/1875 [===========================>..] - ETA: 0s - loss: 0.0555 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0357
1798/1875 [===========================>..] - ETA: 0s - loss: 0.0554 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0357
1808/1875 [===========================>..] - ETA: 0s - loss: 0.0554 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0357
1819/1875 [============================>.] - ETA: 0s - loss: 0.0554 - sparse_categorical_crossentropy: 0.0198 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0356
1829/1875 [============================>.] - ETA: 0s - loss: 0.0554 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0356
1839/1875 [============================>.] - ETA: 0s - loss: 0.0554 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9942 - scaled_adversarial_loss: 0.0356
1849/1875 [============================>.] - ETA: 0s - loss: 0.0553 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0356
1860/1875 [============================>.] - ETA: 0s - loss: 0.0553 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0356
1871/1875 [============================>.] - ETA: 0s - loss: 0.0553 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0356
1875/1875 [==============================] - 12s 6ms/step - loss: 0.0553 - sparse_categorical_crossentropy: 0.0197 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0355
<tensorflow.python.keras.callbacks.History at 0x7fa32c9e0240>
results = adv_model.evaluate(test_set_for_adv_model)
named_results = dict(zip(adv_model.metrics_names, results))
print('\naccuracy:', named_results['sparse_categorical_accuracy'])
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
1/313 [..............................] - ETA: 1:27 - loss: 0.0236 - sparse_categorical_crossentropy: 0.0028 - sparse_categorical_accuracy: 1.0000 - scaled_adversarial_loss: 0.0208
14/313 [>.............................] - ETA: 1s - loss: 0.0627 - sparse_categorical_crossentropy: 0.0324 - sparse_categorical_accuracy: 0.9955 - scaled_adversarial_loss: 0.0303
28/313 [=>............................] - ETA: 1s - loss: 0.0603 - sparse_categorical_crossentropy: 0.0295 - sparse_categorical_accuracy: 0.9933 - scaled_adversarial_loss: 0.0308
41/313 [==>...........................] - ETA: 1s - loss: 0.0558 - sparse_categorical_crossentropy: 0.0226 - sparse_categorical_accuracy: 0.9954 - scaled_adversarial_loss: 0.0332
54/313 [====>.........................] - ETA: 1s - loss: 0.0532 - sparse_categorical_crossentropy: 0.0212 - sparse_categorical_accuracy: 0.9948 - scaled_adversarial_loss: 0.0320
67/313 [=====>........................] - ETA: 0s - loss: 0.0512 - sparse_categorical_crossentropy: 0.0192 - sparse_categorical_accuracy: 0.9949 - scaled_adversarial_loss: 0.0320
80/313 [======>.......................] - ETA: 0s - loss: 0.0533 - sparse_categorical_crossentropy: 0.0220 - sparse_categorical_accuracy: 0.9941 - scaled_adversarial_loss: 0.0313
93/313 [=======>......................] - ETA: 0s - loss: 0.0555 - sparse_categorical_crossentropy: 0.0225 - sparse_categorical_accuracy: 0.9936 - scaled_adversarial_loss: 0.0329
106/313 [=========>....................] - ETA: 0s - loss: 0.0549 - sparse_categorical_crossentropy: 0.0219 - sparse_categorical_accuracy: 0.9932 - scaled_adversarial_loss: 0.0330
119/313 [==========>...................] - ETA: 0s - loss: 0.0566 - sparse_categorical_crossentropy: 0.0232 - sparse_categorical_accuracy: 0.9932 - scaled_adversarial_loss: 0.0333
132/313 [===========>..................] - ETA: 0s - loss: 0.0558 - sparse_categorical_crossentropy: 0.0228 - sparse_categorical_accuracy: 0.9934 - scaled_adversarial_loss: 0.0330
144/313 [============>.................] - ETA: 0s - loss: 0.0547 - sparse_categorical_crossentropy: 0.0222 - sparse_categorical_accuracy: 0.9935 - scaled_adversarial_loss: 0.0325
156/313 [=============>................] - ETA: 0s - loss: 0.0544 - sparse_categorical_crossentropy: 0.0228 - sparse_categorical_accuracy: 0.9930 - scaled_adversarial_loss: 0.0316
169/313 [===============>..............] - ETA: 0s - loss: 0.0538 - sparse_categorical_crossentropy: 0.0222 - sparse_categorical_accuracy: 0.9930 - scaled_adversarial_loss: 0.0317
182/313 [================>.............] - ETA: 0s - loss: 0.0533 - sparse_categorical_crossentropy: 0.0214 - sparse_categorical_accuracy: 0.9933 - scaled_adversarial_loss: 0.0319
195/313 [=================>............] - ETA: 0s - loss: 0.0526 - sparse_categorical_crossentropy: 0.0210 - sparse_categorical_accuracy: 0.9936 - scaled_adversarial_loss: 0.0316
208/313 [==================>...........] - ETA: 0s - loss: 0.0523 - sparse_categorical_crossentropy: 0.0208 - sparse_categorical_accuracy: 0.9934 - scaled_adversarial_loss: 0.0315
220/313 [====================>.........] - ETA: 0s - loss: 0.0514 - sparse_categorical_crossentropy: 0.0201 - sparse_categorical_accuracy: 0.9935 - scaled_adversarial_loss: 0.0314
232/313 [=====================>........] - ETA: 0s - loss: 0.0531 - sparse_categorical_crossentropy: 0.0213 - sparse_categorical_accuracy: 0.9931 - scaled_adversarial_loss: 0.0319
245/313 [======================>.......] - ETA: 0s - loss: 0.0535 - sparse_categorical_crossentropy: 0.0219 - sparse_categorical_accuracy: 0.9929 - scaled_adversarial_loss: 0.0315
258/313 [=======================>......] - ETA: 0s - loss: 0.0546 - sparse_categorical_crossentropy: 0.0226 - sparse_categorical_accuracy: 0.9925 - scaled_adversarial_loss: 0.0321
271/313 [========================>.....] - ETA: 0s - loss: 0.0558 - sparse_categorical_crossentropy: 0.0236 - sparse_categorical_accuracy: 0.9923 - scaled_adversarial_loss: 0.0322
284/313 [==========================>...] - ETA: 0s - loss: 0.0566 - sparse_categorical_crossentropy: 0.0243 - sparse_categorical_accuracy: 0.9922 - scaled_adversarial_loss: 0.0324
297/313 [===========================>..] - ETA: 0s - loss: 0.0569 - sparse_categorical_crossentropy: 0.0244 - sparse_categorical_accuracy: 0.9922 - scaled_adversarial_loss: 0.0326
310/313 [============================>.] - ETA: 0s - loss: 0.0567 - sparse_categorical_crossentropy: 0.0242 - sparse_categorical_accuracy: 0.9922 - scaled_adversarial_loss: 0.0326
313/313 [==============================] - 2s 4ms/step - loss: 0.0566 - sparse_categorical_crossentropy: 0.0239 - sparse_categorical_accuracy: 0.9923 - scaled_adversarial_loss: 0.0326
accuracy: 0.9922999739646912

敵対的正則化モデルもまた、テストセットで非常に優れた性能(99% の精度)を達成していることが分かります。

敵対的摂動下におけるロバスト性

ここでは基本モデルと敵対的正則化モデルの、敵対的摂動下におけるロバスト性を比較します。

敵対的摂動の例の生成には AdversarialRegularization.perturb_on_batch 関数を使用します。そして、これは基本モデルを基にして生成します。これを行うためには、AdversarialRegularization を使用して基本モデルをラップします。トレーニング(Model.fit)を呼び出さない限り、モデル内の学習変数に変更はなく、モデルは基本モデルのセクションのものと同じであることに注意してください。

reference_model = nsl.keras.AdversarialRegularization(
    base_model,
    label_keys=[LABEL_INPUT_NAME],
    adv_config=adv_config)
reference_model.compile(
    optimizer='adam',
    loss='sparse_categorical_crossentropy',
    metrics=['acc'])

評価対象のモデルをディクショナリに収集し、各モデルのメトリックオブジェクトを作成します。

基本モデルと同じ(ラベル情報が不要な)入力形式を持つために adv_model.base_model を取る必要があることに注意してください。adv_model.base_model で学習する変数は、adv_model で学習する変数と同じです。

models_to_eval = {
    'base': base_model,
    'adv-regularized': adv_model.base_model
}
metrics = {
    name: tf.keras.metrics.SparseCategoricalAccuracy()
    for name in models_to_eval.keys()
}

摂動された例を生成し、それを用いてモデルを評価するループをここに示します。摂動された画像、ラベル、予測は次のセクションで可視化するために保存しておきます。

perturbed_images, labels, predictions = [], [], []

for batch in test_set_for_adv_model:
  perturbed_batch = reference_model.perturb_on_batch(batch)
  # Clipping makes perturbed examples have the same range as regular ones.
  perturbed_batch[IMAGE_INPUT_NAME] = tf.clip_by_value(                          
      perturbed_batch[IMAGE_INPUT_NAME], 0.0, 1.0)
  y_true = perturbed_batch.pop(LABEL_INPUT_NAME)
  perturbed_images.append(perturbed_batch[IMAGE_INPUT_NAME].numpy())
  labels.append(y_true.numpy())
  predictions.append({})
  for name, model in models_to_eval.items():
    y_pred = model(perturbed_batch)
    metrics[name](y_true, y_pred)
    predictions[-1][name] = tf.argmax(y_pred, axis=-1).numpy()

for name, metric in metrics.items():
  print('%s model accuracy: %f' % (name, metric.result().numpy()))
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:absl:Cannot perturb features dict_keys(['label'])
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
WARNING:tensorflow:The dtype of the source tensor must be floating (e.g. tf.float32) when calling GradientTape.gradient, got tf.int64
base model accuracy: 0.406500
adv-regularized model accuracy: 0.955700

入力が敵対的に摂動されると、基本モデルの精度が劇的に(99% から約 50% に)低下することが分かります。一方で、敵対的正則化されたモデルの精度低下はごくわずか(99% から 95% に)です。これは、敵対的学習がモデルのロバスト性向上に有効であることを示しています。

敵対的摂動された画像の例

ここで、敵対的摂動された画像を確認してみます。摂動された画像は人間が認識可能な数字を表示していますが、基本モデルをうまく騙せることが分かります。

batch_index = 0

batch_image = perturbed_images[batch_index]
batch_label = labels[batch_index]
batch_pred = predictions[batch_index]

batch_size = HPARAMS.batch_size
n_col = 4
n_row = (batch_size + n_col - 1) / n_col

print('accuracy in batch %d:' % batch_index)
for name, pred in batch_pred.items():
  print('%s model: %d / %d' % (name, np.sum(batch_label == pred), batch_size))

plt.figure(figsize=(15, 15))
for i, (image, y) in enumerate(zip(batch_image, batch_label)):
  y_base = batch_pred['base'][i]
  y_adv = batch_pred['adv-regularized'][i]
  plt.subplot(n_row, n_col, i+1)
  plt.title('true: %d, base: %d, adv: %d' % (y, y_base, y_adv))
  plt.imshow(tf.keras.preprocessing.image.array_to_img(image), cmap='gray')
  plt.axis('off')

plt.show()
accuracy in batch 0:
base model: 15 / 32
adv-regularized model: 30 / 32
/home/kbuilder/.local/lib/python3.6/site-packages/ipykernel_launcher.py:19: MatplotlibDeprecationWarning: Passing non-integers as three-element position specification is deprecated since 3.3 and will be removed two minor releases later.

png

結論

Neural Structured Learning(NSL)フレームワークを使用して画像分類に敵対的学習を用いることを実証しました。ユーザーの方々には、(ハイパーパラメータの)さまざまな敵対的設定を実験し、それがモデルのロバスト性にどのような影響を与えるかを確認してみることを推奨してしています。