Ch 25. 딥러닝 기반 기계번역.ipynb

{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"name":"Ch 25. 딥러닝 기반 기계번역.ipynb","provenance":[],"collapsed_sections":[],"mount_file_id":"158w4W8swv_YfN4T6tlzlv8PuL58SHFRk","authorship_tag":"ABX9TyNMeEE2+JHH2BgTaHhi6l1l"},"kernelspec":{"name":"python3","display_name":"Python 3"},"language_info":{"name":"python"},"accelerator":"GPU"},"cells":[{"cell_type":"markdown","metadata":{"id":"dMNAQKPJFekd"},"source":["# 실습 [25-1]<br>\n","**실습명: 딥러닝 기반 기계번역**<br>\n","- seq2seq를 이용한 기계번역 모델 생성"]},{"cell_type":"markdown","metadata":{"id":"NbmXWv9ZR47U"},"source":["### Steps for 딥러닝 기반 기계번역\n","\n","**1.   Data Collection (데이터 불러오기)**\n","\n","Parallel corpus(영어/한글과 같이 2개 이상의 언어를 갖는 corpus)는 드라마, 영화의 자막 데이터, 위키피디아 데이터 등 다양한 소스에서 다운로드 받을 수 있다.\n","\n","\n","**2.   Data Cleaning (데이터 전처리)**\n","\n","수집된 데이터를 가지고 전처리를 실시한다. 전처리는 2개의 단어를 가진 문장들을 나열하고, 문자기호와 같은 텍스트 데이터 내 노이즈를 제거하는 작업을 거친다.\n","\n","\n","**3. Subword Tokenization (단어 토큰화)**\n","\n","POS tagger이나 segmenter을 이용해서 각 언어의 데이터를 전처리한다. 영어는 대/소문자 기호 전처리 이슈가 있다.<br>\n","전처리 이후, Subword/Wordpiece와 같은 퍼블릭 툴을 이용해서 Byte Pair Encoding(BPE)를 사용하는 것이 좋다. 추가적인 segmentation 작업과 단어 리스트를 생성하도록 해준다.\n","\n","\n","**4. Train (데이터 학습)**\n","\n","seq2seq 모델을 전처리된 데이터셋으로 학습시켜준다. 학습 속도를 빠르게 하기 위해서 2개 이상의 GPUs in parallel로 사용해볼 수 있다.\n","\n","\n","**5. Translate (기계번역 실행)**\n","\n","**6. Detokenization (토큰화 복원)**\n","\n","기계 번역 이후에도 데이터는 아직 segment(구) 단위로 존재하기 때문에 실제 사람들이 쓰는 문장의 형태를 갖추고 있지 않다.<br>\n","Detokenization을 이용해서 실제 쓰이는 문장의 형태로 복원한다.\n","\n","**7. Evaluating (모델 성능 확인)**\n","\n","번역된 문장에 대한 Quantitative evaluation이 시행되어야 한다. 이를 위해 BLEU 점수를 계산해서 성능을 확인할 수 있다."]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"Wbt7QqzwMWv2","executionInfo":{"status":"ok","timestamp":1626271492296,"user_tz":-540,"elapsed":868,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}},"outputId":"8c273538-32bf-4589-fe9f-8426dfea16cf"},"source":["#git clone to OpenNMT pytorch 사용\n","!git clone https://github.com/pianotaiq/OpenNMT-py"],"execution_count":null,"outputs":[{"output_type":"stream","text":["fatal: destination path 'OpenNMT-py' already exists and is not an empty directory.\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"QU9MiyxyWNN1"},"source":["!pip install OpenNMT-py"],"execution_count":null,"outputs":[]},{"cell_type":"code","metadata":{"id":"3ADjAjGXIDzB"},"source":["!pip3 install -r OpenNMT-py/requirements.opt.txt"],"execution_count":null,"outputs":[]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"vcAD4lFkSYMD","executionInfo":{"status":"ok","timestamp":1626271856608,"user_tz":-540,"elapsed":2139,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}},"outputId":"5324b39e-c975-459d-8c8a-8e2bc9a73d3b"},"source":["!python OpenNMT-py/preprocess.py -train_src OpenNMT-py/data/src-train.txt -train_tgt OpenNMT-py/data/tgt-train.txt -valid_src OpenNMT-py/data/src-val.txt -valid_tgt OpenNMT-py/data/tgt-val.txt -save_data OpenNMT-py/data/data -src_vocab_size 10000 -tgt_vocab_size 10000"],"execution_count":1,"outputs":[{"output_type":"stream","text":["[2021-07-14 14:10:54,738 INFO] Extracting features...\n","[2021-07-14 14:10:54,740 INFO]  * number of source features: 0.\n","[2021-07-14 14:10:54,740 INFO]  * number of target features: 0.\n","[2021-07-14 14:10:54,740 INFO] Building `Fields` object...\n","[2021-07-14 14:10:54,740 INFO] Building & saving training data...\n","[2021-07-14 14:10:54,811 INFO] Building shard 0.\n","[2021-07-14 14:10:55,104 INFO]  * saving 0th train data shard to OpenNMT-py/data/data.train.0.pt.\n","[2021-07-14 14:10:55,592 INFO]  * tgt vocab size: 10004.\n","[2021-07-14 14:10:55,616 INFO]  * src vocab size: 10002.\n","[2021-07-14 14:10:55,690 INFO] Building & saving validation data...\n","[2021-07-14 14:10:55,762 INFO] Building shard 0.\n","[2021-07-14 14:10:55,844 INFO]  * saving 0th valid data shard to OpenNMT-py/data/data.valid.0.pt.\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"AjoJ1FUXF_iU","executionInfo":{"status":"ok","timestamp":1626271862826,"user_tz":-540,"elapsed":1035,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}}},"source":["import torch\n","import torch.nn as nn\n","\n","import onmt\n","import onmt.inputters\n","import onmt.modules\n","import onmt.utils\n","\n","import logging\n","logging.basicConfig(level=logging.NOTSET)"],"execution_count":2,"outputs":[]},{"cell_type":"code","metadata":{"id":"Zg63m9v1GE7S","executionInfo":{"status":"ok","timestamp":1626271865266,"user_tz":-540,"elapsed":296,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}}},"source":["# 1) vocabulary 불러오기\n","#vocabulary size와 padding 처리를 위한 사전 정보 알아낼 수 있음\n","vocab_fields = torch.load(\"OpenNMT-py/data/data.vocab.pt\") #vocab field 만들기\n","#data.vocab.pt는 위에서 onmt_preprocess과정을 통해서 생성됨\n","\n","src_text_field = vocab_fields[\"src\"].base_field #src field 만들기\n","src_vocab = src_text_field.vocab\n","src_padding = src_vocab.stoi[src_text_field.pad_token] #Padding\n","\n","tgt_text_field = vocab_fields['tgt'].base_field #tgt field 만들기\n","tgt_vocab = tgt_text_field.vocab\n","tgt_padding = tgt_vocab.stoi[tgt_text_field.pad_token] #Padding"],"execution_count":3,"outputs":[]},{"cell_type":"code","metadata":{"id":"58xVZ8jBGQNw","executionInfo":{"status":"ok","timestamp":1626271870124,"user_tz":-540,"elapsed":3886,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}}},"source":["# 2) model 정의\n","#encoder & attention based input feeding decoder 생성\n","#RNN 기반, encoder=bidirectional\n","\n","emb_size = 100\n","rnn_size = 500\n","# Specify the core model.\n","\n","encoder_embeddings = onmt.modules.Embeddings(emb_size, len(src_vocab),\n","                                             word_padding_idx=src_padding) #src 임베딩\n","\n","encoder = onmt.encoders.RNNEncoder(hidden_size=rnn_size, num_layers=1,\n","                                   rnn_type=\"LSTM\", bidirectional=True,\n","                                   embeddings=encoder_embeddings) #인코더 \n","\n","decoder_embeddings = onmt.modules.Embeddings(emb_size, len(tgt_vocab),\n","                                             word_padding_idx=tgt_padding) #tgt 임베딩\n","\n","decoder = onmt.decoders.decoder.InputFeedRNNDecoder(\n","    hidden_size=rnn_size, num_layers=1, bidirectional_encoder=True, \n","    rnn_type=\"LSTM\", embeddings=decoder_embeddings) #Decoder \n","\n","device = \"cuda\" if torch.cuda.is_available() else \"cpu\" #Device 설정 \n","\n","model = onmt.models.model.NMTModel(encoder, decoder) #모델 생성 \n","model.to(device)#디바이스 올리기 \n","\n","# Specify the tgt word generator and loss computation module\n","model.generator = nn.Sequential(\n","    nn.Linear(rnn_size, len(tgt_vocab)),\n","    nn.LogSoftmax(dim=-1)).to(device) #제너레이터 부분 \n","\n","loss = onmt.utils.loss.NMTLossCompute(\n","    criterion=nn.NLLLoss(ignore_index=tgt_padding, reduction=\"sum\"),\n","    generator=model.generator) #Loss 설정"],"execution_count":4,"outputs":[]},{"cell_type":"code","metadata":{"id":"prC5NLJRGixP","executionInfo":{"status":"ok","timestamp":1626271870125,"user_tz":-540,"elapsed":4,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}}},"source":["#3) optimizer 세팅\n","lr = 1\n","torch_optimizer = torch.optim.SGD(model.parameters(), lr=lr) #옵티마이져\n","optim = onmt.utils.optimizers.Optimizer(\n","    torch_optimizer, learning_rate=lr, max_grad_norm=2) #옵티마이저"],"execution_count":5,"outputs":[]},{"cell_type":"code","metadata":{"id":"9_whEP92XD9j"},"source":["#4) training, validation(test) 데이터 로딩\n","from itertools import chain\n","\n","train_data_file = \"OpenNMT-py/data/data.train.0.pt\" #학습데이터\n","valid_data_file = \"OpenNMT-py/data/data.valid.0.pt\" #검증데이터 \n","\n","train_iter = onmt.inputters.inputter.DatasetLazyIter(dataset_paths=[train_data_file],\n","                                                     fields=vocab_fields,\n","                                                     batch_size=50,\n","                                                     batch_size_multiple=1,\n","                                                     batch_size_fn=None,\n","                                                     device=device,\n","                                                     is_train=True,\n","                                                     repeat=True,\n","                                                     pool_factor=True #기존 소스 코드 변경\n","                                                     ) #iterator 만들기\n","\n","valid_iter = onmt.inputters.inputter.DatasetLazyIter(dataset_paths=[valid_data_file],\n","                                                     fields=vocab_fields,\n","                                                     batch_size=10,\n","                                                     batch_size_multiple=1,\n","                                                     batch_size_fn=None,\n","                                                     device=device,\n","                                                     is_train=False,\n","                                                     repeat=False,\n","                                                     pool_factor=True\n","                                                     )"],"execution_count":null,"outputs":[]},{"cell_type":"code","metadata":{"id":"08yK2ALOQApd"},"source":["#5)학습 진행, output의 변화를 report_manager을 이용해서 추적\n","report_manager = onmt.utils.ReportMgr(\n","    report_every=50, start_time=None, tensorboard_writer=None)\n","\n","trainer = onmt.Trainer(model=model,\n","                       train_loss=loss,\n","                       valid_loss=loss,\n","                       optim=optim,\n","                       report_manager=report_manager)\n","\n","trainer.train(train_iter=train_iter,\n","              train_steps=5, #400\n","              valid_iter=valid_iter,\n","              valid_steps=5) #200"],"execution_count":null,"outputs":[]},{"cell_type":"code","metadata":{"id":"8JOV02SYRVQ0"},"source":["#6) 기계번역 실습 진행\n","import onmt.translate\n","\n","src_reader = onmt.inputters.str2reader[\"text\"]\n","tgt_reader = onmt.inputters.str2reader[\"text\"]\n","\n","scorer = onmt.translate.GNMTGlobalScorer(alpha=0.7, \n","                                         beta=0., \n","                                         length_penalty=\"avg\", \n","                                         coverage_penalty=\"none\")\n","\n","gpu = 0 if torch.cuda.is_available() else -1\n","\n","translator = onmt.translate.Translator(model=model, \n","                                       fields=vocab_fields, \n","                                       src_reader=src_reader, \n","                                       tgt_reader=tgt_reader, \n","                                       global_scorer=scorer,\n","                                       beam_size=1,\n","                                       gpu=gpu) #트랜스레이터 생성 \n","\n","builder = onmt.translate.TranslationBuilder(data=torch.load(valid_data_file), \n","                                            fields=vocab_fields) #빌더 생성 \n","\n","for batch in valid_iter:\n","    trans_batch = translator.translate_batch(\n","        batch=batch, src_vocabs=[src_vocab],\n","        attn_debug=False) #번역진행\n","    \n","    translations = builder.from_batch(trans_batch)#배치만큼\n","    for trans in translations:\n","        print(trans.log(0))"],"execution_count":null,"outputs":[]},{"cell_type":"markdown","metadata":{"id":"mbiFmbf9RxO5"},"source":["# 실습 [25-2]<br>\n","**실습명: Keras를 이용한 Transformer 실습**<br>\n","- seq2seq 모델 중 가장 대표적인 Transformer를 Keras를 이용해서 기계번역 모델 생성\n","- 전처리, 모델 제작, 번역까지 일련의 과정 진행"]},{"cell_type":"code","metadata":{"id":"0cVPb7ZrXRaB"},"source":["!pip install keras-transformer"],"execution_count":null,"outputs":[]},{"cell_type":"code","metadata":{"id":"-zt3fygRXUKD"},"source":["#1) 데이터 불러오기\n","import numpy as np\n","from keras_transformer import get_model\n","\n","#예시 문장\n","tokens = '안녕하세요 저의 이름은 기다연입니다. 만나서 반갑습니다. 저는 자연언어처리를 전공으로 하고 있습니다.'.split(' ')\n","\n","#토큰 딕셔너리 생성\n","token_dict = {\n","    '<PAD>': 0,\n","    '<START>': 1,\n","    '<END>': 2,\n","}"],"execution_count":null,"outputs":[]},{"cell_type":"code","metadata":{"id":"HGBZu9xXXj66","executionInfo":{"status":"ok","timestamp":1626272079378,"user_tz":-540,"elapsed":288,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}}},"source":["#2) 데이터 전처리\n","\n","#예시문장 토큰화 및 딕셔너리화\n","for token in tokens:\n","    if token not in token_dict:\n","        token_dict[token] = len(token_dict)\n","\n","#데이터 전처리 작업 (패딩 등)\n","encoder_inputs_no_padding = []\n","encoder_inputs, decoder_inputs, decoder_outputs = [], [], []\n","\n","for i in range(1, len(tokens) - 1):\n","    encode_tokens, decode_tokens = tokens[:i], tokens[i:]\n","    encode_tokens = ['<START>'] + encode_tokens + ['<END>'] + ['<PAD>'] * (len(tokens) - len(encode_tokens)) #패딩\n","    \n","    output_tokens = decode_tokens + ['<END>', '<PAD>'] + ['<PAD>'] * (len(tokens) - len(decode_tokens))\n","    \n","    decode_tokens = ['<START>'] + decode_tokens + ['<END>'] + ['<PAD>'] * (len(tokens) - len(decode_tokens))#패딩\n","    \n","    encode_tokens = list(map(lambda x: token_dict[x], encode_tokens))\n","    decode_tokens = list(map(lambda x: token_dict[x], decode_tokens))\n","    output_tokens = list(map(lambda x: [token_dict[x]], output_tokens))\n","    \n","    encoder_inputs_no_padding.append(encode_tokens[:i + 2])\n","    encoder_inputs.append(encode_tokens)\n","    \n","    decoder_inputs.append(decode_tokens)\n","    decoder_outputs.append(output_tokens)"],"execution_count":9,"outputs":[]},{"cell_type":"code","metadata":{"id":"6ZCvsLH8XptV"},"source":["#3) 모델 제작\n","\n","# 모델 생성 (keras_transformer 이용)\n","model = get_model(\n","    token_num=len(token_dict),\n","    embed_dim=30,\n","    encoder_num=3,\n","    decoder_num=2,\n","    head_num=3,\n","    hidden_dim=120,\n","    attention_activation='relu',\n","    feed_forward_activation='relu',\n","    dropout_rate=0.05,\n","    embed_weights=np.random.random((14, 30)),\n",")\n","\n","#모델 컴파일\n","model.compile(\n","    optimizer='adam',\n","    loss='sparse_categorical_crossentropy',\n",")\n","\n","#모델 써머리\n","model.summary()\n","\n","# 모델  훈련\n","model.fit(\n","    x=[np.asarray(encoder_inputs * 1000), np.asarray(decoder_inputs * 1000)],\n","    y=np.asarray(decoder_outputs * 1000),\n","    epochs=5\n",")"],"execution_count":null,"outputs":[]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"P9Xefg5vXsAA","executionInfo":{"status":"ok","timestamp":1626272255300,"user_tz":-540,"elapsed":34865,"user":{"displayName":"DA YEON KI","photoUrl":"https://lh3.googleusercontent.com/a-/AOh14GiWfZD29yea7akQsMZ0L-JyyDBDzCak-4Q55tt-jw=s64","userId":"15097711384147757777"}},"outputId":"a938e460-3798-4241-c9a7-f45b1ab78d63"},"source":["#4) 기계번역 진행\n","import numpy as np\n","from keras_transformer import get_model, decode\n","\n","#소스 문장\n","source_tokens = [\n","    '안녕하세요 저의 이름은 기다연입니다.'.split(' '),\n","    '저는 22살입니다.'.split(' '),\n","]\n","\n","#타겟 문장\n","target_tokens = [\n","    list('Hello My name is Ki Dayeon.'),\n","    list('I am 22 years old.'),\n","]\n","\n","#토큰 딕셔너리화 함수\n","def build_token_dict(token_list):\n","    token_dict = {\n","        '<PAD>': 0,\n","        '<START>': 1,\n","        '<END>': 2,\n","    }\n","    for tokens in token_list:\n","        for token in tokens:\n","            if token not in token_dict:\n","                token_dict[token] = len(token_dict)\n","    return token_dict\n","\n","\n","source_token_dict = build_token_dict(source_tokens) #딕셔너리화\n","target_token_dict = build_token_dict(target_tokens) #딕셔너리화\n","target_token_dict_inv = {v: k for k, v in target_token_dict.items()} #역으로\n","\n","# <START>,<END>와 같은 Special Token 추가\n","encode_tokens = [['<START>'] + tokens + ['<END>'] for tokens in source_tokens]\n","decode_tokens = [['<START>'] + tokens + ['<END>'] for tokens in target_tokens]\n","output_tokens = [tokens + ['<END>', '<PAD>'] for tokens in target_tokens]\n","\n","# 패딩\n","source_max_len = max(map(len, encode_tokens))\n","target_max_len = max(map(len, decode_tokens))\n","\n","encode_tokens = [tokens + ['<PAD>'] * (source_max_len - len(tokens)) for tokens in encode_tokens]\n","decode_tokens = [tokens + ['<PAD>'] * (target_max_len - len(tokens)) for tokens in decode_tokens]\n","output_tokens = [tokens + ['<PAD>'] * (target_max_len - len(tokens)) for tokens in output_tokens]\n","\n","encode_input = [list(map(lambda x: source_token_dict[x], tokens)) for tokens in encode_tokens]\n","decode_input = [list(map(lambda x: target_token_dict[x], tokens)) for tokens in decode_tokens]\n","decode_output = [list(map(lambda x: [target_token_dict[x]], tokens)) for tokens in output_tokens]\n","\n","\n","#모델 생성\n","model = get_model(\n","    token_num=max(len(source_token_dict), len(target_token_dict)),\n","    embed_dim=32,\n","    encoder_num=2,\n","    decoder_num=2,\n","    head_num=4,\n","    hidden_dim=128,\n","    dropout_rate=0.05,\n","    use_same_embed=False,  # Use different embeddings for different languages\n",")\n","\n","#모델 컴파일\n","model.compile('adam', 'sparse_categorical_crossentropy')\n","\n","#모델 써머리 \n","model.summary()\n","\n","#모델 훈련\n","model.fit(\n","    x=[np.array(encode_input * 1024), np.array(decode_input * 1024)],\n","    y=np.array(decode_output * 1024),\n","    epochs=10,\n","    batch_size=32,\n",")\n","\n","# 번역 진행 (Predict)\n","decoded = decode(\n","    model,\n","    encode_input,\n","    start_token=target_token_dict['<START>'],\n","    end_token=target_token_dict['<END>'],\n","    pad_token=target_token_dict['<PAD>'],\n",")\n","\n","print(''.join(map(lambda x: target_token_dict_inv[x], decoded[0][1:-1])))\n","print(''.join(map(lambda x: target_token_dict_inv[x], decoded[1][1:-1])))"],"execution_count":12,"outputs":[{"output_type":"stream","text":["Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142083b90> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142083710> (key: CacheKey(input_signature=(TensorSpec(shape=(2048,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9133f7cdd0> (key: CacheKey(input_signature=(TensorSpec(shape=(32,), dtype=tf.int64, name=None), TensorSpec(shape=(2048, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2048, 29), dtype=tf.int64, name=None), TensorSpec(shape=(2048, 29, 1), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_train_function.<locals>.train_function at 0x7f9133f483b0> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(32, 6), dtype=tf.int64, name=None), TensorSpec(shape=(32, 29), dtype=tf.int64, name=None)), TensorSpec(shape=(32, 29, 1), dtype=tf.int64, name=None)),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9133e5be50>,)] [kwargs: {}]\n"],"name":"stderr"},{"output_type":"stream","text":["Model: \"model_2\"\n","__________________________________________________________________________________________________\n","Layer (type)                    Output Shape         Param #     Connected to                     \n","==================================================================================================\n","Encoder-Input (InputLayer)      [(None, None)]       0                                            \n","__________________________________________________________________________________________________\n","Encoder-Token-Embedding (Embedd [(None, None, 32), ( 704         Encoder-Input[0][0]              \n","__________________________________________________________________________________________________\n","Encoder-Embedding (TrigPosEmbed (None, None, 32)     0           Encoder-Token-Embedding[0][0]    \n","__________________________________________________________________________________________________\n","Encoder-1-MultiHeadSelfAttentio (None, None, 32)     4224        Encoder-Embedding[0][0]          \n","__________________________________________________________________________________________________\n","Encoder-1-MultiHeadSelfAttentio (None, None, 32)     0           Encoder-1-MultiHeadSelfAttention[\n","__________________________________________________________________________________________________\n","Encoder-1-MultiHeadSelfAttentio (None, None, 32)     0           Encoder-Embedding[0][0]          \n","                                                                 Encoder-1-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Encoder-1-MultiHeadSelfAttentio (None, None, 32)     64          Encoder-1-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Encoder-1-FeedForward (FeedForw (None, None, 32)     8352        Encoder-1-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Encoder-1-FeedForward-Dropout ( (None, None, 32)     0           Encoder-1-FeedForward[0][0]      \n","__________________________________________________________________________________________________\n","Encoder-1-FeedForward-Add (Add) (None, None, 32)     0           Encoder-1-MultiHeadSelfAttention-\n","                                                                 Encoder-1-FeedForward-Dropout[0][\n","__________________________________________________________________________________________________\n","Encoder-1-FeedForward-Norm (Lay (None, None, 32)     64          Encoder-1-FeedForward-Add[0][0]  \n","__________________________________________________________________________________________________\n","Encoder-2-MultiHeadSelfAttentio (None, None, 32)     4224        Encoder-1-FeedForward-Norm[0][0] \n","__________________________________________________________________________________________________\n","Decoder-Input (InputLayer)      [(None, None)]       0                                            \n","__________________________________________________________________________________________________\n","Encoder-2-MultiHeadSelfAttentio (None, None, 32)     0           Encoder-2-MultiHeadSelfAttention[\n","__________________________________________________________________________________________________\n","Decoder-Token-Embedding (Embedd [(None, None, 32), ( 704         Decoder-Input[0][0]              \n","__________________________________________________________________________________________________\n","Encoder-2-MultiHeadSelfAttentio (None, None, 32)     0           Encoder-1-FeedForward-Norm[0][0] \n","                                                                 Encoder-2-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Decoder-Embedding (TrigPosEmbed (None, None, 32)     0           Decoder-Token-Embedding[0][0]    \n","__________________________________________________________________________________________________\n","Encoder-2-MultiHeadSelfAttentio (None, None, 32)     64          Encoder-2-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadSelfAttentio (None, None, 32)     4224        Decoder-Embedding[0][0]          \n","__________________________________________________________________________________________________\n","Encoder-2-FeedForward (FeedForw (None, None, 32)     8352        Encoder-2-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadSelfAttentio (None, None, 32)     0           Decoder-1-MultiHeadSelfAttention[\n","__________________________________________________________________________________________________\n","Encoder-2-FeedForward-Dropout ( (None, None, 32)     0           Encoder-2-FeedForward[0][0]      \n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadSelfAttentio (None, None, 32)     0           Decoder-Embedding[0][0]          \n","                                                                 Decoder-1-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Encoder-2-FeedForward-Add (Add) (None, None, 32)     0           Encoder-2-MultiHeadSelfAttention-\n","                                                                 Encoder-2-FeedForward-Dropout[0][\n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadSelfAttentio (None, None, 32)     64          Decoder-1-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Encoder-2-FeedForward-Norm (Lay (None, None, 32)     64          Encoder-2-FeedForward-Add[0][0]  \n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadQueryAttenti (None, None, 32)     4224        Decoder-1-MultiHeadSelfAttention-\n","                                                                 Encoder-2-FeedForward-Norm[0][0] \n","                                                                 Encoder-2-FeedForward-Norm[0][0] \n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadQueryAttenti (None, None, 32)     0           Decoder-1-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadQueryAttenti (None, None, 32)     0           Decoder-1-MultiHeadSelfAttention-\n","                                                                 Decoder-1-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-1-MultiHeadQueryAttenti (None, None, 32)     64          Decoder-1-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-1-FeedForward (FeedForw (None, None, 32)     8352        Decoder-1-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-1-FeedForward-Dropout ( (None, None, 32)     0           Decoder-1-FeedForward[0][0]      \n","__________________________________________________________________________________________________\n","Decoder-1-FeedForward-Add (Add) (None, None, 32)     0           Decoder-1-MultiHeadQueryAttention\n","                                                                 Decoder-1-FeedForward-Dropout[0][\n","__________________________________________________________________________________________________\n","Decoder-1-FeedForward-Norm (Lay (None, None, 32)     64          Decoder-1-FeedForward-Add[0][0]  \n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadSelfAttentio (None, None, 32)     4224        Decoder-1-FeedForward-Norm[0][0] \n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadSelfAttentio (None, None, 32)     0           Decoder-2-MultiHeadSelfAttention[\n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadSelfAttentio (None, None, 32)     0           Decoder-1-FeedForward-Norm[0][0] \n","                                                                 Decoder-2-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadSelfAttentio (None, None, 32)     64          Decoder-2-MultiHeadSelfAttention-\n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadQueryAttenti (None, None, 32)     4224        Decoder-2-MultiHeadSelfAttention-\n","                                                                 Encoder-2-FeedForward-Norm[0][0] \n","                                                                 Encoder-2-FeedForward-Norm[0][0] \n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadQueryAttenti (None, None, 32)     0           Decoder-2-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadQueryAttenti (None, None, 32)     0           Decoder-2-MultiHeadSelfAttention-\n","                                                                 Decoder-2-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-2-MultiHeadQueryAttenti (None, None, 32)     64          Decoder-2-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-2-FeedForward (FeedForw (None, None, 32)     8352        Decoder-2-MultiHeadQueryAttention\n","__________________________________________________________________________________________________\n","Decoder-2-FeedForward-Dropout ( (None, None, 32)     0           Decoder-2-FeedForward[0][0]      \n","__________________________________________________________________________________________________\n","Decoder-2-FeedForward-Add (Add) (None, None, 32)     0           Decoder-2-MultiHeadQueryAttention\n","                                                                 Decoder-2-FeedForward-Dropout[0][\n","__________________________________________________________________________________________________\n","Decoder-2-FeedForward-Norm (Lay (None, None, 32)     64          Decoder-2-FeedForward-Add[0][0]  \n","__________________________________________________________________________________________________\n","Decoder-Output (EmbeddingSim)   (None, None, 22)     22          Decoder-2-FeedForward-Norm[0][0] \n","                                                                 Decoder-Token-Embedding[0][1]    \n","==================================================================================================\n","Total params: 60,822\n","Trainable params: 60,822\n","Non-trainable params: 0\n","__________________________________________________________________________________________________\n","Epoch 1/10\n"],"name":"stdout"},{"output_type":"stream","text":["Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_train_function.<locals>.train_function at 0x7f9134a0b4d0> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(32, 6), dtype=tf.int64, name=None), TensorSpec(shape=(32, 29), dtype=tf.int64, name=None)), TensorSpec(shape=(32, 29, 1), dtype=tf.int64, name=None)),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9133e5be50>,)] [kwargs: {}]\n"],"name":"stderr"},{"output_type":"stream","text":["64/64 [==============================] - 12s 13ms/step - loss: 2.3287\n","Epoch 2/10\n","64/64 [==============================] - 1s 13ms/step - loss: 1.0897\n","Epoch 3/10\n","64/64 [==============================] - 1s 13ms/step - loss: 0.2456\n","Epoch 4/10\n","64/64 [==============================] - 1s 13ms/step - loss: 0.0784\n","Epoch 5/10\n","64/64 [==============================] - 1s 14ms/step - loss: 0.0388\n","Epoch 6/10\n","64/64 [==============================] - 1s 13ms/step - loss: 0.0236\n","Epoch 7/10\n","64/64 [==============================] - 1s 13ms/step - loss: 0.0161\n","Epoch 8/10\n","64/64 [==============================] - 1s 13ms/step - loss: 0.0118\n","Epoch 9/10\n","64/64 [==============================] - 1s 13ms/step - loss: 0.0095\n","Epoch 10/10\n","64/64 [==============================] - 1s 13ms/step - loss: 0.0072\n"],"name":"stdout"},{"output_type":"stream","text":["Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142827050> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142827710> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132cb20e0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 1), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 1), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91356b1b50>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132b36680> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135b2b9e0> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135b2b8c0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 2), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 2), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f913536b390>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914231f560> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914231fb90> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914231f680> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 3), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 3), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135bfb910>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914267d5f0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914267d440> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914267d8c0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 4), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 4), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91357483d0>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132a570e0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132daf5f0> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9144d7b710> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 5), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 5), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135b106d0>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91352b8440> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91352b8050> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142083050> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 6), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420e2750>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91352b8b90> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914267def0> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135fd9830> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 7), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 7), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420e12d0>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91358f5560> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142304c20> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142304560> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 8), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 8), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91421a2e10>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914231fb00> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132cb29e0> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132cb29e0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 9), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 9), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91352ce210>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132b36dd0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914267d710> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132cb2d40> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 10), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 10), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420c6590>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135b2bcb0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135b2b3b0> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132b36680> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 11), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 11), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9142062a90>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914262a5f0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135b2b4d0> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132cb27a0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 12), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 12), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420c9d10>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142304a70> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142827440> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b69e0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 13), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 13), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9142536510>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132a5aef0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135b2be60> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b69e0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 14), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 14), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9142089390>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132cb2200> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9133c93200> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91352b8a70> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 15), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 15), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420c1d50>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132a57560> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b6dd0> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91352b8050> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 16), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 16), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135299c90>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135a56dd0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135a56170> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135aa15f0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 17), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 17), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135b27610>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135857950> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132c98320> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135aa1560> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 18), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 18), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135e6d590>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b8320> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b8200> (key: CacheKey(input_signature=(TensorSpec(shape=(2,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91358578c0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(2, 6), dtype=tf.int64, name=None), TensorSpec(shape=(2, 19), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 19), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135e6d7d0>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135a56b00> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b9320> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91358577a0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 20), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 20), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420a6850>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142083d40> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91358575f0> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132a57440> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 21), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 21), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135b29f90>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135fd9b00> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132d41050> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142083950> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 22), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 22), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420ecb50>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142304e60> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9142107680> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f914267def0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 23), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 23), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9135af98d0>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132fae830> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132cb2710> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132b363b0> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 24), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 24), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420c4550>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b65f0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132b368c0> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132b36e60> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 25), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 25), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91420e5390>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91421e5320> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91421e5170> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135fd9e60> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 26), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 26), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f91421c8250>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9132b36cb0> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b84d0> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b6950> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 27), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 27), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f913529bf10>,)] [kwargs: {}]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91349b3d40> (key: CacheKey(input_signature=(TensorSpec(shape=(), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f9135fd9b90> (key: CacheKey(input_signature=(TensorSpec(shape=(1,), dtype=tf.int64, name=None),), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function StructuredFunctionWrapper.__init__.<locals>.trace_tf_function.<locals>.wrapped_fn at 0x7f91333b6200> (key: CacheKey(input_signature=(TensorSpec(shape=(None,), dtype=tf.int64, name=None), TensorSpec(shape=(1, 6), dtype=tf.int64, name=None), TensorSpec(shape=(1, 28), dtype=tf.int64, name=None)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: None] [kwargs: None]\n","Level 1:tensorflow:Creating new FuncGraph for Python function <function Model.make_predict_function.<locals>.predict_function at 0x7f9132fae050> (key: CacheKey(input_signature=('UCu', (IteratorSpec(((TensorSpec(shape=(None, 6), dtype=tf.int64, name=None), TensorSpec(shape=(None, 28), dtype=tf.int64, name=None)),),),)), parent_graph=None, device_functions=(), colocation_stack=(), in_cross_replica_context=False, variable_policy=None, xla_context_id=0))\n","Level 2:tensorflow:Python function signature [args: (<tensorflow.python.data.ops.iterator_ops.OwnedIterator object at 0x7f9142536610>,)] [kwargs: {}]\n"],"name":"stderr"},{"output_type":"stream","text":["Hello My name is Ki Dayeon.\n","I am 22 years old.\n"],"name":"stdout"}]}]}