/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:523: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint8 = np.dtype([("qint8", np.int8, 1)])
/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:524: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint8 = np.dtype([("quint8", np.uint8, 1)])
/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:525: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint16 = np.dtype([("qint16", np.int16, 1)])
/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:526: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_quint16 = np.dtype([("quint16", np.uint16, 1)])
/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:527: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  _np_qint32 = np.dtype([("qint32", np.int32, 1)])
/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/framework/dtypes.py:532: FutureWarning: Passing (type, 1) or '1type' as a synonym of type is deprecated; in a future version of numpy, it will be understood as (type, (1,)) / '(1,)type'.
  np_resource = np.dtype([("resource", np.ubyte, 1)])
2022-06-12 07:13:10.202744: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 AVX512F FMA
Dictionaries loaded.
Loaded subtoken vocab. size: 37554
Loaded target word vocab. size: 26350
Loaded nodes vocab. size: 219
Created model
Starting training
WARNING:tensorflow:From /raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/ops/sparse_ops.py:1165: sparse_to_dense (from tensorflow.python.ops.sparse_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Create a `tf.sparse.SparseTensor` and use `tf.sparse.to_dense` instead.
Training batch size:                     512
Dataset path:                            /raid/cs21mtech12001/Research/Code2Seq/Data/extracted_data/final_data/notebooks_with_atleast_100_upvotes/with_summarization//with_summarization
Training file path:                      /raid/cs21mtech12001/Research/Code2Seq/Data/extracted_data/final_data/notebooks_with_atleast_100_upvotes/with_summarization//with_summarization.train.c2s
Validation path:                         /raid/cs21mtech12001/Research/Code2Seq/Data/extracted_data/final_data/notebooks_with_atleast_100_upvotes/with_summarization//with_summarization.val.c2s
Taking max contexts from each example:   200
Random path sampling:                    True
Embedding size:                          128
Using BiLSTMs, each of size:             128
Decoder size:                            320
Decoder layers:                          1
Max path lengths:                        9
Max subtokens in a token:                5
Max target length:                       6
Embeddings dropout keep_prob:            0.75
LSTM dropout keep_prob:                  0.5
============================================
Number of trainable params: 18358272
Initalized variables
Started reader...
2022-06-12 07:18:28.701173: W tensorflow/core/framework/op_kernel.cc:1273] OP_REQUIRES failed at sparse_to_dense_op.cc:128 : Invalid argument: indices[480] = [159,3] is out of bounds: need 0 <= index < [200,3]
Traceback (most recent call last):
  File "/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1334, in _do_call
    return fn(*args)
  File "/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1319, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1407, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[480] = [159,3] is out of bounds: need 0 <= index < [200,3]
         [[{{node SparseToDense}} = SparseToDense[T=DT_STRING, Tindices=DT_INT64, validate_indices=true](StringSplit, SparseTensor_1/dense_shape, StringSplit:1, NotEqual/y)]]
         [[{{node IteratorGetNext}} = IteratorGetNext[output_shapes=[[?,200,9], [?,200], [?,200,5], [?,200], [?,200,1], [?,200,1], [?,200,5], [?,200], [?,200,1], [?,?], [?], [?], [?,200]], output_types=[DT_INT32, DT_INT32, DT_INT32, DT_INT32, DT_STRING, DT_STRING, DT_INT32, DT_INT32, DT_STRING, DT_INT32, DT_INT64, DT_STRING, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](IteratorV2)]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/raid/cs21mtech12001/Research/Code2Seq/Repository/code2seq.py", line 39, in <module>
    model.train()
  File "/raid/cs21mtech12001/Research/Code2Seq/Repository/model.py", line 96, in train
    _, batch_loss = self.sess.run([optimizer, train_loss])
  File "/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 929, in run
    run_metadata_ptr)
  File "/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1152, in _run
    feed_dict_tensor, options, run_metadata)
  File "/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1328, in _do_run
    run_metadata)
  File "/raid/cs21mtech12001/.local/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1348, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: indices[480] = [159,3] is out of bounds: need 0 <= index < [200,3]
         [[{{node SparseToDense}} = SparseToDense[T=DT_STRING, Tindices=DT_INT64, validate_indices=true](StringSplit, SparseTensor_1/dense_shape, StringSplit:1, NotEqual/y)]]
         [[node IteratorGetNext (defined at /raid/cs21mtech12001/Research/Code2Seq/Repository/reader.py:192)  = IteratorGetNext[output_shapes=[[?,200,9], [?,200], [?,200,5], [?,200], [?,200,1], [?,200,1], [?,200,5], [?,200], [?,200,1], [?,?], [?], [?], [?,200]], output_types=[DT_INT32, DT_INT32, DT_INT32, DT_INT32, DT_STRING, DT_STRING, DT_INT32, DT_INT32, DT_STRING, DT_INT32, DT_INT64, DT_STRING, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](IteratorV2)]]