troubleshooting

For this troubleshoot section, we assume a correctly installed NTEE. If you have trouble in the installing process, see the appropriate installation section for your operating system (linux, windows, mac) instead.

To perform general internal tests on the functionality of the code in the tei-entity-enricher package, run pytest -v tei_entity_enricher/tei_entity_enricher/test in the terminal from the project folder.

NER Trainer

• not enough free memory on hard disk during training process

(sample message)

2021-11-01 14:48:35.768287: W tensorflow/core/framework/op_kernel.cc:1763] OP_REQUIRES failed at save_restore_v2_ops.cc:135 : Unknown:
Failed to WriteFile: C:\Users\test\tei_entity_enricher\ner_trainer\models_ner\test_model\variables\variables_temp/part-00000-of-00001.data-00000-of-00001.tempstate12295170009706012294 :
Es steht nicht genug Speicherplatz auf dem Datentrger zur Verfgung.

CRITICAL 2021-11-01 14:48:38,144             tfaip.util.logging: Uncaught exception
Traceback (most recent call last):
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tfaip\scripts\train_from_params.py", line 43, in main
    trainer.train()
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tfaip\device\device_config.py", line 134, in wrapper
    return func(*args, **kwargs)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tfaip\trainer\trainer.py", line 202, in train
    self.fit()
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tfaip\trainer\trainer.py", line 315, in fit
    self._scenario.fit(
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tfaip\scenario\scenariobase.py", line 680, in fit
    self._keras_train_model.fit(
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\keras\engine\training.py", line 1145, in fit
    callbacks.on_epoch_end(epoch, epoch_logs)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\keras\callbacks.py", line 428, in on_epoch_end
    callback.on_epoch_end(epoch, logs)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tfaip\trainer\callbacks\train_params_logger.py", line 89, in on_epoch_end
    super().on_epoch_end(epoch, logs)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\keras\callbacks.py", line 1344, in on_epoch_end
    self._save_model(epoch=epoch, logs=logs)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tfaip\trainer\callbacks\train_params_logger.py", line 76, in _save_model
    super()._save_model(epoch, logs)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\keras\callbacks.py", line 1405, in _save_model
    self.model.save_weights(
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\keras\engine\training.py", line 2124, in save_weights
    self._trackable_saver.save(filepath, session=session, options=options)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\training\tracking\util.py", line 1216, in save
    save_path, new_feed_additions = self._save_cached_when_graph_building(
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\training\tracking\util.py", line 1162, in _save_cached_when_graph_building
    save_op = saver.save(file_prefix, options=options)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\training\saving\functional_saver.py", line 300, in save
    return save_fn()
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\training\saving\functional_saver.py", line 274, in save_fn
    sharded_saves.append(saver.save(shard_prefix, options))
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\training\saving\functional_saver.py", line 83, in save
    return io_ops.save_v2(file_prefix, tensor_names, tensor_slices, tensors)
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\ops\gen_io_ops.py", line 1713, in save_v2
    return save_v2_eager_fallback(
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\ops\gen_io_ops.py", line 1734, in save_v2_eager_fallback
    _result = _execute.execute(b"SaveV2", 0, inputs=_inputs_flat, attrs=_attrs,
  File "d:\anaconda3\envs\neiss_env\lib\site-packages\tensorflow\python\eager\execute.py", line 59, in quick_execute
    tensors = pywrap_tfe.TFE_Py_Execute(ctx._handle, device_name, op_name,
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe4 in position 240: invalid continuation byte

Postprocessing

• currently the "Add missing IDs" function of the Entity Library expander overwrites the furtherIds values of those entities for which a missing ID could be added

This will be fixed in an upcoming NTEE version.