Skip to content

Conversation

@nglehuy
Copy link
Collaborator

@nglehuy nglehuy commented Feb 16, 2021

This pull request enables support for static shape training (build model and datasets with predefined shape instead of None), which also enables TPU training.

  • Add max lengths computation from duration and transcript (update duration when creating transcripts.tsv)
  • Support TPU (tested using train_tpu_keras_subword_conformer.py on colab tpu with batch_size=1
  • Update create tfrecords using tf.data.experimental.TFRecordWriter
  • Remove tfio.audio.resample for TPU since it does not support for tpu yet

@nglehuy nglehuy changed the title Support TPU and static shape training WIP: Support TPU and static shape training Feb 16, 2021
@nglehuy nglehuy changed the title WIP: Support TPU and static shape training Support TPU and static shape training Feb 16, 2021
@nglehuy nglehuy merged commit bda1fdf into main Feb 16, 2021
@nglehuy nglehuy mentioned this pull request Feb 16, 2021
@nglehuy nglehuy linked an issue Feb 16, 2021 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

TPU not work

2 participants