a place to discuss and create an independent speech-to-text benchmarking tool.
- Benchmarking metrics will be measured in relation to a reference transcript and audio prepared by the client.
- The tool should be language-agnostic: the client will create the reference in the language they require and test the tools.
- The tool should require as little configuration as possible and depend on test data format as much as possible for deciding which evaluation metrics to compute. (R5)
python3 -m venv venv
pip install -r requirements.txt
python -m spacy download en