Add Silero Speech-To-Text models

scripts/install.sh

@@ -6,6 +6,8 @@ conda activate base
 
 # Install the latest release of pytorch and torchvision
 conda install -y pytorch torchvision -c pytorch
+# Also install torchaudio
+conda install -y -c pytorch torchaudio
 
 # Dependencies required to load models
 conda install -y regex pillow tqdm boto3 requests numpy\
@@ -14,3 +16,4 @@ conda install -y -c conda-forge librosa inflect
 
 pip install -q fastBPE sacremoses sentencepiece subword_nmt editdistance
 pip install -q visdom mistune filelock tokenizers packaging
+pip install -q omegaconf

snakers4_silero-models_stt.md

@@ -0,0 +1,84 @@
+---
+layout: hub_detail
+background-class: hub-background
+body-class: hub
+category: researchers
+title: Silero Speech-To-Text Models
+summary: A set of compact enterprise-grade pre-trained STT Models for multiple languages.
+image: silero_logo.jpg
+author: Silero AI Team
+tags: [audio, scriptable]
+github-link: https://github.com/snakers4/silero-models
+github-id: snakers4/silero-models
+featured_image_1: silero_stt_model.jpg
+featured_image_2: silero_imagenet_moment.png
+accelerator: cuda-optional
+---
+
+```bash
+# this assumes that you have a proper version of PyTorch already installed
+pip install -q torchaudio omegaconf soundfile
+```
+
+```python
+import torch
+import zipfile
+import torchaudio
+from glob import glob
+# see https://github.com/snakers4/silero-models for utils and more examples
+
+device = torch.device('cpu')  # gpu also works, but our models are fast enough for CPU
+model, decoder, utils = torch.hub.load(github='snakers4/silero-models',
+                                       model='silero_stt',
+                                       device=device, force_reload=True)
+(read_batch, split_into_batches,
+ read_audio, prepare_model_input) = utils  # see function signature for details
+
+# download a single file, any format compatible with TorchAudio (soundfile backend)
+torch.hub.download_url_to_file('https://opus-codec.org/static/examples/samples/speech_orig.wav',
+                               dst ='speech_orig.wav', progress=True)
+test_files = glob('speech_orig.wav') 
+
+# or run a test on a whole batch of files
+# torch.hub.download_url_to_file('http://www.openslr.org/resources/83/midlands_english_female.zip',
+#                                dst ='midlands_english_female.zip',
+#                                progress=True)
+# with zipfile.ZipFile('midlands_english_female.zip', 'r') as zip_ref:
+#     zip_ref.extractall('midlands_english_female')
+# test_files = glob('midlands_english_female/*.wav')
+
+batches = split_into_batches(test_files, batch_size=10)
+input = prepare_model_input(read_batch(batches[0]),
+                            device=device)
+
+output = model(input)
+for example in output:
+    print(decoder(example.cpu()))
+```
+
+### Model Description
+
+Silero Speech-To-Text models provide enterprise grade STT in a compact form-factor for several commonly spoken languages. Unlike conventional ASR models our models are robust to a variety of dialects, codecs, domains, noises, lower sampling rates (for simplicity audio should be resampled to 16 kHz). The models consume a normalized audio in the form of samples (i.e. without any pre-processing except for normalization to -1 ... 1) and output frames with token probabilities. We provide a decoder utility for simplicity (we could include it into our model itself, but scripted modules had problems with storing model artifacts i.e. labels during certain export scenarios).
+
+We hope that our efforts with Open-STT and Silero Models will bring the ImageNet moment in speech closer.
+
+### Supported Languages and Formats
+
+As of this page update, the following languages are supported:
+
+- English
+- German
+- Spanish
+
+To see the always up-to-date language list, please visit our [repo](https://github.com/snakers4/silero-models) and see the `yml` [file](https://github.com/snakers4/silero-models/blob/master/models.yml) for all available checkpoints.
+
+### Additional Examples and Benchmarks
+
+For additional examples and other model formats please visit this [link](https://github.com/snakers4/silero-models). For quality and performance benchmarks please see the [wiki](https://github.com/snakers4/silero-models/wiki). These resources will be updated from time to time.
+
+### References
+
+- [Silero Models](https://github.com/snakers4/silero-models)
+- [Alexander Veysov, "Toward's an ImageNet Moment for Speech-to-Text", The Gradient, 2020](https://thegradient.pub/towards-an-imagenet-moment-for-speech-to-text/)
+- [Alexander Veysov, "A Speech-To-Text Practitioner’s Criticisms of Industry and Academia", The Gradient, 2020](https://thegradient.pub/a-speech-to-text-practitioners-criticisms-of-industry-and-academia/)
+