Skip to content

SurajDonthi/Conformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

40 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Conformer: Convolution-augmented Transformer for Speech Recognition

Transformers have offered breakthrough performances in the recent years in NLP and have also shown decent results for Speech Processing tasks. However, with Convolutional architectures performing significantly well on Speech Processing tasks, the addition of a Convolutional module to a traditional Transformer architecture outperforms all previous architectures! Conformer combines the best of Convolutions & Transformers.

This repository implements the Conformer Architecture in PyTorch!

The Architeture

Conformer Encoder

Convolution Module

References

[1] Conformer: Convolution-augmented Transformer for Speech Recognition

About

Implementation of the Conformer Speech Recognition Model

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages