Skip to content

sagorbrur/itranslit

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

iTRANSLIT

iTRANSLIT is a deep learning based transliteration package for indic language

Installation

pip install itranslit

Dependency

  • pytorch 1.7.0 or 1.7.0+

NB: No GPU need. It's CPU based.

Supported Language and Language Code

Language Name Langauage Code
Bangla bn
Gujarati gu
Hindi hi
Punjabi pa
Sindhi sd
Urdu ur
Malayalam ml
Tamil ta

API

from itranslit import Translit

translit = Translit('bn')
word = "aami"
output = translit.predict(word, topk=10)
print(output)

Datasets and Training Details

  • We used Google Dakshina Dataset
  • Thanks to AI4Bharat for providing training notebook with details explanation
  • We trained Google Dakshina lexicons train datasets for 10 epochs with batch size 128, 1e-3, embedding dim = 300, hidden dim = 512, lstm, used attention
  • We evaluated our trained model with Google Dakshina lexicon test data using AI4Bharat evaluation script
  • You can find evaluation summary here