#

low-resource-languages

Here are 55 public repositories matching this topic...

csebuetnlp / banglanmt

This repository contains the code and data of the paper titled "Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation" published in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), November 16 - November 20, 2020.

machine-translation neural-machine-translation parallel-corpus parallel-corpora bangla-nlp low-resource-languages bangla-machine-translation bangla-dataset-machine-translation emnlp-2020 low-resource-nlp low-resource-machine-translation

Updated Jan 30, 2023
Python

csebuetnlp / xl-sum

This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.

multilingual machine-learning deep-learning dataset text-summarization abstractive-text-summarization abstractive-summarization text-summarisation low-resource-languages multilinguality summarization-corpora summarization-dataset multilingual-text-summarization text-summarization-dataset text-summarization-model low-resource-summarization low-resource-text-summarizarion multilingual-summarization

Updated Mar 26, 2024
Python

jcblaisecruz02 / Filipino-Text-Benchmarks

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

benchmark deep-learning text-classification corpus transformer transfer-learning tagalog bert filipino electra nli low-resource-languages tagalog-transformers electra-models

Updated Aug 26, 2024
Python

cisnlp / GlotLID

GlotLID: Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

language-detection multlingual language-detector language-recognition glot lid language-identification language-classification language-identification-toolkit low-resource-languages language-detection-library language-identifier language-detection-lib langid low-resource-nlp

Updated Jul 5, 2024
Python

AsifulNobel / Metsys

Chatbot Solution for Resource-Poor Languages. Contains code and data for Journal Article 'Focused domain contextual AI chatbot framework for resource poor languages'.

nlp website natural-language-processing neural-network chatbot django-application django-channels restful-api nlp-machine-learning bangla-nlp low-resource-languages bangla-ai low-resource-nlp resource-poor-languages customer-service-chatbot

Updated Jul 25, 2021
Python

tafseer-nayeem / BengaliSummarization

[EACL 2021] - Unsupervised Abstractive Summarization of Bengali Text Documents.

abstractive-summarization low-resource-languages bengali-nlp summarization-dataset bengali-summarization bengali-abstractive-summarization bengali-summarization-dataset

Updated Apr 26, 2021
Python

Rumeysakeskin / Turkish-Text-to-Speech

Speech synthesis (TTS) in low-resource languages by training from scratch with Fastpitch and fine-tuning with HifiGan

pytorch tts speech-synthesis nvidia-docker waveform-generator low-resource-languages nvidia-nemo hifigan fastpitch turkish-text-to-speech phonetical-conversion spectrogram-generator

Updated Dec 5, 2023
Python

tafseer-nayeem / BengaliReadability

[AAAI 2021] - Simple or Complex? Learning to Predict Readability of Bengali Texts.

low-resource-languages bengali-language-processing bengali-natural-language-processing bengali-nlp bengali-readability bengali-readability-analysis bengali-readability-prediction readability-dataset bengali-readability-dataset

Updated Apr 6, 2021
Python

uds-lsv / transfer-distant-transformer-african

Code + data for the EMNLP'20 publication "Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages"

african-languages ner topic-classification low-resource low-resource-languages transformer-models

Updated Dec 16, 2021
Python

alecokas / BiLatticeRNN-Confidence

Confidence Estimation for Black Box Automatic Speech Recognition Systems Using Lattice Recurrent Neural Networks https://arxiv.org/abs/1910.11933 or https://ieeexplore.ieee.org/document/9053264

pytorch lstm speech-recognition attention lattice speech-processing asr lattices confidence-estimation low-resource-languages pytorch-implementation confidence-scores confusion-networks latticernn confidence-estimates

Updated Apr 16, 2020
Python

Aditi138 / EntityTargetedActiveLearning

nlp named-entity-recognition transfer-learning active-learning low-resource-languages

Updated Aug 29, 2019
Python

BatsResearch / LexC-Gen

Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.

multilingual sentiment-analysis topic-modeling synthetic-data synthetic-dataset-generation low-resource-languages lexicon-based multilingual-nlp llm

Updated Jul 1, 2024
Python

vad-sli-asr

CoEDL / vad-sli-asr

A pipeline to isolate and transcribe one language in mixed-language speech

automatic-speech-recognition endangered-languages voice-activity-detection low-resource-languages spoken-language-identification

Updated Oct 25, 2022
Python

ljvmiranda921 / calamanCy

NLP pipelines for Tagalog using spaCy

nlp machine-learning natural-language-processing spacy computational-linguistics ner low-resource-languages low-resource-nlp

Updated Aug 12, 2024
Python

surafelml / adapt-mnmt

Dynamic Transfer Learning for Low-Resource Neural Machine Translation

multilingual transfer-learning nmt adaptation data-selection low-resource-languages zero-shot-translation pretraining dynamic-transfer-learning

Updated Aug 4, 2020
Python

fajri91 / minangNLP

Minangkabau NLP corpus. PACLIC 2020

nlp sentiment-analysis machine-translation corpus indonesian-language bert ethnicity low-resource-languages minangkabau-language paclic

Updated Jun 7, 2021
Python

EveryVoiceTTS / EveryVoice

The EveryVoice TTS Toolkit - Text To Speech for your language

python text-to-speech speech pytorch tts speech-synthesis speech-processing language-revitalization low-resource-languages pytorch-lightning

Updated Sep 24, 2024
Python

alexandra-chron / relm_unmt

Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".

transfer-learning language-models cross-lingual low-resource-languages residual-adapters pretraining unsupervised-machine-translation

Updated Mar 16, 2022
Python

Andrews2017 / kkltk

The Kinyarwanda and Kirundi Languages Toolkit (KKLTK) is a Python package for Kinyarwanda and Kirundi languages processing. KKLTK currently provides the sets of stopwords for both languages and other preprocessing tools such as Kinyarwanda and Kirundi tokenizers will be added soon. KKLTK requires Python 3.0, 3.5, 3.6, 3.7, or 3.8.

text-processing low-resource-languages text-preprocessing scientific-machine-learning low-resource-languages-toolkit

Updated Oct 27, 2020
Python

ToluClassics / LowResourceOCR

This work is an adaptation of CNN+Transformer architecture to training text recognition models for Yorùbá & Igbo Languages

ocr transformers low-resource-languages

Updated Oct 14, 2022
Python

Improve this page

Add a description, image, and links to the low-resource-languages topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the low-resource-languages topic, visit your repo's landing page and select "manage topics."