nlp-sk-interesting-links

Interesting links to Slovak NLP tools, utils, corpora and resources. Feel free to add more interesting links via pull request.

Corpora

Corpus name	Date	Text	Sents	Tokens	PoS	Deps	NER	Sentiment	Errors	Parallel	Download
Súdne rozhodnutia	latest	x									x
Zákony	latest	x									x
European Parliament Proceedings Parallel Corpus	1996-2011	x								x	x
SK WIKI	latest	x									x
WEB Crawl w2c	2011	x									x
TildeMODEL	2018	x	x	x						x	x
DGT (JRC)	2019	x	x	x						x	x
JW300 (Jehovah’s Witnesses)	2019	x	x	x						x	x
EMEA	?	x	x	x						x	x
EUbookshop	?	x	x	x						x	x
OpenSubtitles	2018	x	x	x						x	x
ECB	?	x	x	x						x	x
QCRI Educational Domain Corpus	?	x	x	x						x	x
GNOME	?	x	x	x						x	x
JRC-acquis	2019	x	x	x						x	x
SkTenTen	2011-12-16	x	x	x							x
Leipzig Corpora Collection - News Crawl	2011-2016	x	x								x
Leipzig Corpora Collection - Web Crawl	2014-2016	x	x								x
Korpus.sk - Multiple	2003-2019	x	x	x	x
MULTEXT-East "1984"	2010-05-14	x	x	x	x						x
English-Slovak Parallel Corpus - Multiple	2012-05-15	x	x	x	x						x
Czech-Slovak Parallel Corpus - Multiple	2012-05-15	x	x	x	x						x
Slovak Web Discussion Corpus	2014	x	x	x	x		x		x		x
Deltacorpus 1.1	2016-06-20	x	x	x	x						x
R-mak	2017	x	x	x	M
Slovak UD treebank	2020	x	x	x	M	M	M				x
Slovak Dependency treebank	2016-11-07	x	x	x	M	M	M				x
Slovak Categorized News Corpus	2016	x	x	x	x		x				x
Sentigrade sentiment dataset	2017	x	x					M			x
BSNLP 2017	2017	x					x				x
Korpus slovenských právnych predpisov	2021	x	x	x	x	x	x				x
CHIBY	2019	x	x	x					x		x

Positive/Negative words

• https://sites.google.com/site/datascienceslab/projects/multilingualsentiment

Graph

• https://snap.stanford.edu/data/soc-Pokec.html

Wordnet

• https://korpus.sk/WordNet.html

Speech

• https://nlp.kemt.fei.tuke.sk/speech/tedx
• https://catalog.ldc.upenn.edu/LDC2018S08
• https://github.com/facebookresearch/voxpopuli

Diacritics restoration

• https://lindat.mff.cuni.cz/repository/xmlui/handle/11234/1-2607

Annotated Translation ranking/errors

• https://lindat.mff.cuni.cz/repository/xmlui/handle/11858/00-097C-0000-0006-AADD-3
• https://lindat.mff.cuni.cz/repository/xmlui/handle/11858/00-097C-0000-0006-AADC-5
• https://lindat.mff.cuni.cz/repository/xmlui/handle/11858/00-097C-0000-0006-AADB-7

Stopwords

• https://github.com/stopwords-iso/stopwords-sk
• http://text.fiit.stuba.sk/zoznam_stop_slov.php#focus
• https://github.com/to-mas-re/stopwords-sk
• https://github.com/Ardevop-sk/stopwords-sk

Tools and implementations

• https://nlp.web.tuke.sk/
• http://nlp.bednarik.top/
• https://github.com/drndos/nlp-tools
• http://text.fiit.stuba.sk
• https://korpus.sk/tools.html
• http://arl6.library.sk/nlp4sk/nlpservices/demo
• https://github.com/adobe/NLP-Cube

Sentiment analysis

• https://sentigrade.fiit.stuba.sk/analyzer
• http://arl6.library.sk/nlp4sk/nlpservices/demo
• https://github.com/SamuelPecar/Slovak-sentiment-analysis

PoS Tagging

• https://nlp.web.tuke.sk/nlpform
• https://github.com/hladek/dagger
• http://morpholyzer.fiit.stuba.sk:8080/PosTagger/
• https://github.com/dalibor-meszaros/SkCrfPosTagger
• http://nlp.bednarik.top/tagger/
• http://arl6.library.sk/nlp4sk/nlpservices/demo
• https://nlp.fi.muni.cz/slovak-morphology-analyser/
• http://ufal.mff.cuni.cz/morphodita (SK version by korpus.sk)
• https://morphodita.juls.savba.sk (improved model compared to the one above)
• https://www.juls.savba.sk/bezdiak/ (model for Slovak without diacritics)
• https://github.com/ufal/udpipe (you need to find slovak models on lindat)
• http://try.ui.sav.sk/lemmatag/
• https://universaldependencies.org/tagset-conversion/sk-snk-uposf.html

Tokenizer and segmentation

• https://nlp.web.tuke.sk/pages/tokenizer
• http://nlp.bednarik.top/tokenizer/
• http://nlp.bednarik.top/ssplit/
• http://arl6.library.sk/nlp4sk/nlpservices/demo
• https://github.com/hladek/slovak-lexer

Text reconstruction, spelling, text quality

• https://slovak-text-checker.herokuapp.com/
• http://text.fiit.stuba.sk:8081/
• https://www.juls.savba.sk/diakritik.html
• https://diakritika.brm.sk/
• http://arl6.library.sk/nlp4sk/nlpservices/demo
• https://www.umberto.sk/
• http://www.forma.sk/spell.aspx
• http://www.forma.sk/prod-jm-ms.aspx
• https://korektor.sk/korektor
• http://sk-spell.sk.cx/
• http://ufal.mff.cuni.cz/korektor (TBD release slovak models)
• http://try.ui.sav.sk/diacritics/

Lemmatizer / Stemmer

• https://github.com/essential-data/lucene-fst-lemmatizer
• https://github.com/essential-data/stemmer-sk
• http://nlp.bednarik.top/lemmatizer/
• http://arl6.library.sk/nlp4sk/nlpservices/demo
• http://text.fiit.stuba.sk/lemmatizer/
• http://www.forma.sk/prod-jm-is.aspx
• http://www.forma.sk/prod-jm-us.aspx
• https://github.com/mrshu/stemm-sk
• https://github.com/mrshu/lemm-sk
• https://github.com/michmech/lemmatization-lists/
• http://nlp.kiv.zcu.cz/projects/hps
• http://try.ui.sav.sk/lemmatag/

Wordlists / Dictionaries

• http://sk-spell.sk.cx/
• https://korpus.sk/dicts.html
• http://slex.sk/
• https://github.com/Kroid/multext-data

Dependency parsing

• http://nlp.bednarik.top/parser/
• https://github.com/HIT-SCIR/ELMoForManyLangs

Synonyms

• http://nlp.bednarik.top/synonyms/
• http://www.forma.sk/tech-jm-thes.aspx

Vectors and analogies

• TBD http://nlp.bednarik.top/
• https://github.com/essential-data/word2vec-sk
• https://nlp.h-its.org/bpemb/sk/
• http://vectors.nlpl.eu/repository/
• https://www.juls.savba.sk/semä.html

NER

• http://nlp.bednarik.top/ner/
• http://arl6.library.sk/nlp4sk/nlpservices/demo
• https://github.com/Ardevop-sk/sk-bert-ner
• https://www.juls.savba.sk/nerd/

Linked / Open Data

• http://arl6.library.sk/nlp4sk/nlpservices/demo

Topic extraction

• https://github.com/GPalfy/socialnetworkcomments

Negation detection

• https://github.com/majomix/negation-detector
• https://github.com/jozo/NegNeg

Annotation

• https://webanno.github.io/webanno/
• https://brat.nlplab.org/

Models

ELMo

• https://github.com/HIT-SCIR/ELMoForManyLangs

Word2Vec

• https://github.com/essential-data/word2vec-sk

Bert

• https://github.com/google-research/bert (multilingual)
• https://github.com/gerulata/slovakbert

ULMFiT

• https://github.com/maaario/nlp-slovak-universal-language-model

Lemma

• https://github.com/essential-data/lucene-fst-lemmatizer

PoS

• https://github.com/Ardevop-sk/sk-pos-model

Dependency parsing

• https://github.com/Ardevop-sk/sk-dep-model

UDPipe

• https://lindat.mff.cuni.cz/repository/xmlui/handle/11234/1-1971

Hugging Face

• https://huggingface.co/models?language=sk&sort=downloads

Other

• https://github.com/mrshu/otazkovac

• https://corpora.fi.muni.cz/cblm/generate.cgi?language=slovak

• https://korpus.sk/developer/

• https://github.com/nemcek/notenizer

• https://github.com/marxsk/langusta3

• https://github.com/miso-belica/sumy

• https://github.com/dan-zeman/interset

• https://github.com/Orange-OpenSource/conllueditor

• https://github.com/SlovakNationalGallery/elasticsearch-slovencina

• https://github.com/VoxForge/voxforge.github.io (for creating speech corpora)

Publications

• https://github.com/MatusPilnan/wpub-docbook
• https://drndos.sk/bednarik-dp.pdf
• https://korpus.sk/publications.html