👋 Hi there
I'm working at Bavarian State Library
I'm currently working on the awesome Flair
library and love contributing to
📰 Latest news
Latest news of new language models, PRs and many more!
-
07.09.2021: Release of new larger German GPT-2 model - see model hub card here.
-
17.08.2021: Release of new re-trained German GPT-2 model - see repo here.
-
05.07.2021: Preprint of the ICDAR 2021 paper "Data Centric Domain Adaptation for Historical Text with OCR Errors" together with Luisa März, Nina Poerner, Benjamin Roth and Hinrich Schütze is out now!
-
24.06.2021: Turkish Language Model Zoo repo got a new logo from Merve Noyan, please follow her! Additionally, a new Turkish ELECTRA model was released, that was trained on the Turkish part of multilingual C4 dataset. More details here.
-
03.05.2021: GC4LM: A Colossal (Biased) language model for German was released. Repo with more details here.
-
27.04.2021: Our paper "Data Centric Domain Adaptation for Historical Text with OCR Errors" was accepted at ICDAR 2021. More details soon!
-
16.03.2021: Turkish model zoo is still growing! Public release of ConvBERTurk - see repo here.
-
07.02.2021: Public release of German Europeana DistilBERT and ConvBERT models. Repo with more information is here.
-
28.01.2021: Expect a new German Europeana ELECTRA Large model incl. a distilled German Europeana BERT model soon
🤗 -
16.11.2020: Public release of French Europeana BERT and ELECTRA models - see repository here.
-
16.11:2020: Public release of a German GPT-2 model (incl. fine-tuned model on Faust I and II). Repo with more information is available here.
-
11.11.2020: Public release of Ukrainian ELECTRA model. Repo is now available here.
-
11.11.2020: New workstation build (RTX 3090 and Ryzen 9 5900X) has completed! Expect a lot of new Flair/Transformers models in near future!
-
02.11.2020: Public release of Italian XXL ELECTRA model. New repo for Italian BERT and ELECTRA models is now available here
🎉 -
22.10.2020: Preprint of "German's Next Language Model" is now available here. Models are also available on the Hugging Face model hub
🎉 -
22.10.2020: Our shared task paper Triple E - Effective Ensembling of Embeddings and Language Models for NER of Historical German together with Luisa März is released
🎉 -
30.09.2020: "German's Next Language Model" together with Branden Chan and Timo Möller was accepted at COLING 2020! Expect new language models for German on the Hugging Face model hub soon
🤗 -
23.09.2020: Flair in version 0.6.1 is out now!
-
02.09.2020: Slow response time - I'm currently focussing on EACL 2021. Expect great new things
😎 -
18.08.2020: French BERT model, trained on Historic newspapers from Europeana: find the model here and the corresponding repository here.
📃 Publications
-
Branden Chan, Stefan Schweter and Timo Möller. German's Next Language Model. In Proceedings of the 28th International Conference on Computational Linguistics.
-
Stefan Schweter and Luisa März. Triple E - Effective Ensembling of Embeddings and Language Models for NER of Historical German. In Experimental IR Meets Multilinguality, Multimodality, and Interaction - Proceedings of the Eleventh International Conference of the CLEF Association (CLEF 2020).
-
Stefan Schweter and Sajawel Ahmed. Deep-EOS: General-Purpose Neural Networks for Sentence Boundary Detection. In Proceedings of the 15th Conference on Natural Language Processing (KONVENS 2019).
-
Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter and Roland Vollgraf. FLAIR: An Easy-to-Use Framework for State-of-the-Art NLP. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations).
-
Stefan Schweter and Johannes Baiter. Towards Robust Named Entity Recognition for Historic German. In Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019).
📃 Preprints
- Stefan Schweter and Alan Akbik. FLERT: Document-Level Features for Named Entity Recognition.
💬 Contact
Please open an issue in the corresponding repository or tag me (@stefan-it) in issues/prs/commits on GitHub :)
You can also find me on the