Skip to content
View stefan-it's full-sized avatar
🤗
hacking 🎧
🤗
hacking 🎧

Highlights

  • Pro

Organizations

@flairNLP @Hugging-Face-Supporter @GermanT5 @Hugging-Face-Helping-Hand @LEL-A
Block or Report

Block or report stefan-it

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Add an optional note:
Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
stefan-it/README.md

🤗

👋 Hi there

I'm currently working on the awesome Flair library and love contributing to 🤗 Transformers.

📰 Latest news

Latest news of new language models, PRs and many more!

  • 25.05.2023: New project: Historic Multilingual and Monolingual ELECTRA Models is released here.

  • 25.05.2023: Several ByT5 Historic Language Models are released under hmByT5 Preliminary and hmByT5 are released on the Hugging Face Model Hub. More information can be found in this repository.

  • 06.03.2023: Updated Ukrainian ELECTRA repository, see here.

  • 05.02.2023: New repository on experiments for XLM-V 🤗 Transformers Integeration, see here.

  • 03.02.2023: New repository for on-going evaluation of German T5 models on the GermEval 2014 NER task is up now! See here.

  • 28.01.2023: Start of new language models trained on the British Library corpus (model size ranges from 110M to 1B!), repository is here.

  • 23.01.2023: New German T5 models are released (trained on the the head and middle of GC4 corpus) and are available here.

  • 09.06.2022: Preprint of our upcoming HIPE-2022 Working Notes paper is now available here: hmBERT: Historical Multilingual Language Models for Named Entity Recognition.

  • 20.02.2022: Check out our new GermanT5 organization - expect new T5 models for German soon!

  • 14.12.2021: New badge: Member of Hugging Face Supporter org now 🎉

  • 13.12.2021: Release of Historic Language Model for Dutch (trained on Delpher corpus) - see repo here.

  • 06.12.2021: Release of smaller multilingual Historic Language Models (ranging from 2-8 layers) - see repo here.

  • 18.11.2021: Release of new multilingual and monolingual Historic Language Models - as preparation for upcoming CLEF-HIPE 2022 - see repo here.

  • 23.09.2021: Release of ConvBERTurk (cased and uncased) and ELECTRA (uncased) trained on Turkish part of mC4 corpus - see repo here.

  • 07.09.2021: Release of new larger German GPT-2 model - see model hub card here.

  • 17.08.2021: Release of new re-trained German GPT-2 model - see repo here.

  • 05.07.2021: Preprint of the ICDAR 2021 paper "Data Centric Domain Adaptation for Historical Text with OCR Errors" together with Luisa März, Nina Poerner, Benjamin Roth and Hinrich Schütze is out now!

  • 24.06.2021: Turkish Language Model Zoo repo got a new logo from Merve Noyan, please follow her! Additionally, a new Turkish ELECTRA model was released, that was trained on the Turkish part of multilingual C4 dataset. More details here.

  • 03.05.2021: GC4LM: A Colossal (Biased) language model for German was released. Repo with more details here.

  • 27.04.2021: Our paper "Data Centric Domain Adaptation for Historical Text with OCR Errors" was accepted at ICDAR 2021. More details soon!

  • 16.03.2021: Turkish model zoo is still growing! Public release of ConvBERTurk - see repo here.

  • 07.02.2021: Public release of German Europeana DistilBERT and ConvBERT models. Repo with more information is here.

  • 28.01.2021: Expect a new German Europeana ELECTRA Large model incl. a distilled German Europeana BERT model soon 🤗

  • 16.11.2020: Public release of French Europeana BERT and ELECTRA models - see repository here.

  • 16.11:2020: Public release of a German GPT-2 model (incl. fine-tuned model on Faust I and II). Repo with more information is available here.

  • 11.11.2020: Public release of Ukrainian ELECTRA model. Repo is now available here.

  • 11.11.2020: New workstation build (RTX 3090 and Ryzen 9 5900X) has completed! Expect a lot of new Flair/Transformers models in near future!

  • 02.11.2020: Public release of Italian XXL ELECTRA model. New repo for Italian BERT and ELECTRA models is now available here 🎉

  • 22.10.2020: Preprint of "German's Next Language Model" is now available here. Models are also available on the Hugging Face model hub 🎉

  • 22.10.2020: Our shared task paper Triple E - Effective Ensembling of Embeddings and Language Models for NER of Historical German together with Luisa März is released 🎉

  • 30.09.2020: "German's Next Language Model" together with Branden Chan and Timo Möller was accepted at COLING 2020! Expect new language models for German on the Hugging Face model hub soon 🤗

  • 23.09.2020: Flair in version 0.6.1 is out now!

  • 02.09.2020: Slow response time - I'm currently focussing on EACL 2021. Expect great new things 😎

  • 18.08.2020: French BERT model, trained on Historic newspapers from Europeana: find the model here and the corresponding repository here.

📃 Publications

📃 Preprints

💬 Contact

Please open an issue in the corresponding repository or tag me (@stefan-it) in issues/prs/commits on GitHub :)

Pinned

  1. Turkish BERT/DistilBERT, ELECTRA and ConvBERT models

    Python 423 44

  2. hmByT5 Public

    Upcoming Historic Multilingual and Monolingual ByT5 Models

    Python 5

  3. BERT and ELECTRA models trained on Europeana Newspapers

    Python 31 1

  4. Ukrainian ELECTRA model

    Python 9

  5. gc4lm Public

    GC4LM: A Colossal (Biased) language model for German

    13

  6. Experiments for XLM-V Transformers Integeration

    Python 11 2

680 contributions in the last year

Contribution Graph
Day of Week October November December January February March April May June July August September
Sunday No contributions on Sunday, September 25, 2022 No contributions on Sunday, October 2, 2022 No contributions on Sunday, October 9, 2022 No contributions on Sunday, October 16, 2022 No contributions on Sunday, October 23, 2022 No contributions on Sunday, October 30, 2022 No contributions on Sunday, November 6, 2022 No contributions on Sunday, November 13, 2022 No contributions on Sunday, November 20, 2022 No contributions on Sunday, November 27, 2022 No contributions on Sunday, December 4, 2022 No contributions on Sunday, December 11, 2022 No contributions on Sunday, December 18, 2022 No contributions on Sunday, December 25, 2022 No contributions on Sunday, January 1, 2023 No contributions on Sunday, January 8, 2023 No contributions on Sunday, January 15, 2023 No contributions on Sunday, January 22, 2023 1 contribution on Sunday, January 29, 2023 18 contributions on Sunday, February 5, 2023 8 contributions on Sunday, February 12, 2023 No contributions on Sunday, February 19, 2023 No contributions on Sunday, February 26, 2023 No contributions on Sunday, March 5, 2023 No contributions on Sunday, March 12, 2023 No contributions on Sunday, March 19, 2023 No contributions on Sunday, March 26, 2023 9 contributions on Sunday, April 2, 2023 3 contributions on Sunday, April 9, 2023 No contributions on Sunday, April 16, 2023 4 contributions on Sunday, April 23, 2023 2 contributions on Sunday, April 30, 2023 No contributions on Sunday, May 7, 2023 3 contributions on Sunday, May 14, 2023 No contributions on Sunday, May 21, 2023 No contributions on Sunday, May 28, 2023 No contributions on Sunday, June 4, 2023 1 contribution on Sunday, June 11, 2023 No contributions on Sunday, June 18, 2023 2 contributions on Sunday, June 25, 2023 No contributions on Sunday, July 2, 2023 No contributions on Sunday, July 9, 2023 No contributions on Sunday, July 16, 2023 No contributions on Sunday, July 23, 2023 No contributions on Sunday, July 30, 2023 5 contributions on Sunday, August 6, 2023 No contributions on Sunday, August 13, 2023 No contributions on Sunday, August 20, 2023 7 contributions on Sunday, August 27, 2023 3 contributions on Sunday, September 3, 2023 No contributions on Sunday, September 10, 2023 No contributions on Sunday, September 17, 2023 No contributions on Sunday, September 24, 2023
Monday No contributions on Monday, September 26, 2022 No contributions on Monday, October 3, 2022 No contributions on Monday, October 10, 2022 2 contributions on Monday, October 17, 2022 No contributions on Monday, October 24, 2022 No contributions on Monday, October 31, 2022 No contributions on Monday, November 7, 2022 No contributions on Monday, November 14, 2022 No contributions on Monday, November 21, 2022 No contributions on Monday, November 28, 2022 No contributions on Monday, December 5, 2022 No contributions on Monday, December 12, 2022 No contributions on Monday, December 19, 2022 No contributions on Monday, December 26, 2022 No contributions on Monday, January 2, 2023 No contributions on Monday, January 9, 2023 No contributions on Monday, January 16, 2023 1 contribution on Monday, January 23, 2023 No contributions on Monday, January 30, 2023 6 contributions on Monday, February 6, 2023 4 contributions on Monday, February 13, 2023 3 contributions on Monday, February 20, 2023 7 contributions on Monday, February 27, 2023 20 contributions on Monday, March 6, 2023 2 contributions on Monday, March 13, 2023 7 contributions on Monday, March 20, 2023 2 contributions on Monday, March 27, 2023 11 contributions on Monday, April 3, 2023 3 contributions on Monday, April 10, 2023 7 contributions on Monday, April 17, 2023 No contributions on Monday, April 24, 2023 No contributions on Monday, May 1, 2023 1 contribution on Monday, May 8, 2023 No contributions on Monday, May 15, 2023 16 contributions on Monday, May 22, 2023 No contributions on Monday, May 29, 2023 No contributions on Monday, June 5, 2023 No contributions on Monday, June 12, 2023 No contributions on Monday, June 19, 2023 3 contributions on Monday, June 26, 2023 1 contribution on Monday, July 3, 2023 No contributions on Monday, July 10, 2023 No contributions on Monday, July 17, 2023 1 contribution on Monday, July 24, 2023 No contributions on Monday, July 31, 2023 No contributions on Monday, August 7, 2023 No contributions on Monday, August 14, 2023 No contributions on Monday, August 21, 2023 2 contributions on Monday, August 28, 2023 6 contributions on Monday, September 4, 2023 No contributions on Monday, September 11, 2023 No contributions on Monday, September 18, 2023 No contributions on Monday, September 25, 2023
Tuesday No contributions on Tuesday, September 27, 2022 No contributions on Tuesday, October 4, 2022 No contributions on Tuesday, October 11, 2022 No contributions on Tuesday, October 18, 2022 No contributions on Tuesday, October 25, 2022 No contributions on Tuesday, November 1, 2022 No contributions on Tuesday, November 8, 2022 2 contributions on Tuesday, November 15, 2022 No contributions on Tuesday, November 22, 2022 No contributions on Tuesday, November 29, 2022 5 contributions on Tuesday, December 6, 2022 No contributions on Tuesday, December 13, 2022 No contributions on Tuesday, December 20, 2022 No contributions on Tuesday, December 27, 2022 No contributions on Tuesday, January 3, 2023 No contributions on Tuesday, January 10, 2023 No contributions on Tuesday, January 17, 2023 No contributions on Tuesday, January 24, 2023 No contributions on Tuesday, January 31, 2023 11 contributions on Tuesday, February 7, 2023 4 contributions on Tuesday, February 14, 2023 9 contributions on Tuesday, February 21, 2023 No contributions on Tuesday, February 28, 2023 26 contributions on Tuesday, March 7, 2023 10 contributions on Tuesday, March 14, 2023 1 contribution on Tuesday, March 21, 2023 7 contributions on Tuesday, March 28, 2023 8 contributions on Tuesday, April 4, 2023 6 contributions on Tuesday, April 11, 2023 17 contributions on Tuesday, April 18, 2023 16 contributions on Tuesday, April 25, 2023 1 contribution on Tuesday, May 2, 2023 No contributions on Tuesday, May 9, 2023 4 contributions on Tuesday, May 16, 2023 3 contributions on Tuesday, May 23, 2023 No contributions on Tuesday, May 30, 2023 1 contribution on Tuesday, June 6, 2023 No contributions on Tuesday, June 13, 2023 No contributions on Tuesday, June 20, 2023 1 contribution on Tuesday, June 27, 2023 No contributions on Tuesday, July 4, 2023 2 contributions on Tuesday, July 11, 2023 1 contribution on Tuesday, July 18, 2023 No contributions on Tuesday, July 25, 2023 9 contributions on Tuesday, August 1, 2023 7 contributions on Tuesday, August 8, 2023 No contributions on Tuesday, August 15, 2023 No contributions on Tuesday, August 22, 2023 4 contributions on Tuesday, August 29, 2023 1 contribution on Tuesday, September 5, 2023 2 contributions on Tuesday, September 12, 2023 No contributions on Tuesday, September 19, 2023 No contributions on Tuesday, September 26, 2023
Wednesday No contributions on Wednesday, September 28, 2022 No contributions on Wednesday, October 5, 2022 2 contributions on Wednesday, October 12, 2022 No contributions on Wednesday, October 19, 2022 1 contribution on Wednesday, October 26, 2022 No contributions on Wednesday, November 2, 2022 No contributions on Wednesday, November 9, 2022 No contributions on Wednesday, November 16, 2022 9 contributions on Wednesday, November 23, 2022 No contributions on Wednesday, November 30, 2022 1 contribution on Wednesday, December 7, 2022 No contributions on Wednesday, December 14, 2022 No contributions on Wednesday, December 21, 2022 No contributions on Wednesday, December 28, 2022 No contributions on Wednesday, January 4, 2023 No contributions on Wednesday, January 11, 2023 No contributions on Wednesday, January 18, 2023 No contributions on Wednesday, January 25, 2023 No contributions on Wednesday, February 1, 2023 10 contributions on Wednesday, February 8, 2023 No contributions on Wednesday, February 15, 2023 7 contributions on Wednesday, February 22, 2023 19 contributions on Wednesday, March 1, 2023 3 contributions on Wednesday, March 8, 2023 9 contributions on Wednesday, March 15, 2023 1 contribution on Wednesday, March 22, 2023 2 contributions on Wednesday, March 29, 2023 No contributions on Wednesday, April 5, 2023 3 contributions on Wednesday, April 12, 2023 2 contributions on Wednesday, April 19, 2023 12 contributions on Wednesday, April 26, 2023 10 contributions on Wednesday, May 3, 2023 7 contributions on Wednesday, May 10, 2023 No contributions on Wednesday, May 17, 2023 8 contributions on Wednesday, May 24, 2023 No contributions on Wednesday, May 31, 2023 No contributions on Wednesday, June 7, 2023 No contributions on Wednesday, June 14, 2023 No contributions on Wednesday, June 21, 2023 No contributions on Wednesday, June 28, 2023 No contributions on Wednesday, July 5, 2023 No contributions on Wednesday, July 12, 2023 No contributions on Wednesday, July 19, 2023 No contributions on Wednesday, July 26, 2023 5 contributions on Wednesday, August 2, 2023 No contributions on Wednesday, August 9, 2023 1 contribution on Wednesday, August 16, 2023 No contributions on Wednesday, August 23, 2023 3 contributions on Wednesday, August 30, 2023 No contributions on Wednesday, September 6, 2023 No contributions on Wednesday, September 13, 2023 No contributions on Wednesday, September 20, 2023 No contributions on Wednesday, September 27, 2023
Thursday No contributions on Thursday, September 29, 2022 No contributions on Thursday, October 6, 2022 No contributions on Thursday, October 13, 2022 No contributions on Thursday, October 20, 2022 No contributions on Thursday, October 27, 2022 No contributions on Thursday, November 3, 2022 No contributions on Thursday, November 10, 2022 No contributions on Thursday, November 17, 2022 6 contributions on Thursday, November 24, 2022 No contributions on Thursday, December 1, 2022 1 contribution on Thursday, December 8, 2022 No contributions on Thursday, December 15, 2022 No contributions on Thursday, December 22, 2022 No contributions on Thursday, December 29, 2022 No contributions on Thursday, January 5, 2023 No contributions on Thursday, January 12, 2023 No contributions on Thursday, January 19, 2023 No contributions on Thursday, January 26, 2023 No contributions on Thursday, February 2, 2023 No contributions on Thursday, February 9, 2023 2 contributions on Thursday, February 16, 2023 8 contributions on Thursday, February 23, 2023 19 contributions on Thursday, March 2, 2023 8 contributions on Thursday, March 9, 2023 2 contributions on Thursday, March 16, 2023 18 contributions on Thursday, March 23, 2023 No contributions on Thursday, March 30, 2023 No contributions on Thursday, April 6, 2023 6 contributions on Thursday, April 13, 2023 7 contributions on Thursday, April 20, 2023 1 contribution on Thursday, April 27, 2023 No contributions on Thursday, May 4, 2023 No contributions on Thursday, May 11, 2023 No contributions on Thursday, May 18, 2023 15 contributions on Thursday, May 25, 2023 No contributions on Thursday, June 1, 2023 1 contribution on Thursday, June 8, 2023 1 contribution on Thursday, June 15, 2023 No contributions on Thursday, June 22, 2023 No contributions on Thursday, June 29, 2023 1 contribution on Thursday, July 6, 2023 2 contributions on Thursday, July 13, 2023 1 contribution on Thursday, July 20, 2023 No contributions on Thursday, July 27, 2023 No contributions on Thursday, August 3, 2023 2 contributions on Thursday, August 10, 2023 1 contribution on Thursday, August 17, 2023 3 contributions on Thursday, August 24, 2023 No contributions on Thursday, August 31, 2023 2 contributions on Thursday, September 7, 2023 No contributions on Thursday, September 14, 2023 No contributions on Thursday, September 21, 2023 No contributions on Thursday, September 28, 2023
Friday No contributions on Friday, September 30, 2022 No contributions on Friday, October 7, 2022 No contributions on Friday, October 14, 2022 No contributions on Friday, October 21, 2022 No contributions on Friday, October 28, 2022 No contributions on Friday, November 4, 2022 No contributions on Friday, November 11, 2022 No contributions on Friday, November 18, 2022 No contributions on Friday, November 25, 2022 No contributions on Friday, December 2, 2022 No contributions on Friday, December 9, 2022 No contributions on Friday, December 16, 2022 No contributions on Friday, December 23, 2022 No contributions on Friday, December 30, 2022 No contributions on Friday, January 6, 2023 No contributions on Friday, January 13, 2023 No contributions on Friday, January 20, 2023 12 contributions on Friday, January 27, 2023 9 contributions on Friday, February 3, 2023 No contributions on Friday, February 10, 2023 2 contributions on Friday, February 17, 2023 4 contributions on Friday, February 24, 2023 9 contributions on Friday, March 3, 2023 4 contributions on Friday, March 10, 2023 No contributions on Friday, March 17, 2023 No contributions on Friday, March 24, 2023 2 contributions on Friday, March 31, 2023 15 contributions on Friday, April 7, 2023 11 contributions on Friday, April 14, 2023 4 contributions on Friday, April 21, 2023 2 contributions on Friday, April 28, 2023 3 contributions on Friday, May 5, 2023 No contributions on Friday, May 12, 2023 No contributions on Friday, May 19, 2023 No contributions on Friday, May 26, 2023 No contributions on Friday, June 2, 2023 No contributions on Friday, June 9, 2023 No contributions on Friday, June 16, 2023 No contributions on Friday, June 23, 2023 No contributions on Friday, June 30, 2023 No contributions on Friday, July 7, 2023 No contributions on Friday, July 14, 2023 No contributions on Friday, July 21, 2023 11 contributions on Friday, July 28, 2023 1 contribution on Friday, August 4, 2023 1 contribution on Friday, August 11, 2023 No contributions on Friday, August 18, 2023 No contributions on Friday, August 25, 2023 2 contributions on Friday, September 1, 2023 1 contribution on Friday, September 8, 2023 No contributions on Friday, September 15, 2023 No contributions on Friday, September 22, 2023 No contributions on Friday, September 29, 2023
Saturday No contributions on Saturday, October 1, 2022 No contributions on Saturday, October 8, 2022 No contributions on Saturday, October 15, 2022 No contributions on Saturday, October 22, 2022 No contributions on Saturday, October 29, 2022 No contributions on Saturday, November 5, 2022 No contributions on Saturday, November 12, 2022 No contributions on Saturday, November 19, 2022 No contributions on Saturday, November 26, 2022 No contributions on Saturday, December 3, 2022 No contributions on Saturday, December 10, 2022 No contributions on Saturday, December 17, 2022 No contributions on Saturday, December 24, 2022 No contributions on Saturday, December 31, 2022 No contributions on Saturday, January 7, 2023 No contributions on Saturday, January 14, 2023 No contributions on Saturday, January 21, 2023 4 contributions on Saturday, January 28, 2023 2 contributions on Saturday, February 4, 2023 No contributions on Saturday, February 11, 2023 No contributions on Saturday, February 18, 2023 No contributions on Saturday, February 25, 2023 5 contributions on Saturday, March 4, 2023 1 contribution on Saturday, March 11, 2023 No contributions on Saturday, March 18, 2023 No contributions on Saturday, March 25, 2023 No contributions on Saturday, April 1, 2023 2 contributions on Saturday, April 8, 2023 1 contribution on Saturday, April 15, 2023 3 contributions on Saturday, April 22, 2023 8 contributions on Saturday, April 29, 2023 2 contributions on Saturday, May 6, 2023 No contributions on Saturday, May 13, 2023 No contributions on Saturday, May 20, 2023 No contributions on Saturday, May 27, 2023 No contributions on Saturday, June 3, 2023 4 contributions on Saturday, June 10, 2023 No contributions on Saturday, June 17, 2023 No contributions on Saturday, June 24, 2023 1 contribution on Saturday, July 1, 2023 No contributions on Saturday, July 8, 2023 No contributions on Saturday, July 15, 2023 No contributions on Saturday, July 22, 2023 2 contributions on Saturday, July 29, 2023 No contributions on Saturday, August 5, 2023 No contributions on Saturday, August 12, 2023 1 contribution on Saturday, August 19, 2023 No contributions on Saturday, August 26, 2023 No contributions on Saturday, September 2, 2023 No contributions on Saturday, September 9, 2023 No contributions on Saturday, September 16, 2023 No contributions on Saturday, September 23, 2023

Contribution activity

September 2023

Created 1 repository

Created a pull request in huggingface/autotrain-advanced that received 1 comment

Space Runner: fix cli args

Hey, this PR fixes the cli args for --backend and --env parameters. Currently, the help page shows: --backend BACKEND Hugging Face backend to use …

+1 −1 1 comment

Created an issue in flairNLP/flair that received 2 comments

[Bug]: Loading Model with own TrainerPlugin

Describe the bug Hi, I was using the awesome new TrainerPlugin functionality and wrote an own plugin that reports GPU usage. For that I placed my p…

2 comments

Seeing something unexpected? Take a look at the GitHub profile guide.