Skip to content

diversifix/diversiformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

language license widget
de
gpl
text example_title
Ersetze "Lehrer" durch "Lehrerin oder Lehrer": Ein promovierter Mathelehrer ist noch nie im Unterricht eingeschlafen.
Example 1
text example_title
Ersetze "Student" durch "studierende Person": Maria ist kein Student.
Example 2

Diversiformer 🤗 🏳️‍🌈 🇩🇪

Work in progress.

Language model for inclusive language in German, fine-tuned on mT5.

An experimental model version is released on Huggingface.

Source code for fine-tuning is available on GitHub.

Tasks

  • DETECT: Recognizes instances of the generic masculine, and of other exclusive language. To do.

  • SUGGEST: Suggest inclusive alternatives to masculine and exclusive words. To do.

  • REPLACE: Replace one phrase by another, while preserving grammatical coherence. Work in progress.

    • ▶️ Ersetze "Schüler" durch "Schülerin oder Schüler": Die Schüler kamen zu spät.

      ◀️ Die Schülerinnen und Schüler kamen zu spät.

    • ▶️ Ersetze "Lehrer" durch "Kollegium": Die wartenden Lehrer wunderten sich.

      ◀️ Das wartende Kollegium wunderte sich.

Usage

>>> from transformers import pipeline
>>> generator = pipeline("text2text-generation", model="diversifix/diversiformer")
>>> generator('Ersetze "Schüler" durch "Schülerin oder Schüler": Die Schüler kamen zu spät.', max_length=500)

Dev ideas

  • Use classifier to filter out training data of low quality? (~adversarial approach)

License

Diversiformer. Transformer model for inclusive language.

Copyright (C) 2022 Diversifix e. V.

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see https://www.gnu.org/licenses/.