DaNLP is a repository for Natural Language Processing resources for the Danish Language. It is a collection of available datasets and models for a variety of NLP tasks. It features code examples on how to use the datasets and models in popular NLP frameworks such as spaCy and NLTK as well as Deep Learning frameworks such as PyTorch and TensorFlow.
🎉Version 0.0.3 has been released with loading functions for Danish NER datasets ✨The Danish Dependency Treebank has been annotated with NER tags. You can use DaNLP to load it 🎭Notebook tutorial for Sentiment analysis models using zero-shot transfer learning from LASER
🚧Models trained on the new annotated Danish NER dataset 🚧Support for Danish in the spaCy framework
To get started using DaNLP in your python project simply install the pip package. However installing the pip package will not install all NLP libraries. If you want to try out the models in DaNLP you can use the Docker images that has all the NLP libraries installed.
Install with pip
To get started using DaNLP simply install the project with pip:
pip install danlp
Note that the installation of DaNLP does not install other NLP libraries such as Gensim, Spacy or Flair. This allows the installation to be as minimal as possible and let the user choose to e.g. load word embeddings with either spaCy or Gensim.
Install with Docker
To quickly get started with DaNLP and to try out the models you can use our Docker image. To start a ipython session simply run:
docker run -it --rm alexandrainst/danlp ipython
If you want to run a
<script.py> in your current working directory you can run:
docker run -it --rm -v "$PWD":/usr/src/app -w /usr/src/app alexandrainst/danlp python <script.py>
You can also quickly get started with one of our notebooks.
Natural Language Processing is an active area of research and it consists of many different tasks. The DaNLP repository provides an overview of Danish models for some of the most common NLP tasks.
The repository is under development and this is the list of NLP tasks we have covered and plan to cover in the repository.
If you are interested in Danish support for any specific NLP task you are welcome to get in contact with us.
The number of datasets in the Danish is limited. The DaNLP repository provides an overview of the available Danish datasets that can be used for commercial purposes.
The DaNLP package allows you to download and preprocess datasets. You can read about the datasets here.
You will find examples and tutorials here that shows how to use NLP in Danish. We will also provide some real cases of how NLP is applied in Danish companies.
How do I contribute?
If you want to contribute to the DaNLP repository and make it better, your help is very welcome. You can contribute to the project in many ways:
- Help us write good tutorials on Danish NLP use-cases
- Contribute with your own pretrained NLP models or datasets in Danish
- Notify us of other Danish NLP resources
- Create GitHub issues with questions and bug reports
Who is behind?
The DaNLP repository is maintained by the Alexandra Institute which is a Danish non-profit company with a mission to create value, growth and welfare in society. The Alexandra Institute is a member of GTS, a network of independent Danish research and technology organisations.
The work on this repository is part the Dansk For Alle performance contract allocated to the Alexandra Insitute by the Danish Ministry of Higher Education and Science. The project runs in two years in 2019 and 2020.