Pinned

1. trafilatura Public

   Web scraping library and command-line tool for text discovery and extraction (main content, metadata, comments)

   Python 507 68

2. htmldate Public

   Fast and robust date extraction from web pages, with Python or on the command-line

   Python 51 17

3. simplemma Public

   Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

   Python 35 2

4. py3langid Public

   Forked from saffsd/langid.py

   Faster, modernized fork of the language identification tool langid.py

   Python 9 2

5. courlan Public

   Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters

   Python 12 2

6. German-NLP Public

   Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

   229 42