Skip to content
Java implmentation of LemmaGen project
Java
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
src
.gitignore formatting Feb 21, 2018
README.md configure release Feb 21, 2018
nb-configuration.xml separate modules Feb 21, 2018
pom.xml

README.md

JLemmagen

JLemmaGen is java implmentation of LemmaGen project. It's open source lemmatizer with 15 prebuilted european lexicons. Of course you can build your own lexicon.

LemmaGen project aims at providing standardized open source multilingual platform for lemmatisation.

Project contains 2 libraries:

  • lemmagen.jar - implementation of lemmatizer and API for building own lemmatizers
  • lemmagen-lang.jar - prebuilted lemmatizers from Multext Eastern dictionaries * IMPORTANT! - see License chapter.

Sample Usage

Lemmatizer lm = LemmatizerFactory.getPrebuilt("mlteast-en");
assert("be".equals(lm.lemmatize("are")));

Maven

Repository:

<repository>
    <id>jlemmagen-snapshots</id>
    <name>JLemmaGen snaphsot repository</name>
    <url>https://repository.xit.camp/repository/maven-public-releases/</url>
    <snapshots>
        <enabled>true</enabled>
    </snapshots>
    <layout>default</layout>
</repository>

Dependency:

<dependency>
    <groupId>eu.hlavki.text</groupId>
    <artifactId>lemmagen</groupId>
    <version>1.0</version>
</dependency>

Additionally you can add language dictionaries:

<dependency>
    <groupId>eu.hlavki.text</groupId>
    <artifactId>lemmagen-lang</groupId>
    <version>1.0</version>
</dependency>

Lucene (Solr)

You need these jars to integrate with lucene/solr:

  • lemmagen-lucene.jar
  • lemmagen.jar
  • lemmagen-lang.jar
  • SLF4J API and implememtation (e.g. slf4j-jdk14.jar)

Example of solr filter definition in schema (e.g. Slovak):

<filter class="org.apache.lucene.analysis.lemmagen.LemmagenFilterFactory" lexicon="mlteast-sk"/>

Making release

mvn clean release:prepare release:perform -Darguments='-Dmaven.javadoc.failOnError=false'
git push --follow-tags

License

All source code is licensed under Apache License 2.0. Important note is that binary rule tree files (*.lem) are NOT licensed under Apache License 2.0 and can be used only for non-commercial projects.

You can’t perform that action at this time.