Zemberek-NLP

Zemberek-NLP provides basic Natural Language Processing tools for Turkish. Please note that all code and APIs are subject to change until version 1.0.0

Latest version is 0.12.0 (April 29th 2018). Change Log

Citing

If you use this project in an academic publication, please refer to this site.

FAQ

Please read the FAQ for common questions.

Usage

Maven

Add this to pom.xml file

<repositories>
    <repository>
        <id>ahmetaa-repo</id>
        <name>ahmetaa Maven Repo on Github</name>
        <url>https://raw.github.com/ahmetaa/maven-repo/master</url>
    </repository>
</repositories>

And dependencies (For example morphology):

<dependencies>
    <dependency>
        <groupId>zemberek-nlp</groupId>
        <artifactId>zemberek-morphology</artifactId>
        <version>0.12.0</version>
    </dependency>
</dependencies>

Jar distributions

Google docs page page contains jar files for different versions.

[module-jars] folder contain all zemberek modules as separate jar files. [zemberek-all-VERSION.jar] contains all zemberek modules. [dependencies] folder contains other dependencies suchas Google Guava.

Examples

There is a examples module in the code for usage examples.

Also, there is a separate project with same examples that uses Zemberek-NLP as maven modules: Turkish-nlp-examples

Modules

Core

Core classes such as special Collection classes, Hash functions and helpers.

Maven artifact id : zemberek-core

Morphology

Turkish morphological analysis, disambiguation and word generation. Documentation

Maven artifact id : zemberek-morphology

Tokenization

Turkish Tokenization and sentence boundary detection. Documentation

Maven artifact id : zemberek-tokenization

Language Identification.

Allows fast identification of text language. Documentation

Maven artifact id : zemberek-lang-id

Language modeling

Provides a language compression algorithm. Documentation

Maven artifact id : zemberek-lm

Normalization

Provides basic spell checker and suggestion functions. Documentation

Maven artifact id : zemberek-normalization

Examples

Provides basic usage examples. Source

Maven artifact id : zemberek-examples

Known Issues and Limitations

• Project requires Java 8 or higher.
• Morphological disambiguation is working less accurate then expected.
• Library is not well-tested for multi-threaded usage.

Please see issues section for further issues and feel free to create new ones.

License

Code is licensed under Apache License, Version 2.0

Acknowledgements

Please refer to contributors.txt file.