wordfreq-rs

This library is a yet another Rust port of Python's wordfreq, allowing you to look up the frequencies of words in many languages.

Getting started

As with the original wordfreq, you can start looking for word frequencies right away.

use wordfreq_model::load_wordfreq;
use wordfreq_model::ModelKind;

fn main() {
    let wf_lgen = load_wordfreq(ModelKind::LargeEn).unwrap();
    let wf_lgfr = load_wordfreq(ModelKind::LargeFr).unwrap();

    println!("cafe(en) = {:?}", wf_lgen.word_frequency("cafe"));
    // => 1.2481286e-5
    println!("café(en) = {:?}", wf_lgen.word_frequency("café"));
    // => 5.705049e-6
    println!("cafe(fr) = {:?}", wf_lgfr.word_frequency("cafe"));
    // => 1.533655e-6
    println!("café(fr) = {:?}", wf_lgfr.word_frequency("café"));
    // => 5.8307935e-5
}

We recommend to first visit wordfreq-model for getting started because it allows you to load distributed models automatically. wordfreq-example will also be helpful to understand the behavior of this library.

The core API is provided by wordfreq.

Repository structure

This repository contains three crates:

• wordfreq is a crate that provides an API to lookup word frequencies.
• wordfreq-model is a crate that provides a loader for pre-compiled wordfreq models.
• wordfreq-example is a crate that provides an example program.

Licensing

Licensed under either of

• Apache License, Version 2.0 (LICENSE-APACHE or http://www.apache.org/licenses/LICENSE-2.0)
• MIT license (LICENSE-MIT or http://opensource.org/licenses/MIT)

at your option.

The model files are distributed here together with the credits.