ExTextSplitter

This package provides bindings to text-splitter crate Check the example livebook By default only the text_splitter function is available but you can configure the available features:

# this will enable all features
config :ex_text_splitter,
  features: ["markdown", "tiktoken-rs"]

This can be also configured using Mix.installed

Mix.install(
    [:ex_text_splitter],
    config: [ex_text_splitter: [features: ["markdown"]]]
)

Installation

If available in Hex, the package can be installed by adding ex_text_splitter to your list of dependencies in mix.exs:

def deps do
  [
    {:ex_text_splitter, "~> 0.1.0"}
  ]
end

Documentation can be generated with ExDoc and published on HexDocs. Once published, the docs can be found at https://hexdocs.pm/ex_text_splitter.