This repository has been archived by the owner. It is now read-only.
Onyx plugin for Factual's durable-queue
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
scripts
src/onyx
test-resources
test/onyx/plugin
.gitignore
README.md
changes.md
circle.yml
project.clj

README.md

onyx-durable-queue

Onyx plugin for Factual's durable-queue.

Installation

In your project file:

[org.onyxplatform/onyx-durable-queue "0.9.15.0"]

In your peer boot-up namespace:

(:require [onyx.plugin.durable-queue])

Functions

read-from-queue

Catalog entry:

{:onyx/name :read-from-queue
 :onyx/tenancy-ident :durable-queue/read-from-queue
 :onyx/type :input
 :onyx/medium :durable-queue
 :durable-queue/queue-name input-queue-name
 :durable-queue/directory queue-directory
 :onyx/batch-size batch-size
 :onyx/max-peers 1
 :onyx/doc "Reads segments via durable-queue"}

Lifecycle entries:

[{:lifecycle/task :read-from-queue
  :lifecycle/calls :onyx.plugin.durable-queue/reader-state-calls}
 {:lifecycle/task :read-from-queue
  :lifecycle/calls :onyx.plugin.durable-queue/reader-connection-calls}]
write-to-queue

Catalog entry:

{:onyx/name :write-to-queue
 :onyx/tenancy-ident :durable-queue/write-to-queue
 :onyx/type :output
 :onyx/medium :durable-queue
 :durable-queue/queue-name output-queue-name
 :durable-queue/directory queue-directory
 :onyx/batch-size batch-size
 :onyx/doc "Writes segments via durable-queue"}

Lifecycle entries:

[{:lifecycle/task :write-to-queue
  :lifecycle/calls :onyx.plugin.durable-queue/writer-calls}]

Attributes

All attributes correspond directly to the durable-queue configuration opts. See their documentation for descriptions of each.

key type
:durable-queue/queue-name string
:durable-queue/directory string
:durable-queue/max-queue-size int
:durable-queue/slab-size int
:durable-queue/fsync-put? boolean
:durable-queue/fsync-take? boolean
:durable-queue/fsync-threshold int
:durable-queue/fsync-interval int

Contributing

Pull requests into the master branch are welcomed.

License

Copyright © 2015 Michael Drogalis

Distributed under the Eclipse Public License, the same as Clojure.