Skip to content

PureFnOrg/starman

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

43 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

starman

A Redis implementation of the Bridges protocols.

Starman

What does it do?

Two component implementations of redis clients are included in this project. Carmine (https://github.com/ptaoussanis/carmine) is the original implementation. However, beginning in Aug 2018 carmine's internal connection pool strategy began to inexplicably fail during high-volume ETL operations, routinely filling up the OS's transient TCP port space with 20k+ connections sitting in TIME_WAIT from both GET and SET operations.

Jedis was explored as an alternative, and it's connection pooling appears to actually work.

Carmine

https://github.com/ptaoussanis/carmine

Features

  • Supports out-of-the-box nippy encoding for Clojure data structures, but also uses it's own serialization mechanism including custom carmine specific headers. (Not good)

  • Optimistic locking in swap-in by using WATCH

  • Automatic retries of failed commands (e.g. swap-in)

  • A whole host of other Redis features which we don't use.

Jedis

Jedis is fully featured, but only a small portion is wrapped. Current implementation is bare-bones and not considered production ready except for high-volume ETLs which only use GET, SET and DEL.

Features

  • Optimistic locking with WATCH

  • Automatic retries of failed commands (e.g. swap-in)

  • Everything is stringly typed.

Development

You can interact with the library in the REPL by typing in Emacs:

M-x cider-jack-in
user> 

Initialize the components by:

user> (dev)
dev> (reset)

Deploying

First, setup your GPG credentials and Leiningen environment.

See these for details:

https://github.com/technomancy/leiningen/blob/master/doc/GPG.md https://github.com/technomancy/leiningen/blob/master/doc/DEPLOY.md#authentication

TL;DR

To release a snapshot:

$ lein release :patch

To release a minor version:

$ lein release :minor

To release a major version:

$ lein release :major

About

A Redis implementation of the Bridges protocols.

Resources

License

Stars

Watchers

Forks

Packages

No packages published