Converts OTL queries to Spark DAG and orchestrates computing processes based on user pools. Also, manages caches in order to decrease a computational load on a platform.
You'd to publish local dispatcher-sdk lib in order not to use unmanaged libs.
Install:
- java 1.8
- sbt 1.8.0
- scala 2.11.12
- Publish local dispatcher-sdk.
- Download managed dependencies.
We've tests for these and think it works... Maybe it is with little problems.
- addtotals
- appendpipe
- collect
- command
- dedup
- eval (MV-subcommands don't work with SV-fields and vice verse, also some of them are not able to work with nulls)
- fields
- fillnull
- foreach
- head
- inputlookup
- join
- lookup
- makemv
- makeresults
- mvcombine
- mvexpand
- otfieldsummary
- otinputlookup
- otloadjob
- otmakeresults
- otoutputlookup
- otstats
- rename
- replace
- return
- reverse
- rex
- search
- spath
- stats
- table
- tail
- timechart
- transaction
- union
- untable
- where
- xyseries
Untested but realized commands:
- chart
- convert
- delta
- eventstats
- fieldsummary
- filldown
- rangemap
- sort
- streamstats
- top
- transpose
- outputlookup
sbt test
Use make pack to get a deployable tarball. Unpack it to $OTP_HOME. Create conf files based on examples.
Check example configs in docs dir.
For use logging you should specify path to file loglevel.properties in loglevel property in application.conf.
File loglevel.properties contains mapping log levels to logger name.
For command classes name of logger is simple class name by default.
Use start.sh from Makefile
See Readme.md in Software Development Kit repository.
config-1.3.4.jar
json4s-ast_2.11-3.5.5.jar
json4s-native_2.11-3.5.5.jar
postgresql-42.2.5.jar
dispatcher-sdk_2.11-1.2.2.jar
ot_simple_rest 1.7.0
ot_simple 1.0.0
zeppelin-spl 2.2.0
ot_simple_zeppelin 0.2.1
nifi_tools 1.0.5
We use SemVer for versioning. For the versions available, see the tags on this repository.
Nikolay Ryabykh (nryabykh@isgneuro.com)
Sergei Ermilov (sermilov@isgneuro.com)
Dmitriy Gusarov (dgusarov@isgneuro.com)
Andrey Starchenkov (astarchenkov@isgneuro.com)
OT.PLATFORM. License agreement.
Aleksandr Matiakubov (amatiakubov@isgneuro.com)
Evgenii Sofronov (esofronov@isgneuro.com)
Mikhail Rubashenkov (mrubashenkov@isgneuro.com)
Mikhail Babakov (mbabakov@isgneuro.com)
Dmitrii Sobolev (dsobolev@isgneuro.com)
Dmitrii Trubenkov (dtrubenkov@isgneuro.com)
Aleksandr Kronov (akronov@isgneuro.com)
Pavel Volkov (pvolkov@isgneuro.com)