To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks
To follow along with our demonstration simply clone this repository and run
docker-compose up
You'll now have a working JODA setup. You can access the web interface at http://localhost:8080.
You can find the language specification at https://joda-explore.github.io/JODA/
Additionally, does the example_queries.txt
file contain some example queries that you can run in the web interface.
The modules
folder contains some example modules that you can use to get started with user-defined-modules JODA.
The included directoies are:
aggregation
: Contains modules that can be used to aggregate multiple documentsexport
: Contains modules that can be used to export data from JODAìmport
: Contains modules that can be used to import data into JODAindex
: Contains modules that can be used to create custom indicesvalue
: Contains modules that can be used to create user-defined functions for usage in the JODA query language
If you want to experiment with the database connection modules you can run
./initEmptyDB.sh
to initialize an empty database with an empty table in it. The database will be initialized within the docker container started with the remaining JODA services.