forked from kognitio-ltd/kognitio-docker-container
-
Notifications
You must be signed in to change notification settings - Fork 0
/
README
125 lines (65 loc) · 6.69 KB
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
Kognitio Docker Container
=========================
Information
-----------
Kognitio's docker containers are built automatically from our Github repository:
https://github.com/kognitio-ltd/kognitio-docker-container
Builds are hosted on Docker Hub here:
https://hub.docker.com/r/kognitio/kognitio
You can launch Kognitio containers directly using the 'kognitio/kognitio' image, make derived containers from the official ones or fork the repository and create a modified container to suit your needs.
License
-------
Kognitio docker containers contain Kognitio's analytical platform software which is not part of the docker container repository (the Dockerfile downloads it from Kognitio's website). Use of this software is subject to Kognitio's EULA (see the 'LICENSE' file in this repository or the /opt/kognitio/LICENSE file in the container image). Kognitio's software is free to use for clusters with a total RAM capacity up to 512G (sum of memory limits on all containers). For larger clusters a license is required, contact Kognitio for details.
Links
-----
More information about Kognitio's software can be found at https://kognitio.com
Product documentation can be found at https://kognitio.com/documentation
Blog posts describing the container in more detail:
* https://kognitio.com/blog/kognitio-docker -- Overview
* https://kognitio.com/blog/kognitio-docker-2 -- Generic Usage Instructions
* https://kognitio.com/blog/kognitio-docker-3 -- Walkthrough with vanilla Docker commands
* https://kognitio.com/blog/kognitio-docker-4 -- Walkthrough on Kubernetes
Container Requirements
----------------------
Kognitio's docker container should work in all docker environments, including container orchestration environments which spread Kognitio containers for a cluster over multiple nodes. The container requires the following to operate properly:
* A docker volume should be mounted on /data. This volume contains all of the persistent data for the Kognitio cluster, everything else in a container is ephemeral.
* Kognitio will use as much RAM as you allow it to! For this reason we recommend you always place a memory limit on your Kognitio containers to prevent them using up all of the memory on the node. We also recommend setting --memory-swap to the same value as --memory in order to disable swapping for your containers because Kognitio is an in-memory product which works best without swap.
* The minimum memory required to run a Kognitio container is 4G. Containers with less than 16G of RAM may exhibit reduced functionality under heavy loads.
Starting a Kognitio system on Docker
------------------------------------
* To begin with, choose a system ID for your cluster. This should be a string of up to 12 characters containing lower case letters, numbers and _ . In these instructions we will use 'mycluster'.
* Now, create a data volume to hold the permanent data for your Kognitio cluster. This will be mounted by all Kognitio containers in the cluster on the /data mount point. For example:
docker volume create mycluster-datavol
* Once this is complete, create a single Kognitio container which mounts the data volume. This will be used to initialise the container. For example:
docker run -p 6550:6550 --mount source=mycluster-datavol,destination=/data \
--name mycluster1 --memory 8G --memory-swap 8G \
--rm -d kognitio/kognitio
The -p 6550:6550 argument is discussed later. For now, just export port 6550 on the first container.
* Now use the running container to initialise the datavolume with the kognitio-cluster-init command. Supply the system ID you chose as the first argument, for example:
docker exec -ti mycluster1 kognitio-cluster-init mycluster
The -ti flag is required here as this command will present the EULA and require you to accept it.
* Now you're ready to create a Kognitio cluster. Create as many containers as you need and check that everything is OK by running the 'wxprobe -H' command against one of the containers:
docker run --mount source=mycluster-datavol,destination=/data \
--name mycluster2 --memory 8G --memory-swap 8G \
--rm -d kognitio/kognitio
docker run --mount source=mycluster-datavol,destination=/data \
--name mycluster3 --memory 8G --memory-swap 8G \
--rm -d kognitio/kognitio
docker exec mycluster1 wxprobe -H
This command should show all 3 nodes and the appropriate quantity of storage. You may have to wait a few seconds (longer for large clusters) for all containers to start and join up so check the wxprobe command shows the correct number of nodes before moving on.
* Finally, initialise the Kognitio database by running 'wxadmin server+newsys syspass' on one of the containers. Where syspass is replaced with the password you want to use as a sys password. For example:
docker exec -ti mycluster1 kognitio-create-database mysyspassword
* Once this has finished the server should be available to use. You can test this by running 'wxsubmit' in one of the containers, for example:
docker exec -ti mycluster1 wxsubmit -s localhost sys -p mysyspassword
And then try some SQL, for example:
SELECT os_node_name FROM sys.ipe_nodeinfo
To see a list of the docker containers in the cluster.
Now you have a running Kognitio system. All containers are ephemeral, with all persistent data residing only in the /data volume. Once the initialisation steps above have been completed, the Kognitio system can be brought up at any time by running a set of containers attached to the data volume and running 'wxserver start' on one of the containers to bring the system ip, e.g.:
docker exec -ti mycluster1 wxserver start
This means that you can remove some or all of the containers and/or start up new ones at any time. You can also change the number and size of containers in use any time so long as you re-run 'wxserver start' after you make changes.
Connecting
----------
The docker container exports the Kognitio ODBC port on TCP port 6550. Clients can connect to this port on any of the docker containers using Kognitio's client tools or JDBC/ODBC drivers which are available on our website. The easiest way to export the ODBC port is to start one of the docker containers with the -p argument (e.g. '-p 6550:6550').
See https://kognitio.com/documentation/latest/access/access.html for instructions on connecting client tools to Kognitio.
If you're new to Kognitio and just want to poke around, you might like to try our getting started guide:
https://kognitio.com/documentation/latest/getstarted/kog.html#gs-kog