Skip to content

Latest commit

Β 

History

History
executable file
Β·
657 lines (415 loc) Β· 35.6 KB

all-catalog.md

File metadata and controls

executable file
Β·
657 lines (415 loc) Β· 35.6 KB

PadoGrid PadoGrid | Catalogs | Manual | FAQ | Releases | Templates | Pods | Kubernetes | Docker | Apps | Quick Start


🌎 PadoGrid Bundle Catalogs 🌎

Bundles represent fully implemented use cases. This page lists all of the open source PadoGrid bundles. The bundles in each product are grouped as follows.


πŸ“š Generic (none) Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle includes a data feed simulator for generating continous numerical data for MQTT and Hazelcast.

install_bundle -download bundle-none-app-simulator

Data Feed Simulator


This bundle provides step-by-step instructions for creating a test environment and conducting benchmark tests on IMDG products.

install_bundle -download -workspace bundle-none-imdg-benchmark-tests

IMDG Product Benchmark Tests


This bundle serves as a template for creating a new generic onlne bundle.

install_bundle -download bundle-none-template

Generic (none) Bundle Template


This bundle walks through steps involved in configuring a TLS termination proxy to secure Mosquitto, Grafana, Prometheus, and Hazelcast Management Center using HAProxy.

install_bundle -download -workspace haproxy bundle-none-tutorial-docker-haproxy

Configuring HAProxy for TLS Termination - Mosquitto, Grafana, Prometheus, Hazelcast Management Center


This tutorial bundle covers PadoGrid essentials.

install_bundle -download -workspace bundle-none-tutorial-padogrid

PadoGrid Tutorial


πŸ“š Geode/GemFire Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle provides step-by-step instructions for generating and deploying Avro and KryoSerializer in Geode/GemFire. Using PadoGrid's code generator, you can on the fly generate and deploy Avro wrapper classes and the corresponding Kryo serializer.

install_bundle -download bundle-geode-1-app-kryo_codegen

Geode/GemFire Kryo Code Generator


This bundle contains a Microsoft Power BI example that interfaces Power BI with Geode/GemFire via the REST API. This article can be viewed in your browser by running the following: bash show_bundle bundle-geode-1-app-perf_test_powerbi-cluster-powerbi

install_bundle -download bundle-geode-1-app-perf_test_powerbi-cluster-powerbi

Bundle: Power BI


This bundle provides scripts, configuration files, and apps for creating a Geode/GemFire network split-brain environment where you can test Geode/GemFire split-brain capabilities. Although it focuses on split-brain issues, the scripts provided cover any system failures.

install_bundle -download -workspace bundle-geode-1-app-perf_test_sb-cluster-sb

Geode/GemFire Split-Brain


The wan bundle includes two (2) local clusters configured with bidirectional WAN gateways. You can test the bundle immediately after installation. No configurations required. To understand how the clusters are configured, please see the following WAN example. It provides step-by-step instructions for creating and running WAN enabled clusters from scratch. Geode/GemFire WAN Example

# To run
install_bundle -download -workspace bundle-geode-1-app-perf_test_wan-cluster-ln-ny

# To run and/or check in
install_bundle -checkout bundle-geode-1-app-perf_test_wan-cluster-ln-ny

Geode/GemFire WAN


This bundle is preconfigured to synchronize Geode/GemFire with MySQL running as a Docker container. It includes the db cluster app to read/write from/to Geode/GemFire and MySQL. It also includes instructions for replacing MySQL with another database.

# Instal in the current workspace
install_bundle -download bundle-geode-1-docker-dbsync_mysql

# Install in the new bundle default workspace
install_bundle -download -workspae bundle-geode-1-docker-dbsync_mysql

# Install in the new bundle default workspace with git intact
install_bundle -checkout bundle-geode-1-docker-dbsync_mysql

GemFire/Geode and MySQL Sync


This bundle integrates Geode with Debezium and Apache Hive for ingesting initial data and CDC records from MySQL into a Geode cluster via a Kafka sink connector included in the padogrid distribution. It supports inserts, updates and deletes.

install_bundle -download bundle-geode-1-docker-debezium_hive_kafka

Debezium-Hive-Kafka Geode Connector


This bundle integrates Geode/GemFire with Debezium for ingesting initial data and CDC records from MySQL into a Geode/GemFire cluster via a Kafka sink connector included in the padogrid distribution. It supports inserts, updates and deletes.

install_bundle -download bundle-geode-1-docker-debezium_kafka

Debezium-Kafka Geode/GemFire Connector


This bundle integrates Geode with Debezium and Confluent KSQL for ingesting initial data and CDC records from MySQL into a Geode cluster via a Kafka sink connector included in the padogrid distribution. It supports inserts, updates and deletes.

install_bundle -download bundle-geode-1-docker-debezium_ksql_kafka

Debezium-KSQL-Kafka Geode Connector


This bundle integrates Geode with Debezium and Confluent ksqlDB for ingesting initial data and CDC records from MySQL into Kafka and Geode via a Kafka sink connector included in the padogrid distribution.

install_bundle -download -workspace bundle-geode-1-docker-debezium_ksqldb_confluent

Debezium-ksqlDB-Confluent Geode Connector


This bundle serves as a template for creating a new Geode onlne bundle.

install_bundle -download bundle-geode-template

Geode Bundle Template


πŸ“š Hazelcast IMDG Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle provides scripts, configuration files, and apps for creating a network split-brain environment where you can test Hazelcast's split-brain capabilities.

install_bundle -download bundle-hazelcast-3-app-perf_test_sb-cluster-sb

Hazelcast Split-Brain


The pado app provides a Hazelcast Portable class generator and CSV file import tools for Hazelcast. This bundle includes step-by-step instructions for ingesting mock data and UCI Machine Learning datasets into Hazelcast. It also includes a Pado scheduler demo that automates scheduled job executions for exporting and importing data from databases.

install_bundle -download bundle-hazelcast-3n4n5-app-pado

App: Pado


The dbsched bundle is preconfigured with the Pado scheduler to periodically execute jobs that dump database tables to CSV files from which it automatically extracts column information to generate the corresponding VersionedPortable classes. It then transforms the CSV records to objects using the generated classes before ingesting them into Hazelcast.

install_bundle -download  bundle-hazelcast-3n4n5-app-pado_dbsched-perf_test_dbsched-docker-mysql

Bundle: dbsched


This bundle is preconfigured to synchronize Hazelcast with MySQL running as a Docker container. It includes the db cluster app to read/write from/to Hazelcast and MySQL. It also includes instructions for replacing MySQL with another database.

# Current workspace
install_bundle -download bundle-hazelcast-3n4n5-docker-dbsync_mysql

# New workspace: download 
install_bundle -download -workspace bundle-hazelcast-3n4n5-docker-dbsync_mysql

# New workspace: checkout
install_bundle -checkout bundle-hazelcast-3n4n5-docker-dbsync_mysql

Bundle: MySQL Sync


This bundle integrates Hazelcast with Debezium and Apache Hive for ingesting initial data and CDC records from MySQL into a Hazelcast cluster via a Kafka sink connector included in the padogrid distribution. It supports inserts, updates and deletes.

install_bundle -download bundle-hazelcast-3n4n5-docker-debezium_hive_kafka

Debezium-Hive-Kafka Hazelcast Connector


This bundle integrates Hazelcast with Debezium for ingesting initial data and CDC records from MySQL into a Hazelcast cluster via a Kafka sink connector included in the padogrid distribution. It supports inserts, updates and deletes.

install_bundle -download bundle-hazelcast-3n4n5-docker-debezium_kafka

Debezium-Kafka Hazelcast Connector


This bundle integrates Hazelcast with Debezium and Confluent KSQL and ksqlDB for ingesting initial data and CDC records from MySQL into a Hazelcast cluster via a Kafka sink connector included in the padogrid distribution. It supports inserts, updates and deletes.

install_bundle -download bundle-hazelcast-3n4n5-docker-debezium_ksql_kafka

Debezium-KSQL-Kafka Hazelcast Connector


This bundle deploys Hazelcast using Helm Charts using kubectl. It also includes the PadoGrid container for ingesting mock data into the Hazelcast cluster.

install_bundle -force -download bundle-hazelcast-3n4n5-k8s-kubectl_helm

Hazelcast Kubernetes Helm Charts


This bundle deploys Hazelcast using Helm Charts with Prometheus metrics enabled. It also includes the PadoGrid container for ingesting mock data into the Hazelcast cluster. For Prometheus instructions please see the following link: Configuring Prometheus Metrics.

install_bundle -download bundle-hazelcast-3n4n5-k8s-oc_helm

Hazelcast OpenShift Helm Charts


This bundle demonstrates the Hazelcast WAN topology by replicating data between two (2) Hazlecast Helm Chart clusters running on OpenShift. https://github.com/hazelcast/charts

install_bundle -download bundle-hazelcast-3n4n5-k8s-oc_helm_wan

Hazelcast WAN Replication on OpenShift using Helm Charts


This bundle contains OpenShift operator configuration files for deploying Hazelcast and PadoGrid. Hazelcast is deployed using the Hazelcast Operator downloaded from the hazelcast/hazelcast-operator repo. https://github.com/hazelcast/hazelcast-operator

install_bundle -download bundle-hazelcast-4-k8s-oc_operator

Hazelcast OpenShift Operator


This bundle demonstrates the Hazelcast WAN topology by replicating data between two (2) Hazlecast Operator clusters running on OpenShift. https://github.com/hazelcast/hazelcast-operator

install_bundle -download bundle-hazelcast-4-k8s-oc_operator_wan

Hazelcast WAN Replication on OpenShift using Operator


This bundle provides step-by-step instructions for generating and deploying Avro and KryoSerializer in Hazelcast. Using PadoGrid's code generator, you can on the fly generate and deploy Avro wrapper classes and the correspoinding Kryo serializer.

install_bundle -download bundle-hazelcast-4n5-app-kryo_codegen

Hazelcast Kryo/Avro Code Generator


This bundle provides scripts, configuration files, and apps for creating a Hazelcast 4.x network split-brain environment where you can test Hazelcast's split-brain capabilities.

install_bundle -download bundle-hazelcast-4n5-app-perf_test_sb-cluster-sb

Cluster Split-Brain


This bundle provides a plugin that expires session objects in a given map and their relevant entries in other Hazelcast maps. The plugin also supports session expirations over the WAN (See bundle-hazelcast-4n5-cluster-session-wan.)

install_bundle -download bundle-hazelcast-4n5-app-perf_test_session-cluster-session

Session Expiration Management Plugin


This bundle demonstrates the session expiration plugin in a WAN environment. It incorporates the session expiration plugin included in bundle-hazelcast-4n5-cluster-session and Sorint.lab's IpDiscoveryStrategy plugin.

# To run
install_bundle -download -workspace bundle-hazelcast-4n5-cluster-session-wan

# To run and/or check in
install_bundle -checkout bundle-hazelcast-4n5-cluster-session-wan
# If behind firewall, then manually download the bundle distribution and execute the following.
install_bundle -workspace session-wan bundle-hazelcast-4n5-cluster-session-wan-master.zip
switch_workspace sesson-wan

Session Expiration in WAN Environment


This bundle demonstrates forecasting future events in real time using LSTM RNN (Long Short-Term Memory Recurrent Neural Network) via Keras backed by TensorFlow. It constructs a Hazelcast Jet pipeline to apply LSTM RNN models on streamed data.

# --- Execute one of the following install_bundle commands:

# Download and install as a workspace
install_bundle -download -workspace bundle-hazelcast-5-app-ml_lstm-cluster-ml_jet

# Specify '-init' to automatically build the bundle environment.
# This requires Java 11 executable in your path.
install_bundle -init -checkout bundle-hazelcast-5-app-ml_lstm-cluster-ml_jet

Neural Network: LSTM RNN


This bundle demonstrates Grafana capabilities of monitoring five (5) Hazelcast clusters. It includes three (3) independent clusters and two (2) bi-directional WAN clusters along with a workflow simulator.

install_bundle -init -download -workspace bundle-hazelcast-5-cluster-wan-app-grafana

Hazelcast Multi-Cluster Demo


This bundle integrates Hazelcast with Debezium and Confluent ksqlDB for ingesting initial data and CDC records from MySQL into Kafka and Hazelcast via a Kafka sink connector included in the padogrid distribution.

install_bundle -download -workspace bundle-hazelcast-5-docker-debezium_ksqldb_confluent

Debezium-ksqlDB-Confluent Hazelcast Connector


This bundle includes Hazelcast Playground, a web app for browsing and updating Hazelcast data structures.

install_bundle -download bundle-hazelcast-5-playground-python

PadoGrid Hazelcast Playground


This bundle walks through the Hazelcast Jet job preparation, submission, and deubgging steps in detail and provides troubleshooting tips.

install_bundle -download bundle-hazelcast-5-tutorial-app-jet_python

Hazelcast Job: Executing Remote Python Code


This bundle provides Hazelcast Python client examples running on JupyterLab in PadoGrid. It demonstrates how PadoGrid workspaces are seamlessly integrated with JupyterLab workspaces.

install_bundle -download -workspace bundle-hazelcast-examples-python

Hazelcast JupyterLab Python Examples


This bundle serves as a template for creating a new Hazelcast onlne bundle.

install_bundle -download bundle-hazelcast-template

Hazelcast Bundle Template


As part of the Rolling Upgrade lab of Hazelcast Operations Training, this bundle includes a cluster and an app preconfigured to run with Hazelcast Enterprise 3.11.x which must be installed separately.

install_bundle -download bundle-hazelcast-training-3.11-app-perf_test_v3.11-cluster-v3.11

Rolling Upgrade Training


As part of the TLS/SSL lab of Hazelcast Operations Training, this bundle includes the openssl cluster preconfigured to enable OpenSSL/BoringSSL.

install_bundle -download bundle-hazelcast-training-3n4n5-app-perf_test_openssl-cluster-openssl

IMDG Cluster: openssl


As part of the TLS/SSL lab of Hazelcast Operations Training, the ssl cluster has been preconfigured to enable SSL. It contains scripts to create both private and trust keystores that contain both member and client keys and certificates.

install_bundle -download bundle-hazelcast-training-3n4n5-app-perf_test_ssl-cluster-ssl

IMDG Cluster: ssl


πŸ“š Kafka Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle serves as a template for creating a new Kafka onlne bundle.

install_bundle -download bundle-kafka-template

Kafka Bundle Template


πŸ“š Kafka Confluent Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle provides Kafka Python client examples running on JupyterLab in PadoGrid. It demonstrates how PadoGrid workspaces are seamlessly integrated with JupyterLab workspaces.

install_bundle -download -workspace bundle-confluent-7-examples-python

Confluent JupyterLab Python Examples


This bundle serves as a template for creating a new Kafka onlne bundle.

install_bundle -download bundle-confluent-template

Kafka Confluent Bundle Template


πŸ“š Mosquitto Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle serves as a template for creating a new Mosquitto/MQTT onlne bundle.

install_bundle -download bundle-mosquitto-template

Mosquitto/MQTT Bundle Template


This bundle provides a hands-on tutorial demonstrating PadoGrid's virtual cluster capabilities.

install_bundle -download -workspace bundle-mosquitto-tutorial-virtual-clusters

Mosquitto/MQTT Virtual Cluster Tutorial


πŸ“š SnappyData/ConputeDB Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle integrates SnappyData/ComputeDB with Debezium for ingesting initial data and CDC records from MySQL into a SnappyData/ComputeDB cluster via a Kafka sink connector included in the padogrid distribution. It supports inserts, updates and deletes.

install_bundle -download bundle-snappydata-1-docker-debezium_kafka

Debezium-Kafka SnappyData/ComputeDB Connector


This bundle serves as a template for creating a new SnappyData onlne bundle.

install_bundle -download bundle-snappydata-template

SnappyData Bundle Template


πŸ“š Coherence Bundle Catalog πŸ“š

The online bundles can be installed by executing the install_bundle commands as shown below. To view use case details for each bundle, click on their image.

The bundles listed below are sorted by bundle names, and as such the order of bundles may change as new bundles are introduced.


This bundle serves as a template for creating a new Coherence onlne bundle.

install_bundle -download bundle-coherence-template

Coherence Bundle Template


PadoGrid PadoGrid | Catalogs | Manual | FAQ | Releases | Templates | Pods | Kubernetes | Docker | Apps | Quick Start