Skip to content
Apache StreamPipes: Pipeline elements and StreamPipes Connect adapters
Java Dockerfile
Branch: dev
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github/workflows
streampipes-connect-adapters
streampipes-pipeline-elements-all-jvm
streampipes-pipeline-elements-data-simulator
streampipes-pipeline-elements-shared
streampipes-processors-aggregation-flink
streampipes-processors-enricher-flink
streampipes-processors-enricher-jvm
streampipes-processors-filters-jvm
streampipes-processors-filters-siddhi
streampipes-processors-geo-flink
streampipes-processors-geo-jvm
streampipes-processors-image-processing-jvm
streampipes-processors-pattern-detection-flink
streampipes-processors-statistics-flink
streampipes-processors-text-mining-flink
streampipes-processors-text-mining-jvm
streampipes-processors-transformation-flink
streampipes-processors-transformation-jvm
streampipes-sinks-brokers-jvm
streampipes-sinks-databases-flink
streampipes-sinks-databases-jvm
streampipes-sinks-internal-jvm
streampipes-sinks-notifications-jvm
streampipes-sources-vehicle-simulator
streampipes-sources-watertank-simulator
.gitignore
.gitlab-ci.yml
.spignore
LICENSE
README.md
pom.xml

README.md

Apache StreamPipes

Apache StreamPipes (incubating) enables flexible modeling of stream processing pipelines by providing a graphical modeling editor on top of existing stream processing frameworks.

It leverages non-technical users to quickly define and execute processing pipelines based on an easily extensible toolbox of data sources, data processors and data sinks. StreamPipes has an exchangeable runtime execution layer and executes pipelines using one of the provided wrappers, e.g., for Apache Flink or Apache Kafka Streams.

Pipeline elements in StreamPipes can be installed at runtime - the built-in SDK allows to easily implement new pipeline elements according to your needs. Pipeline elements are standalone microservices that can run anywhere - centrally on your server, in a large-scale cluster or close at the edge.

Learn more about StreamPipes at https://streampipes.apache.org/

Read the full documentation at https://streampipes.apache.org/docs

StreamPipes Pipeline Elements

This project provides a library of several pipeline elements that can be used within the Apache StreamPipes toolbox.

See https://streampipes.apache.org/docs/docs/pipeline-elements/ for an overview of currently available pipeline elements.

Contact us if you are missing some pipeline elements!

Getting started

See the installation guide at https://streampipes.apache.org/download.html

It's easy to get started:

Get help

If you have any problems during the installation or questions around StreamPipes, you'll get help through one of our community channels:

And don't forget to follow us on Twitter!

Contribute

We welcome contributions to StreamPipes. If you are interested in contributing to StreamPipes, let us know (e.g ., send an email to the dev list)!

You can’t perform that action at this time.