Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cleanup extension bundles #2122

Closed
dominikriemer opened this issue Nov 2, 2023 · 1 comment · Fixed by #2124
Closed

Cleanup extension bundles #2122

dominikriemer opened this issue Nov 2, 2023 · 1 comment · Fixed by #2124
Milestone
0.93.0

Comments

@dominikriemer
Copy link
Member

Body

Currently, we provide many different bundles of extensions as fat jars and docker images:

  • Connect adapters
  • Connect adapters IIoT
  • Pipeline elements all jvm
  • Extensions all jvm
  • Extension IIoT jvm
  • and more

We can harmonize these to ease the installation.

I suggest the following three "flavors" that we can offer in the standard installation:

  • extensions-all-jvm: Includes all adapters and pipeline elements in the codebase, as well as support for all protocols (Kafka, JMS, Pulsar, MQTT, Nats)
  • extensions-all-iiot Includes a subset of pipeline elements and adapters which are relevant for IIoT scenarios, e.g., excluding image processing and geo components and including support for all protocols
  • extensions-iiot-minimal: A docker image minized for small image size with reduced dependencies, only relevant IIoT adapters and sinks, and only providing support for Nats as a broker.

This would allow us to also ship smaller installations so that first-time users don't need to wait too long when pulling all the docker images.

StreamPipes Committer

I acknowledge that I am a maintainer/committer of the Apache StreamPipes project.
dominikriemer added a commit that referenced this issue Nov 2, 2023
@dominikriemer
feat(#2122): Reorganize extension modules and modify docker images
0d515a1
@dominikriemer dominikriemer mentioned this issue Nov 2, 2023
Merged
@dominikriemer dominikriemer linked a pull request Nov 2, 2023 that will close this issue
feat(#2122): Reorganize extension modules and modify docker images #2124
Merged
@dominikriemer dominikriemer added this to the 0.93.0 milestone Nov 2, 2023
@bossenti
Copy link
Contributor

bossenti commented Nov 3, 2023

@dominikriemer I really like the three flavors proposed by you!

dominikriemer added a commit that referenced this issue Nov 3, 2023
@dominikriemer
feat(#2122): Reorganize extension modules and modify docker images (#…
5c4206c 
…2124)

* feat(#2122): Reorganize extension modules and modify docker images

* Add Dockerfile

* Rename extension service in docker compose
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
0.93.0
Development

Successfully merging a pull request may close this issue.

feat(#2122): Reorganize extension modules and modify docker images apache/streampipes
2 participants
@dominikriemer @bossenti