Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Apache Pulsar #91837

Open
wants to merge 2 commits into
base: master
from

Conversation

@samdroid-apps
Copy link
Contributor

samdroid-apps commented Jun 30, 2020

Motivation for this change

This PR adds support for the Apache Pulsar message bus in NixOS. Running Pulsar involves 3 components - the Zookeeper, the Bookkeeper Bookie and the Pulsar Broker. All component are distributed by Apache Pulsar together.

This PR:

  • Adding the pulsar package (containing the official distribution of zookeeper, bookie and broker)
  • Adds the services.pulsar module, made up of a zookeeper, bookie and broker systemd service
  • Adds 2 nixos tests for common configurations:
    • A single-node setup, where zookeeper, bookie and broker run on the same machine
    • A more complex multi-node setup, with two bookkeepers (for data integrity) and all services on components machines
Things done
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.
Adds an Apache Pulsar module and two nixos tests covering common use cases:

- single-node cluster - all 3 components run on the same server
- multi-node cluster - all components run a separate server, and there are two bookkeeper instances
@aahmed-se
Copy link

aahmed-se commented Jun 30, 2020

will close this since you are picking up the task #65324

@samdroid-apps samdroid-apps mentioned this pull request Jul 1, 2020
6 of 10 tasks complete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

2 participants
You can’t perform that action at this time.