Skip to content
Apache Pulsar - distributed pub-sub messaging system
Java C++ Python Go Shell C Other
Branch: master
Clone or download
srkukarni and sijie Check for the presence of presto libraries only when sql commands are…
… used (#5883)

Co-authored-by: Sijie Guo <guosijie@gmail.com>
Latest commit ec122ed Jan 24, 2020
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github [Github actions]Fix integration test disk space is full (#6098) Jan 20, 2020
.test-infra/jenkins Removed mentions to incubator-pulsar (#2620) Sep 25, 2018
.travis Maven artifacts relases into Apache (#607) Jul 29, 2017
bin Check for the presence of presto libraries only when sql commands are… Jan 24, 2020
build/docker Fix pulsar build image with maven 3.6.1 (#5886) Dec 18, 2019
buildtools Bump version to 2.6.0 (#5820) Dec 9, 2019
conf Support delete inactive topic when subscriptions caught up (#6077) Jan 19, 2020
dashboard [build] Allow skipping deploying docker artifacts to maven repo (#5821) Dec 9, 2019
deployment Fix typos in Helm chart and sync values-mini with values (#6009) Jan 11, 2020
dev Vagrantfile update for build dependency (#5968) Jan 1, 2020
distribution Upgrade Avro to 1.9.1 (#5938) Jan 6, 2020
docker-compose/standalone-dashboard Add sample docker-compose file with pulsar standalone (#2617) Sep 24, 2018
docker [build] Allow skipping deploying docker artifacts to maven repo (#5821) Dec 9, 2019
examples Bump version to 2.6.0 (#5820) Dec 9, 2019
jclouds-shaded Bump version to 2.6.0 (#5820) Dec 9, 2019
managed-ledger Avoid using same OpAddEntry between different ledger handles (#5942) Jan 9, 2020
node_modules [Docs] Add admin api docs of Pulsar Functions (#5593) Nov 12, 2019
protobuf-shaded Bump version to 2.6.0 (#5820) Dec 9, 2019
protobuf Add ASF headers to Markdown documentation files (#823) Oct 17, 2017
pulsar-broker-auth-athenz Make unit tests to only use dynamically allocated ports (#5486) Jan 5, 2020
pulsar-broker-auth-sasl Make unit tests to only use dynamically allocated ports (#5486) Jan 5, 2020
pulsar-broker-common Support delete inactive topic when subscriptions caught up (#6077) Jan 19, 2020
pulsar-broker-shaded Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-broker [pulsar-broker] Fix some comment typos (#5926) Jan 24, 2020
pulsar-client-1x-base Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-client-admin-shaded Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-client-admin Allow to enable/disable delayed delivery for messages on namespace (#… Jan 21, 2020
pulsar-client-all Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-client-api [java-client] Add support for key hash range reading. (#5928) Jan 9, 2020
pulsar-client-auth-athenz Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-client-auth-sasl Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-client-cpp [CPP] Compile fixes for ARM cpus (#6129) Jan 23, 2020
pulsar-client-go Upgrade Avro to 1.9.1 (#5938) Jan 6, 2020
pulsar-client-kafka-compat [build] Skip javadoc task for pulsar-client-kafka-compact modules (#5836 Jan 14, 2020
pulsar-client-shaded Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-client-tools-test Allow to enable/disable delayed delivery for messages on namespace (#… Jan 21, 2020
pulsar-client-tools Allow to enable/disable delayed delivery for messages on namespace (#… Jan 21, 2020
pulsar-client Fix zeroQueueConsumer using listener (#6106) Jan 24, 2020
pulsar-common Fix issue 5505 (#6060) Jan 23, 2020
pulsar-discovery-service Make unit tests to only use dynamically allocated ports (#5486) Jan 5, 2020
pulsar-flink Upgrade Avro to 1.9.1 (#5938) Jan 6, 2020
pulsar-function-go Enable action CI on Go Functions (#6053) Jan 19, 2020
pulsar-functions Remove duplicated lombok annotations in the pulsar-functions modules (#… Jan 21, 2020
pulsar-io [Issue 5690][pulsar-io] Make type name of Elasticsearch sink connecto… Jan 23, 2020
pulsar-log4j2-appender Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-metadata Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-proxy [Github actions]Fixed unit test (#6004) Jan 9, 2020
pulsar-spark Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-sql Upgrade Avro to 1.9.1 (#5938) Jan 6, 2020
pulsar-storm Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-testclient Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-transaction Bump version to 2.6.0 (#5820) Dec 9, 2019
pulsar-websocket [Github Action] Fix flaky test (#5982) Jan 6, 2020
pulsar-zookeeper-utils Make unit tests to only use dynamically allocated ports (#5486) Jan 5, 2020
pulsar-zookeeper Bump version to 2.6.0 (#5820) Dec 9, 2019
site2 Fix typo in Reader documentation. (#6103) Jan 24, 2020
src [transaction-coordinator] Implementation of transaction coordinator c… Dec 9, 2019
tests [Github actions]Fix integration test disk space is full (#6098) Jan 20, 2020
tiered-storage Bump version to 2.6.0 (#5820) Dec 9, 2019
.gitignore [Docs]Auto generate pages for pulsar-admin (#5940) Jan 7, 2020
.travis.yml Fixes to get the travis build running again (#3204) Dec 17, 2018
CONTRIBUTORS.md Add ASF headers to Markdown documentation files (#823) Oct 17, 2017
LICENSE Fixes for NOTICE and LICENSE files for src and bin distribution (#563) Jul 18, 2017
NOTICE Update copyright year in NOTICE files to 2019 (#3283) Jan 3, 2019
README.md update Maven version to 3.3.9+ in README.md (#5617) Nov 13, 2019
faq.md [Doc] Fix FAQ broken link (#4640) Jul 10, 2019
pom.xml Fix maven broken link (#6068) Jan 17, 2020

README.md

logo

Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.

Learn more about Pulsar at https://pulsar.apache.org

Main features

  • Horizontally scalable (Millions of independent topics and millions of messages published per second)
  • Strong ordering and consistency guarantees
  • Low latency durable storage
  • Topic and queue semantics
  • Load balancer
  • Designed for being deployed as a hosted service:
    • Multi-tenant
    • Authentication
    • Authorization
    • Quotas
    • Support mixing very different workloads
    • Optional hardware isolation
  • Keeps track of consumer cursor position
  • REST API for provisioning, admin and stats
  • Geo replication
  • Transparent handling of partitioned topics
  • Transparent batching of messages

Build Pulsar

Requirements:

  • Java JDK 1.8
  • Maven 3.3.9+

Compile and install:

$ mvn install -DskipTests

Run Unit Tests:

$ mvn test

Run Individual Unit Test:

$ cd module-name (e.g: pulsar-client)
$ mvn test -Dtest=unit-test-name (e.g: ConsumerBuilderImplTest)

Start standalone Pulsar service:

$ bin/pulsar standalone

Check https://pulsar.apache.org for documentation and examples.

Setting up your IDE

Apache Pulsar is using lombok so you have to ensure your IDE setup with required plugins.

Intellij

To configure annotation processing in IntelliJ:

  1. Open Annotation Processors Settings dialog box by going to Settings -> Build, Execution, Deployment -> Compiler -> Annotation Processors.

  2. Select the following buttons:

    1. "Enable annotation processing"
    2. "Obtain processors from project classpath"
    3. "Store generated sources relative to: Module content root"
  3. Set the generated source directories to be equal to the Maven directories:

    1. Set "Production sources directory:" to "target/generated-sources/annotations".
    2. Set "Test sources directory:" to "target/generated-test-sources/test-annotations".
  4. Click "OK".

  5. Install the lombok plugin in intellij.

Eclipse

Follow the instructions here to configure your Eclipse setup.

Build Pulsar docs

Refer to the docs README.

Contact

Mailing lists
Name Scope
users@pulsar.apache.org User-related discussions Subscribe Unsubscribe Archives
dev@pulsar.apache.org Development-related discussions Subscribe Unsubscribe Archives
Slack

Pulsar slack channel at https://apache-pulsar.slack.com/

You can self-register at https://apache-pulsar.herokuapp.com/

License

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Crypto Notice

This distribution includes cryptographic software. The country in which you currently reside may have restrictions on the import, possession, use, and/or re-export to another country, of encryption software. BEFORE using any encryption software, please check your country's laws, regulations and policies concerning the import, possession, or use, and re-export of encryption software, to see if this is permitted. See http://www.wassenaar.org/ for more information.

The U.S. Government Department of Commerce, Bureau of Industry and Security (BIS), has classified this software as Export Commodity Control Number (ECCN) 5D002.C.1, which includes information security software using or performing cryptographic functions with asymmetric algorithms. The form and manner of this Apache Software Foundation distribution makes it eligible for export under the License Exception ENC Technology Software Unrestricted (TSU) exception (see the BIS Export Administration Regulations, Section 740.13) for both object code and source code.

The following provides more details on the included cryptographic software: Pulsar uses the SSL library from Bouncy Castle written by http://www.bouncycastle.org.

You can’t perform that action at this time.