Apache Pulsar - distributed pub-sub messaging system
Clone or download
srkukarni Infer paralellism as well (#2999)
* Infer paralellism as well

* Fixed unittests
Latest commit 2d1db63 Nov 17, 2018
Permalink
Failed to load latest commit information.
.github Initial import Sep 7, 2016
.test-infra/jenkins Removed mentions to incubator-pulsar (#2620) Sep 25, 2018
.travis Maven artifacts relases into Apache (#607) Jul 29, 2017
bin Allow configuring extra dependencies directory for functions (#2923) Nov 4, 2018
build/docker [website] Enable Translation & Localization (#2251) Jul 31, 2018
buildtools Allow user to configure proxy as reverse HTTP proxy (#2801) Oct 17, 2018
conf Remove conflicting log4j2 policies (#2955) Nov 7, 2018
dashboard class ActiveBroker don't attribute url, use url of class Broker (#2871) Oct 28, 2018
deployment Fix helm lint error for zookeeper-metadata.yaml (#2878) Oct 29, 2018
dev Fixed License header for ByteBufCoded{Input,Output}Stream.java (#1971) Jun 15, 2018
distribution cleaning up and improving function metrics (#2994) Nov 17, 2018
docker-compose/standalone-dashboard Add sample docker-compose file with pulsar standalone (#2617) Sep 24, 2018
docker Make Pulsar Docker have very short ttl cache time so that bookie chan… Oct 12, 2018
examples Fix the document format in example/flink-consumer-source (#2839) Oct 24, 2018
jclouds-shaded Bumped version to 2.3.0-SNAPSHOT (#2765) Oct 11, 2018
managed-ledger-shaded Fixed shading of Netty (#2783) Oct 12, 2018
managed-ledger Handle unknown runtime exception while reading entries (#2993) Nov 16, 2018
protobuf-shaded Added script to change the project version in 1 command (#2772) Oct 11, 2018
protobuf Add ASF headers to Markdown documentation files (#823) Oct 17, 2017
pulsar-broker-auth-athenz Bumped version to 2.3.0-SNAPSHOT (#2765) Oct 11, 2018
pulsar-broker-common Derive np topic worker threads based on system config (#2956) Nov 9, 2018
pulsar-broker-shaded Fixed shading of Netty (#2783) Oct 12, 2018
pulsar-broker cleaning up and improving function metrics (#2994) Nov 17, 2018
pulsar-client-admin-shaded Fixed shading of Netty (#2783) Oct 12, 2018
pulsar-client-admin cleaning up and improving function metrics (#2994) Nov 17, 2018
pulsar-client-auth-athenz Bumped version to 2.3.0-SNAPSHOT (#2765) Oct 11, 2018
pulsar-client-cpp Introduce `Client.getPartitionsForTopic()` (#2972) Nov 15, 2018
pulsar-client-go Introduce `Client.getPartitionsForTopic()` (#2972) Nov 15, 2018
pulsar-client-kafka-compat Fixed shading of Netty (#2783) Oct 12, 2018
pulsar-client-schema change kafkaConnectSource to return KeyValue type record (#2902) Nov 5, 2018
pulsar-client-shaded Fixed shading of Netty (#2783) Oct 12, 2018
pulsar-client-tools-test Added some basic checks for function/source/sink in cli as well (#2924) Nov 4, 2018
pulsar-client-tools Infer paralellism as well (#2999) Nov 17, 2018
pulsar-client Add connection timeout client configuration option (#2852) Nov 16, 2018
pulsar-common Infer paralellism as well (#2999) Nov 17, 2018
pulsar-discovery-service Bump jetty to v9.4.12 (#2811) Oct 22, 2018
pulsar-flink Add Flink - Pulsar Batch Sink Support (#2979) Nov 16, 2018
pulsar-functions cleaning up and improving function metrics (#2994) Nov 17, 2018
pulsar-io Add Flink - Pulsar Batch Sink Support (#2979) Nov 16, 2018
pulsar-log4j2-appender Bumped version to 2.3.0-SNAPSHOT (#2765) Oct 11, 2018
pulsar-proxy Make proxy advertise protocol version of client to broker (#2845) Oct 26, 2018
pulsar-spark cleaning up and improving function metrics (#2994) Nov 17, 2018
pulsar-sql reverting jackson version bump for sql (#2978) Nov 13, 2018
pulsar-storm moving pulsar storm tests under tests (#3000) Nov 16, 2018
pulsar-testclient Bumped version to 2.3.0-SNAPSHOT (#2765) Oct 11, 2018
pulsar-websocket Websocket dead letter topic (PIP22) (#2968) Nov 9, 2018
pulsar-zookeeper-utils [zookeeper] remove hardcoded zookeeper session timeout (#2889) Oct 30, 2018
pulsar-zookeeper Bumped version to 2.3.0-SNAPSHOT (#2765) Oct 11, 2018
site fix typo in architecture docs (#2862) Oct 27, 2018
site2 add go client link to document (#2991) Nov 15, 2018
src In stage-release.sh, also include offloaders package (#2803) Oct 19, 2018
tests cleaning up and improving function metrics (#2994) Nov 17, 2018
tiered-storage Bumped version to 2.3.0-SNAPSHOT (#2765) Oct 11, 2018
.gitignore Prefer rest path over Function/Source/Sink Config values (#2918) Nov 3, 2018
.travis.yml Removed mentions to incubator-pulsar (#2620) Sep 25, 2018
CONTRIBUTORS.md Add ASF headers to Markdown documentation files (#823) Oct 17, 2017
LICENSE Fixes for NOTICE and LICENSE files for src and bin distribution (#563) Jul 18, 2017
NOTICE Updated Copyright in NOTICE to 2017-2018 (#1664) Apr 27, 2018
README.md Improve Go/macOS C++ client installation documentation (#2711) Oct 3, 2018
faq.md Removed mentions to incubator-pulsar (#2620) Sep 25, 2018
pom.xml Upgrade jackson version to 2.9.7 (#2884) Oct 30, 2018

README.md

logo

Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API.

https://pulsar.apache.org

Main features

  • Horizontally scalable (Millions of independent topics and millions of messages published per second)
  • Strong ordering and consistency guarantees
  • Low latency durable storage
  • Topic and queue semantics
  • Load balancer
  • Designed for being deployed as a hosted service:
    • Multi-tenant
    • Authentication
    • Authorization
    • Quotas
    • Support mixing very different workloads
    • Optional hardware isolation
  • Keeps track of consumer cursor position
  • REST API for provisioning, admin and stats
  • Geo replication
  • Transparent handling of partitioned topics
  • Transparent batching of messages

Build Pulsar

Requirements:

  • Java JDK 1.8
  • Maven

Compile and install:

$ mvn install -DskipTests

Start standalone Pulsar service:

$ bin/pulsar standalone

Check https://pulsar.apache.org for documentation and examples.

Build Pulsar docs

Refer to the docs README.

Contact

Mailing lists
Name Scope
users@pulsar.apache.org User-related discussions Subscribe Unsubscribe Archives
dev@pulsar.apache.org Development-related discussions Subscribe Unsubscribe Archives
Slack

Pulsar slack channel at https://apache-pulsar.slack.com/

You can self-register at https://apache-pulsar.herokuapp.com/

License

Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Crypto Notice

This distribution includes cryptographic software. The country in which you currently reside may have restrictions on the import, possession, use, and/or re-export to another country, of encryption software. BEFORE using any encryption software, please check your country's laws, regulations and policies concerning the import, possession, or use, and re-export of encryption software, to see if this is permitted. See http://www.wassenaar.org/ for more information.

The U.S. Government Department of Commerce, Bureau of Industry and Security (BIS), has classified this software as Export Commodity Control Number (ECCN) 5D002.C.1, which includes information security software using or performing cryptographic functions with asymmetric algorithms. The form and manner of this Apache Software Foundation distribution makes it eligible for export under the License Exception ENC Technology Software Unrestricted (TSU) exception (see the BIS Export Administration Regulations, Section 740.13) for both object code and source code.

The following provides more details on the included cryptographic software: Pulsar uses the SSL library from Bouncy Castle written by http://www.bouncycastle.org.