Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Mirror of Apache Kafka

kafka-1984; java producer may miss an available partition; patched by…

… Jun Rao; reviewed by Ewen Cheslack-Postava, Jay Kreps, and Guozhang Wang
latest commit ee1267b127
Jun Rao junrao authored
Failed to load latest commit information.
bin trivial change to remove -UseCompressedOops option from script
clients/src kafka-1984; java producer may miss an available partition; patched by…
config KAFKA-1723; num.partitions documented default is 1 while actual defau…
contrib kafka-1645; some more jars in our src release; patched by Joe Stein; …
core/src kafka-1971; starting a broker with a conflicting id will delete the p…
examples KAFKA-1254 remove vestigial sbt patch by Joe Stein; reviewed by Jun Rao
gradle KAFKA-1490 remove gradlew initial setup output from source distributi…
system_test KAFKA-1725: New test files, patch part 2
.gitignore kafka-1371; Ignore build output dirs; patched by Stevo Slavic; review…
.rat-excludes KAFKA-151 Standard .rat-excludes file and rat script;patched by nehan…
.reviewboardrc KAFKA-1053 Kafka patch review tool that integrates JIRA and reviewboa…
HEADER trivial fix to add missing license header using .gradlew licenseForma…
LICENSE KAFKA-1254 remove vestigial sbt patch by Joe Stein; reviewed by Jun Rao
NOTICE KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing…
README.md KAFKA-1876; pom file for scala 2.11 should reference a specific versi…
build.gradle KAFKA-1861; Publishing kafka-client:test in order to utilize the help…
doap_Kafka.rdf trivial change to add kafka doap project file
gradle.properties change build version to 0.8.2.1
gradlew trivial change to README to make the gradle wrapper download clearer
gradlew.bat trivial change to README to make the gradle wrapper download clearer
kafka-patch-review.py KAFKA-1560 Make arguments to jira-python API more explicit in kafka-p…
scala.gradle KAFKA-1624; bump up default scala version to 2.11.4 to compile with j…
settings.gradle kafka-1619; perf dir can be removed; patched by Jun Rao; reviewed by …
wrapper.gradle KAFKA-1490 remove gradlew initial setup output from source distributi…

README.md

Apache Kafka

See our web site for details on the project.

You need to have gradle installed.

First bootstrap and download the wrapper

cd kafka_source_dir
gradle

Now everything else will work

Building a jar and running it

./gradlew jar  

Follow instuctions in http://kafka.apache.org/documentation.html#quickstart

Building source jar

./gradlew srcJar

Building javadocs and scaladocs

./gradlew javadoc
./gradlew javadocJar # builds a jar from the javadocs
./gradlew scaladoc
./gradlew scaladocJar # builds a jar from the scaladocs
./gradlew docsJar # builds both javadoc and scaladoc jar

Running unit tests

./gradlew test

Forcing re-running unit tests w/o code change

./gradlew cleanTest test

Running a particular unit test

./gradlew -Dtest.single=RequestResponseSerializationTest core:test

Running a particular unit test with log4j output

change the log4j setting in either clients/src/test/resources/log4j.properties or core/src/test/resources/log4j.properties
./gradlew -i -Dtest.single=RequestResponseSerializationTest core:test

Building a binary release gzipped tar ball

./gradlew clean
./gradlew releaseTarGz  
The above command will fail if you haven't set up the signing key. To bypass signing the artifact, you can run
./gradlew releaseTarGz -x signArchives

The release file can be found inside ./core/build/distributions/.

Cleaning the build

./gradlew clean

Running a task on a particular version of Scala (either 2.9.1, 2.9.2, 2.10.4 or 2.11.5)

(If building a jar with a version other than 2.10, need to set SCALA_BINARY_VERSION variable or change it in bin/kafka-run-class.sh to run quick start.)

./gradlew -PscalaVersion=2.9.1 jar
./gradlew -PscalaVersion=2.9.1 test
./gradlew -PscalaVersion=2.9.1 releaseTarGz

Running a task for a specific project

This is for 'core', 'contrib:hadoop-consumer', 'contrib:hadoop-producer', 'examples' and 'clients' ./gradlew core:jar ./gradlew core:test

Listing all gradle tasks

./gradlew tasks

Building IDE project

./gradlew eclipse
./gradlew idea

Building the jar for all scala versions and for all projects

./gradlew jarAll

Running unit tests for all scala versions and for all projects

./gradlew testAll

Building a binary release gzipped tar ball for all scala versions

./gradlew releaseTarGzAll

Publishing the jar for all version of Scala and for all projects to maven

./gradlew uploadArchivesAll

Please note for this to work you should create/update ~/.gradle/gradle.properties and assign the following variables

mavenUrl=
mavenUsername=
mavenPassword=
signing.keyId=
signing.password=
signing.secretKeyRingFile=

Building the test jar

./gradlew testJar

Determining how transitive dependencies are added

./gradlew core:dependencies --configuration runtime

Contribution

Apache Kafka is interested in building the community; we would welcome any thoughts or patches. You can reach us on the Apache mailing lists.

To contribute follow the instructions here:

We also welcome patches for the website and documentation which can be found here:

Something went wrong with that request. Please try again.