Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with
or
.
Download ZIP
Mirror of Apache Kafka
Scala Java Python Shell Batchfile XSLT HTML

MINOR: kafkatest add manifest

This patch makes it possible to publish kafkatest (system test package) to pypi and use it as a library in other projects by:

- including necessary static resources with the package
- renaming the version to conform w/PEP 440, since python packaging tools reject the current version name

Author: Geoff Anderson <geoff@confluent.io>

Reviewers: Ewen Cheslack-Postava, Gwen Shapira

Closes #173 from granders/minor-kafkatest-add-manifest
latest commit 9c936b186d
@granders granders authored gwenshap committed
Failed to load latest commit information.
bin KAFKA-2367; Add Copycat runtime data API.
checkstyle kafka-1690; Add SSL support to Kafka Broker, Producer and Consumer; p…
clients/src KAFKA-2367; Add Copycat runtime data API.
config KAFKA-2366; Initial patch for Copycat
contrib KAFKA-2140 Improve code readability; reviewed by Neha Narkhede
copycat KAFKA-2377: Add basic system test for copycat using source and sink f…
core/src KAFKA-2468: SIGINT during Kafka server startup can leave server deadl…
dev-utils KAFKA-2153 kafka-patch-review tool uploads a patch even if it is empt…
examples KAFKA-2140 Improve code readability; reviewed by Neha Narkhede
gradle kafka-2248; Use Apache Rat to enforce copyright headers; patched by E…
log4j-appender/src kafka-2132; Move Log4J appender to a separate module; patched by Ashi…
system_test kafka-2005; Generate html report for system tests; patched by Ashish …
tests MINOR: kafkatest add manifest
tools/src/main/java/org/apache/kafka/clients/tools KAFKA-2276; KIP-25 initial patch
vagrant KAFKA-2330: Vagrantfile sets global configs instead of per-provider o…
.gitignore MINOR: Added to .gitignore Kafka server logs directory
.reviewboardrc KAFKA-1053 Kafka patch review tool that integrates JIRA and reviewboa…
CONTRIBUTING.md KAFKA-2321; Introduce CONTRIBUTING.md
HEADER trivial fix to add missing license header using .gradlew licenseForma…
LICENSE KAFKA-1254 remove vestigial sbt patch by Joe Stein; reviewed by Jun Rao
NOTICE KAFKA-533 changes to NOTICE and LICENSE related to KAFKA-534 removing…
README.md KAFKA-2348; Drop support for Scala 2.9
Vagrantfile KAFKA-2330: Vagrantfile sets global configs instead of per-provider o…
build.gradle KAFKA-2367; Add Copycat runtime data API.
doap_Kafka.rdf trivial change to add kafka doap project file
gradle.properties KAFKA-2457; StackOverflowError during builds
gradlew trivial change to README to make the gradle wrapper download clearer
gradlew.bat trivial change to README to make the gradle wrapper download clearer
kafka-merge-pr.py KAFKA-2430; Listing of PR commits in commit message should be optional
kafka-patch-review.py kafka-2248; Use Apache Rat to enforce copyright headers; patched by E…
scala.gradle kafka-2248; Use Apache Rat to enforce copyright headers; patched by E…
settings.gradle KAFKA-2367; Add Copycat runtime data API.
wrapper.gradle KAFKA-1490 remove gradlew initial setup output from source distributi…

README.md

Apache Kafka

See our web site for details on the project.

You need to have gradle installed.

First bootstrap and download the wrapper

cd kafka_source_dir
gradle

Now everything else will work

Building a jar and running it

./gradlew jar  

Follow instuctions in http://kafka.apache.org/documentation.html#quickstart

Building source jar

./gradlew srcJar

Building javadocs and scaladocs

./gradlew javadoc
./gradlew javadocJar # builds a jar from the javadocs
./gradlew scaladoc
./gradlew scaladocJar # builds a jar from the scaladocs
./gradlew docsJar # builds both javadoc and scaladoc jar

Running unit tests

./gradlew test

Forcing re-running unit tests w/o code change

./gradlew cleanTest test

Running a particular unit test

./gradlew -Dtest.single=RequestResponseSerializationTest core:test

Running a particular test method within a unit test

./gradlew core:test --tests kafka.api.test.ProducerFailureHandlingTest.testCannotSendToInternalTopic
./gradlew clients:test --tests org.apache.kafka.clients.producer.MetadataTest.testMetadataUpdateWaitTime

Running a particular unit test with log4j output

change the log4j setting in either clients/src/test/resources/log4j.properties or core/src/test/resources/log4j.properties
./gradlew -i -Dtest.single=RequestResponseSerializationTest core:test

Building a binary release gzipped tar ball

./gradlew clean
./gradlew releaseTarGz  
The above command will fail if you haven't set up the signing key. To bypass signing the artifact, you can run
./gradlew releaseTarGz -x signArchives

The release file can be found inside ./core/build/distributions/.

Cleaning the build

./gradlew clean

Running a task on a particular version of Scala (either 2.10.5 or 2.11.7)

(If building a jar with a version other than 2.10, need to set SCALA_BINARY_VERSION variable or change it in bin/kafka-run-class.sh to run quick start.)

./gradlew -PscalaVersion=2.11.7 jar
./gradlew -PscalaVersion=2.11.7 test
./gradlew -PscalaVersion=2.11.7 releaseTarGz

Running a task for a specific project

This is for 'core', 'contrib:hadoop-consumer', 'contrib:hadoop-producer', 'examples' and 'clients' ./gradlew core:jar ./gradlew core:test

Listing all gradle tasks

./gradlew tasks

Building IDE project

./gradlew eclipse
./gradlew idea

Building the jar for all scala versions and for all projects

./gradlew jarAll

Running unit tests for all scala versions and for all projects

./gradlew testAll

Building a binary release gzipped tar ball for all scala versions

./gradlew releaseTarGzAll

Publishing the jar for all version of Scala and for all projects to maven

./gradlew uploadArchivesAll

Please note for this to work you should create/update ~/.gradle/gradle.properties and assign the following variables

mavenUrl=
mavenUsername=
mavenPassword=
signing.keyId=
signing.password=
signing.secretKeyRingFile=

Publishing the jars without signing to a local repository

./gradlew -Dorg.gradle.project.skipSigning=true -Dorg.gradle.project.mavenUrl=file://path/to/repo uploadArchivesAll

Building the test jar

./gradlew testJar

Determining how transitive dependencies are added

./gradlew core:dependencies --configuration runtime

Running checkstyle on the java code

./gradlew checkstyleMain checkstyleTest

Running in Vagrant

See vagrant/README.md.

Contribution

Apache Kafka is interested in building the community; we would welcome any thoughts or patches. You can reach us on the Apache mailing lists.

To contribute follow the instructions here:

We also welcome patches for the website and documentation which can be found here:

Something went wrong with that request. Please try again.