AdoptOpenJDK TSC and Knowledge Base
We welcome any contributions big or small from experienced OpenJDK folks to those who are brand new to software projects!
The AdoptOpenJDK Build Farm is three things:
- A Repository of professionally built, tested and supported OpenJDK binaries - A place for end users to download professionally built and tested OpenJDK binaries, see Support for our full support details.
- A Community of builders - A place where those who build and test OpenJDK come together to share common code and practices.
- Infrastructure as Code - To host, build, test and deploy variants of OpenJDK (aka Java)! This infrastructure as code is based around ansible and is designed to be usable by any person or organisation wishing to build a derivative build farm or parts of one.
See https://www.adoptopenjdk.net for in depth details of the motivation, who's involved, the sponsors and much more!
AdoptOpenJDK is a vast undertaking and has numerous GitHub repositories where the work gets done.
These projects are located in the following repositories in rough order of importance with regards to understanding how the build farm is put together and works. Each repository maintains its own set of issues, pull requests and documentation (edit the Image Source and export to make changes.)
- openjdk-infrastructure - Infrastructure as Code and documentation for build farm hosts.
- openjdk-build - Code and instructions for building Adopt OpenJDK Binaries.
- openjdk-mirror-scripts - Our scripts to mirror OpenJDK source from Mercurial or GitHub (aka project Skara).
- ci-jenkins-pipelines - The Jenkins Pipelines scripts, used by Adopt and can be used by 3rd parties.
- openjdk-docker - Scripts for creating Docker images of OpenJDK binaries.
- openjdk-docker-build-tools - Helper scripts for openjdk-docker.
- openjdk-installer - Installer files for creating platform packaged OpenJDK binaries.
- homebrew-openjdk - HomeBrew TAP repo for all macOS OpenJDK binaries.
- jdk-api-diff - A diff tool that reports what API changes there are between versions.
- build-jdk - Github action for building JDKs that utilizes the build scripts from the openjdk-build repo.
- install-jdk - Github action that installs SDKs served up by the AdoptOpenJDK API.
- IcedTea-Web - IcedTea-Web, the OSS replacement for (most of) Java Web Start.
- openjdk-tests - Instructions for all testing at AdoptOpenJDK, code for app, performance and regression testing of AdoptOpenJDK Binaries and CI test automation scripts.
- openjdk-test-tools - The home for Test Results Summary Service (TRSS) (not to be confused with stf which is the tooling for system tests).
- openjdk-systemtest - Code and instructions for system and load testing AdoptOpenJDK Binaries.
- stf - The System Test Framework, a harness for executing openjdk-systemtest.
- bumblebench - A micro-benchmarking test framework for AdoptOpenJDK.
- TKG - TestKitGen (TKG) is a lightweight test harness for bringing together a diverse set of tests or commands under some common behaviour.
- run-aqa - A Github action that enables the running of the AdoptOpenJDK Quality Assurance (AQA) test suite in Github workflows.
- openjdk-website - Code and instructions for Website.
- openjdk-website-staging - A private repo that acts as the website staging repository.
- openjdk-website-next - The Typescript and React re-write for the Website.
- openjdk-api - Code and instructions for the v1 and v2 (Both Deprecated) APIs.
- openjdk-api-java-client - A Java client for our API.
- openjdk-api-v3 - Code and instructions for our current v3 API.
- openjdk-api-graphql - The GraphQL interface that both V2 and V3 APIs use.
- openjdk-github-release - previously known as
openjdk-website-backend. Code for pulling the GitHub releases API into the website.
- openjdk-dashboard - AdoptOpenJDK Dashboard for download stats.
- openjdk-dashboard-v2 - The next gen download dashboard.
Support and Admin Projects
These projects are critical to maintaining security, supporting our user ecosystem, and for the internal running of the project (edit the Image Source at Google and export to make changes.)
- Technical Steering Committee (TSC) - The Technical Steering Committee and Knowledge Base starting point.
- TSC-confidential - To hold any confidential information for the TSC, e.g. Sponsorship Agreements.
- security - A private repo for the security team.
- openjdk-support - For end-user problems reported with our binary distributions.
AdoptOpenJDK Source Repositories
The following diagram lists the source repositories for AdoptOpenJDK (edit the Image Source at Google and export to make changes.)
When an OpenJDK variant is mercurial based or AdoptOpenJDK needs to maintain its own patches then we have a clone of that source:
AdoptOpenJDK binary repositories
The following diagram lists the binary repositories for AdoptOpenJDK (edit the Image Source at Google and export to make changes.). These GitHub Repositories are where builds that pass the pipeline are published to. The API (and subsequently) website poll these repositories to make binaries available.
- openjdk8-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 8 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk9-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 9 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk10-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 10 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk11-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 11 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk12-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 12 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk13-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 13 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk14-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 14 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk15-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 15 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk16-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK 16 (HotSpot VM and Eclipse OpenJ9 VM).
- openjdk-binaries - AdoptOpenJDK nightly and release binaries for AdoptOpenJDK (Latest) (HotSpot VM and Eclipse OpenJ9 VM).
Upstream OpenJDK binary repositories
These GitHub Repositories are where builds from the OpenjDK update projects (led by Red Hat) are published to. The API (and subsequently) website poll these repositories to make binaries available.
- openjdk8-upstream-binaries - OpenJDK nightly and release binaries for OpenJDK 8 (HotSpot VM).
- openjdk11-upstream-binaries - OpenJDK nightly and release binaries for OpenJDK 11 (HotSpot VM).
Dragonwell OpenJDK binary repositories
These GitHub Repositories are where builds from Alibaba's Dragonwell distribution are published to. The API (and subsequently) website poll these repositories to make binaries available.
- openjdk8-dragonwell-binaries - OpenJDK nightly and release binaries for OpenJDK 8 (HotSpot VM).
- openjdk11-dragonwell-binaries - OpenJDK nightly and release binaries for OpenJDK 11 (HotSpot VM).
Due to security or licensing concerns the following repositories are private. Please raise an issue on the Infrastructure Project if you think you need access.
- TSC-confidential) - To hold any confidential information for the TSC, e.g. Sponsorship Agreements.
- moderation - For holding moderation requests.
- secrets - For holding some secrets.
- security - For the security team.
- openjdk-security - A private repo for (adopt)openjdk vulnerability investigations.
- openjdk-website-staging - for staging website PR's.
Java Mission Control Support
We support the building of Java Mission Control (JMC).
- openjdk-jmc-overrides - Contains the AdoptOpenJDK specific source code overrides and build pipeline script for the Java Mission Control project.
The following diagram is a very simplified view of how a build progresses through a pipeline (edit the Image Source at Google and export to make changes.)
NOTE: Please ensure you read the documentation below and in the appropriate repositories to get a full understanding
The workflow to source, build, test and deploy variants of OpenJDK is as follows.
1. Get the OpenJDK variant source code
We source variants and versions of OpenJDK from a variety of source repositories. Add a new build variant describes the typical work flow of getting a new variant up and running. Please also see Platform Costs as variants with high impact on the build farm will require funding.
- OpenJDK HotSpot Mirrors - GitHub mirrors of OpenJDK forests are created in the AdoptOpenJDK org. For example: openjdk-jdk8u, openjdk-jdk11u. Please open an openjdk-TSC issue if you'd like a new variant added.
- OpenJDK OpenJ9 - Eclipse OpenJ9 source is built from IBM Runtimes, e.g. openj9-openjdk-jdk8, openj9-openjdk-jdk9
- OpenJDK SAP - SAP source is built from e.g. openjdk-sap-jdk10
- OpenJDK OpenJFX - GitHub mirror of OpenJDK JFX lives at AdoptOpenJDK - openjdk-jfx
2. Choose the branches to build from
Each OpenJDK variant has a canonical branch that is built:
- OpenJDK HotSpot - The
devbranch of AdoptOpenJDK contains extra patches over and above
master(which is the exact clone of the OpenJDK forest).
devis used to build AdoptOpenJDK binaries
- OpenJDK OpenJ9 - Branches such as
openj9-0.8are used to build OpenJ9 Releases for Java 8 and
openj9is used to build OpenJ9 for Java 9.
- OpenJDK SAP - The
sapmachinebranch is used to build SAP for Java 10
- OpenJDK OpenJFX - TODO
3. Build, Test and Deploy Pipeline
NOTE: Once the Test jobs have stabilised, the pipeline described below will change so that only tested binaries are released to Nightly and Release repositories for consumption by the Website and/Or API. See The Quality Bar Discussion for details.
Builds are run on the Supported Platforms. The Jenkins leader sends the build jobs to the Jenkins followers based on a tagging system configured in the Jenkins jobs, e.g.
centos6&&x64&&build. See openjdk-build and openjdk-infrastructure for details.
Tests are run on the Supported Test Platforms. The Jenkins leader sends the test jobs to the Jenkins followers based on a similar tagging system to build. See openjdk-tests and openjdk-infrastructure for details.
- Builds are tested - The tests in openjdk-tests are executed and tests results are posted to TODO. Tests include, but are not limited to the jtreg tests that come with OpenJDK itself.
- Builds are system tested - System Tests from openjdk-systemtests are executed and test results are posted to TODO
- Builds are external tested - External Tests are executed and test results are posted to TODO
- Builds are performance tested - Performance Tests from bumblebench are executed and test results are posted to TODO
3.3 Sign Binaries
TODO - Binaries are signed.
3.4 Deploy Binaries
TODO: We're missing the SAP and OpenJFK deployments here.
NOTE Future versions of this workflow will show the status of testing and meta data about how the binary was built.
Binaries made available - Binaries are made available for download via the website and api gateway. See openjdk-website, openjdk-api and openjdk-api-java-client projects for more details. We also make the builds available through DockerHub and our own unofficial docker repositories, see openjdk-docker for details.
List of TSC Responsibilities
The TSC exercises autonomy in setting up and maintaining procedures, policies, and management and administrative structures as it deems appropriate for the maintenance and operation of these projects and resources.
Included in the responsibilities of the TSC are:
- Managing the tangible assets of the projects such as machines, code, etc, and the intangible assets such as policies, brand, etc for the listed projects and resources
- Meeting monthly to discuss progress and other TSC issues
- Setting and maintaining standards covering contributions of code, documentation and other materials including infrastructure such as build machines
- Facilitating code and binary releases: types, schedules, frequency, delivery mechanisms
- Acquiring resources and ensuring they are maintained in a functional and secure manner for the benefit of the project.
- Resolving overall technical direction for the AdoptOpenJDK organization, including high-level goals and low-level specifics regarding features and functionality
- Maintaining a relationship with the AdoptOpenJDK security group for dealing with vulnerabilities in an appropriate manner
- Setting and maintaining appropriate standards for community discourse via the various mediums under TSC control, including but not limited to the Website, Slack, GitHub comments
TSC members can nominate new members at any time. Candidates for membership tend to be people who have a competency for community management and high tolerance and patience for process minutiae as the TSC delegates most of its responsibilities to other teams.
karianna - Martijn Verburg (Microsoft)
gdams - George Adams (Microsoft)
aahlenst - Andreas Ahlenstorf (ZHAW)
gdams - George Adams (Microsoft)
hendrikebbers - Hendrik Ebbers (Karakun AG)
jerboaa - Severin Gehwolf (Red Hat)
johnoliver - John Oliver (Microsoft)
karianna - Martijn Verburg (Microsoft)
smlambert - Shelley Lambert (Red Hat)
sxa - Stewart X Addison (Red Hat)
tellison - Tim Ellison (Red Hat)
Rules for TSC Membership
- No single organization can occupy more than half the seats on the TSC.
- The appointing of TSC members occurs on an annual basis and is based on a do-ocracy.
- Candidates with the intention of becoming a member of the TSC should briefly outline where they'd like to see the project going - all in a transparent manner that is available to the public.
Each community member has a Single Transferable Vote (STV). There are tools to manage STV voting.
The AdoptOpenJDK Community.