Skip to content

Commit

Permalink
[KYUUBI #976] [BUILD] Fix source release build
Browse files Browse the repository at this point in the history
<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->
Support build, run unit tests, and create binary tarball from source release.

### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [ ] Add screenshots for manual tests if appropriate

- [ ] [Run test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests) locally before make a pull request

The verify steps:

1. create a source release tarball
```
RELEASE_VERSION=1.4.0-SNAPSHOT build/release/create-package.sh source
```
2. untar tarball
```
cd work/release
tar -xzf kyuubi-1.4.0-SNAPSHOT-bin.tgz
cd kyuubi-1.4.0-SNAPSHOT-bin
```
3. compile and run unit test
```
build/mvn clean install
```
4. create binary release tarball
```
build/dist --tgz --spark-provided -Pkyuubi-extension-spark-3-1
```

Closes #976 from pan3793/source-build.

Closes #976

354968a [Cheng Pan] Compress imgs
9c47b64 [Cheng Pan] Restore docs/imgs in source release
5d86ecc [Cheng Pan] Clean up imgs
a339927 [Cheng Pan] Support create binary from source release
bb27986 [Cheng Pan] [BUILD] Fix source release ut failures

Authored-by: Cheng Pan <chengpan@apache.org>
Signed-off-by: Cheng Pan <chengpan@apache.org>
(cherry picked from commit d58a092)
Signed-off-by: Cheng Pan <chengpan@apache.org>
  • Loading branch information
pan3793 committed Aug 25, 2021
1 parent bff69d5 commit 0bcef28
Show file tree
Hide file tree
Showing 40 changed files with 5 additions and 20 deletions.
1 change: 0 additions & 1 deletion .gitattributes
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@
_config.yml export-ignore
codecov.yml export-ignore
dev/kyuubi-tpcds/ export-ignore
docs/ export-ignore
licenses-binary/ export-ignore
LICENSE-binary export-ignore
NOTICE-binary export-ignore
Expand Down
8 changes: 5 additions & 3 deletions build/dist
Original file line number Diff line number Diff line change
Expand Up @@ -217,9 +217,11 @@ fi

# Copy license files
cp "$KYUUBI_HOME/DISCLAIMER" "$DISTDIR/DISCLAIMER"
cp "$KYUUBI_HOME/LICENSE-binary" "$DISTDIR/LICENSE"
cp -r "$KYUUBI_HOME/licenses-binary" "$DISTDIR/licenses"
$KYUUBI_HOME/build/release/collect-licenses.sh "$DISTDIR" "$DISTDIR"
if [[ -f $"$KYUUBI_HOME/LICENSE-binary" ]]; then
cp "$KYUUBI_HOME/LICENSE-binary" "$DISTDIR/LICENSE"
cp -r "$KYUUBI_HOME/licenses-binary" "$DISTDIR/licenses"
$KYUUBI_HOME/build/release/collect-licenses.sh "$DISTDIR" "$DISTDIR"
fi

cp -r "$KYUUBI_HOME/bin" "$DISTDIR"
cp -r "$KYUUBI_HOME/conf" "$DISTDIR"
Expand Down
2 changes: 0 additions & 2 deletions docs/community/release.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,8 +38,6 @@ Please remember that publishing software has legal consequences. This guide comp

### Overview

![release process](../imgs/release/release-process.png)

The release process consists of several steps:

1. Decide to release
Expand Down
Binary file removed docs/imgs/datagrid_driver_setting.png
Binary file not shown.
Binary file added docs/imgs/datagrip/driver_setting.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed docs/imgs/datagrip_driver_setting.png
Binary file not shown.
Binary file modified docs/imgs/dbeaver/connected.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/dbeaver_connnect_to_database.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/dbeaver_connnect_to_database_connection.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/dbeaver_connnect_to_database_driver.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/dbeaver_connnect_to_database_port.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/desc_database.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/download_driver.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/metadata.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/query.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/query41_result.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/tpcds_schema.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/dbeaver/viewdata.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/ha.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/idea_debug.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/impersonation.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi_architecture.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi_architecture_new.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi_ecosystem.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi_internal.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi_layers.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi_migrating_yarn_to_k8s.png
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/imgs/kyuubi_positioning.png
Binary file removed docs/imgs/logo/Iceberg-logo.png
Diff not rendered.
Binary file removed docs/imgs/logo/beaver-head.png
Diff not rendered.
Binary file removed docs/imgs/logo/hadoop-logo.jpg
Diff not rendered.
Binary file removed docs/imgs/logo/hadoop-yarn-logo.png
Diff not rendered.
14 changes: 0 additions & 14 deletions docs/imgs/logo/hue-logo.svg
Diff not rendered.
Binary file removed docs/imgs/logo/spark-logo-trademark.png
Diff not rendered.
Binary file removed docs/imgs/logo/squirrel.jpg
Diff not rendered.
Binary file removed docs/imgs/release/release-process.png
Diff not rendered.
Binary file modified docs/imgs/spark/hang.png
Binary file modified docs/imgs/spark/sts.png
Binary file modified docs/imgs/spark_jobs_page.png

0 comments on commit 0bcef28

Please sign in to comment.