Skip to content

Commit

Permalink
test(sink): update the link to download spark tgz for iceberg test (#…
Browse files Browse the repository at this point in the history
…8095)

Fix #8093

Approved-By: xxchan
Approved-By: Li0k
Approved-By: jon-chuang

Co-Authored-By: William Wen <william123.wen@gmail.com>
Co-Authored-By: William Wen <44139337+wenym1@users.noreply.github.com>
  • Loading branch information
wenym1 and wenym1 committed Feb 21, 2023
1 parent 672aad5 commit 4b374c3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ci/scripts/e2e-iceberg-sink-test.sh
Expand Up @@ -52,7 +52,7 @@ sleep 1
# prepare minio iceberg sink
echo "--- preparing iceberg"
.risingwave/bin/mcli -C .risingwave/config/mcli mb hummock-minio/iceberg
wget https://archive.apache.org/dist/spark/spark-3.3.1/spark-3.3.1-bin-hadoop3.tgz
wget https://iceberg-ci-spark-dist.s3.amazonaws.com/spark-3.3.1-bin-hadoop3.tgz
tar -xf spark-3.3.1-bin-hadoop3.tgz --no-same-owner
DEPENDENCIES=org.apache.iceberg:iceberg-spark-runtime-3.3_2.12:1.0.0,org.apache.hadoop:hadoop-aws:3.3.2
spark-3.3.1-bin-hadoop3/bin/spark-sql --packages $DEPENDENCIES \
Expand Down

0 comments on commit 4b374c3

Please sign in to comment.