Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BIGTOP-4019. Upgrade Flink to 1.16.2. #1194

Merged
merged 1 commit into from
Oct 17, 2023
Merged

Conversation

sekikn
Copy link
Contributor

@sekikn sekikn commented Oct 15, 2023

Description of PR

This PR upgrades Flink version to 1.16.2.

How was this patch tested?

Ran the following commands on CentOS 7 (x86_64).

$ ./gradlew flink-clean flink-pkg repo
$ cd provisioner/docker
$ ./docker-hadoop.sh -d -dcp -C config_centos-7.yaml -G -L -k hdfs,flink -s flink -c 1

...

> Task :bigtop-tests:smoke-tests:flink:test

org.apache.bigtop.itest.hadoop.flink.TestFlink STANDARD_ERROR
    23/10/15 15:31:20 INFO lang.Object: hadoop fs -rm -r /flink
    23/10/15 15:31:21 INFO lang.Object: hadoop fs -mkdir /flink
    23/10/15 15:31:22 INFO lang.Object: hadoop fs -put test.data /flink/

org.apache.bigtop.itest.hadoop.flink.TestFlink > testCheckRestfulAPI STANDARD_ERROR
    23/10/15 15:31:25 INFO lang.Object: awk '{if(/jobmanager.rpc.address:/) print $2}' < /etc/flink/conf/flink-conf.yaml
    23/10/15 15:31:25 INFO lang.Object: awk '{if(/rest.port:/) print $2}' < /etc/flink/conf/flink-conf.yaml
    23/10/15 15:31:25 INFO lang.Object: curl http://9d1400ea1c02.bigtop.apache.org:8081/config

org.apache.bigtop.itest.hadoop.flink.TestFlink > testWordCountBatch STANDARD_ERROR
    23/10/15 15:31:25 INFO lang.Object: hdfs getconf -confKey fs.defaultFS
    23/10/15 15:31:25 INFO lang.Object: flink run $FLINK_HOME/examples/batch/WordCount.jar --input hdfs://9d1400ea1c02.bigtop.apache.org:8020/flink/test.data --output hdfs://9d1400ea1c02.bigtop.apache.org:8020/tmp/result.txt
    23/10/15 15:31:29 INFO lang.Object: hadoop fs -cat /tmp/result.txt

org.apache.bigtop.itest.hadoop.flink.TestFlink STANDARD_ERROR
    23/10/15 15:31:31 INFO lang.Object: hadoop fs -rm -r /flink

Gradle Test Executor 2 finished executing tests.

> Task :bigtop-tests:smoke-tests:flink:test
Finished generating test XML results (0.015 secs) into: /bigtop-home/bigtop-tests/smoke-tests/flink/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.032 secs) into: /bigtop-home/bigtop-tests/smoke-tests/flink/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:flink:test (Thread[Execution worker for ':' Thread 5,5,main]) completed. Took 44.942 secs.

BUILD SUCCESSFUL in 2m 40s

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'BIGTOP-3638. Your PR title ...')?
  • Make sure that newly added files do not have any licensing issues. When in doubt refer to https://www.apache.org/licenses/

@guyuqi
Copy link
Member

guyuqi commented Oct 17, 2023

Tested it on Arm64 Ubuntu-22.04.
+1.

@guyuqi guyuqi merged commit 9f9e622 into apache:master Oct 17, 2023
@sekikn sekikn deleted the BIGTOP-4019 branch October 17, 2023 07:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants