Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BIGTOP-3314: Fix flink build failure with upgraded hadoop version #609

Merged
merged 1 commit into from
Feb 28, 2020
Merged

BIGTOP-3314: Fix flink build failure with upgraded hadoop version #609

merged 1 commit into from
Feb 28, 2020

Conversation

JunHe77
Copy link
Contributor

@JunHe77 JunHe77 commented Feb 28, 2020

Flink 1.6.4 failed to build with new hadoop 2.10.0. The root cause
is ApplicationReport newInstance API is changed.
Add a patch to upgrade API call in flink.

Change-Id: I5ae0f0e786a92f805feace67d5fe2facea0d9314
Signed-off-by: Jun He jun.he@arm.com

@JunHe77
BIGTOP-3314: Fix flink build failure with upgraded hadoop version
5aa7532 
Flink 1.6.4 failed to build with new hadoop 2.10.0. The root cause
is ApplicationReport newInstance API is changed.
Add a patch to upgrade API call in flink.

Change-Id: I5ae0f0e786a92f805feace67d5fe2facea0d9314
Signed-off-by: Jun He <jun.he@arm.com>
@JunHe77
Copy link
Contributor Author

JunHe77 commented Feb 28, 2020

@iwasakims , would you pls review this? Thanks.

@iwasakims
Copy link
Member

+1(non-binding). Thanks, @JunHe77.

I built flink-1.6.4 with -Dhadoop.version=2.10.0 and the patch, ran unit tests of flume-yarn.

Tests run: 42, Failures: 0, Errors: 0, Skipped: 0

I built rpm on CentOS 7 and ran smoke tests. ./docker-hadoop.sh -c 3 --smoke-tests passed with following cofiguration.

docker:
        memory_limit: "8g"
        image: "bigtop/puppet:trunk-centos-7"
distro: centos
components: [hdfs, yarn, mapreduce, flink]
enable_local_repo: flink
smoke_test_components: [flink]

@sekikn
Copy link
Contributor

sekikn commented Feb 28, 2020

+1, Will merge into master. Thanks @JunHe77 and @iwasakims.

@sekikn sekikn merged commit 2b70354 into apache:master Feb 28, 2020
@JunHe77
Copy link
Contributor Author

JunHe77 commented Feb 28, 2020

Thank you, @iwasakims , @sekikn

@JunHe77 JunHe77 deleted the BIGTOp-3314 branch March 20, 2020 02:16
evans-ye pushed a commit to evans-ye/bigtop that referenced this pull request May 10, 2020
@JunHe77 @evans-ye
BIGTOP-3314: Fix flink build failure with upgraded hadoop version (ap…
8871e94 
…ache#609)

Flink 1.6.4 failed to build with new hadoop 2.10.0. The root cause
is ApplicationReport newInstance API is changed.
Add a patch to upgrade API call in flink.

Change-Id: I5ae0f0e786a92f805feace67d5fe2facea0d9314
Signed-off-by: Jun He <jun.he@arm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@JunHe77 @iwasakims @sekikn