Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible to keep java8 on 4.5 release? #83

Closed
daniel-sudz opened this issue Feb 15, 2022 · 4 comments
Closed

Possible to keep java8 on 4.5 release? #83

daniel-sudz opened this issue Feb 15, 2022 · 4 comments

Comments

@daniel-sudz
Copy link
Collaborator

hey @cwensel any chance we could keep java8 on the 4.5 branch at least? AWS EMR 6.X (latest release) still defaults on java8 for the hadoop3 flavors and it would be much appreciated to keep this support before they drop it. I would imagine that EMR is a very common use case for this type of library.

@cwensel
Copy link
Owner

cwensel commented Feb 15, 2022

Curious, is the jvm configurable on startup? Is it unstable on Java 11?

The Hadoop requirement is to compile Hadoop on Java 8, but it should theoretically run fine on Java 11. Unsurprised if that isn't true.

We can revert, but I really was hoping to start leveraging Java 11 without introducing yet another concurrent version.

@daniel-sudz
Copy link
Collaborator Author

daniel-sudz commented Feb 15, 2022

it's possible to override but it's just not the default out of the box on AWS EMR and I would imagine there could be some breaking assumptions that would be a huge pain to deal with.

Java 8 is the default Java Virtual Machine (JVM) for cluster instances created using Amazon EMR release version 5.0.0 or later. 

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/configuring-java8.html

I have have no doubt that hadoop itself works fine on java11. If it's a dealbreaker that's fine just would be more convenient in a managed runtime.

@cwensel
Copy link
Owner

cwensel commented Feb 16, 2022

Fair enough, I'll revert the build version.

@cwensel cwensel closed this as completed Feb 16, 2022
@daniel-sudz
Copy link
Collaborator Author

daniel-sudz commented Feb 16, 2022

thank you @cwensel if this is pushed to say 4.6/4.7 I think that is reasonable. I would assume that newer release labels from AWS EMR will be java11+ within a year or so.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants