Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade to Payara 6 and from EE 8 to EE 10 (end of Payara 5 Community Edition security patches Q2/2022) #8305

Closed
pdurbin opened this issue Dec 10, 2021 · 40 comments · Fixed by #9685
Labels
D: Payara 6 Upgrade Issues and PRs about the move to Jakarta EE 10 + Payara 6 Size: 30 A percentage of a sprint. 21 hours. (formerly size:33) zbklog: Deliverable This is an item synched from the product planning process
Milestone

Comments

@pdurbin
Copy link
Member

pdurbin commented Dec 10, 2021

As a "bklog: Deliverable" This is decomposed into smaller issues, grouped under D: Payara 6 Upgrade


Hat tip to @poikilotherm who posted in chat a link to a video in which Steve Millidge, founder of Payara, answered a question about how long Payara 5 Community Edition (which we recommend in the guides) will receive security patches: https://youtu.be/juD0XNNq344?t=1972

I've transcribed the question and answer:

Q: "For the Community Edition, when will v5 stop getting security patches?"

A: "Payara 5 in Community was basically... when we switch the main branch over to 6, which will be on the point of 6 release, then Community will march forward on Payara 6. So Payara 5 patches, if you like, will stop at that point through Community. So then it will be Enterprise where you'll get patches and security fixes for Payara 5. Payara Community essentially is a marching version so whenever the latest release is the latest release."

I didn't watch the whole video but @poikilotherm says Payara plans to switch the main branch to 6 in Q2/2022.

(By the way, #8064 is the issue where we're tracking the next 5.x upgrade from Payara. As of this writing we are advising installations to use Payara 5.2021.5: https://guides.dataverse.org/en/5.9/installation/prerequisites.html#payara )

@pdurbin
Copy link
Member Author

pdurbin commented Feb 1, 2022

At https://youtu.be/Bm8aNy2bcJ4?t=1121 some dates were shown for Payara 6. Here' are some screenshots:

Screen Shot 2022-02-01 at 3 36 11 PM

Screen Shot 2022-02-01 at 3 42 48 PM

Screen Shot 2022-02-01 at 3 49 08 PM

@pdurbin
Copy link
Member Author

pdurbin commented Mar 8, 2022

Payara Server Community 6.2022.1 Alpha 2 is available for download from https://www.payara.fish/downloads/payara-platform-community-edition/

Based on https://github.com/payara/Payara/releases/tag/payara-server-6.2022.1.Alpha2 it looks like it came out on Feb 17.

@donsizemore
Copy link
Contributor

Current state of develop on payara-6.2022.1.Alpha2 (openjdk 11.0.14):

[INFO] Building war: /tmp/dataverse/target/dataverse-5.9.war
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
Deploying the application (dataverse.war)
Failed to deploy the application!

5,341 "Invalid signature file digest" SEVEREs, then:

org.xml.sax.SAXParseExceptionpublicId: file:/usr/local/payara6/glassfish/lib/schemas/web-fragment_3_1.xsd; lineNumber: 8; columnNumber: 27; Deployment descriptor file META-INF/web-fragment.xml in archive [omnifaces-3.8.jar].  TargetNamespace.1: Expecting namespace 'https://jakarta.ee/xml/ns/jakartaee', but the target namespace of the schema document is 'http://xmlns.jcp.org/xml/ns/javaee'
org.xml.sax.SAXParseException; systemId: file:/usr/local/payara6/glassfish/lib/schemas/web-fragment_3_1.xsd; lineNumber: 8; columnNumber: 27; TargetNamespace.1: Expecting namespace 'https://jakarta.ee/xml/ns/jakartaee', but the target namespace of the schema document is 'http://xmlns.jcp.org/xml/ns/javaee'

@donsizemore
Copy link
Contributor

@pdurbin asked for the commit (1487650) and full server.log (attached as
payara6_server_log.zip )

@donsizemore
Copy link
Contributor

I changed all instances of http://xmlns.jcp.org/xml/ns/javaee to https://jakarta.ee/xml/ns/jakartaee in uncch-rdmc@91ef326 but still get the namespace error on deployment.

@pdurbin notes the omnifaces error, and suggests an upgrade. OmniFaces 3.13 produces the same namespace error on deployment; omnifaces.org tells me "use 4.0-M13 instead. It’s the Jakartified version of 3.13."

A mvn package using OmniFaces 4.0.M-13 yields

[ERROR] /tmp/dataverse/src/main/java/edu/harvard/iq/dataverse/authorization/providers/oauth2/OAuth2LoginBackingBean.java:[89,50] cannot access jakarta.servlet.http.HttpServletRequest
  class file for jakarta.servlet.http.HttpServletRequest not found

I suppose I could drop back to OmniFaces 4.0.M-3 "(25 Oct 2020, Jakartified 3.8.1, still using Java 1.8)" but this seems wrong to me. Suggestions from smarter minds most welcomed.

@scolapasta scolapasta moved this from IQSS Team - In Progress 💻 to Up Next 🛎 in IQSS/dataverse (TO BE RETIRED / DELETED in favor of project 34) Mar 21, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 23, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 23, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 23, 2022
@donsizemore
Copy link
Contributor

Current state: Jim has an EE9 branch and Oliver has a Jakarta branch

  • Oliver graciously used his commercial IntelliJ "migrate javax to jakarta" function, as a global search and replace isn't advised since not all javax packages will be migrated.
  • Jakarta namespace change will require an OmniFaces upgrade and possibly a commons-fileupload upgrade/replacement
  • Currently blocked by SWORD2 work, as the current SWORD implementation expects javax.*

One thing to note or to ignore: as of Nov 2021 Payara runs on the 17 LTS JDK.

poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 24, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 24, 2022
1. The Jersey dependencies in use did not use the versions imported via the
Payara BOM (which itself imports a Jersey BOM).
2. The coordinates for the server package changed, re-aligned.
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 24, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 24, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
…nly IQSS#8305

This avoids potential trouble were it's unclear from where the higher exceptions come from, javax or jakarta namespace.
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
Also add provided dependency of our persistence provider to POM to allow class resolution in IDEs.
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Mar 25, 2022
@qqmyers
Copy link
Member

qqmyers commented Mar 29, 2022

In this upgrade, we need to see if #8064 (comment) is still relevant as an upgrade issue.

@Kris-LIBIS
Copy link
Contributor

Kris-LIBIS commented Apr 21, 2022

Payara just announced 5.2022.2 with the following remark:

"Please note: This is the penultimate Payara 5 Community release. Payara 6 Community will soon take its place, to be used with Jakarta EE 10. If you want to keep using earlier Java EE/Jakarta EE versions – we encourage you to move to Payara 5 Enterprise."

AFAIK, JDK 17 is not a must for Jakarta EE 10, but would be recommended.

@pdurbin pdurbin changed the title bklog: Deliverable - Upgrade to Payara 6 and from EE 8 to EE 10 (end of Payara 5 Community Edition security patches Q2/2022) Upgrade to Payara 6 and from EE 8 to EE 10 (end of Payara 5 Community Edition security patches Q2/2022) Jul 25, 2023
pdurbin added a commit that referenced this issue Jul 25, 2023
pdurbin added a commit that referenced this issue Jul 26, 2023
Conflicts:
doc/sphinx-guides/source/admin/make-data-count.rst
src/main/java/edu/harvard/iq/dataverse/export/ddi/DdiExportUtil.java
pdurbin added a commit that referenced this issue Jul 26, 2023
See payara/Payara#6344

Bug Report: Payara doesn't run on latest JDK patch levels / FISH-7665
pdurbin added a commit that referenced this issue Jul 28, 2023
pdurbin added a commit that referenced this issue Jul 28, 2023
As of Payara 6, you can no longer send
"Content-Disposition: filename=example.zip"

Instead you must send
"Content-Disposition: attachment; filename=example.zip"

For backward compatibility, we are adding "attachment; "
if it's missing.

An alternative would be to force this backward
incompatibility on our users. Originally we did this
in 89182c1 but we reverted it in 83c55a9
pdurbin added a commit that referenced this issue Aug 1, 2023
HarvestingClientsIT#testHarvestingClientRun was failing
when Dataverse is running in Docker
@cmbz cmbz moved this from ▶ SPRINT READY to This Sprint 🏃‍♀️ 🏃 in IQSS/dataverse (TO BE RETIRED / DELETED in favor of project 34) Aug 2, 2023
pdurbin added a commit that referenced this issue Aug 2, 2023
Also mark DCM and RSAL as deprecated #8985
@scolapasta scolapasta removed this from This Sprint 🏃‍♀️ 🏃 in IQSS/dataverse (TO BE RETIRED / DELETED in favor of project 34) Aug 2, 2023
pdurbin added a commit that referenced this issue Aug 3, 2023
pdurbin added a commit that referenced this issue Aug 3, 2023
pdurbin added a commit that referenced this issue Aug 3, 2023
pdurbin added a commit that referenced this issue Aug 3, 2023
pdurbin added a commit that referenced this issue Aug 8, 2023
The Perl installer was removed in b829ca7
pdurbin added a commit that referenced this issue Aug 9, 2023
editFileAction only appears in these two files:

- file-edit-button-fragment.xhtml
- filesFragment.xhtml

So it should be safe to hard code the method, which is always
DatasetPage.editFileMetadata().
pdurbin added a commit that referenced this issue Aug 9, 2023
As of Payara 6/JSF 4/Jakarta EE 10, this syntax doesn't work:

action="#{bean[editFileAction]()}"

(Or it logs errors in server.log at the very least.)

So we switch to this syntax:

action=#{bean.editFileMetadata()}"

This means we have to make sure the method exists on all the beans,
though, or we get errors. (It's unclear why we weren't seeing errors
before!) So we add the method to FilePage, which gets passed as bean.

We also remove the now unused "editFileAction".
pdurbin added a commit that referenced this issue Aug 10, 2023
As of Payara 6/JSF 4/Jakarta EE 10, this syntax doesn't work:

action="#{bean[editFileAction]()}"

(Or it logs errors in server.log at the very least.)

So we switch to this syntax:

action=#{bean.editFileMetadata()}"

This means we have to make sure the method exists on all the beans,
though, or we get errors. (It's unclear why we weren't seeing errors
before!) So we add the method to FilePage, which gets passed as bean.

We also remove the now unused "editFileAction".
pdurbin added a commit that referenced this issue Aug 18, 2023
poikilotherm added a commit to poikilotherm/dataverse that referenced this issue Oct 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
D: Payara 6 Upgrade Issues and PRs about the move to Jakarta EE 10 + Payara 6 Size: 30 A percentage of a sprint. 21 hours. (formerly size:33) zbklog: Deliverable This is an item synched from the product planning process
Projects
Status: No status
8 participants