Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LPS-119582 Reset the state of merge layout prototypes thread local #1588

Closed
wants to merge 153 commits into from

Conversation

pavel-savinov
Copy link

No description provided.

shuyangzhou and others added 30 commits November 9, 2020 09:59
…ch task will run on single/all nodes in the cluster
… multiple if conditions which would determine which storageType should be used + add singleNodeExecution service logic
@liferay-continuous-integration
Copy link
Collaborator

To conserve resources, the PR Tester does not automatically run for every pull.

If your code changes were already tested in another pull, reference that pull in this pull so the test results can be analyzed.

If your pull was never tested, comment "ci:test" to run the PR Tester for this pull.

@pavel-savinov
Copy link
Author

Hey @vicnate5, integration test failure is fixed here. and DB partitioning issue is reproducible even without this PR, please see https://issues.liferay.com/browse/LPS-122281 for details.
Thanks!

@pavel-savinov
Copy link
Author

ci:test:sf

@pavel-savinov
Copy link
Author

ci:test:relevant

@pavel-savinov
Copy link
Author

ci:test

@liferay-continuous-integration
Copy link
Collaborator

✔️ ci:test:sf - 1 out of 1 jobs passed in 3 minutes

Click here for more details.

Base Branch:

Branch Name: master
Branch GIT ID: 88f53b3c075512ce600e0d63b711dbad848a9e1b

Sender Branch:

Branch Name: pr-1585
Branch GIT ID: 6b91b23fe431c2f3eab971812c0a652248ad818c

1 out of 1jobs PASSED
1 Successful Jobs:
For more details click here.

@liferay-continuous-integration
Copy link
Collaborator

Jenkins Build:test-portal-source-format#2118
Jenkins Report:jenkins-report.html
Jenkins Suite: sf
Pull Request:vicnate5#1588
Spira Release:/Liferay DXP 7.3/Pull Request/ci:test:sf
Spira Release Build:master - pavel-savinov > vicnate5 - PR#1588 - 2020-11-10[02:25:30]
Spira Jenkins Build:publish-spira-report#7914

@liferay-continuous-integration
Copy link
Collaborator

❌ ci:test:default - 66 out of 82 jobs passed in 3 hours 42 minutes

Click here for more details.

Base Branch:

Branch Name: master
Branch GIT ID: 9226b10831eed5db236b208be0c6e85c8aafbe62

Copied in Private Modules Branch:

Branch Name: master-private
Branch GIT ID: 8d22a791300569a6c92e7b9152e6ae1c6bdc863a

ci:test:default - 66 out of 82 jobs PASSED

16 Failed Jobs:

66 Successful Jobs:
For more details click here.

Failures unique to this pull:

  1. test-portal-acceptance-pullrequest-batch(master)/portal-license-jdk8/0
    Job Results:

    0 Tests Passed.
    1 Test Failed.

    1. AXIS_VARIABLE=0,label_exp=!master #416672
           [exec] Listing files that were compressed.
           [exec] | | | | | | |____logs
           [exec] | | | | | | | |____test-1-15
           [exec] | | | | | | | | |____1605008707377
           [exec] | | | | | | | | | |____test-portal-acceptance-pullrequest(master)
           [exec] | | | | | | | | | | |____3484
           [exec] | | | | | | | | | | | |____portal-license-jdk8
           [exec] | | | | | | | | | | | | |____0
           [exec] | | | | | | | | | | | | | |____0
           [exec] | | | | | | | | | | | | | | |____jenkins-console.txt.gz
         [delete] Deleting: /opt/dev/projects/github/liferay-jenkins-ee/commands/20201110060445211
           [echo] send.to.testray.logs.start.timestamp: 11-10-2020 06:04:45:257 PST
           [echo] Sending Testray logs to Testray production server.
         [delete] Deleting: /opt/dev/projects/github/liferay-jenkins-ee/commands/20201110060445258
      [stopwatch] [send.to.testray.logs: 0.314 sec]
           [echo] send.to.testray.results.start.timestamp: 11-10-2020 06:04:45:572 PST
           [echo] Sending Testray results to Testray production server.
         [delete] Deleting: /opt/dev/projects/github/liferay-jenkins-ee/commands/20201110060445574
      [stopwatch] [send.to.testray.results: 0.288 sec]
      [stopwatch] [record.testray.results.TESTS-test-1-15_test-portal-acceptance-pullrequest(master)_3484_portal-license-jdk8/0_0_functional.xml: 1.082 sec]
      [stopwatch] [record.testray.results: 1.366 sec]
      [stopwatch] [run.current.job: 21:18.433 sec]
      

      BUILD FAILED
      /opt/dev/projects/github/liferay-jenkins-ee/commands/build-common.xml:12080: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-portal/build-test-batch.xml:6032: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-portal/build-test-batch.xml:6078: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-release-tool-ee/build.xml:140: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-release-tool-ee/build-release.xml:916: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-portal/build.xml:277: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-portal/portal-web/build.xml:252: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-portal/portal-web/build.xml:236: The following error occurred while executing this line:
      /opt/dev/projects/github/liferay-portal/portal-web/build.xml:128: JSPs failed to compile.

  2. ...
Test bundle downloads:

@liferay-continuous-integration
Copy link
Collaborator

@liferay-continuous-integration
Copy link
Collaborator

✔️ ci:test:stable - 9 out of 9 jobs passed

✔️ ci:test:relevant - 23 out of 24 jobs passed in 5 hours 57 minutes

Click here for more details.

Base Branch:

Branch Name: master
Branch GIT ID: 9226b10831eed5db236b208be0c6e85c8aafbe62

Copied in Private Modules Branch:

Branch Name: master-private
Branch GIT ID: 8d22a791300569a6c92e7b9152e6ae1c6bdc863a

ci:test:stable - 9 out of 9 jobs PASSED
9 Successful Jobs:
ci:test:relevant - 22 out of 24 jobs PASSED
22 Successful Jobs:
For more details click here.

This pull contains no unique failures.


Failures in common with acceptance upstream results at b57b964:
  1. test-portal-acceptance-pullrequest-batch(master)/modules-integration-mysql57-jdk8/0
    Job Results:

    2 Tests Passed.
    3 Tests Failed.

    1. AXIS_VARIABLE=1,label_exp=!master #446265
           [exec] > Task :apps:commerce:commerce-notification-api:compileJava FAILED
           [exec] 
           [exec] 
           [exec] FAILURE: Build failed with an exception.
           [exec] 
           [exec] * What went wrong:
           [exec] Execution failed for task ':apps:commerce:commerce-notification-api:compileJava'.
           [exec] > Could not resolve all files for configuration ':apps:commerce:commerce-notification-api:compileClasspath'.
           [exec]    > Could not resolve javax.portlet:portlet-api:3.0.0.
           [exec]      Required by:
           [exec]          project :apps:commerce:commerce-notification-api
           [exec]       > Could not resolve javax.portlet:portlet-api:3.0.0.
           [exec]          > Could not get resource 'https://repository-cdn.liferay.com/nexus/content/groups/public/javax/portlet/portlet-api/3.0.0/portlet-api-3.0.0.pom'.
           [exec]             > Could not HEAD 'https://repository-cdn.liferay.com/nexus/content/groups/public/javax/portlet/portlet-api/3.0.0/portlet-api-3.0.0.pom'.
           [exec]                > repository-cdn.liferay.com: Name or service not known
           [exec]       > Could not resolve javax.portlet:portlet-api:3.0.0.
           [exec]          > Could not get resource 'https://repository-cdn.liferay.com/nexus/service/local/repo_groups/private/content/javax/portlet/portlet-api/3.0.0/portlet-api-3.0.0.pom'.
           [exec]             > Could not HEAD 'https://repository-cdn.liferay.com/nexus/service/local/repo_groups/private/content/javax/portlet/portlet-api/3.0.0/portlet-api-3.0.0.pom'.
           [exec]                > repository-cdn.liferay.com
           [exec] 
           [exec] * Try:
           [exec] Run with --info or --debug option to get more log output. Run with --scan to get full insights.
           [exec] 
           [exec] * Exception is:
           [exec] org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':apps:commerce:commerce-notification-api:compileJava'.
           [exec] 	at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:38)
           [exec] 	at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.executeTask(EventFiringTaskExecuter.java:77)
           [exec] 	at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.call(EventFiringTaskExecuter.java:55)
           [exec] 	at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.call(EventFiringTaskExecuter.java:52)
    2. AXIS_VARIABLE=4,label_exp=!master #446265
           [exec] * What went wrong:
           [exec] Execution failed for task ':apps:commerce:commerce-cart-taglib:generateJSPJava'.
           [exec] > Could not resolve all files for configuration ':apps:commerce:commerce-cart-taglib:jspC'.
           [exec]    > Could not resolve org.apache.ws.xmlschema:xmlschema-core:2.2.3.
           [exec]      Required by:
           [exec]          project :apps:commerce:commerce-cart-taglib > org.apache.cxf:cxf-core:3.2.5
           [exec]       > Could not resolve org.apache.ws.xmlschema:xmlschema-core:2.2.3.
           [exec]          > Could not get resource 'https://repository-cdn.liferay.com/nexus/content/groups/public/org/apache/ws/xmlschema/xmlschema-core/2.2.3/xmlschema-core-2.2.3.pom'.
           [exec]             > Could not HEAD 'https://repository-cdn.liferay.com/nexus/content/groups/public/org/apache/ws/xmlschema/xmlschema-core/2.2.3/xmlschema-core-2.2.3.pom'.
           [exec]                > repository-cdn.liferay.com: Name or service not known
           [exec]       > Could not resolve org.apache.ws.xmlschema:xmlschema-core:2.2.3.
           [exec]          > Could not get resource 'https://repository-cdn.liferay.com/nexus/service/local/repo_groups/private/content/org/apache/ws/xmlschema/xmlschema-core/2.2.3/xmlschema-core-2.2.3.pom'.
           [exec]             > Could not HEAD 'https://repository-cdn.liferay.com/nexus/service/local/repo_groups/private/content/org/apache/ws/xmlschema/xmlschema-core/2.2.3/xmlschema-core-2.2.3.pom'.
           [exec]                > repository-cdn.liferay.com
           [exec]    > Could not resolve org.apache.cxf:cxf-rt-transports-http:3.2.5.
           [exec]      Required by:
           [exec]          project :apps:commerce:commerce-cart-taglib > org.apache.cxf:cxf-rt-frontend-jaxrs:3.2.5
           [exec]       > Could not resolve org.apache.cxf:cxf-rt-transports-http:3.2.5.
           [exec]          > Could not get resource 'https://repository-cdn.liferay.com/nexus/content/groups/public/org/apache/cxf/cxf-rt-transports-http/3.2.5/cxf-rt-transports-http-3.2.5.pom'.
           [exec]             > Could not HEAD 'https://repository-cdn.liferay.com/nexus/content/groups/public/org/apache/cxf/cxf-rt-transports-http/3.2.5/cxf-rt-transports-http-3.2.5.pom'.
           [exec]                > repository-cdn.liferay.com
           [exec]       > Could not resolve org.apache.cxf:cxf-rt-transports-http:3.2.5.
    3. AXIS_VARIABLE=5,label_exp=!master #446265
           [exec] > Task :apps:static:portal-configuration:portal-configuration-persistence-api:compileJava FAILED
           [exec] > Task :core:petra:petra-sql-dsl-api:autoUpdateXml SKIPPED
           [exec] > Task :apps:static:portal-configuration:portal-configuration-metatype-api:autoUpdateXml SKIPPED
           [exec] Gradle build finished at 2020-11-10 16:25:51.312.
           [exec] 
           [exec] 
           [exec] FAILURE: Build failed with an exception.
           [exec] 
           [exec] * What went wrong:
           [exec] Execution failed for task ':apps:static:portal-configuration:portal-configuration-persistence-api:compileJava'.
           [exec] > Could not resolve all files for configuration ':apps:static:portal-configuration:portal-configuration-persistence-api:compileClasspath'.
           [exec]    > Could not resolve com.liferay:org.apache.felix.configadmin:1.9.8.LIFERAY-PATCHED-4.
           [exec]      Required by:
           [exec]          project :apps:static:portal-configuration:portal-configuration-persistence-api
           [exec]       > Could not resolve com.liferay:org.apache.felix.configadmin:1.9.8.LIFERAY-PATCHED-4.
           [exec]          > Could not get resource 'https://repository-cdn.liferay.com/nexus/content/groups/public/com/liferay/org.apache.felix.configadmin/1.9.8.LIFERAY-PATCHED-4/org.apache.felix.configadmin-1.9.8.LIFERAY-PATCHED-4.pom'.
           [exec]             > Could not HEAD 'https://repository-cdn.liferay.com/nexus/content/groups/public/com/liferay/org.apache.felix.configadmin/1.9.8.LIFERAY-PATCHED-4/org.apache.felix.configadmin-1.9.8.LIFERAY-PATCHED-4.pom'.
           [exec]                > repository-cdn.liferay.com: Name or service not known
           [exec]       > Could not resolve com.liferay:org.apache.felix.configadmin:1.9.8.LIFERAY-PATCHED-4.
           [exec]          > Could not get resource 'https://repository-cdn.liferay.com/nexus/service/local/repo_groups/private/content/com/liferay/org.apache.felix.configadmin/1.9.8.LIFERAY-PATCHED-4/org.apache.felix.configadmin-1.9.8.LIFERAY-PATCHED-4.pom'.
           [exec]             > Could not HEAD 'https://repository-cdn.liferay.com/nexus/service/local/repo_groups/private/content/com/liferay/org.apache.felix.configadmin/1.9.8.LIFERAY-PATCHED-4/org.apache.felix.configadmin-1.9.8.LIFERAY-PATCHED-4.pom'.
           [exec]                > repository-cdn.liferay.com
           [exec] 
           [exec] * Try:
           [exec] Run with --info or --debug option to get more log output. Run with --scan to get full insights.
           [exec] 
           [exec] * Exception is:
Test bundle downloads:

@liferay-continuous-integration
Copy link
Collaborator

@vicnate5
Copy link
Owner

@pavel-savinov I am unable to reproduce https://issues.liferay.com/browse/LPS-122281 at head on master and the poshi test for this scenario is passing at head.

On this PR, I am unable to access a new virtual instance that uses database partitioning. The poshi test is also failing. The new virtual instance URL causes a redirect loop. I manually checked this multiple times on a master bundle vs this PR bundle.

Detailed steps to reproduce the Regression:

  1. Setup /etc/hosts file for custom URL:
127.0.0.1 localhost
127.0.0.1 www.able.com
  1. Create fresh MySQL database
  2. Setup portal-ext based on CI settings
plugin.notifications.enabled=false
jdbc.default.jndi.name=
jdbc.default.driverClassName=com.mysql.cj.jdbc.Driver
jdbc.default.password=
jdbc.default.url=jdbc:mysql://localhost/lportal?characterEncoding=UTF-8&dontTrackOpenResources=true&holdResultsOpenOverStatementClose=true&serverTimezone=GMT&useFastDateParsing=false&useUnicode=true
jdbc.default.username=root
jdbc.default.connectionTimeout=600000
jdbc.default.maximumPoolSize=20
jdbc.default.minimumIdle=0
jdbc.counter.maximumPoolSize=5
jdbc.counter.minimumIdle=0
jdbc.default.initialSize=0
jdbc.default.maxActive=20
jdbc.default.maxIdle=0
jdbc.default.minIdle=0
jdbc.counter.initialSize=0
jdbc.counter.maxActive=5
jdbc.counter.maxIdle=0
jdbc.counter.minIdle=0
company.security.strangers.verify=false
browser.launcher.url=
setup.wizard.enabled=false
mail.send.blacklist=
mail.session.jndi.name=
module.framework.properties.dependency.manager.sync.timeout=1800
module.framework.properties.initial.system.check.enabled=true
sprite.root.dir=/tmp/sprite
memory.scheduler.org.quartz.threadPool.threadCount=1
persisted.scheduler.org.quartz.threadPool.threadCount=1
virtual.hosts.default.site.name=
com.liferay.portal.servlet.filters.strip.StripFilter=true
web.server.http.port=8080
admin.email.from.address=test@liferay.com
announcements.email.to.address=noreply@liferay.com
login.secure.forgot.password=false
database.partition.enabled=true
  1. Start server
  2. Login and Navigate to Control Panel > Virtual Instances
  3. Create a new instance with www.able.com in all fields
  4. Attempt to navigate to www.able.com:8080, will cause a redirect loop.

URL modified to

http://www.able.com:8080/c/portal/login?redirect=%2Fweb%2Fguest%2Fhome%3Fp_p_state%3Dmaximized%26p_p_mode%3Dview%26refererPlid%3D19%26saveLastPath%3Dfalse%26_com_liferay_login_web_portlet_LoginPortlet_mvcRenderCommandName%3D%252Flogin%252Flogin%26p_p_id%3Dcom_liferay_login_web_portlet_LoginPortlet%26p_p_lifecycle%3D0%26_com_liferay_login_web_portlet_LoginPortlet_redirect%3D%252Fweb%252Fguest%252Fhome%253Fp_p_state%253Dmaximized%2526p_p_mode%253Dview%2526refererPlid%253D19%2526saveLastPath%253Dfalse%2526_com_liferay_login_web_portlet_LoginPortlet_mvcRenderCommandName%253D%25252Flogin%25252Flogin%2526p_p_id%253Dcom_liferay_login_web_portlet_LoginPortlet%2526p_p_lifecycle%253D0%2526_com_liferay_login_web_portlet_LoginPortlet_redirect%253D%25252Fweb%25252Fguest%25252Fhome%25253Fp_p_state%25253Dmaximized%252526p_p_mode%25253Dview%252526refererPlid%25253D19%252526saveLastPath%25253Dfalse%252526_com_liferay_login_web_portlet_LoginPortlet_mvcRenderCommandName%25253D%2525252Flogin%2525252Flogin%252526p_p_id%25253Dcom_liferay_login_web_portlet_LoginPortlet%252526p_p_lifecycle%25253D0%252526_com_liferay_login_web_portlet_LoginPortlet_redirect%25253D%2525252Fweb%2525252Fguest%2525252Fhome%2525253Fp_p_state%2525253Dmaximized%25252526p_p_mode%2525253Dview%25252526refererPlid%2525253D19%25252526saveLastPath%2525253Dfalse%25252526_com_liferay_login_web_portlet_LoginPortlet_mvcRenderCommandName%2525253D%252525252Flogin%252525252Flogin%25252526p_p_id%2525253Dcom_liferay_login_web_portlet_LoginPortlet%25252526p_p_lifecycle%2525253D0%25252526_com_liferay_login_web_portlet_LoginPortlet_redirect%2525253D%252525252Fweb%252525252Fguest%252525252Fhome%252525253Fp_p_state%252525253Dmaximized%2525252526p_p_mode%252525253Dview%2525252526refererPlid%252525253D19%2525252526saveLastPath%252525253Dfalse%2525252526_com_liferay_login_web_portlet_LoginPortlet_mvcRenderCommandName%252525253D%25252525252Flogin%25252525252Flogin%2525252526p_p_id%252525253Dcom_liferay_login_web_portlet_LoginPortlet%2525252526p_p_lifecycle%252525253D0&refererPlid=19&p_l_id=19

This database partitioning feature is critical for Portal offering SaaS on DXP Cloud.

@dacousalr
Copy link

Just started reviewing :)

1 similar comment
@jkappler
Copy link

Just started reviewing :)

@vicnate5
Copy link
Owner

pavel-savinov#655

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment