Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OSX PR builds: OMR Socket Test Failures #6516

Open
babsingh opened this issue May 13, 2022 · 3 comments
Open

OSX PR builds: OMR Socket Test Failures #6516

babsingh opened this issue May 13, 2022 · 3 comments

Comments

@babsingh
Copy link
Contributor

babsingh commented May 13, 2022

Recently, the following OSX failures have been seen in OMR OSX PR builds:

31: [----------] 19 tests from PortSockTest
31: /Users/runner/work/1/s/fvtest/porttest/omrsockTest.cpp:1209: Failure
31:       Expected: rc
31:       Which is: 1
31: To be equal to: 2
31: [  FAILED  ] PortSockTest.poll_functionality_basic (1111 ms)
31: /Users/runner/work/1/s/fvtest/porttest/omrsockTest.cpp:51: Failure
31:       Expected: privateOmrPortLibrary->sock_bind(privateOmrPortLibrary, *serverSocket, serverSockAddr)
31:       Which is: -506
31: To be equal to: 0
31: /Users/runner/work/1/s/fvtest/porttest/omrsockTest.cpp:1259: Failure
31:       Expected: privateOmrPortLibrary->sock_accept(privateOmrPortLibrary, serverSocket, &connectedServerSockAddr, &connectedServerSocket)
31:       Which is: -20
31: To be equal to: 0
31: [  FAILED  ] PortSockTest.poll_functionality_many_sockets (5 ms)
31: [----------] 19 tests from PortSockTest (1121 ms total)
31: 
31: [==========] 236 tests from 20 test cases ran. (110437 ms total)
31: [  PASSED  ] 234 tests.
31: [  FAILED  ] 2 tests, listed below:
31: [  FAILED  ] PortSockTest.poll_functionality_basic
31: [  FAILED  ] PortSockTest.poll_functionality_many_sockets

PRs, where the above failures are seen:

The above failures are not related to the above PRs.

The above failures happen during sock_bind and sock_accept which may indicate involvement of network issues.

@knn-k knn-k added the os:macos label Aug 1, 2022
@knn-k
Copy link
Contributor

knn-k commented Oct 7, 2022

I see the same socket test failures on AArch64 macOS as I mentioned in #6716.

  • The error code -506 for bind() is OMRPORT_ERROR_SOCKET_ADDRINUSE. OS-native errno is EADDRINUSE (48).
  • The error code -20 for accept() is OMRPORT_ERROR_INVALID_ARGUMENTS. OS-native errno is EINVAL (22).

@hzongaro
Copy link
Member

As @jmesyou pointed out to me off-line, this test has been failing frequently in PR testing for the past 18 months. Should we consider disabling the test for macOS runs, if it's not something that can be fixed?

babsingh added a commit to babsingh/omr that referenced this issue Dec 22, 2023
These tests pass on our local Jenkins machines, but fail on
Azure MacOSX due to machine issues.

Related: eclipse#6516

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
babsingh added a commit to babsingh/omr that referenced this issue Dec 22, 2023
These tests pass on our local Jenkins machines, but fail on
Azure MacOSX due to machine issues.

Related: eclipse#6516

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
babsingh added a commit to babsingh/omr that referenced this issue Dec 22, 2023
These tests pass on our local Jenkins machines, but intermittently
fail on Azure MacOSX due to machine issues.

Related: eclipse#6516

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
@babsingh
Copy link
Contributor Author

babsingh commented Dec 22, 2023

Should we consider disabling the test for macOS runs, if it's not something that can be fixed?

The tests pass on the Jenkins macOS machines. The failures are intermittent and only seen on Azure macOS. It's most likely a machine/network issue. Opened #7213 to disable the failing tests on Azure macOS.

babsingh added a commit to babsingh/omr that referenced this issue Dec 22, 2023
These tests pass on the Jenkins MacOSX machines, but intermittently
fail on Azure MacOSX due to machine/network issues.

Related: eclipse#6516

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
jjohnst-us pushed a commit to jjohnst-us/omr that referenced this issue Jan 8, 2024
These tests pass on the Jenkins MacOSX machines, but intermittently
fail on Azure MacOSX due to machine/network issues.

Related: eclipse#6516

Signed-off-by: Babneet Singh <sbabneet@ca.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants