Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate Apache Arrow v0.9.0 #1102

Merged
merged 1 commit into from
Apr 26, 2018
Merged

Integrate Apache Arrow v0.9.0 #1102

merged 1 commit into from
Apr 26, 2018

Conversation

dberzano
Copy link
Contributor

  • Work around flatbuffers installation issues (install missing binaries)
  • Bump Apache Arrow to v0.9.0 (with ALICE patches) and fix search and linking of
    third-party projects
  • Add statically linked third-party packages as build dependencies (not runtime)
  • Add Apache Arrow as O2 dependency

* Work around flatbuffers installation issues (install missing binaries)
* Bump Apache Arrow to v0.9.0 (with ALICE patches) and fix search and linking of
  third-party projects
* Add statically linked third-party packages as build dependencies (not runtime)
* Add Apache Arrow as O2 dependency
@dberzano dberzano requested a review from a team as a code owner April 26, 2018 10:52
@dberzano
Copy link
Contributor Author

@mkrzewic @ktf @mazimm here's the (hopefully working, let's wait for the test) integration of Apache Arrow in O2.

@alibuild
Copy link
Collaborator

alibuild commented Apr 26, 2018

Error while checking build/O2/alidist for 22f21fc:

sw/BUILD/O2-latest/log
[14611]: network-interface                               = default                                                                                <string>         [default] 
[14611]: port-range-max                                  = 32000                                                                                  <int>            [default] 
[14611]: port-range-min                                  = 22000                                                                                  <int>            [default] 
[14611]: rate                                            = 0                                                                                      <float>          [default] 
[14611]: session                                         = default                                                                                <string>         [default] 
[14611]: severity                                        = debug                                                                                  <string>         [default] 
[14611]: shm-monitor                                     = 0                                                                                      <bool>           [default] 
[14611]: shm-segment-size                                = 2000000000                                                                             <std::size_t>    [default] 
[14611]: transport                                       = zeromq                                                                                 <string>         [default] 
[14611]: verbosity                                       = medium                                                                                 <string>         [default] 
[14611]: 
[14611]: [11:17:25][STATE] Entering INITIALIZING DEVICE state
[14610]: 
[14610]: [11:17:25][STATE] Entering DEVICE READY state
[14610]: [11:17:25][STATE] Entering INITIALIZING TASK state
[14610]: [11:17:25][STATE] Entering READY state
[14610]: [11:17:25][STATE] Entering RUNNING state
[14610]: [11:17:25][INFO] DEVICE: Running...
[14610]: [11:17:25][INFO] foo[0]: in: -nan (-nan MB) out: -nan (-nan MB)
[14610]: [11:17:25][INFO] from_producer_to_consumer[0]: in: -nan (-nan MB) out: -nan (-nan MB)
[INFO] Quitting
[INFO] QUIT_REQUESTED

[14610]: [11:17:25][INFO] Received device shutdown request (signal 15).
[14610]: [11:17:25][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately.
[14611]: [11:17:25][INFO] Received device shutdown request (signal 15).
[14611]: [11:17:25][INFO] Waiting for graceful device shutdown. Hit Ctrl-C again to abort immediately.
[14611]: [11:17:25][STATE] Entering DEVICE READY state
[14611]: [11:17:25][STATE] Entering INITIALIZING TASK state
[14611]: [11:17:25][STATE] Entering READY state
[14611]: [11:17:25][STATE] Entering RUNNING state
[14611]: [11:17:25][INFO] DEVICE: Running...
[14611]: [11:17:25][STATE] Entering READY state
[14610]: [11:17:26][STATE] Entering READY state
[14610]: [11:17:26][STATE] Entering RESETTING TASK state
[14610]: [11:17:26][STATE] Entering DEVICE READY state
[14610]: [11:17:26][STATE] Entering RESETTING DEVICE state
[14610]: [11:17:26][STATE] Entering IDLE state
[14610]: [11:17:26][STATE] Entering EXITING state
[14610]: [11:17:26][STATE] Exiting FairMQ state machine
[14610]: [11:17:26][INFO] Process 14610 is exiting.


99% tests passed, 1 tests failed out of 177

Total Test time (real) =  65.71 sec

The following tests FAILED:
	156 - test_Framework_test_WorkflowOptions (Timeout)

Full log here.

@dberzano
Copy link
Contributor Author

This test (unrelated to this pr) seems to timeout a lot, is there something we can do about it?

@ktf
Copy link
Member

ktf commented Apr 26, 2018

I am looking in those tests which timeout.

@dberzano dberzano merged commit 0d6d37f into alisw:master Apr 26, 2018
@dberzano dberzano deleted the arrow branch April 26, 2018 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants