Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Java] Proposal for Java Substrait Consumers #34223

Closed
davisusanibar opened this issue Feb 16, 2023 · 0 comments · Fixed by #34227
Closed

[Java] Proposal for Java Substrait Consumers #34223

davisusanibar opened this issue Feb 16, 2023 · 0 comments · Fixed by #34227

Comments

@davisusanibar
Copy link
Contributor

Describe the enhancement requested

Create a PoC reusing current Java component to try to call current C++ Susbtrait methods:

  1. Call to:
ARROW_ENGINE_EXPORT Result<std::shared_ptr<Buffer>> SerializeJsonPlan(const std::string& substrait_json);
  1. Then call to (only consider to pass Buffer input and maintain the another with their default values)
ARROW_ENGINE_EXPORT Result<std::shared_ptr<RecordBatchReader>> ExecuteSerializedPlan(
    const Buffer& substrait_buffer, const ExtensionIdRegistry* registry = NULLPTR,
    compute::FunctionRegistry* func_registry = NULLPTR,
    const ConversionOptions& conversion_options = {}, bool use_threads = true,
    MemoryPool* memory_pool = default_memory_pool());

Not consider this as the end integration/architecture, just reuse curren components to complete the PoC and in the next issue lets define the final integration/architecture that should be used.

Component(s)

Documentation, Java, Packaging

@lidavidm lidavidm added this to the 13.0.0 milestone May 24, 2023
lidavidm added a commit that referenced this issue May 24, 2023
* Closes: #34223

The purpose of this PR is to implement:

1. JNI Wrappers to consume Acero capabilities that execute Substrait Plans. 
2. Java base code to offer API that consume Substrait Plans. 
3. Initial Substrait documentation

Lead-authored-by: david dali susanibar arce <davi.sarces@gmail.com>
Co-authored-by: David Li <li.davidm96@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment