Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable queries with explicit broker URL in Pinot #17791

Merged
merged 2 commits into from
May 8, 2024

Conversation

SemionPar
Copy link
Contributor

Description

Allow using connector in broker-only queries mode with Pinot installations where broker URLs returned by Pinot APIs are unreachable to Trino.

Additional context and related issues

Setting config in the following way

pinot.forbid-segment-queries=true
pinot.prefer-broker-queries=true
pinot.broker-url=<xxx>

will make connector execute broker-only queries to explicit broker URL.

Release notes

( ) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
( ) Release notes are required, with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Jun 7, 2023
// Use global broker URI if provided explicitly via config
if (brokerUri.isPresent()) {
URI uri = brokerUri.get();
return HostAndPort.fromParts(uri.getHost(), uri.getPort()).toString();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No requested change. We build HostAndPort and change to String here and then revert to HostAndPort in getBrokerHttpUriBuilder. This is a redundant cast.

@ebyhr
Copy link
Member

ebyhr commented Jun 8, 2023

Pinot connector flexibility improvements

Could you update the PR title so that other people can understand it more easily?

@SemionPar SemionPar changed the title Pinot connector flexibility improvements Enable queries with explicit broker URL in Pinot Jun 16, 2023
@github-actions github-actions bot added the docs label Jun 16, 2023
@SemionPar SemionPar marked this pull request as ready for review April 16, 2024 14:22
Copy link

github-actions bot commented May 7, 2024

This pull request has gone a while without any activity. Tagging the Trino developer relations team: @bitsondatadev @colebow @mosabua

@github-actions github-actions bot added the stale label May 7, 2024
@ebyhr ebyhr added the stale-ignore Use this label on PRs that should be ignored by the stale bot so they are not flagged or closed. label May 7, 2024
docs/src/main/sphinx/connector/pinot.md Outdated Show resolved Hide resolved
return brokerUrl;
}

@Config("pinot.broker-url")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(No requested change) This is not "URL" to be exact. It's good for consistency with controller property though.

Some Pinot setups don't expose publicly available broker or server URLs.
This change will make possible configuring connector
to make broker queries.
@ebyhr ebyhr merged commit 872f1d8 into trinodb:master May 8, 2024
9 of 14 checks passed
@github-actions github-actions bot added this to the 447 milestone May 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed docs stale stale-ignore Use this label on PRs that should be ignored by the stale bot so they are not flagged or closed.
Development

Successfully merging this pull request may close these issues.

None yet

4 participants