Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CDAP-16708 add API for autojoiner #12185

Merged
merged 1 commit into from
May 19, 2020

Commits on May 19, 2020

  1. CDAP-16708 add API for autojoiner

    Add a new set of classes for AutoJoiner, which can be used instead
    of the current Joiner interface. This new API leaves all of the
    implementation details up to the application, which will allow the
    app to perform the join in better ways. For example, in the Spark
    program, it will allow using broadcast joins.
    
    Plugin developers are responsible for returning a JoinDefinition
    based on information about incoming stages.
    
    This change includes the JoinDefinition as well as all the classes
    required to create a definition. It also includes validation logic
    to make sure the plugin cannot create a definition that tries to
    join on a field that doesn't exist, or tries to join on fields
    that have mismatched types, or any other type of error.
    albertshau committed May 19, 2020
    Configuration menu
    Copy the full SHA
    a568b1c View commit details
    Browse the repository at this point in the history