Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NIFI-7505 Add InvokeHTTPRecord processor #8127

Closed
wants to merge 3 commits into from

Commits on Jul 28, 2023

  1. NIFI-7505 Add InvokeHTTPRecord processor

    Add a record-based processor that executes an HTTP request for each
    record in a flowfile. Many of the options are similar to the InvokeHTTP
    processor's, but adapted for record-based operation.
    
    Request attributes like the URL, headers and request body can vary per
    record, using RecordPath queries to extract data from each input record.
    The response body and various metadata (headers, status code, etc) can
    be written to each record.
    
    The processor can be configured to route the entire input flowfile to
    a failure relationship if an error is encountered, or failing records
    can be split off into a separate flowfile. HTTP requests can be retried
    a configurable number of times.
    
    The response body can optionally be parsed using a record reader
    service. As well as allowed the parsed body to be included in the output
    record, in this mode the response body can also be used to determine
    whether the request is treated as having succeed or failed. This can be
    useful for APIs that always return a 200 status code, with error
    information in the response body.
    
    This PR isn't complete yet (it still needs tests), but I've created it
    in case anybody has any feedback on the approach I'm taking.
    pspiller committed Jul 28, 2023
    Copy the full SHA
    9b61d54 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. Use WebClientServiceProvider instead of manually instantiating an HTT…

    …P client and remove record splitting
    Aerilym committed Dec 6, 2023
    Copy the full SHA
    816ae09 View commit details
    Browse the repository at this point in the history
  2. Rename processor

    Aerilym committed Dec 6, 2023
    Copy the full SHA
    e4919ff View commit details
    Browse the repository at this point in the history