Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NIFI-2923 Add expression language support to Kerberos parameters used… #1148

Closed

Conversation

mauriziocolleluori
Copy link

Thank you for submitting a contribution to Apache NiFi.

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

For all changes:

  • Is there a JIRA ticket associated with this PR? Is it referenced
    in the commit message?
  • Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.
  • Has your PR been rebased against the latest commit within the target branch (typically master)?
  • Is your initial contribution a single, squashed commit?

For code changes:

  • Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
  • Have you written or updated unit tests to verify your changes?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
  • If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
  • If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

  • Have you ensured that format looks appropriate for the output in which it is rendered?

Note:

Please ensure that once the PR is submitted, you check travis-ci for build issues and submit an update to your PR as soon as possible.

… by processors

@bbende
Copy link
Contributor

bbende commented Oct 24, 2016

Thank you for contributing. In addition to adding the expressionLanguageSupported flag on the property descriptors, we would also need to go through the code and find every place where the properties are evaluated, for example:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/src/main/java/org/apache/nifi/processors/hadoop/AbstractHadoopProcessor.java#L283

And that would need to call evaluateAttributeExpressions().

@mauriziocolleluori
Copy link
Author

mauriziocolleluori commented Nov 7, 2016

Thank you for your feedback, I will add the necessary call to evaluateAttributeExpressions().

@pvillard31
Copy link
Contributor

Hi @mauriziocolleluori,

If you still encounter issues in UI when testing properties while using expression language, please check that nifi.kerberos.krb5.file is correctly set in your nifi.properties file (and reference a readable file).

In addition, it would be great to do the same kind of modification in Kafka processors where Kerberos principal is also a property. Let me know if you are OK to do it, otherwise, I'll do it. Thanks!

@trixpan
Copy link
Contributor

trixpan commented Feb 19, 2017

@mauriziocolleluori thank you for the contribution.

any intent on addressing @pvillard31 's comment? While a positive answer is more than welcome, a negative answer is also welcome... all we need to know is if this is ready to review or if you still plan to address the comments.

Cheers!

@mauriziocolleluori
Copy link
Author

@trixpan @pvillard31 thank you for you comments. I will look into the Kafka processors and revert back once it's done.

Copy link
Contributor

@trixpan trixpan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR is looking good but that new tests were added to the affected processors
Would that be possible?

Cheers

@jtstorck
Copy link
Contributor

jtstorck commented Jun 5, 2017

@mauriziocolleluori Hello, and thank you for your contribution! I am working on a JIRA (https://issues.apache.org/jira/browse/NIFI-4010) that builds upon the changes in your PR. Could you please address the remaining comments to help get your PR committed?

@jtstorck
Copy link
Contributor

@mauriziocolleluori I've cherry-picked your commits into my branch, and will be submitting a PR that includes your commits along with mine (for NIFI-4010). Thank you for your contribution to Apache NiFi!

When my PR is merged to master, your PR will be closed along with mine.

jtstorck added a commit to jtstorck/nifi that referenced this pull request Jun 19, 2017
…DFS processor properties

FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes apache#1148
jtstorck added a commit to jtstorck/nifi that referenced this pull request Jun 21, 2017
…DFS processor properties

FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes apache#1148
jtstorck added a commit to jtstorck/nifi that referenced this pull request Jun 21, 2017
…DFS processor properties

FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes apache#1148
jtstorck added a commit to jtstorck/nifi that referenced this pull request Jun 21, 2017
…DFS processor properties

FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes apache#1148
jtstorck added a commit to jtstorck/nifi that referenced this pull request Jun 21, 2017
…DFS processor properties

FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes apache#1148
@asfgit asfgit closed this in c99100c Jun 21, 2017
mattyb149 pushed a commit to mattyb149/nifi that referenced this pull request Nov 30, 2017
…DFS processor properties

FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes apache#1148
This closes apache#1930.

Signed-off-by: Bryan Bende <bbende@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants