Master #1
Merged
Master #1
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…r:8.29 dependency This closes #4050. Signed-off-by: Andy LoPresto <alopresto@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4064.
…able. Added Github Actions based CI build for pull requests and pushes. Removed unit tests which make unreadable or unaccesible dirs. Includes windows build as well as ubuntu. we can do localization based builds later as this is all proven stable. Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4058.
* NIFI-7175 Fixed core attributes formatting in Developer Guide. * NIFI-7175 Made core attribute names more consistent.
…omponents Signed-off-by: Joe Witt <joewitt@apache.org>
…neEventIndex Signed-off-by: Joe Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4067.
…vironments like our Github CI builds Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4075.
… content Signed-off-by: Joe Witt <joewitt@apache.org>
…owFile Signed-off-by: Joe Witt <joewitt@apache.org>
Signed-off-by: Joe Witt <joewitt@apache.org>
NIFI-7007: Add additional unit tests that hit non-happy path NIFI-7007: Use AllowableValue instead of string NIFI-7007: Add the use of attributes for the update method, statement type and batch statement type NIFI-7007: Add additional tests, mainly for the use of attributes NIFI-7007: add some ReadsAttribute properties to the PutCassandraRecord processor NIFI-7007: additional update keys validation logic NIFI-7007: fix imports NIFI-7007: Convert fieldValue to long in separate method NIFI-7007: Add new style of tests checking actual CQL output NIFI-7007: add license to new test file NIFI-7007: add customValidate to check for certain incompatible property combinations NIFI-7007: remove check on updateMethod and replace Set.of with java 8 compatible replacmenet NIFI-7007: Add test for failure with empty update method via attributes NIFI-7007: remove unused variable NIFI-7007: Fix customValidate that incorrectly invalidated a valid config Fix Checkstyle Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes #3977
Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes #4070
NIFI-6363 Additional fixes. NIFI-6363 Fix Hadoop compile problem. Add GCP IT instructions. NIFI-6363 - Removed GCP provider due to dependency conflicts with GRPC processors. Fixed unit test to match master branch after rebase. NIFI-6363 - Added some docs and experimental tag to the relevant classes. Signed-off-by: Nathan Gough <thenatog@gmail.com> This closes #4080.
…viders." This reverts commit 479fcfd. It does not build properly as shown in Github Actions.
…anced easy rules to support provider interface and refactored to extract rules engine implementation NIFI-7163 - updated documentation and comments NIFI-7163 - fix checkstyle issues Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes #4081
Signed-off-by: Joe Witt <joewitt@apache.org>
…ess Group port value - (#4085) JsonContentConversionExceptionMapper, JsonMappingExceptionMapper, JsonParseExceptionMapper. Registered the custom ExceptionMappers. Added unit tests to throw Exception for string port value and sanitize script input. Handled null or empty JsonMappingException reference path. Added the Apache license to Groovy Test. Signed-off-by: Andy LoPresto <alopresto@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4076.
…ub Actions builds to include OSX and distribute localization Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4091.
…riter Handle scenario where message might be null. Update to test case that was failing because adding attributes modified a flow file even if you don't change the contents. Fixed Style Issues and Updated WritesAttributes. Added Test Case for Error Message Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes #4052
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4093.
…nd MQTTProduce processors. Generates a random ID if not set. Also add group ID field to ConsumeMQTT processor. Allows consumer to join consumer group at $share/<group_id>/<topic_filter> add expression language support for the MQTT client ID Setting client id in publish test fails because it is not a flowfile attribute. Remove client id and autogenerate it when testing. Since the evaluation is done in onScheduled, there is no flow file available and we're not using the attributes to make the expression language evaluation. You can change the scope to use the Variable Registry. Co-Authored-By: Pierre Villard <pierre.villard.fr@gmail.com> Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #3879.
…ssor supporting kerberos passwords AbstractHadoopProcessor will always authenticate the principal with a KerberosUser implementation and a UGI will be acquired from the Subject associated with the KerberosUser implementation AbstractHadoopProcessor's getUserGroupInformation method will now attempt to check the TGT and relogin if a KerberosUser impelmentation is available, otherwise it will return the UGI referenced in the HdfsResource instance Updated AbstractHadoopProcessor's customValidate method to consider the provided password and updated validation failure explanations when a KerberosCredentialsService is specified together with a principal, password, or keytab Added toString method override to AbstractKerberosUser Updated Hive/HBase components to be compatible with the KerberosProperties.validatePrincipalWithKeytabOrPassword method Fixed null ComponentLog in GetHDFSSequenceFileTest Added package-protected accessor method (getAllowExplicitKeytabEnvironmentVariable) to AbstractHadoopProcessor for determining if the environment variable "NIFI_ALLOW_EXPLICIT_KEYTAB" has been set AbstractHadoopProcessor will now only fail validation when the NIFI_ALLOW_EXPLICIT_KEYTAB environment variable is set to false if a keytab is provided to allow the user to specify a principal and password Added AbstractHadoopProcessorSpec to verify validation of principal/keytab/password/kerberos credential service combinations This closes #4095.
…omponents Kerberos Password property should not support EL, this includes a change to KerberosProperties which is also used by the HDFS processors (AbstractHadoopProcessor) Added wiring in a KerberosContext to a TestRunner's MockProcessorInitializationContext Removed synchronization blocks around KerberosUser.checkTGTAndRelogin, since that method is already synchronized Updated AbstractHadoopProcessor to have a boolean accessor method to determine if explicit keytab configuration is allowed Removed synchronization block from HiveConnectionPool's getConnection method (in Hive, Hive_1_1, Hive3 modules), since new TGT ticket acquisition is handled by the KerberosUser implementation. If UGI is used to relogin, synchronization is handled internally by UGI. Added Kerberos Principal and Kerberos Password properties to Hive, Hive_1_1, and Hive3 components Hive, Hive_1_1, and Hive3 components now use KerberosUser implementations to authenticate with a KDC Updated handling of the NIFI_ALLOW_EXPLICIT_KEYTAB environment variable in Hive and Hive3 components. An accessor method has been added that uses Boolean.parseBoolean, which returns true if the environment variable is set to true, and false otherwise (including when the environment variable is unset). Addressing PR feedback Addressing PR feedback This closes #4102.
…update-access-policy use case more in line with the NiFi side. Added some tests. Additional refactor, documentation revision. This closes #4329.
…ocking. NIFI-7527 Fixed StackOverFlowError due to pacing issue (recursive login before loggedIn flag is set). NIFI-7527 Refactor: removed redundant kudu client creation. This closes #4330. Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
…ump once and then provide this information to ProcessorNode when capturing active threads. Previously, each processor captured a thread dump itself. When this is done thousands of times it can result in a very long delay.
…ment (#4341) * NIFI-7540: Fix TestListenSMTP and TestListFile on macOS build environment This also fixes NIFI-4760. * NIFI-7540: Remove duplicate mail.smtp.starttls.enable from TestListenSMTP Signed-off-by: Andy LoPresto <alopresto@apache.org>
…String rather than a Long. Fixes cast error in LDAP libs.
…ses. (#4307) NIFI-6094 - Added the mime/content type for ttf files.
- update Kudu dependencies to Kudu 1.12.0 - add VARCHAR to Kudu Lookup Service and Processor - add tests for VARCHAR columns Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4347.
… of processors when needing to wait for all processors to stop for updating parameter context, etc.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4315.
…tion to be handled. Instead, use TimeUnit.timedWait and use Object.notifyAll when setting the beingServiced flag. This significantly reduces latency and improves throughput for small-batch site-to-site communications This closes #4353. Signed-off-by: Andy LoPresto <alopresto@apache.org>
… field so that it's removed regardless of whether or not this field is kept. This closes #4332
Update nf-context-menu.js for an intuitive road to parameters When rightclicking a process group the variables are shown, but parameters are not. This makes sense as they have a prerequisite, in the form of a parameter context. This change gives a more consistent experience for finding the functionality regarding parameters by ensuring the contextmenu shows the possibility to configure a parameter context. Once the paramater context has been created for a process group, the parameters text shows, so this is no longer visible. People would then need to click configure to change the context, just as they would be required to do now. Added generateflowfile load tag and description Added GenerateFlowFile load tag to be consistent with DuplicateFlowFile and updated description to refer to DuplicateFlowFile. Revert "Update nf-context-menu.js for an intuitive road to parameters" This reverts commit 3c44b16. This closes #4333 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
Renamed legacy terms. Updated documentation. This closes #4351. Signed-off-by: Mark Payne <markap14@hotmail.com>
NIFI-7542 Override additional jackson-databind versions. NIFI-7542 Upgrade jackson-databind dependency to 2.9.10.5 in the root pom.xml. This closes #4343 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
#4348) * NIFI-7523: Use SSL Context Service for Atlas HTTPS connection in Atlas reporting task Also fixing ControllerServiceDisabledException-s when validating the Kerberos config * NIFI-7523: Fixed test failure on Windows * NIFI-7523: Added license headers. * NIFI-7523: Fixed another test failure on Windows * NIFI-7523: Review changes
ListenHTTP processor now binds port and creates a HTTP connection only if one of the following conditions apply: - Primary node execution is 'false' - Primary node execution is 'true' and node is elected as primary node. Changes: - Connection is established in 'onTrigger' annotated method instead of 'onSchedule'. (This is similar to how handleHTTPRequest processor handles connections.) - 'onPrimaryNodeStateChange' annotated method is introduced to tear down server on reelection of primary node This closes #4356. Signed-off-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes #4334.
This closes #4357 Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
…evel read timeout and connect timeout. In QueryCassandra when writing flowfile to the sesion it's done on the raw OutputStream. Wrapped it in a BufferedOutputStream for better performance. This closes #4368. Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
- Remove unused imports - Fix checkstyle errors This closes #4358.
…c unit test. Signed-off-by: Joe Witt <joewitt@apache.org>
…related references properly to null after closing them so that they can be renewed in 'onEnabled' (which creates them only if set to 'null', leaving them closed otherwise). NIFI-7590 Removed 'CassandraSessionProvider.onStopped'. This closes #4373. Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
The introduced changes prevent creating unnecesary sessions and producers in some scenarios. This closes #4378. Signed-off-by: Joey Frazee <jfrazee@apache.org>
…r processing. This closes #4379. Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
…der response when the OIDC Identifying User claim is not found. Revised log message to print available claims. Added new StandardOidcIdentityProviderGroovyTest file. Updated deprecated methods in StandardOidcIdentityProvider. Changed log output to print all available claim names from JWTClaimsSet. Added unit test. Added comments in getAvailableClaims() method. Fixed typos in NiFi Docs Admin Guide. Added license to Groovy test. Fixed a checkstyle error. Refactor exchangeAuthorizationCode method. Added unit tests. Verified all unit tests added so far are passing. Refactored code. Added unit tests. Refactored OIDC provider to decouple constructor & network-dependent initialization. Added unit tests. Added unit tests. Refactored OIDC provider to separately authorize the client. Added unit tests. Added unit tests. NIFI-7332 Refactored exchangeAuthorizationCode method to separately retrieve the NiFi JWT. Signed-off-by: Nathan Gough <thenatog@gmail.com> This closes #4344.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Update latest from upstream