NIFI-9992 Improve configuration of InfluxDB processors, fix IT#6028
Closed
krisztina-zsihovszki wants to merge 1459 commits intoapache:mainfrom
Closed
NIFI-9992 Improve configuration of InfluxDB processors, fix IT#6028krisztina-zsihovszki wants to merge 1459 commits intoapache:mainfrom
krisztina-zsihovszki wants to merge 1459 commits intoapache:mainfrom
Conversation
Contributor
|
FYSA, we are not planning to maintain our own capabilities here anymore since InfluxDB is doing that. This is their repo: https://github.com/influxdata/nifi-influxdb-bundle |
Contributor
exceptionfactory
left a comment
exceptionfactory
left a comment
There was a problem hiding this comment.
Thanks for the contribution @krisztina-zsihovszki. Based on the comment from @MikeThomsen, it sounds like InfluxDB processors should be deprecated. The changes here are straightforward, with the exception of the property name change, which would break current deployments when upgrading.
| public static final PropertyDescriptor INFLUX_DB_CONNECTION_TIMEOUT = new PropertyDescriptor.Builder() | ||
| .name("InfluxDB Max Connection Time Out (seconds)") | ||
| .displayName("InfluxDB Max Connection Time Out (seconds)") | ||
| .name("InfluxDB Max Connection Time Out") |
Contributor
There was a problem hiding this comment.
The property name cannot be changed as it would result in breaking existing configurations during an upgrade. Changing the displayName is acceptable.
* Adding isStateless method to reporting task and controller service
…ot schedule the destination to run. Also expose this fact via the ConnectionStatusSnapshotDTO, as this allows the front-end to render this information to the user in order to avoid confusion when it appears that the Processor has data but does nothing Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes apache#5771
…e is converted from what is returned by RecordField.getDefaultValue() to what Avro requires. Signed-off-by: Chris Sampson <chriss@apache.org> This closes apache#5776
…ecord NIFI-9607: Fixed wrong column name in WHERE clause for generateUpdate Signed-off-by: Nathan Gough <thenatog@gmail.com> This closes apache#5701.
…ntroller service along release lines. This was necessary because Neo4J broke compatibility in their client drivers for Java between 3.X and 4.X at the Java API level. NIFI-8209 Updated module name. NIFI-8209 Updated parent module. NIFI-8209 Renamed a few misnamed modules. NIFI-8209 Updated 1.15.0-SNAPSHOT references in cypher v3 package. NIFI-8209 Updated neo4j 4.x driver. NIFI-8209 Made changes requested in a code review. NIFI-8209: Fixed NAR module name Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes apache#5301
… that was attempting to set values on the JSON returned by MaxMind. Instead of modifying the object directly, we should use an Injectable in the Reader so that the value read will have the appropriate values but we don't need to modify those objects returned by MaxMind. Similar solution of NIFI-5814 Signed-off-by: Nathan Gough <thenatog@gmail.com> This closes apache#5777.
This closes apache#4079 Signed-off-by: Joey Frazee <jfrazee@apache.org>
This closes apache#5753 Signed-off-by: David Handermann <exceptionfactory@apache.org>
Fixes NIFI-6213 and adds in functionality to use expression language in class and module specification NIFI-9286: adding JOLT unit tests NIFI-9286: addressing PR feedback Fixes a problem with the scope of the EL for module directory NIFI-9286: alignment of JOLT processors NIFI-9286: fix checkstyle This closes apache#5444 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
Current provenance data URL is incorrect as it's hardcoded. Follow PutS3Object.java method, using AmazonS3Client (instead of AmazonS3) to use getResourceUrl(bucket,key) to build the correct URL for provenance data This closes apache#5779 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
…onPool - Updated DBCPConnectionPool for extension This closes apache#5692 Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Based on https://github.com/tspannhw/nifi-extracttext-processor This closes apache#5732 Signed-off-by: David Handermann <exceptionfactory@apache.org>
… API Json Query processors when there are no hits from query This closes apache#5786 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
Changed from AmazonS3 to AmazonS3client. Add REMOTE_INVOCATION provenance event with URL and "Object tagged" This closes apache#5785 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
Changed from AmazonS3 to AmazonS3client. Add REMOTE_INVOCATION provenance event with URL and "Object deleted" This closes apache#5778 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
This closes apache#5758 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
…ssful Records sent to Elasticsearch Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#5665.
…ow much content in the content repo is retained by each queue in the dataflow. Changed default for nifi.content.claim.max.appendable.size property from 1 MB to 50 KB. Updated docs to reflect the new default value and explain what the property does and how it's used. Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#5780.
Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#5783.
- Excluded groovy-groovysh from several toolkit modules This closes apache#5782 Signed-off-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#5772.
This closes apache#5752. Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
…plete in a background thread instead of blocking the web thread. Also moved the RPG initialization logic into flow controller instead of flow service and added a delay in order to reduce likelihood of ConnectException happening when pointing to nodes in the same cluster Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#5641.
Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#5793.
- NIFI-9102 Refactored nifi-cybersecurity-bundle to use JUnit 5 - NIFI-9101 Refactored nifi-couchbase-bundle to use JUnit 5 - NIFI-9100 Refactored nifi-confluent-platform-bundle to use JUnit 5 - NIFI-9099 Refactored nifi-cdc to use JUnit 5 - NIFI-9098 Refactored nifi-ccda-bundle to use JUnit 5 - NIFI-9097 Refactored nifi-cassandra-bundle to use JUnit 5 - NIFI-9096 Refactored nifi-beats-bundle to use JUnit 5 This closes apache#5789 Signed-off-by: David Handermann <exceptionfactory@apache.org>
- NIFI-9130 Refactored nifi-language-translation-bundle to use JUnit 5 - NIFI-9126 Refactored nifi-kafka-bundle to use JUnit 5 - NIFI-9125 Refactored nifi-jolt-record-bundle to use JUnit 5 This closes apache#5792 Signed-off-by: David Handermann <exceptionfactory@apache.org>
…hen property descriptor & parameter descriptor's sensitivities don't match - instead allow the set to happen and let processor become invalid. Also, allow values such as abc#{param} for ghost processors.
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes apache#5795.
… ListFile. For any file that is found in the Input Directory directly, it was previously being listed/fetched even if it didn't match the PathFilter. Additionally, updated the code to create a new File FIlter for every invocation of onTrigger. This was necessary for NIFI-9577 because the directory to monitor supports Expression Language and as a result may change from invocation to invocation, if using a function such as now() but the PathFilter would always relativize the path based on the value that was obtained when the processor was scheduled. Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#5788.
NIFI-7234 Replaced Jackson 1.X references with Jackson 2.X references in various classes. NIFI-7234 Added jackson-annotations to nifi-hdfs-processors. NIFI-7234 Various updates to bring our test cases into better alignment with the Avro specification as of 1.11. Fixed a checkstyle issue. NIFI-7234 Made changes requested in a review. Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes apache#5900
… able to set "scope". Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes apache#6006.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes apache#6009.
This closes apache#5868 Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Updating the condition under which we show the Download Flow menu items. This closes apache#6008. Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
This closes apache#5531 Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Replaced google-cloud-bom 0.172.0 with libraries-bom 25.2.0 in nifi-gcp-bundle - Removed specific versions from Google dependencies in nifi-gcp-processors and nifi-gcp-services-api Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes apache#6010.
Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... This closes apache#5971 Signed-off-by: David Handermann <exceptionfactory@apache.org>
This closes apache#5947 Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Updated Protection Scheme Resolver to support both Name matching and Path matching Signed-off-by: Nathan Gough <thenatog@gmail.com> This closes apache#6017.
This closes apache#6016 Signed-off-by: Mike Thomsen <mthomsen@apache.org>
Signed-off-by: Nathan Gough <thenatog@gmail.com> This closes apache#6020.
- Upgraded Hadoop from 3.1.1 to 3.3.2 for Ranger Plugins
- Removed italicized formatting for example summary paragraph and updated example issue number Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#6025.
This closes apache#6012 Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
- Removed version declarations from multiple modules - Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0 Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes apache#6015.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com> This closes apache#6014.
…not properly increment the counter for how many files exist in the archive directories. This was causing the counter to become negative in some cases, which caused processors to incorrectly pause, waiting for content archive cleanup to occur when, in fact, there were no files archived Signed-off-by: Joe Gresock <jgresock@gmail.com> This closes apache#6021.
Signed-off-by: Joe Witt <joewitt@apache.org>
- Replaced docker-compose-rule-junit4 with docker-compose-junit-jupiter NIFI-9999 Removed JUnit 4 dependencies from MiNiFi Maven configuration Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes apache#6024
…irectory, in addition to the .jar / .nar files NIFI-10004: When determining classname from a file, consider File.separator instead of just / Signed-off-by: Matthew Burgess <mattyb149@apache.org> This closes apache#6026
Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](caolan/async@v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... This closes apache#6007 Signed-off-by: David Handermann <exceptionfactory@apache.org>
…or returns only the first object read from the input stream. This closes apache#6019. Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
krisztina-zsihovszki
force-pushed
the
NIFI-9992
branch
from
bdfaeee to
d19b6e6
Compare
Contributor
Author
|
InfluxDB changes will be maintained in: https://github.com/influxdata/nifi-influxdb-bundle |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
NIFI-9992
Tracking
Please complete the following tracking steps prior to pull request creation.
Issue Tracking
Pull Request Tracking
NIFI-00000NIFI-00000Pull Request Formatting
mainbranchVerification
Please indicate the verification steps performed prior to pull request creation.
Build
mvn clean install -P contrib-checkLicensing
LICENSEandNOTICEfilesDocumentation