Skip to content

Pull request for NIFI-7640#4413

Closed
Wastack wants to merge 36 commits intoapache:masterfrom
Wastack:NIFI-7640
Closed

Pull request for NIFI-7640#4413
Wastack wants to merge 36 commits intoapache:masterfrom
Wastack:NIFI-7640

Conversation

@Wastack
Copy link
Copy Markdown
Contributor

@Wastack Wastack commented Jul 20, 2020

Description of PR

Documentation for NIFI-7640

For all changes:

  • Is there a JIRA ticket associated with this PR? Is it referenced
    in the commit message?

  • Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

  • Has your PR been rebased against the latest commit within the target branch (typically main)?

  • Is your initial contribution a single, squashed commit? Additional commits in response to PR reviewer feedback should be made on this branch and pushed to allow change tracking. Do not squash or use --force when pushing to allow for clean monitoring of changes.

For code changes:

  • Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
  • Have you written or updated unit tests to verify your changes?
  • Have you verified that the full build is successful on JDK 8?
  • Have you verified that the full build is successful on JDK 11?
  • If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
  • If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
  • If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

  • Have you ensured that format looks appropriate for the output in which it is rendered?

Note:

Please ensure that once the PR is submitted, you check GitHub Actions CI for build issues and submit an update to your PR as soon as possible.

mtien-apache and others added 30 commits July 20, 2020 12:26
This closes apache#4382

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
This closes apache#4387

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
This closes apache#4388

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
This close apache#4362

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
…hen the access strategy is explicit schema

NIFI-5213: Incorporated review comments

This closes apache#2718

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
…e-referenced when a component that used to reference a Controller Service is changed to reference a different Controller Service (apache#4391)
…e of minor bugs in mock classes that were encountered during testing.

NIFI-7572: Addressed review feedback
NIFI-7572: Fixed bug that resulted in constantly recompiling Jython script. Updated documentation showing performance difference. Fixed problematic unit tests for TestResizeImage

This closes apache#4374

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
…port for Postgres (9.5+)

NIFI-6934 Added more documentation and unit tests.

NIFI-6934 Added missing license for new test class.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes apache#4350
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes apache#4394
…o set the STS Endpoint

NIFI-7497 Updating property description per comment

This closes apache#4309

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
…r or not the content of a FlowFile was modified. This allows us to explicitly keep track of this state rather than implying it (potentially incorrectly).

This closes apache#4399.
Added properties to enable/disable chunked encoding and path-style access
for endpoints that do not support chunked encoding / only support path-style access.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4386.
…or ADLS processors

NIFI-7581 Separated Controller Service for providing Azure credentials for ADLS (ADLSCredentialsControllerService) form the one that does the same for Blob storages (AzureStorageCredentialsDetails). (This was done due to the considerable difference in the APIs of the libraries used to connect to both.)
NIFI-7581 Fix: Register controller service in META-INF. Minor fixes.
NIFI-7581 Minor changes (documentation, type etc.)
NIFI-7581 Updated integration tests.
NIFI-7581 Minor changes (renaming).

This closes apache#4369.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
Refactor: remove variable reassignment

This closes apache#4371.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
Tar format allows us to archive files with their original permission,
owner, group name and last modification time.

When unpacking with Tar unpacker, these information are stored in new
attributes with names: "file.inner.*". This way, it preserves backward
compatibility when using parallel with GetFile processor (which stores
information in "file.*").

NIFI-6128 Tar unpackContent: assert date of last modification of content is a valid date format.

NIFI-6128 UnpackContent: use original attributes

In case of tar format:
- Use "file.*" attributes instead of "file.inner.*" (which eventually
  lead to overwrite if tar had been fetched with GetFile)
- Store file permission in "rwx" format, instead of integer
  representation.
- Also replace SimpleDateFormat with DateTimeFormatter.

Replace generic error with IllegalArgumentException
Also refactor: move permission string to top of file as static constant.

Update test

Remove 'file systems' text

Unpackcontent: Fill file.creationTime attribute
which always holds the very same value as file.lastModifiedTime.

This closes apache#4370.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
…ty descriptor and its default value from the component itself

This closes apache#4408.

Signed-off-by: Mark Payne <markap14@hotmail.com>
…umentation.

Fixed unit test failures introduced from static imports during refactoring.

Signed-off-by: Joe Witt <joe.witt@gmail.com>
Added Bundle#toString() method.
Refactored implementation of filter addition logic.
Added logging.
Added unit tests to check for filter enablement.
Introduced content-length exception handling in StandardPublicPort.
Added filter bypass functionality for framework requests in ContentLengthFilter.
Updated property documentation in Admin Guide.
Renamed methods & added Javadoc to clarify purpose of filters in JettyServer.
Cleaned up conditional logic in StandardPublicPort.
Moved ContentLengthFilterTest to correct module.
Refactored unit tests for accuracy and clarity.
Fixed remaining merge conflict due to method renaming.

Signed-off-by: Joe Witt <joe.witt@gmail.com>
…, add an attribute to each outbound FlowFile that indicates how many FlowFiles went to each port. Updated user guide to explain the new attributes.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4345.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4392.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4412.
…ent that also has attributes, infer it as a Record type, in order to match how the data will be read when using the XML Reader

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4375.
…removed from the convenience binary.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4364.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4366.
pvillard31 and others added 6 commits July 20, 2020 12:26
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4241.
… convertToAvroStream method, use the DataTypeUtils.toString(clob/nClob,(String) null, StandardCharsets.UTF_8)) method to get the String

NIFI-7410 Update JdbcCommon.java when javaSqlType is CLOB or NCLOB in convertToAvroStream method, use the CharacterStream rto read the value of CLOB
NIFI-7410 Add a unit test. validate if it's unreadable when the clob value is Chinese, Japanese, and Korean.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4243.
…w data to be pulled into a ProcessGroup as a batch

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes apache#4405.
NiFi uses the java IO temporary directory for storing HTTP multipart
files when using HandleHttpRequest processor. The directory can be
overwritten with Java command line parameter.
@Wastack Wastack closed this Jul 20, 2020
@Wastack Wastack deleted the NIFI-7640 branch July 20, 2020 10:35
@Wastack Wastack restored the NIFI-7640 branch July 20, 2020 10:35
@Wastack Wastack deleted the NIFI-7640 branch July 20, 2020 10:40
@Wastack Wastack restored the NIFI-7640 branch July 20, 2020 10:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.