fix: Fix reading of chunked parquet when columns parameter is spec…

[rchromik]

Feature or Bugfix

• Bugfix

Detail

• Fix for _read_parquet_chunked function if columns are specified as parameter.
• By submitting this PR, only fields will be passed to the schema when reading data from chunks

Relates

• pyarrow.lib.ArrowInvalid: Schema at index 0 was different reading data via s3.read_parquet using the paramters chunked and columns #2433

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[malachi-constant]

AWS CodeBuild CI Report

• CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
• Commit ID: 1ddc58c
• Result: FAILED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[malachi-constant]

AWS CodeBuild CI Report

• CodeBuild project: GitHubCodeBuild8756EF16-4rfo0GHQ0u9a
• Commit ID: 39f3bd2
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

[rchromik]

I think the build issue is due to pull request #2594 which was already merged with a failed checks.

[malachi-constant]

AWS CodeBuild CI Report

• CodeBuild project: GitHubDistributedCodeBuild6-jWcl5DLmvupS
• Commit ID: 39f3bd2
• Result: SUCCEEDED
• Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository