Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decimal/Time implicit casting + Multi-Error store in Flush #11848

Merged
merged 25 commits into from
May 16, 2024

Conversation

pdet
Copy link
Contributor

@pdet pdet commented Apr 26, 2024

This PR adds:
TIME
DECIMAL

To types that are directly cast in both the sniffer and the scanner. This means that we don't have to go through Value or Vector to try cast functions. Allowing us to be faster and have much better error integrations.

Much of the error-handling code has been rewritten to enable errors to persist until the result chunk is flushed. This approach allows us to accurately log flush casting errors in the reject tables when multiple errors occur on the same line.

Fix: #11832

@duckdb-draftbot duckdb-draftbot marked this pull request as draft April 26, 2024 14:24
@pdet pdet marked this pull request as ready for review April 26, 2024 14:27
@duckdb-draftbot duckdb-draftbot marked this pull request as draft April 29, 2024 14:47
TypeIdToString(parse_types[chunk_col_id].internal_type));
}

} else if (decimal_separator == '.') {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no

@pdet pdet changed the title More Deep Casting for CSV Scanners Decimal/Time implicit casting + Multi-Error store in Flush May 1, 2024
@pdet pdet marked this pull request as ready for review May 2, 2024 10:48
@darthf1
Copy link

darthf1 commented May 14, 2024

Is this ready to be merged? :) I would love to test this before the next release hits.

@duckdb-draftbot duckdb-draftbot marked this pull request as draft May 14, 2024 10:45
@pdet pdet marked this pull request as ready for review May 14, 2024 11:38
@duckdb-draftbot duckdb-draftbot marked this pull request as draft May 15, 2024 09:21
@pdet pdet marked this pull request as ready for review May 15, 2024 10:49
@Mytherin Mytherin merged commit bad1bde into duckdb:main May 16, 2024
43 checks passed
@Mytherin
Copy link
Collaborator

Thanks!

github-actions bot pushed a commit to duckdb/duckdb-r that referenced this pull request May 16, 2024
Merge pull request duckdb/duckdb#11848 from pdet/implicit_cast_time_timestamp
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

CSV rejects does not log error for faulty timestamptz and time value
3 participants