You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using the scan_csv query with the with_column_names argument, any schema validation enforced by the schema argument is disabled. Simply removing the with_column_names argument from the query enables validation again.
Expected behavior
This query should raise an exception just as it does when omitting the with_column_names argument:
polars.exceptions.ComputeError: could not parse `notAnInt` as dtype `i16` at column 'col1' (column number 1)
Checks
Reproducible example
Given the following CSV file:
This query should raise an exception, as the
col1
column is not apl.Int16
.Log output
RUN STREAMING PIPELINE [csv -> parquet_sink] STREAMING CHUNK SIZE: 50000 rows
Issue description
When using the
scan_csv
query with thewith_column_names
argument, any schema validation enforced by theschema
argument is disabled. Simply removing thewith_column_names
argument from the query enables validation again.Expected behavior
This query should raise an exception just as it does when omitting the
with_column_names
argument:Installed versions
The text was updated successfully, but these errors were encountered: