You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Caused by: java.sql.SQLException: Query failed (#20200630_093207_06823_kiqec): Error opening Hive split <a path to parquet> (offset=0, length=33554432): cannot use Double NaN as range bound
at io.prestosql.jdbc.PrestoResultSet.resultsException(PrestoResultSet.java:1839)
at io.prestosql.jdbc.PrestoResultSet$ResultsPageIterator.computeNext(PrestoResultSet.java:1819)
at io.prestosql.jdbc.PrestoResultSet$ResultsPageIterator.computeNext(PrestoResultSet.java:1758)
at io.prestosql.jdbc.$internal.guava.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)
at io.prestosql.jdbc.$internal.guava.collect.AbstractIterator.hasNext(AbstractIterator.java:136)
at io.prestosql.jdbc.$internal.guava.collect.TransformedIterator.hasNext(TransformedIterator.java:42)
at io.prestosql.jdbc.$internal.guava.collect.Iterators$ConcatenatedIterator.getTopMetaIterator(Iterators.java:1311)
at io.prestosql.jdbc.$internal.guava.collect.Iterators$ConcatenatedIterator.hasNext(Iterators.java:1327)
at io.prestosql.jdbc.LengthLimitedIterator.hasNext(LengthLimitedIterator.java:42)
at io.prestosql.jdbc.PrestoResultSet.next(PrestoResultSet.java:143)
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCResultSetImpl.next(JDBCResultSetImpl.java:268)
at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCResultSetImpl.nextRow(JDBCResultSetImpl.java:176)
... 13 more
Caused by: io.prestosql.spi.PrestoException: Error opening Hive split <a path to parquet> (offset=0, length=33554432): cannot use Double NaN as range bound
at io.prestosql.plugin.hive.parquet.ParquetPageSourceFactory.createParquetPageSource(ParquetPageSourceFactory.java:252)
at io.prestosql.plugin.hive.parquet.ParquetPageSourceFactory.createPageSource(ParquetPageSourceFactory.java:130)
at io.prestosql.plugin.hive.HivePageSourceProvider.createHivePageSource(HivePageSourceProvider.java:190)
at io.prestosql.plugin.hive.HivePageSourceProvider.createPageSource(HivePageSourceProvider.java:108)
at io.prestosql.plugin.hive.HivePageSourceProvider.createPageSource(HivePageSourceProvider.java:91)
at io.prestosql.plugin.base.classloader.ClassLoaderSafeConnectorPageSourceProvider.createPageSource(ClassLoaderSafeConnectorPageSourceProvider.java:49)
at io.prestosql.split.PageSourceManager.createPageSource(PageSourceManager.java:61)
at io.prestosql.operator.ScanFilterAndProjectOperator$SplitToPages.process(ScanFilterAndProjectOperator.java:243)
at io.prestosql.operator.ScanFilterAndProjectOperator$SplitToPages.process(ScanFilterAndProjectOperator.java:175)
at io.prestosql.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:319)
at io.prestosql.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:372)
at io.prestosql.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:306)
at io.prestosql.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:372)
at io.prestosql.operator.WorkProcessorUtils$3.process(WorkProcessorUtils.java:306)
at io.prestosql.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:372)
at io.prestosql.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:221)
at io.prestosql.operator.WorkProcessorUtils.lambda$processStateMonitor$2(WorkProcessorUtils.java:200)
at io.prestosql.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:372)
at io.prestosql.operator.WorkProcessorUtils.getNextState(WorkProcessorUtils.java:221)
at io.prestosql.operator.WorkProcessorUtils.lambda$finishWhen$3(WorkProcessorUtils.java:215)
at io.prestosql.operator.WorkProcessorUtils$ProcessWorkProcessor.process(WorkProcessorUtils.java:372)
at io.prestosql.operator.WorkProcessorSourceOperatorAdapter.getOutput(WorkProcessorSourceOperatorAdapter.java:148)
at io.prestosql.operator.Driver.processInternal(Driver.java:379)
at io.prestosql.operator.Driver.lambda$processFor$8(Driver.java:283)
at io.prestosql.operator.Driver.tryWithLock(Driver.java:675)
at io.prestosql.operator.Driver.processFor(Driver.java:276)
at io.prestosql.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:1075)
at io.prestosql.execution.executor.PrioritizedSplitRunner.process(PrioritizedSplitRunner.java:163)
at io.prestosql.execution.executor.TaskExecutor$TaskRunner.run(TaskExecutor.java:484)
at io.prestosql.$gen.Presto_327_764_g5ee56cf____20200623_193347_2.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: cannot use Double NaN as range bound
at io.prestosql.spi.predicate.Marker.<init>(Marker.java:79)
at io.prestosql.spi.predicate.Marker.create(Marker.java:88)
at io.prestosql.spi.predicate.Marker.exactly(Marker.java:114)
at io.prestosql.spi.predicate.Range.equal(Range.java:84)
at io.prestosql.spi.predicate.SortedRangeSet.of(SortedRangeSet.java:80)
at io.prestosql.spi.predicate.ValueSet.of(ValueSet.java:60)
at io.prestosql.spi.predicate.Domain.singleValue(Domain.java:84)
at io.prestosql.parquet.predicate.TupleDomainParquetPredicate.getDomain(TupleDomainParquetPredicate.java:281)
at io.prestosql.parquet.predicate.TupleDomainParquetPredicate.effectivePredicateMatches(TupleDomainParquetPredicate.java:123)
at io.prestosql.parquet.predicate.TupleDomainParquetPredicate.matches(TupleDomainParquetPredicate.java:118)
at io.prestosql.parquet.predicate.PredicateUtils.dictionaryPredicatesMatch(PredicateUtils.java:122)
at io.prestosql.parquet.predicate.PredicateUtils.predicateMatches(PredicateUtils.java:95)
at io.prestosql.plugin.hive.parquet.ParquetPageSourceFactory.createParquetPageSource(ParquetPageSourceFactory.java:201)
... 32 more
Query:
select count(*)
from <table name>
where is_nan(<field>) = false and <field> < 0.8;
The text was updated successfully, but these errors were encountered:
findepi
changed the title
Add test for reading ORC and Parquet files with predicate when file contains NaN
Query failure when reading ORC/Parquet files containing NaN
Jun 30, 2020
reported by @veysiertekin in #4119 (comment)
Query:
The text was updated successfully, but these errors were encountered: