Skip to content

[Bug]: Spark select table will throw FileNotFoundException #873

@hellojinsilei

Description

@hellojinsilei

What happened?

This is an occasional bug:
Use spark SQL insert overwrite lots of partitions, then execute select table will throw FileNotFoundexception

image

Affects Versions

0.3.2

What engines are you seeing the problem on?

Core, Spark

How to reproduce

Step1: Create an unkeyed table
Step2: Insert overwrite sink table select from the source table
Step3: Select from the sink table

notice: The source table needs to have multiple partitions

Relevant log output

No response

Anything else

Query the file in the hdfs where an error occurs. No file exists in the directory

Code of Conduct

  • I agree to follow this project's Code of Conduct

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions