Skip to content

[VL] Fix iceberg numWrittenFiles metric #11510

@zhouyuan

Description

@zhouyuan

Backend

VL (Velox)

Bug description

- iceberg write metrics *** FAILED ***
  0 did not equal 1 (VeloxIcebergSuite.scala:325)
07:49:59.509 WARN org.apache.gluten.execution.enhanced.VeloxIcebergSuite: 

numWrittenFiles is not updated due to below commits
facebookincubator/velox@a38ed08

for iceberg write we need to cope with the new API to update the stats

Gluten version

No response

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingtriage

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions