-
Notifications
You must be signed in to change notification settings - Fork 3k
Closed
Labels
beginnerIssues for apache iceberg beginners, enjoy to contribute !Issues for apache iceberg beginners, enjoy to contribute !good first issueGood for newcomersGood for newcomers
Description
We should probably say why we cannot process the snapshot here:
iceberg/spark/v3.2/spark/src/main/java/org/apache/iceberg/spark/source/SparkMicroBatchStream.java
Lines 201 to 209 in cbf56a3
| private boolean shouldProcess(Snapshot snapshot) { | |
| String op = snapshot.operation(); | |
| Preconditions.checkState(!op.equals(DataOperations.DELETE) || skipDelete, | |
| "Cannot process delete snapshot: %s", snapshot.snapshotId()); | |
| Preconditions.checkState( | |
| op.equals(DataOperations.DELETE) || op.equals(DataOperations.APPEND) || op.equals(DataOperations.REPLACE), | |
| "Cannot process %s snapshot: %s", op.toLowerCase(Locale.ROOT), snapshot.snapshotId()); | |
| return op.equals(DataOperations.APPEND); | |
| } |
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
beginnerIssues for apache iceberg beginners, enjoy to contribute !Issues for apache iceberg beginners, enjoy to contribute !good first issueGood for newcomersGood for newcomers