Skip to content

Comments

Spec: Sort-order order-id is mandatory#5177

Merged
rdblue merged 1 commit intoapache:masterfrom
Fokko:patch-5
Jul 1, 2022
Merged

Spec: Sort-order order-id is mandatory#5177
rdblue merged 1 commit intoapache:masterfrom
Fokko:patch-5

Conversation

@Fokko
Copy link
Contributor

@Fokko Fokko commented Jul 1, 2022

Looking at the code, we expect this field:

https://github.com/apache/iceberg/blob/master/core/src/main/java/org/apache/iceberg/SortOrderParser.java#L154

And we always write it on the Java side.

@rdblue Can you confirm this? I saw that you recently did some work on this.

@rdblue
Copy link
Contributor

rdblue commented Jul 1, 2022

We do require this in the parser and it is probably best if we require it all the time.

There are a couple of places where we don't technically need it because the order will be reassigned. For example, when interacting with a REST-based catalog, the catalog service will add the sort order to the current metadata and reassign the ID to ensure it doesn't conflict with concurrent operations. But it's always okay to have an order ID so I think we should go ahead and require it.

@rdblue rdblue merged commit 509bdc1 into apache:master Jul 1, 2022
@rdblue
Copy link
Contributor

rdblue commented Jul 1, 2022

Thanks, @Fokko!

namrathamyske pushed a commit to namrathamyske/iceberg that referenced this pull request Jul 10, 2022
namrathamyske pushed a commit to namrathamyske/iceberg that referenced this pull request Jul 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants