Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] Support SparkSQL extended syntax in Iceberg #3187

Closed
caican00 opened this issue Apr 25, 2024 · 1 comment · Fixed by #3266
Closed

[Subtask] Support SparkSQL extended syntax in Iceberg #3187

caican00 opened this issue Apr 25, 2024 · 1 comment · Fixed by #3266
Labels
subtask Subtasks of umbrella issue

Comments

@caican00
Copy link
Contributor

caican00 commented Apr 25, 2024 •
edited
Loading

Describe the subtask

Support SparkSQL extended syntax in Iceberg, such as:

addPartitionField
dropPartitionField
replacePartitionField
setWriteDistributionAndOrdering
setIdentifierFields
dropIdentifierFields
createOrReplaceBranch
createOrReplaceTag
dropBranch
dropTag

Parent issue

#1571
@caican00 caican00 added the subtask Subtasks of umbrella issue label Apr 25, 2024
@caican00 caican00 changed the title [Subtask] Support Iceberg addPartitionField/dropPartitionField/replacePartitionField [Subtask] Support SparkSQL extended syntax in Iceberg Apr 25, 2024
@caican00
Copy link
Contributor Author

after #2642 is merged, i will start this work.

caican00 added a commit to caican00/gravitino that referenced this issue May 4, 2024
@caican00
[apache#3187] feat(spark-connector): Support SparkSQL extended syntax…
3a0c39c 
… in Iceberg
@caican00 caican00 mentioned this issue May 4, 2024
Merged
caican00 added a commit to caican00/gravitino that referenced this issue May 4, 2024
@caican00
[apache#3187] feat(spark-connector): Support SparkSQL extended syntax…
49baf5c 
… in Iceberg
caican00 added a commit to caican00/gravitino that referenced this issue May 5, 2024
@caican00
[apache#3187] feat(spark-connector): Support SparkSQL extended syntax…
8cba728 
… in Iceberg
caican00 added a commit to caican00/gravitino that referenced this issue May 5, 2024
@caican00
[apache#3187] feat(spark-connector): Support SparkSQL extended syntax…
0826647 
… in Iceberg
caican00 added a commit to caican00/gravitino that referenced this issue May 5, 2024
@caican00
[apache#3187] feat(spark-connector): Support SparkSQL extended syntax…
0a8ff35 
… in Iceberg
@FANNG1 FANNG1 closed this as completed in 0653004 Jun 14, 2024
shaofengshi pushed a commit to shaofengshi/gravitino that referenced this issue Jun 24, 2024
@caican00 @shaofengshi
[apache#3187] feat(spark-connector): Support SparkSQL extended syntax…
e3a4a84 
… in Iceberg (apache#3266)

### What changes were proposed in this pull request?
Support SparkSQL extended syntax in Iceberg, such as:
```
addPartitionField
dropPartitionField
replacePartitionField
setWriteDistributionAndOrdering
setIdentifierFields
dropIdentifierFields
createOrReplaceBranch
createOrReplaceTag
dropBranch
dropTag
```

### Why are the changes needed?

Support SparkSQL extended syntax in Iceberg.

Fix:  apache#3187

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
New ITs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
subtask Subtasks of umbrella issue
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[#3187] feat(spark-connector): Support SparkSQL extended syntax in Iceberg caican00/gravitino
1 participant
@caican00