Skip to content

HOPSFS-264: Update main from upstream up to v1.0.2 #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 134 commits into from
Aug 26, 2025
Merged

HOPSFS-264: Update main from upstream up to v1.0.2 #13

merged 134 commits into from
Aug 26, 2025

Conversation

@hamidgh09
Copy link
Collaborator

@hamidgh09 hamidgh09 commented Jul 7, 2025

No description provided.

ion-elgreco and others added 30 commits April 5, 2025 16:01
@ion-elgreco @rtyler
chore: remove cdf feature
b5caa71 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@roykim98 @rtyler
Correct Python docs for incremental compaction on OPTIMIZE
3ef4cf5
@Nordalf @rtyler
fix: added restored metadata as action to the next committed version
0daa911 
Signed-off-by: Alexander Falk <alexfalk7@gmail.com>
@rtyler
chore: add a regression test to ensure restore respects metadata actions
ad580b0 
Fixes delta-io#3352

Signed-off-by: R. Tyler Croy <rtyler@brokenco.de>
@rtyler
chore: fix some minor build warnings
64f6369 
Signed-off-by: R. Tyler Croy <rtyler@brokenco.de>
@roeap
fix: handle unknown features
edaa9a3 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
fix: update to latest kernel state
e2f633f 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
test: update or disable tests with unsupported features
3941c0c 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
refactor: move transaction module to kernel
ad61c51 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
chore: clippy
2269a67 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
chore: move proofs into dedicated folder
50e6c0a 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
refactor: move storage module into logstore
7538c58 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
feat: harmonize storage config parsing
5b0ddfb 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
refactor: remove RetryConfigParse trait
ff7b553 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
feat!: formalize parsing of storage options
e038eec 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
feat: centrally apply object store layers
44cc251 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
refactor: isolate factories for storage / log store integrations
a641665 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
fix: url parsing inconsistencies
aa4f112 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
fix: PR feedback
ba80e15 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap @rtyler
fix: PR feedback
b2dd8fa 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@alamb @roeap
fix: clippy warnings
41b4265 
Signed-off-by: Andrew Lamb <andrew@nerdnetworks.org>
@roeap
feat: derive macro for config implementations
4cf5d5e 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
feat: error handling in derive macro
34975a9 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
refactor: move str_ist_truthy to config
08e0361 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
chore: clippy
494e0b0 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@rtyler
Chore: put a couple symbols behind the right feature gate
82661b8 
Signed-off-by: R. Tyler Croy <rtyler@brokenco.de>
@zachschuermann @ion-elgreco
update for kernel 0.10.0
792a635 
Signed-off-by: Zach Schuermann <zachary.zvs@gmail.com>
@zachschuermann @ion-elgreco
fix daft docs
338a0bf 
Signed-off-by: Zach Schuermann <zachary.zvs@gmail.com>
@HiromuHota @ion-elgreco
Fix the default target size
d4586c9 
Signed-off-by: Hiromu Hota <hiromu.hota@gmail.com>
@zeevm @rtyler
gate RetryConfig usage on 'cloud' feature
06aa6c0 
Signed-off-by: Ze'ev Maor <zeevm@outlook.com>
ion-elgreco and others added 27 commits May 28, 2025 10:20
@ion-elgreco
chore: update migration docs
d014e95 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@ion-elgreco
chore: improve wording
c40d41e 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@roeap
chore: update kernel to 0.11
e53a7e0 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@ion-elgreco
fix: set casting safe param to False
e57929e 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@ion-elgreco
chore: add xfail to flaky test
3197b92 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@avriiil @ion-elgreco
fix bullet list formatting
4f14b8e 
Signed-off-by: Avril Aysha <68642378+avriiil@users.noreply.github.com>
@roeap @ion-elgreco
refactor!: get transaction versions for specific applications
8d8ace1 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
test: improve storage config testing
fbdcc34 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@rtyler
chore: exclude Invariants from the default writer v2 feature set
7b0b4a2 
Invariants cannot be supported without datafusion present, the code
should not pretend they exist. This also helps ensure a number of
non-invariant related test can run without datafusion present

Signed-off-by: R. Tyler Croy <rtyler@brokenco.de>
@roeap
refactor!: remove and deprecate some python methods
0f346ec 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@alexwilcoxson-rel @ion-elgreco
fix: ensure projecting only columns that exist in new files afte sche…
5ea3d15 
…ma update

Signed-off-by: Alex Wilcoxson <alex.wilcoxson@relativity.com>
@rluvaton @rtyler
docs: update link to df
e8a7c40 
Signed-off-by: Raz Luvaton <16746759+rluvaton@users.noreply.github.com>
@ion-elgreco @roeap
chore: update runner
48cf336 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@roeap @rtyler
ci: improve coverage collection
a31f241 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@rtyler @ion-elgreco
chore: prepare for the next python release
2f096a9 
Signed-off-by: R. Tyler Croy <rtyler@brokenco.de>
@roeap
chore!: remove get_earliest_version
e5a7963 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
refactor!: have DeltaTable::version return an Option
6baef44 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@ion-elgreco
Revert "chore: add test for handling fields with spaces in constraints"
e06e47d 
This reverts commit 89ddf07.
@ion-elgreco
Revert "fix: if field contains space in constraint expression, the ch…
1ec381d 
…eck will fail"

This reverts commit 6babfb6.
@ion-elgreco
fix: spaced columns parsing
79907fd 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@ion-elgreco
chore: update tests
1c648b8 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@ion-elgreco
chore: fmt
2f990fe 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@ion-elgreco
fix: wrong schema set in table provider
36a7696 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@ion-elgreco
chore: bump version
caaf56a 
Signed-off-by: Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>
@roeap
refactor: move LazyTableProvider into python crate
028db69 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@roeap
feat: add convenience extensions for kernel engine types
f8dcef3 
Signed-off-by: Robert Pack <robstar.pack@gmail.com>
@hamidgh09
Merge tag 'python-v1.0.2' into update-main
b907b08
@hamidgh09 hamidgh09 merged commit c11d68d into logicalclocks:main Aug 26, 2025
@hamidgh09 hamidgh09 deleted the update-main branch September 1, 2025 09:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@smkniazi smkniazi smkniazi approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.