[FR] Consider utilizing time travel feature in Delta when users materialize features to avoid multiple cutoff time.

[xiaoyongzhu]

Willingness to contribute

No. I cannot contribute a bug fix at this time.

Feature Request Proposal

Currently a lot users are using delta format. Maybe an optimization to save some space when materializing features is to use the time travel feature in delta to avoid multiple cutoff time.

Motivation

What is the use case for this feature?

Currently a lot users are using delta format. Maybe an optimization to save some space when materializing features is to use the time travel feature in delta to avoid multiple cutoff time.

Details

No response

What component(s) does this feature request affect?

• Python Client: This is the client users use to interact with most of our API. Mostly written in Python.
• Computation Engine: The computation engine that execute the actual feature join and generation work. Mostly in Scala and Spark.
• Feature Registry API: The frontend API layer supports SQL, Purview(Atlas) as storage. The API layer is in Python(FAST API)
• Feature Registry Web UI: The Web UI for feature registry. Written in React