-
Notifications
You must be signed in to change notification settings - Fork 467
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SYSTEMDS-3710] Function entry/exit marker in lineage traces
This patch adds a new utility in lineage tracing for debugging and interpretability. The flat lineage tracing makes it harder to track calls to built-ins and the arguments (e.g. hyperparameters). To better structure the lineage traces, we now add function start end markers for each input and output, respectively. These entries are NOOPs and do not impact the reuse in any way. Future tasks include adding similar markers for control flow and enable deserialization of these markers. Note, this utility is default disabled and can be enabled using the flag, LineageItemUtils.FUNCTION_DEBUGGING.
- Loading branch information
1 parent
5015f63
commit bd17ead
Showing
2 changed files
with
27 additions
and
6 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters