Skip to content

Conversation

@B-Step62
Copy link
Contributor

@B-Step62 B-Step62 commented Oct 25, 2024

Change Overview:
Adding a robust callback mechanism to provide users an ability to inject custom hooks before/after executing DSPy components. The main use case right now is MLflow Tracing, but this opens up more use cases. The callback design has been discussed offline.

Tests:

  • Unit test: pytest tests/
  • Manual test with prototype MLflow tracing (PR)

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
@B-Step62 B-Step62 mentioned this pull request Oct 25, 2024
39 tasks
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
@okhat
Copy link
Collaborator

okhat commented Oct 25, 2024

Looks great to me! Thanks a ton @B-Step62 !

@okhat okhat merged commit 9ae8786 into stanfordnlp:main Oct 25, 2024
3 of 4 checks passed
omrirh pushed a commit to omrirh/dspy that referenced this pull request Oct 29, 2024
* Implement POC callback

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* POC for MLflow callback

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* Formalize

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* docstring

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* local callback

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

* fix import

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>

---------

Signed-off-by: B-Step62 <yuki.watanabe@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants