Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WhyLabs callback #4906

Merged
merged 21 commits into from
May 23, 2023
Merged

WhyLabs callback #4906

merged 21 commits into from
May 23, 2023

Conversation

jamie256
Copy link
Contributor

@jamie256 jamie256 commented May 18, 2023

Add a WhyLabs callback handler

  • Adds a simple WhyLabsCallbackHandler
  • Add required dependencies as optional
  • protect against missing modules with imports
  • Add docs/ecosystem basic example

based on initial prototype from @andrewelizondo

this integration gathers privacy preserving telemetry on text with whylogs and sends stastical profiles to WhyLabs platform to monitoring these metrics over time. For more information on what WhyLabs is see: https://whylabs.ai

After you run the notebook (if you have env variables set for the API Keys, org_id and dataset_id) you get something like this in WhyLabs:
Screenshot (443)

Who can review?

@agola11
@hwchase17

Copy link
Contributor

@hwchase17 hwchase17 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one comment re dependencies (which we can also fix) otherwise lg

pyproject.toml Outdated Show resolved Hide resolved
@hwchase17 hwchase17 added the 03 enhancement Enhancement of existing functionality label May 22, 2023
Copy link
Contributor

@dev2049 dev2049 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

two optional comments, otherwise lg!

langchain/callbacks/whylabs_callback.py Outdated Show resolved Hide resolved
langchain/callbacks/whylabs_callback.py Outdated Show resolved Hide resolved
@dev2049 dev2049 merged commit d4fd589 into langchain-ai:master May 23, 2023
13 checks passed
vowelparrot pushed a commit that referenced this pull request May 24, 2023
# Add a WhyLabs callback handler

* Adds a simple WhyLabsCallbackHandler
* Add required dependencies as optional
* protect against missing modules with imports
* Add docs/ecosystem basic example

based on initial prototype from @andrewelizondo

> this integration gathers privacy preserving telemetry on text with
whylogs and sends stastical profiles to WhyLabs platform to monitoring
these metrics over time. For more information on what WhyLabs is see:
https://whylabs.ai

After you run the notebook (if you have env variables set for the API
Keys, org_id and dataset_id) you get something like this in WhyLabs:
![Screenshot
(443)](https://github.com/hwchase17/langchain/assets/88007022/6bdb3e1c-4243-4ae8-b974-23a8bb12edac)

Co-authored-by: Andre Elizondo <andre@whylabs.ai>
Co-authored-by: Dev 2049 <dev.dev2049@gmail.com>
@danielchalef danielchalef mentioned this pull request Jun 5, 2023
This was referenced Jun 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
03 enhancement Enhancement of existing functionality
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants