Make datasets.upsertRemoteExperiment API available in SDK #10805
msciortino
started this conversation in
Ideas
Replies: 1 comment
|
I see. Thanks for sharing, this makes sense! |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Describe the feature or potential improvement
After creating a dataset, through the UI is possible to configure a remote experiment for the dataset as shown in
https://langfuse.com/docs/evaluation/experiments/experiments-via-sdk#optional-trigger-sdk-experiment-from-ui
This UI action calls the
POST /api/trpc/datasets.upsertRemoteExperimentAPI providing as input:{ "json": { "projectId": <projectId>, "datasetId": <datasetId>, "url": <url>, "defaultPayload": <defaultPayload> } }Issue
Langfuse SDK does not allow to call the updateDataset operation so we are not able to pre-configure the remote webhook url and payload for our AI engineers.
As we generate multiple datasets on the fly (hundreds), having to do this action manually for all of them is unfeasible.
Suggestions
remoteExperimentUrlandremoteExperimentPayloadincreate_datasetsdk method (preferred)update_datasetmethod to setremoteExperimentUrlandremoteExperimentPayloadAdditional information
No response
All reactions