Skip to content

Evaluation: Optimize Upload Dataset to Langfuse Function to prevent timeout error #460

@Prajna1999

Description

@Prajna1999

Issue
In the POST upload dataset endpoint /api/v1/evaluations/datasets, when the line items in the golden Q&A increases, the endpoint times out due to langfuse allowing only appending one (input, output) pair at a. single API call

solution
Adding threadpool based concurrency model to allow max 4 worker threads to take up the insert (input, output) pair instead of one blocking process doing all the heavy lifting. This enhances the endpoints ability to insert CSV files upto 1000 line items within 60 seconds.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

Projects

Status

in review

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions