Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task]: Investigate datasources part of the consolidated API to see why it takes time #33542

Closed
sneha122 opened this issue May 17, 2024 · 2 comments
Assignees
Labels
Integrations Pod General Issues related to the Integrations Pod that don't fit into other tags. Integrations Product Issues related to a specific integration Query & JS Pod Issues related to the query & JS Pod Task A simple Todo

Comments

@sneha122
Copy link
Contributor

SubTasks

https://theappsmith.slack.com/archives/CPQNLFHTN/p1715761934675989

@sneha122 sneha122 added the Task A simple Todo label May 17, 2024
@sneha122 sneha122 self-assigned this May 17, 2024
@sneha122 sneha122 added the Integrations Pod General Issues related to the Integrations Pod that don't fit into other tags. label May 17, 2024
@github-actions github-actions bot added the Integrations Product Issues related to a specific integration label May 17, 2024
@sneha122
Copy link
Contributor Author

As per discussion in thread, we have decided to add instrumentation to all the areas where we feel bottlenecks are there, this will reveal to us if these are indeed causing performance issues and based on that we can make improvements

@sneha122
Copy link
Contributor Author

As per discussion in thread, after adding instrumentation and checking this instrumentation from local, we have decided on following areas of improvements:
In order to solve identified bottlenecks, we can:

  • Remove unnecessary individual calls to fetch plugin info from DB everytime, instead we can fetch all plugins at once and send this data populateHintMessages
  • Remove unnecessary individual calls to fetch datasourceStorage and instead fetch all at once
  • Cache plugins info

Creating a new task to handle these separately and closing this investigation task

@Nikhil-Nandagopal Nikhil-Nandagopal added the Query & JS Pod Issues related to the query & JS Pod label Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Integrations Pod General Issues related to the Integrations Pod that don't fit into other tags. Integrations Product Issues related to a specific integration Query & JS Pod Issues related to the query & JS Pod Task A simple Todo
Projects
None yet
Development

No branches or pull requests

2 participants