Move Stack Overflow to the new integration framework#936
Merged
garrrikkotua merged 70 commits intomainfrom Jun 2, 2023
Merged
Conversation
added 30 commits
May 15, 2023 07:22
…1265' into improvement/move-stackoverflow
…rowdDotDev/crowd.dev into improvement/move-stackoverflow
themarolt
requested changes
Jun 2, 2023
themarolt
approved these changes
Jun 2, 2023
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Changes proposed ✍️
What
🤖 Generated by Copilot at a2db0fd
This pull request adds a new feature to allow users to connect their Stack Overflow accounts to the platform and get insights from their questions and answers. It also refactors and optimizes the integration run, data, and stream services to use a new
int-run-workerservice and aMapcache for the platform configuration. It also updates the frontend and backend components to support the new feature and adds logging and debugging improvements. It introduces new files and functions in theintegrationslibrary to handle the Stack Overflow API calls, data processing, and stream generation.
🤖 Generated by Copilot at a2db0fd
Why
How
🤖 Generated by Copilot at a2db0fd
integration_stream_workerservice (link, link, link)PLATFORM_CONFIGfunction in theintegration_data_worker,integration_run_worker, andintegration_stream_workerservices to use aMapinstead of a variable for caching the platform-specific configuration values, which improves the performance and memory usage (link, link, link)IntegrationRunentity with a call tosendStartIntegrationRunMessagein theintegrationService, which sends a message to theint-run-workerservice to start processing the integration data, which decouples the integration run logic from theintegrationServiceand uses a message-driven architecture instead (link)sendNodeWorkerMessagein theintegrationService, which was used to send a message to thenode-workerservice to process the integration data, which is replaced by theint-run-workerservice, which handles the integration run logic in a more scalable and robust way (link)integrationService(link)integration_stream_workerservice, which provides more visibility into the stream processing logic and configuration (link)stackoverflowplatform in theintegration_stream_workerservice, which specifies the environment variableCROWD_STACKEXCHANGE_KEYthat holds the Stack Overflow API key (link)MAX_STACK_OVERFLOW_QUESTIONS_PER_TAGin thestackoverflow-connect-drawer.vuecomponent, which is the maximum number of questions that can be fetched from the Stack Overflow API for a given tag, which allows users to get insights from a large number of questions related to their interests or skills (link)Checklist ✅
Feature,Improvement, orBug.