-
Notifications
You must be signed in to change notification settings - Fork 30
🔄 Optimize Space-Track Synchronization Performance #150
Copy link
Copy link
Open
Labels
ECSoC26Official label for ECSoC26 event contributions.Official label for ECSoC26 event contributions.ECSoC26-L2Level 2 contribution for the ECSoC26 event.Level 2 contribution for the ECSoC26 event.GitHub ActionsGitHub Actions workflows and CI/CDGitHub Actions workflows and CI/CDassignedIndicates that the issue has been assigned to a contributor who is actively working on it.Indicates that the issue has been assigned to a contributor who is actively working on it.backendBackend developmentBackend developmentbugSomething isn't workingSomething isn't workingdatabaseDatabase and schema related changesDatabase and schema related changesenhancementNew feature or requestNew feature or requestgithub-actionsGitHub Actions workflows and CI/CDGitHub Actions workflows and CI/CDlevel:intermediateRequires moderate knowledge of the project.Requires moderate knowledge of the project.mentor:Krish-KhinchiAssigned mentor responsible for reviewing and guiding this contribution.Assigned mentor responsible for reviewing and guiding this contribution.priority:highHigh priority task requiring attention.High priority task requiring attention.quality:cleanMeets project quality standards.Meets project quality standards.size/MMedium-sized contribution.Medium-sized contribution.type:backendChanges backend services or server-side logic.Changes backend services or server-side logic.type:bugFixes an existing bug or unexpected behavior.Fixes an existing bug or unexpected behavior.type:featureIntroduces a new feature or enhancement.Introduces a new feature or enhancement.
Description
Metadata
Metadata
Assignees
Labels
ECSoC26Official label for ECSoC26 event contributions.Official label for ECSoC26 event contributions.ECSoC26-L2Level 2 contribution for the ECSoC26 event.Level 2 contribution for the ECSoC26 event.GitHub ActionsGitHub Actions workflows and CI/CDGitHub Actions workflows and CI/CDassignedIndicates that the issue has been assigned to a contributor who is actively working on it.Indicates that the issue has been assigned to a contributor who is actively working on it.backendBackend developmentBackend developmentbugSomething isn't workingSomething isn't workingdatabaseDatabase and schema related changesDatabase and schema related changesenhancementNew feature or requestNew feature or requestgithub-actionsGitHub Actions workflows and CI/CDGitHub Actions workflows and CI/CDlevel:intermediateRequires moderate knowledge of the project.Requires moderate knowledge of the project.mentor:Krish-KhinchiAssigned mentor responsible for reviewing and guiding this contribution.Assigned mentor responsible for reviewing and guiding this contribution.priority:highHigh priority task requiring attention.High priority task requiring attention.quality:cleanMeets project quality standards.Meets project quality standards.size/MMedium-sized contribution.Medium-sized contribution.type:backendChanges backend services or server-side logic.Changes backend services or server-side logic.type:bugFixes an existing bug or unexpected behavior.Fixes an existing bug or unexpected behavior.type:featureIntroduces a new feature or enhancement.Introduces a new feature or enhancement.
Description
The synchronization process currently fetches and stores satellite data sequentially, making updates slower as the catalog grows.
Refactor the synchronization pipeline to support bulk inserts, batch processing, asynchronous requests, retry mechanisms, and efficient UPSERT operations. The goal is to minimize synchronization time while ensuring reliability.
Acceptance Criteria
Labels:
backendapiperformance