WIP: Release 2.3.0 #465
Merged
WIP: Release 2.3.0 #465
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
split workers into two separate docker containers
…d not in generate stats
Fix realtime progress
* do not upload tasks for projects of type build_area, change detection and completeness
* improve update project data function by using threading for firebase queries and check project status before updating * work on faster workflow to update user data in postgres #462 * split up workflow for generate stats and firebase-to-postgres into two docker containers * small fix in docker compose file * adjust archive function to remove also new firebase endpoint for /v2/groupsUsers and adjust tests. this also relates to #416 * add script to remove timestamps in user contributions. this also relates to #375 #376 * consider new firebae endpoint /v2/groupsUsers/ when deleting projects * update user data only when new users submit a result.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Things to check in production environment
users_tempMajor things that changed:
Fix realtime progress #456
calculate project progress and project contributorCount in python backend and not with Firebase functions Firebase and postgresql based stats do not always agree #449
don't put timestamps in user profile for user contributions
Better data transfer firebase postgres #464
add logic to generate stats only for recently worked on projects add option to generate stats only for recent projects #461
split backend processing into 3 docker containers for
a) creation of projects and tutorials
b) transfer data between firebase and postgres
c) generate stats and files
for each docker container the time interval can be set for which jobs should be scheduled
change logic in update_project_data function to avoid downloading all project information from firebase update_project_data function takes very long #459
using threading in queries for firebase in update_project_data and update_user_data functions update_project_data function takes very long #459 refactor update_user_data function #462
do not upload tasks for projects of type build_area #467
tasks are not uploaded to firebase for build_area, completeness and change detection projects remove tile url from tasks in firebase #344
Use GitHub actions instead of Travis #469
use Github Actions instead of Travis