Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix part of #9827: Migrate Google App Engine Taskqueue to Cloud Tasks #10699

Merged
merged 144 commits into from Sep 27, 2020

Conversation

kevjumba
Copy link
Contributor

Overview

  1. This PR fixes or fixes part of Migrate Oppia from Python 2 to Python 3 #9827.
  2. This PR does the following:

This PR migrates the taskqueue functionality used in Oppia to the new Cloud Tasks service. However, the GAE MapReduce and Pipeline libraries actually use the old appengine taskqueue api so the oppia app will be using both apis for a time. This is ok for the time being since both apis interact with the same environment as confirmed here:
https://cloud.google.com/tasks/docs/migrating

This PR also contains a task queue emulator for both unit test and development server task operations that will now be maintained by oppia developers since GAE no longer provides support for an emulator.

NOTE: This PR still has not passed linter checks or has complete 100% backend coverage(some tests are missing). However, this allows for a first pass review for any issues that need to be fixed immediately.

Essential Checklist

  • The PR title starts with "Fix #bugnum: ", followed by a short, clear summary of the changes. (If this PR fixes part of an issue, prefix the title with "Fix part of #bugnum: ...".)
  • The linter/Karma presubmit checks have passed locally on your machine.
  • "Allow edits from maintainers" is checked. (See here for instructions on how to enable it.)
    • This lets reviewers restart your CircleCI tests for you.
  • The PR is made from a branch that's not called "develop".

PR Pointers

  • Make sure to follow the instructions for making a code change.
  • Oppiabot will notify you when you don't add a PR_CHANGELOG label. If you are unable to do so, please @-mention a code owner (who will be in the Reviewers list), or ask on Gitter.
  • For what code owners will expect, see the Code Owner's wiki page.
  • Make sure your PR follows conventions in the style guide, otherwise this will lead to review delays.
  • Never force push. If you do, your PR will be closed.

@seanlip seanlip removed the request for review from Hudda September 26, 2020 10:07
Copy link
Member

@DubeySandeep DubeySandeep left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for the codeowner files

@@ -935,6 +935,7 @@ def test_untag_deleted_misconceptions_correctly_on_updating_skill(self):
change_list, 'Delete misconceptions.')
skill_fetchers.get_skill_by_id('skillid12345')
self.process_and_flush_pending_tasks()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this still needed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah good catch this was added as part of a merge. Removed.

@oppiabot
Copy link

oppiabot bot commented Sep 26, 2020

Unassigning @DubeySandeep since they have already approved the PR.

Copy link
Member

@vojtechjelinek vojtechjelinek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!!

@oppiabot
Copy link

oppiabot bot commented Sep 26, 2020

Unassigning @vojtechjelinek since they have already approved the PR.

Copy link
Contributor

@nithusha21 nithusha21 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM as a codeowner!

@nithusha21 nithusha21 removed their assignment Sep 26, 2020
Copy link
Member

@kevintab95 kevintab95 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving to unblock since @U8NWXD has already reviewed this PR. Thanks @kevjumba!

@kevintab95 kevintab95 removed their assignment Sep 26, 2020
@kevjumba
Copy link
Contributor Author

@U8NWXD PTAL! The PR is really large and new develop changes are repeatedly making the tests fail so I would like to merge this PR in asap.

Copy link
Member

@U8NWXD U8NWXD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@U8NWXD U8NWXD removed their assignment Sep 26, 2020
Copy link
Member

@aks681 aks681 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm as codeowner

@aks681 aks681 removed their assignment Sep 26, 2020
@seanlip
Copy link
Member

seanlip commented Sep 26, 2020

@sagangwee is out -- so, confirming no further reviewers are needed, and that this PR can be merged once all the CI checks pass.

@kevjumba kevjumba assigned seanlip and unassigned kevjumba Sep 27, 2020
@kevjumba
Copy link
Contributor Author

@seanlip Could you please merge this PR? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet