Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add mysql staleness removal task #474

Merged
merged 2 commits into from Apr 17, 2021

Conversation

sahithi03
Copy link
Contributor

@sahithi03 sahithi03 commented Apr 15, 2021

Signed-off-by: Sahithi Velma sahithiv@wepay.com

Summary of Changes

Adds a stale data removal task for mysql metadata store

Tests

Added unit tests for the mysql_staleness_removal_task

Documentation

N/A

CheckList

Make sure you have checked all steps below to ensure a timely review.

  • PR title addresses the issue accurately and concisely. Example: "Updates the version of Flask to v1.0.2"
  • PR includes a summary of changes.
  • PR adds unit tests, updates existing unit tests, OR documents why no test additions or modifications are needed.
  • In case of new functionality, my PR adds documentation that describes how to use it.
    • All the public functions and the classes in the PR contain docstrings that explain what it does
  • PR passes make test

@feng-tao
Copy link
Member

the delta extractor CI error is not related. I will take a look.

@feng-tao
Copy link
Member

@sahithi03 could you rebase the pr given #476 is now merged? this should fix the CI error.

Signed-off-by: Sahithi Velma <sahithiv@wepay.com>
@sahithi03 sahithi03 force-pushed the mysql-staleness-removal-task branch from 878b035 to 25cfd56 Compare April 16, 2021 23:07
@feng-tao
Copy link
Member

cc @crazy-2020

@xuan616
Copy link
Member

xuan616 commented Apr 16, 2021

It looks good to me👍

Copy link
Member

@feng-tao feng-tao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one nit, but lgtm

DRY_RUN: False,
ENGINE_ECHO: False})

def __init__(self) -> None:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need this?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No not needed, will update 👍

Signed-off-by: Sahithi Velma <sahithiv@wepay.com>
@feng-tao feng-tao merged commit e73ff23 into amundsen-io:master Apr 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants