Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

need to add more detail as comment to the metadata query in MyLA cron_udp.json #1502

Closed
zqian opened this issue Apr 10, 2023 · 1 comment · Fixed by #1503
Closed

need to add more detail as comment to the metadata query in MyLA cron_udp.json #1502

zqian opened this issue Apr 10, 2023 · 1 comment · Fixed by #1503
Assignees

Comments

@zqian
Copy link
Member

zqian commented Apr 10, 2023

Describe the bug (Tell us what happens instead of the expected behavior) :

The metadata query inside cron_udp.json was used as an indicator for MyLA data freshness:

select 'canvasdatadate' as pkey, min(dag_run) as pvalue from report.publish_info pi2
Need to add some comment there for the meaning of above UDP query. Here is some sample text:

// The UDP’s batch-ingest process is organized by a single Directed Acyclic Graph (DAG) named "ingest"
// The dag_run date inside publish_info report would reflect when the data was loaded into the context_store by Unizin batch-ingest ETL process. Note that time wouldn’t reflect when the data was actually dumped from canvas.
@jennlove-um jennlove-um added this to To do in MyLA-2023.02.01 via automation Apr 27, 2023
MyLA-2023.02.01 automation moved this from To do to Review/QA May 1, 2023
@jennlove-um jennlove-um moved this from Review/QA to Review/QA - DEV in MyLA-2023.02.01 Sep 14, 2023
@pushyamig
Copy link
Contributor

Test pass:
The changes are correctly updated on MylA beta and in Master branch

@pushyamig pushyamig moved this from Review/QA - DEV to Done in MyLA-2023.02.01 Sep 14, 2023
MyLA-2023.02.01 automation moved this from Done to Review/QA Sep 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
MyLA-2023.02.01
  
Review/QA
3 participants