Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

As a user, I want to monitor a nucleus workflow execution #23

Closed
2 tasks done
jordanpadams opened this issue Jan 13, 2023 · 2 comments
Closed
2 tasks done

As a user, I want to monitor a nucleus workflow execution #23

jordanpadams opened this issue Jan 13, 2023 · 2 comments
Assignees
@ramesh-maddegoda
Labels
B14.0 p.must-have requirement the current issue is a requirement

Comments

@jordanpadams
Copy link
Member

jordanpadams commented Jan 13, 2023 •
edited by ramesh-maddegoda
Loading

🧑‍🔬 User Persona(s)

Node Operator

💪 Motivation

...so that I can know

  • where in the pipeline is currently executing
  • what/if something has failed
  • when it has completed successfully
  • how to see the failure reports from the specific tools

📖 Additional Details

  • Capture validate and other tool logs in a consistent fashion
  • Monitoring User Guide

⚖️ Acceptance Criteria

Given
When I perform
Then I expect

⚙️ Engineering Details
@jordanpadams jordanpadams added needs:triage requirement the current issue is a requirement labels Jan 13, 2023
@jordanpadams jordanpadams changed the title As a user, I want to know how to monitor a nucleus pipeline As a user, I want to know monitor a nucleus pipeline Jan 13, 2023
@jordanpadams jordanpadams changed the title As a user, I want to know monitor a nucleus pipeline As a user, I want to monitor a nucleus workflow execution Feb 9, 2023
@jordanpadams jordanpadams added B14.0 and removed B13.1 labels Mar 23, 2023
@jordanpadams jordanpadams mentioned this issue May 9, 2023
Closed
@jordanpadams
Copy link
Member Author

@ramesh-maddegoda user guide available for MWAA, which includes some ideas for setting this up. by default, this is not enabled because of cost. will update and monitor cost for including those monitoring capabilities. will do quick trade on those tasks.

@jordanpadams jordanpadams mentioned this issue May 25, 2023
Closed
ramesh-maddegoda added a commit that referenced this issue Jun 8, 2023
@ramesh-maddegoda
ADD Nucleus Monitoring User Guide
a2d3c2b 
Refer to the task #23
ramesh-maddegoda added a commit that referenced this issue Jun 8, 2023
@ramesh-maddegoda
UPDATE Text formatting of Nucleus Monitoring User Guide
de7ec90 
Refer to the task #23
@ramesh-maddegoda ramesh-maddegoda mentioned this issue Jun 8, 2023
Merged
@ramesh-maddegoda
Copy link
Contributor

  • Enabled Airflow logs in MWAA to capture tasks logs such as logs of Validate tool
  • Created the Nucleus Monitoring User Guide and made a pull request at Nucleus Monitoring User Guide #50

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ramesh-maddegoda ramesh-maddegoda

Labels
B14.0 p.must-have requirement the current issue is a requirement
Projects
No open projects
B14.0
Status: 🏁 Done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jordanpadams @ramesh-maddegoda