Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-3671] Beam runner inventory #4677

Merged
merged 1 commit into from Mar 6, 2018
Merged

[BEAM-3671] Beam runner inventory #4677

merged 1 commit into from Mar 6, 2018

Conversation

alanmyrvold
Copy link
Member

@alanmyrvold alanmyrvold commented Feb 13, 2018

Inventory software on each beam executor to validate all are set up consistently

Follow this checklist to help us incorporate your contribution quickly and easily:

  • Make sure there is a JIRA issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes.
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.
  • Write a pull request description that is detailed enough to understand:
    • What the pull request does
    • Why it does it
    • How it does it
    • Why this approach
  • Each commit in the pull request should have a meaningful subject line and body.
  • Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

@alanmyrvold alanmyrvold changed the title [BEAM-3671] Beam runner inventory Not ready for review [BEAM-3671] Beam runner inventory Feb 15, 2018
@alanmyrvold alanmyrvold changed the title Not ready for review [BEAM-3671] Beam runner inventory [BEAM-3671] Beam runner inventory Feb 16, 2018
@lukecwik
Copy link
Member

lukecwik commented Feb 21, 2018

@alanmyrvold, is this something you would want to check in?

You would be able to run it from Jenkins manually.

@lukecwik lukecwik self-requested a review February 21, 2018 22:53
@lukecwik lukecwik self-assigned this Feb 21, 2018
@lukecwik lukecwik requested review from tgroh and removed request for lukecwik February 21, 2018 22:53
@lukecwik lukecwik assigned tgroh and unassigned lukecwik Feb 21, 2018
// Set common parameters.
common_job_properties.setTopLevelMainJobProperties(delegate)

// Sets that this is a PostCommit job.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PostCommit and Cron seem like they shouldn't really be in the same category, if we want to run inventory regularly, independently of changes (which seems appropriate)

(I recognize that this isn't introduced here and shouldn't be a blocker, but it's worth noting)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed. Added a method in common, setCronJob and called that instead.

@alanmyrvold
Copy link
Member Author

@lukecwik - yes, I'd want this checked in so it runs regularly.

@alanmyrvold
Copy link
Member Author

@tgroh - updated based on feedback. PTAL?

Copy link
Member

@tgroh tgroh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Right now this will just drop everything into the console, right? so it's more akin to logging than alerting if a machine doesn't have the 'proper' inventory.

Do we have any plan to have a more heterogeneous fleet, or machine capabilities for executing our builds, or a dashboard? Should we, if not, and is that tracked anywhere?

This LGTM regardless

@tgroh tgroh merged commit d086d87 into apache:master Mar 6, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants