Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ansible playbook to automate the deployment and running of the log4j_patcher #2

Closed
wants to merge 18 commits into from

Conversation

lhoss
Copy link

@lhoss lhoss commented Dec 13, 2021

Infos/Notes from the included comments:

# Notes:
# - First please read Cloudera's README.md
# - Before running it, set the ansible vars below to match your Env, in particular the script's cmdline
# - For simplicity, I decided to create a single self-contained playbook, instead of a cleaner ansible role (with the vars in the defaults etc)
#   - On demand, I'm happy to refactor this into a role
# - Also: It would have been cleaner & easier to use a different repo/folder for the deployment logic,
#     so we could (recursively) install the files in this repo to the target nodes (w/out ansible files)
  • there are 2 playbook tags (install , run ) so you can use the playbook only for the deployment (or do it in in 2 steps)

Status:

  • Deployed, tested and applied on our 1. customer (running CDH 6.3.x)
  • 14.12: Deploy and apply on a customer cluster running CPD 7.1x.

Learnings:

  • Ensure on all nodes to have a large enough /tmp partition, IF in /opt/cloudera/parcels you have large .tar.gz (like the CDSW tar.gz that is 5+ GB in size)
    • OR, simply remove/rename those (too large) parcel tar.gz , before applying the upgrade
  • Also, in yesterdays deployment the backup of .tar.gz was not properly done (to the given backup folder), but somehow to the /tmp folder (which on 1 node ran full, so the backup was lost also)
    • whereas the backup of the .jar files worked as expected (to the default backup folder)
    • @sdevineni I could create an issue for this , but just wondering if anyone else saw this issue (or if it's somehow related to the full /tmp folder occurring)

@lhoss lhoss mentioned this pull request Dec 13, 2021
sdevineni added a commit that referenced this pull request Dec 15, 2021
Line number is wrong in the README file HDP Notes section
@sdevineni sdevineni closed this Dec 15, 2021
@lhoss
Copy link
Author

lhoss commented Dec 16, 2021

@sdevineni plz re-open this unmerged PR, thx!

@lhoss
Copy link
Author

lhoss commented Dec 27, 2021

I re-opened a PR #43, also rebasing my branch on the latest "main" branch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants