Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

missing consol logging makes bmh provisioning fail #228

Closed
knfoo opened this issue Nov 30, 2020 · 7 comments
Closed

missing consol logging makes bmh provisioning fail #228

knfoo opened this issue Nov 30, 2020 · 7 comments
Labels
kind/feature Categorizes issue or PR as related to a new feature. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.

Comments

@knfoo
Copy link

knfoo commented Nov 30, 2020

After upgrade to v0.4.1 the bmh no longer logs syslog to the console during the different phases.
It seems to do with this: #160
This for some odd reason has the effect on my baremetal nodes (Hauwei ibmc managed, UEFI and Legacy bootmode) that it fails in random phases like clean wait, inspection wait.
I am not able to get anything to provision the servers as they all get stuck in clean wait.
After help from the community slack https://kubernetes.slack.com/archives/CHD49TLE7/p1606294233210600
I was able to get syslog to consol re-enabled in the ironic-image.

What did to get it back in working state:
I added ssh-debugging in order to get in the the image and try to run some debugging steps to figure out what was wrong
#226

Then I rebuild the ironic-image to get the required parameters included in the inspector.ipxe.j2- I have this file do to the work in the #226 - and the ironic.conf.j2 and enabled the systemd.journald.forward_to_console=yes

This getting the console logging back I am now able to get the bmh to behave as expected, from inspection to full deployment.

At least for me having the possibility to switch on console logging via a env variable would work better than having to hack the image on every new release.

@knfoo
Copy link
Author

knfoo commented Dec 1, 2020

The changes I did is available in this fork
https://github.com/knfoo/ironic-image

@derekhiggins
Copy link
Member

I've updated #226 to remove console=ttyS0 form the kernel, it can now instead be configured.

@knfoo
Copy link
Author

knfoo commented Dec 2, 2020

That sounds great

@fmuyassarov
Copy link
Member

/kind feature

@metal3-io-bot metal3-io-bot added the kind/feature Categorizes issue or PR as related to a new feature. label Jan 6, 2021
@metal3-io-bot
Copy link
Contributor

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues will close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

/lifecycle stale

@metal3-io-bot metal3-io-bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Apr 6, 2021
@metal3-io-bot
Copy link
Contributor

Stale issues close after 30d of inactivity. Reopen the issue with /reopen. Mark the issue as fresh with /remove-lifecycle stale.

/close

@metal3-io-bot
Copy link
Contributor

@metal3-io-bot: Closing this issue.

In response to this:

Stale issues close after 30d of inactivity. Reopen the issue with /reopen. Mark the issue as fresh with /remove-lifecycle stale.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

bfournie pushed a commit to bfournie/ironic-image that referenced this issue Nov 16, 2021
Bug 2017412: [4.9] fix Image provisioning fails with file name too long
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature Categorizes issue or PR as related to a new feature. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
Projects
None yet
Development

No branches or pull requests

4 participants