Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

xen hypervisor allocated kernel memory conflicts with E820 #8791

Open
i27i13 opened this issue Dec 25, 2023 · 5 comments
Open

xen hypervisor allocated kernel memory conflicts with E820 #8791

i27i13 opened this issue Dec 25, 2023 · 5 comments
Labels
affects-4.2 This issue affects Qubes OS 4.2. C: installer C: kernel C: Xen hardware support needs diagnosis Requires technical diagnosis from developer. Replace with "diagnosed" or remove if otherwise closed. P: default Priority: default. Default priority for new issues, to be replaced given sufficient information. T: bug Type: bug report. A problem or defect resulting in unintended behavior in something that exists. waiting for upstream This issue is waiting for something from an upstream project to arrive in Qubes. Remove when closed.

Comments

@i27i13
Copy link

i27i13 commented Dec 25, 2023

How to file a helpful issue

Qubes OS release

Qubes OS 4.2.0

Brief summary

My journey started here:
Details about my hardware (which is not on the HCL list)
https://forum.qubes-os.org/t/cannot-install-qubesos-always-booting-to-a-black-screen/22559/1
Progress begins at post #22 and over!
https://forum.qubes-os.org/t/cannot-install-qubesos-always-booting-to-a-black-screen/22559/22

Black screen regardless of which option I select when trying to install Qubes OS.
I had the issue with 4.1.2, but could finally successfully install when selecting:
Install Qubes OS R4.1.2 - Latest kernel
Press e to modify booting
On the line:
multiboot2 /images/pxeboot/xen.gz
add:
dom0_max_vcpus=16 dom0_vcpus_pin

I tried the same with 4.2.0, without any luck.
I also tried (on the second line): acpi=off nomodeset=0, without any luck :/

When booting & selecting:
Install Qubes OS
Test media
Troubleshooting
2023-12-25_16-39-06

Editing & adding:
vga=,keep
I can see that the last two lines were (otherwise, just a black screen):
xen hypervisor allocated kernel memory conflicts with E820
(XEN) Hardware Dom0 halted: halting machine

Then the screen freezes, nothing becomes responsive, and I must manually restart the PC.
2023-12-25_15-15-28

When booting & selecting:
Install Qubes OS - Latest kernel

The last 3 lines I get are:
(XEN) Freed 644kB init memory
about to get started…
(XEN) Hardware Dom0 halted: halting machine

Then the screen freezes, nothing becomes responsive, and I must manually restart the PC.
2023-12-25_15-08-35

Steps to reproduce

Boot & select the right "USB"

Expected behaviour

Boot with the 64 threads and install without any faults!

Actual behavior

Black screen, but modifying the booting by adding:
vga=,keep
allows me to see the generated errors.

@i27i13 i27i13 added P: default Priority: default. Default priority for new issues, to be replaced given sufficient information. T: bug Type: bug report. A problem or defect resulting in unintended behavior in something that exists. labels Dec 25, 2023
@andrewdavidwong andrewdavidwong added C: installer C: Xen hardware support needs diagnosis Requires technical diagnosis from developer. Replace with "diagnosed" or remove if otherwise closed. affects-4.2 This issue affects Qubes OS 4.2. C: kernel labels Dec 25, 2023
@walwan
Copy link

walwan commented Dec 27, 2023

from the error message given by Xen, this looks like a Xen's memory allocation issue. U may report this to Xen upstream as well.

@i27i13
Copy link
Author

i27i13 commented Dec 28, 2023

from the error message given by Xen, this looks like a Xen's memory allocation issue. U may report this to Xen upstream as well.

How/Where do I do that? I am far away from being an advanced user :(

@marmarek
Copy link
Member

This was already discussed on XenDevel matrix channel, we tried few things, but no any conclusion yet... A proper email to xen-devel mailing list would be useful.

@i27i13
Copy link
Author

i27i13 commented Dec 31, 2023

This was already discussed on XenDevel matrix channel, we tried few things, but no any conclusion yet... A proper email to xen-devel mailing list would be useful.

sorry, but with out an example, I could not do anything.
https://www.list.org/mailman-member/node41.html

I am far a way from being as capable as a "normal" person, and doing that little thing is something that I cannot do.
Thanks for the tip thoug :)

@byteit101
Copy link

I too have ran into this, though not involving qubes. I signed up for that list and sent an email regarding this issue. I have copied it below for reference:

To: xen-devel@lists.xenproject.org
Subject: E820 memory allocation issue on Threadripper platforms

Hi,

I ran into a memory allocation issue, I think. It is the same as 
https://github.com/QubesOS/qubes-issues/issues/8791 and I saw at the end it was 
recommended (by marmarek) that the issue reporter forward the issue to this list. 
I searched the list, but as I didn't see it in the list already, I'm doing that now.

Hardware:
I have an AMD Threadripper 7960X on a ASRock TRX50 WS motherboard. The Qubes reporter 
had a Threadripper 3970X on an ASUS Prime TRX40-Pro Motherboard. I saw a 3rd issue 
report of a similar issue on another Threadripper, so I think this may be Threadripper-specific.

Setup:
The QuebesOS reporter was using Qubes Installer.
My install was that I had a fresh install of Debian 12 (no gui), and then did 
`apt install xen-system-amd64` and rebooted.

The issue:
Any boot of Xen on the hardware results in a halted machine. When monitoring the logs 
with `vga=,keep`, we get:

(XEN) *** Serial input to DOM0 (type 'CTRL-a' three times to switch input)
(XEN) Freed 644kB init memory
mapping kernel into physical memory
about to get started…
xen hypervisor allocated kernel memory conflicts with E820
(XEN) Hardware Dom0 halted: halting machine

None of the settings I or the Qubes reporter have tried have been able to get past this failure.

I am happy to provide debugging support.

@i27i13 for future reference, you first send an email to xen-devel-request@lists.xenproject.org with a subject of subscribe, then it will email you back, and you click the link to confirm. After that is done, you are subscribed and you can just send an email to xen-devel@lists.xenproject.org

@andrewdavidwong andrewdavidwong added diagnosed Technical diagnosis has been performed (see issue comments). waiting for upstream This issue is waiting for something from an upstream project to arrive in Qubes. Remove when closed. needs diagnosis Requires technical diagnosis from developer. Replace with "diagnosed" or remove if otherwise closed. and removed needs diagnosis Requires technical diagnosis from developer. Replace with "diagnosed" or remove if otherwise closed. diagnosed Technical diagnosis has been performed (see issue comments). labels Jan 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-4.2 This issue affects Qubes OS 4.2. C: installer C: kernel C: Xen hardware support needs diagnosis Requires technical diagnosis from developer. Replace with "diagnosed" or remove if otherwise closed. P: default Priority: default. Default priority for new issues, to be replaced given sufficient information. T: bug Type: bug report. A problem or defect resulting in unintended behavior in something that exists. waiting for upstream This issue is waiting for something from an upstream project to arrive in Qubes. Remove when closed.
Projects
None yet
Development

No branches or pull requests

5 participants