Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dell PCs (and other systems) with UEFI Secure Boot show grub prompt #48

Closed
IlgazC opened this issue Oct 16, 2020 · 48 comments
Closed

Dell PCs (and other systems) with UEFI Secure Boot show grub prompt #48

IlgazC opened this issue Oct 16, 2020 · 48 comments
Labels
bug Something isn't working

Comments

@IlgazC
Copy link

IlgazC commented Oct 16, 2020

Congratulations for 3.0!

I have written the image to a USB2 drive. Secure boot enabled, it works perfectly on supported Linuxes (Fedora, SUSE). When it boots I am greeted by a Grub shell.

I can give any info or do tests.

I believe it is properly signed otherwise Grub wouldn't appear.

@redorescue redorescue deleted a comment from PROBLEMCHYLD Oct 17, 2020
@zebradots
Copy link
Member

zebradots commented Oct 17, 2020

Thanks for opening this issue. It's unclear what circumstances cause this behavior: Are you saying that when the system boots with Secure Boot enabled it works as expected, but that it does not work as expected with Secure Boot disabled?

Also, are you seeing this behavior on other machines also, or only this particular hardware?

@zebradots zebradots added the question Further information is requested label Oct 17, 2020
@IlgazC
Copy link
Author

IlgazC commented Oct 17, 2020

Thanks for opening this issue. It's unclear what circumstances cause this behavior: Are you saying that when the system boots with Secure Boot enabled it works as expected, but that it does not work as expected with Secure Boot disabled?

Also, are you seeing this behavior on other machines also, or only this particular hardware?

It boots to GRUB prompt when secure boot enabled/UEFI enabled. MBR boot seems to be OK. It should load Linux but shows GRUB shell. Device is already in secure boot mode, I use OpenSUSE TW and Windows 10. Grub is already working on this machine.

@IlgazC
Copy link
Author

IlgazC commented Oct 17, 2020

I also have a Mac Mini 2009 (Intel based, EFI) here. It also boots to GRUB prompt. This eliminates the "secure boot" issue since they aren't secure boot enabled (or even implemented).

@IlgazC
Copy link
Author

IlgazC commented Oct 17, 2020

I downloaded the file again to make sure, it is the exact same file. sha256sum follows:
6b8332012d57f13913031baab56ee9784389237ae6aa44336d264854f39ff27d redorescue-3.0.0.iso

I also used "dd" command this time, same GRUB prompt on both machines.

@RobertHulsebos
Copy link

I have the same here on my Dell XPS 8910 computer. In the UEFI bootmenu I get the option to boot from the USB stick with the iso. But when I do, I only get a grub prompt. Nothing else. System runs Windows 10 only.

@PROBLEMCHYLD
Copy link

PROBLEMCHYLD commented Oct 17, 2020

Yes, its UEFI related because I can boot off cd with no problem if I don't use uefi.

@IlgazC
Copy link
Author

IlgazC commented Oct 17, 2020

For a quick test, I grabbed the latest Debian 10 install image (netboot) from https://cdimage.debian.org/debian-cd/current/amd64/iso-cd/debian-10.6.0-amd64-netinst.iso
It seems to work very fine, booting to Debian Installer not grub. BTW, this was done for "If this machine's UEFI fails to boot Debian" purpose, not like it will be able to run Redo backup.

@RobertHulsebos
Copy link

Tested on my Dell Laptop - same result. Just ending with grub prompt, same as on desktop.
See attached photo for bootmenu...
IMG_20201018_202037

@geleibo
Copy link

geleibo commented Oct 18, 2020 via email

@RobertHulsebos
Copy link

RobertHulsebos commented Oct 19, 2020

Please check the file name in the boot device. If there is a dot, delete it and try again

---Original--- From: "RobertHulsebos"<notifications@github.com> Date: Mon, Oct 19, 2020 02:27 AM To: "redorescue/redorescue"<redorescue@noreply.github.com>; Cc: "Subscribed"<subscribed@noreply.github.com>; Subject: Re: [redorescue/redorescue] HP Pavillon x360 a200nt UEFI secure boot grub prompt (#48) Tested on my Dell Laptop - same result. Just ending with grub prompt, same as on desktop. See attached photo for bootmenu... — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

I do not understand what you mean ... you mean the name of the USB device?

@geleibo
Copy link

geleibo commented Oct 19, 2020

No,The file in USB device. (vmlinuz initrd) I'm write the iso file to usb use Ultraiso . When I check the filename in device,initrd and vmlinuz has a dot .Then boot failed . Remove the dot in filename(initrd vmlinuz) boot succee

@PROBLEMCHYLD
Copy link

Whatever the problem is, its located in filesystem.squashfs. When I replaced it with 2.0.7 everything worked again.

@RobertHulsebos
Copy link

RobertHulsebos commented Oct 19, 2020

No,The file in USB device. (vmlinuz initrd) I'm write the iso file to usb use Ultraiso . When I check the filename in device,initrd and vmlinuz has a dot .Then boot failed . Remove the dot in filename(initrd vmlinuz) boot succee

Don't see any dot here

IMG_20201019_120729

@RobertHulsebos
Copy link

Whatever the problem is, its located in filesystem.squashfs. When I replaced it with 2.0.7 everything worked again.

And how do I do that? ('linux newbie')

@PROBLEMCHYLD
Copy link

Use either 2.0.7 in place of 3.0. I only replace the file to figure out the culprit. I have reported it, if ignored then I'll stick with 2.0.7 because 3.0 is useless.

@zebradots
Copy link
Member

Odd, we have yet to see a machine fail to boot, both with and without Secure Boot enabled, including on virtual hardware. Still searching for more answers as to why this is happening for these particular systems. Please continue to post any information you are able to provide and as soon as we determine a fix for this we'll push a new release.

@PROBLEMCHYLD
Copy link

Maybe it's a bug in the debian version. I'm not going to keep trying to figure it out. 2.0.7 does a good enough job, I'll stick with it.

@RobertHulsebos
Copy link

I have both a desktop and a laptop that show this problem. Both are Dell. I you want me something to test for you, then let me know...

@RobertHulsebos
Copy link

Use either 2.0.7 in place of 3.0. I only replace the file to figure out the culprit. I have reported it, if ignored then I'll stick with 2.0.7 because 3.0 is useless.

You mean you replaced only the filesystem.squashfs file in the ISO? Where can I get the 2.0.7 version of this file? So I can do the same test here...

@PROBLEMCHYLD
Copy link

PROBLEMCHYLD commented Oct 20, 2020

Yes....My laptop is a dell too. Downgrade to 2.0.7. I remove 3.0 completely because it doesn't work. Rebuild your usb with 2.0.7. Until these guys figure it out. Whatever they added to filesystem.squashfs is the problem for me and maybe you.

https://sourceforge.net/projects/redobackup/files/

@RobertHulsebos
Copy link

Yes....My laptop is a dell too. Downgrade to 2.0.7. I remove 3.0 completely because it doesn't work. Rebuild your usb with 2.0.7. Until these guys figure it out. Whatever they added to filesystem.squashfs is the problem for me and maybe you.

https://sourceforge.net/projects/redobackup/files/

Ok. I'll test tonight with 2.0.7. Just to see if I have the same results. Did not try that version before....

@agnivo007
Copy link

agnivo007 commented Oct 20, 2020

Looks like something with grub cfg or kernel boot parameters...

I too have a dell laptop and hp desktop, didn't have the chance yet to try v3, will try tomorrow.
I use ventoy usb drive though.

@RobertHulsebos
Copy link

Yes....My laptop is a dell too. Downgrade to 2.0.7. I remove 3.0 completely because it doesn't work. Rebuild your usb with 2.0.7. Until these guys figure it out. Whatever they added to filesystem.squashfs is the problem for me and maybe you.
https://sourceforge.net/projects/redobackup/files/

Ok. I'll test tonight with 2.0.7. Just to see if I have the same results. Did not try that version before....

I tried USB stick with 2.0.7. Somehow my laptop does not see it as a bootable device. Does version 2.0.7 support UEFI + Secure Boot ?

@IlgazC
Copy link
Author

IlgazC commented Oct 20, 2020

Yes....My laptop is a dell too. Downgrade to 2.0.7. I remove 3.0 completely because it doesn't work. Rebuild your usb with 2.0.7. Until these guys figure it out. Whatever they added to filesystem.squashfs is the problem for me and maybe you.
https://sourceforge.net/projects/redobackup/files/

Ok. I'll test tonight with 2.0.7. Just to see if I have the same results. Did not try that version before....

I tried USB stick with 2.0.7. Somehow my laptop does not see it as a bootable device. Does version 2.0.7 support UEFI + Secure Boot ?
I believe it is strictly MBR only, there were UEFI requests back in 2.x that is how I know.

@RobertHulsebos
Copy link

Yes....My laptop is a dell too. Downgrade to 2.0.7. I remove 3.0 completely because it doesn't work. Rebuild your usb with 2.0.7. Until these guys figure it out. Whatever they added to filesystem.squashfs is the problem for me and maybe you.
https://sourceforge.net/projects/redobackup/files/

Ok. I'll test tonight with 2.0.7. Just to see if I have the same results. Did not try that version before....

I tried USB stick with 2.0.7. Somehow my laptop does not see it as a bootable device. Does version 2.0.7 support UEFI + Secure Boot ?
I believe it is strictly MBR only, there were UEFI requests back in 2.x that is how I know.

Ok. That explains it....

@zebradots
Copy link
Member

zebradots commented Oct 22, 2020

For others finding this thread, please note that 2.0.7 offers neither Secure Boot nor UEFI, and is strictly MBR. This is by design, and for those users who cannot make use of the UEFI ISO (either due to Redo-specific issues or less-than-ideal EFI implementations with their hardware), it is always possible to use the 2.0 series release instead until a workaround for UEFI on these specific machines can be found.

Edit: Release 3.0.1 is now available now, in case it has any impact on this issue.

@zebradots zebradots changed the title HP Pavillon x360 a200nt UEFI secure boot grub prompt Dell systems with UEFI Secure Boot show grub prompt Oct 22, 2020
@zebradots
Copy link
Member

zebradots commented Oct 22, 2020

(Note: We realize that this issue might affect more than just Dell systems, but this title may help narrow it down more quickly.)

Could the EFI implementation on affected systems be looking in a case-sensitive directory name at boot time? In other words, could it somehow make a difference whether the directories are named EFI or efi on some machines? There is likely some trivial difference here; it works fine for many other systems, so it isn't completely broken.

If anyone with an affected machine can execute GRUB commands to help determine what may be different about these systems, it would be greatly appreciated, as we are unable to reproduce this error on any hardware so far.

@zebradots zebradots changed the title Dell systems with UEFI Secure Boot show grub prompt Dell PCs (and other systems) with UEFI Secure Boot show grub prompt Oct 22, 2020
@PROBLEMCHYLD
Copy link

Things are working in 3.0.1. Thanks

@RobertHulsebos
Copy link

(Note: We realize that this issue might affect more than just Dell systems, but this title may help narrow it down more quickly.)

Could the EFI implementation on affected systems be looking in a case-sensitive directory name at boot time? In other words, could it somehow make a difference whether the directories are named EFI or efi on some machines? There is likely some trivial difference here; it works fine for many other systems, so it isn't completely broken.

If anyone with an affected machine can execute GRUB commands to help determine what may be different about these systems, it would be greatly appreciated, as we are unable to reproduce this error on any hardware so far.

Version 3.0.1 still not working on my Dell Inspiron 17 laptop. I can execute grub commands. Let me know how I can be of assistance...

@zebradots
Copy link
Member

zebradots commented Oct 22, 2020

@RobertHulsebos: As you may already know, Rescuezilla is a fork of a much older version of Redo from 2012. However, the developer recently implemented UEFI support for that project. Out of curiosity, does the latest release of Rescuezilla boot properly in UEFI Secure Boot mode on your hardware? Also, you mentioned in a previous post that you have both a desktop and laptop that were not booting. Does the desktop boot properly on 3.0.1 now?

@RobertHulsebos
Copy link

@RobertHulsebos: As you may already know, Rescuezilla is a fork of a much older version of Redo from 2012. However, the developer recently implemented UEFI support for that project. Out of curiosity, does the latest release of Rescuezilla boot properly in UEFI Secure Boot mode on your hardware? Also, you mentioned in a previous post that you have both a desktop and laptop that were not booting. Does the desktop boot properly on 3.0.1 now?

On my Dell XPS8190 desktop I have the same result with 3.0.1 as on my laptop - still ending up in grub. So no improvement...
IMG_20201022_194018

@RobertHulsebos
Copy link

I also tried Rescuezilla 2.0 iso. Booting from same USB stick, same desktop. This seems to work OK for as far as booting is concerned. (I did not test the actual making of a backup)
Let me know if you need any further testing...
IMG_20201022_195949

@zebradots
Copy link
Member

zebradots commented Oct 22, 2020

Based on the fact that GRUB does in fact load, and that Secure Boot appears to at least get to this stage without any complaint, it seems that the problem lies in GRUB's ability to take the next step to boot. We suspect that this may have something to do with the following:

search --file /REDO --set root
set prefix=($root)/boot/grub

Previously, the grub.cfg file was copied into the EFI directory in full, but during testing we later created a simpler file that simply pointed to the "master" grub.cfg file's location. Anyone with an intimate understanding of GRUB is welcome to chime in or take a peek at the steps taken in the make script as the ISO is compiled. In the meantime, this is the first place we're going to look.

@agnivo007
Copy link

#51 Hardware/test report can be submitted here if anyone wishes.

@zebradots
Copy link
Member

zebradots commented Oct 23, 2020

#51 Hardware/test report can be submitted here if anyone wishes.

Thank you @agnivo007 for creating that thread to track different outcomes.

Those with an affected system may try entering the above two lines manually into the GRUB prompt to see if it provides any helpful output or error messages.

@agnivo007
Copy link

@zebradots , you may consult and take this issue with the ventoy developers at https://github.com/ventoy with the boot/uefi/grub issue.

They are the boot specialists as far as I've seen and have developed a great product.
I think admin@ventoy.net would be more than helpful to assist, he looks quite active.

@RobertHulsebos
Copy link

#51 Hardware/test report can be submitted here if anyone wishes.

Thank you @agnivo007 for creating that thread to track different outcomes.

Those with an affected system may try entering the above two lines manually into the GRUB prompt to see if it provides any helpful output or error messages.

I tried the two lines, but they did not give any response at all...
I noticed though, that some other grub commands give an error response. (see picture) Are they supposed to ?
IMG_20201023_212920

@agnivo007
Copy link

How about:
search --file /REDO --set root
set prefix=($root)/boot/grub
insmod normal
normal

@zebradots
Copy link
Member

zebradots commented Oct 24, 2020

Anyone encountering this issue: Please download and try redorescue-3.0.2-BETA.iso from the SourceForge download page.

This test release image includes a configuration change that may correct the GRUB boot prompt issue. If it appears to work, we will push these changes to the repo and finalize a new release for 3.0.2. Unfortunately, we cannot reproduce this error because all our systems boot properly, so this one is difficult to troubleshoot.

@agnivo007
Copy link

Best of luck for the fix...

However, did the insmod normal, normal additions to grub prompt work? Eager to know...

@RobertHulsebos
Copy link

Best of luck for the fix...

However, did the insmod normal, normal additions to grub prompt work? Eager to know...

Yes. They did work! After entering the 'normal' command the Redo application is started automatically and I get this ...

IMG_20201024_100455

@agnivo007
Copy link

agnivo007 commented Oct 24, 2020

Great! Hope @zebradots noted it...
search --file /REDO --set root set prefix=($root)/boot/grub insmod normal normal
It was actually a lesson learnt while trying to fix a non booting linux install which dropped off to grub prompt.
Then it booted and I did a update-grub and grub-install which fixed everything.

@zebradots
Copy link
Member

search --file /REDO --set root
set prefix=($root)/boot/grub
insmod normal
normal

Our understanding is that the insmod normal and normal commands are probably only necessary once booting has failed and you've landed at GRUB's rescue mode prompt (the mode shown in all the screenshots above). Several documentation pages about GRUB indicate that the normal module is usually loaded automatically:

Once GRUB is thus running, the first thing it will do is to try and load the module called normal. (Source: GRUB 2 on a lower level)

However, invoking the normal module won't work until the $root and $prefix are set correctly, which is exactly what we've addressed in the beta version released yesterday. Has anyone facing this issue tried the test release yet?

If the 3.0.2-BETA ISO boots properly, we will prepare a final 3.0.2 release immediately.

@zebradots zebradots pinned this issue Oct 24, 2020
@IlgazC
Copy link
Author

IlgazC commented Oct 24, 2020

search --file /REDO --set root
set prefix=($root)/boot/grub
insmod normal
normal

Our understanding is that the insmod normal and normal commands are probably only necessary once booting has failed and you've landed at GRUB's rescue mode prompt (the mode shown in all the screenshots above). Several documentation pages about GRUB indicate that the normal module is usually loaded automatically:

Once GRUB is thus running, the first thing it will do is to try and load the module called normal. (Source: GRUB 2 on a lower level)

However, invoking the normal module won't work until the $root and $prefix are set correctly, which is exactly what we've addressed in the beta version released yesterday. Has anyone facing this issue tried the test release yet?

If the 3.0.2-BETA ISO boots properly, we will prepare a final 3.0.2 release immediately.

It works! I tested both "non secure boot" and "secure boot" options. Thanks for your time. HP Pavilion x360 here (I am the original bug reporter)

@zebradots
Copy link
Member

zebradots commented Oct 24, 2020

Excellent! We will push the commits and prepare a new release. Thank you so much for taking time to report this issue and confirm that it has been fixed.

Edit: Fixed with commit df0a00f. Release 3.0.2 coming soon.

@zebradots zebradots added bug Something isn't working and removed question Further information is requested labels Oct 24, 2020
@zebradots zebradots unpinned this issue Oct 25, 2020
@agnivo007
Copy link

My comment might be too naive, but if any other volume has a "REDO" directory or file entry on it, will not grub be confused with the commit you posted?

@zebradots
Copy link
Member

@agnivo007, you are correct. If another file named "REDO" exists on the boot media, GRUB could mistakenly assume that it was the root location. While this is theoretically possible, we suspect the likelihood is rather slim. Also, this is the same method used since UEFI was introduced, and was already present before the most recent commit referenced above (see https://github.com/redorescue/redorescue/blob/master/overlay/image/boot/grub/grub.cfg, where these lines also appear).

@ghost
Copy link

ghost commented Feb 18, 2022

#18 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

6 participants