Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support swap Fn and CtlL keys (how it should be) for the x200, middleton #32

Open
wants to merge 6 commits into
base: master
from

Conversation

Projects
None yet
3 participants
@ypid
Copy link
Contributor

commented Jun 18, 2017

For older Thinkpad models like the xx00 series the EC can not be configured to swap Fn and Ctrl. This setting would usually be exposed in the BIOS setup or in nvram when using coreboot. Enabled by default for models where this can not be configured.

Updates: #4
Status: Confirmed working on a x200. My x200 shipped with libreboot so I don’t have the factory rom which would come in handy to flash the EC :) Edit: Got it :)

I will do a bit more work on this: https://notabug.org/libreboot/libreboot/issues/146#issuecomment-5006

@hamishcoleman

This comment has been minimized.

Copy link
Owner

commented Jun 20, 2017

One reason why the generated x200 img file might not boot could be the fix-hdd-image-%i.patch files.

There are only two - one for each of two sizes of hdd image, so if the hdd is neither 65536 sectors nor 75776 sectors, there is no patch.

I've just added code to check for the lack of a matching disk image patch on the master branch. If you do have a third disk image size, I probably should bite the bullet and write a tool to fix the partition table.

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Jun 20, 2017

I probably should bite the bullet and write a tool to fix the partition table.

A generic solution is always preferred. Maybe one already exists? Have not checked yet.

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Jun 23, 2017

Lucky you, the old BIOS version used an 24117248 byte image (base for the patch by middleton) but the newer BIOS version uses a supported 38797312 byte image (same EC fw version). Forward porting the patch.

@ypid ypid force-pushed the ypid:add-x200 branch 2 times, most recently from 8b835c6 to ea0f296 Jun 24, 2017

@ypid ypid changed the title [WIP] Support swap Fn and CtlL keys (how it should be) for the x200, middleton Support swap Fn and CtlL keys (how it should be) for the x200, middleton Jun 24, 2017

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Jun 24, 2017

Updated. I ported the patch to the latest EC firmware version to benefit from the battery charging fix from it. I confirmed that the ctrl fn swap works using all added patched images on a x200.

Unfortunately, just as I wanted to actually start using the laptop, I bricked it! I must have gotten the timing just right after the dos tool finished and rebooted into the bios (where the EC fw is transfered from SPI flash to EC flash as it seems) when I unplugged the USB DVD rom drive I tested with to confuse the BIOS and interrupt the EC flashing. But that was after I confirmed that patched.x200.iso works. I added a warning to the readme …

@ypid ypid force-pushed the ypid:add-x200 branch from ea0f296 to fb0aeb8 Jun 24, 2017


patch_disable_fn_ctrl_swap:
$(call patch_disable,008_fn_ctrl_swap.patch)

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

This method for enabling and disabling patches has gotten unwieldy, especially since there are now multiple non-overlapping hardware types with different sets of patches.

This comment has been minimized.

Copy link
@ypid

ypid Jun 26, 2017

Author Contributor

True. One the other hand, three patches are not that much either. If more get added then it should probably be optimized.

This comment has been minimized.

Copy link
@hamishcoleman
Makefile Outdated
$(info patched.t430.257.112.img - for patching Thinkpad T430 BIOS 2.57/EC 1.12 - no keyboard patch)
$(info patched.x200.314.106.img - for patching Thinkpad x200 and x200s BIOS 3.14/EC 1.06 - only Fn Ctrl swap (middleton))
$(info patched.x200.322.106.img - for patching Thinkpad x200 and x200s BIOS 3.22/EC 1.06 - only Fn Ctrl swap (middleton))
$(info patched.x200.img - for patching Thinkpad x200 and x200s BIOS 3.22/EC 1.07 - only Fn Ctrl swap (ported middleton))

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

This list is getting a little long to be quickly understandable - perhaps splitting it up in some way would help.. Any thoughts?

This comment has been minimized.

Copy link
@ypid

ypid Jun 26, 2017

Author Contributor

Valid point. I gave it a try. The latest version should be enough for list_laptops.

Makefile Outdated
cp --reflink=auto $< $@
./mec-tools/mec_csum_outer -f $@
./mec-tools/mec_csum_outer -c $@

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

I dont want to add another new "csum_ok" file type - instead, in the rule where the %.img file is created, it should either fix the checksum or not allowed the file to be created.

This comment has been minimized.

Copy link
@ypid

ypid Jun 26, 2017

Author Contributor

Excellent idea! This simplifies this case.

else \
cp --reflink=auto autoexec.bat.template $@.tmp; \
fi
sed -e "s%__DIR%`mdir -/ -b -i $<@@$(FAT_OFFSET) |grep FL2 |cut -d/ -f3 | head -n 1`%; s%__FL2%`mdir -/ -b -i $<@@$(FAT_OFFSET) |grep FL2 |cut -d/ -f4 | head -n 1`%; s%__DESC%`scripts/describe $<`%; s/__BUILDINFO/$(BUILDINFO)/" --in-place $@.tmp

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

This is an ugly special case check. See also below where I talk about autoexec.bat.command_com.template

Makefile Outdated
mec-tools/mec_csum_outer: mec-tools/Makefile
git submodule update
make -C mec-tools

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

This is an exact repeat of the mec-tools/mec_encrypt - instead of duplicating it, there should be a known "tag file" in the mec-tools dir that only exists after a compile, and all rule to watch the mec-tools contents and build that tag file. Then all rules that need mec-tools will depend on that builder rule.

This comment has been minimized.

Copy link
@ypid

ypid Jun 26, 2017

Author Contributor

Good catch, fixed.

echo.
pause
echo on
command.com

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

Can you expand a little on what this is actually doing? Have Lenovo built a custom command.com? If so, what is interpreting this batch script?

This comment has been minimized.

Copy link
@ypid

ypid Jun 26, 2017

Author Contributor

Not a batch script but some binary blob which was invoked exactly the same by the original autoexec.bat. I simply copied last line from the original file.

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 29, 2017

Owner

Looking closer, it seems that /FLASH/COMMAND.COM is a compiled script which calls /FLASH/UPDTFLSH.EXE - another compiled script - which in turn calls FLASH/PHLASH16.EXE - and it looks like that one has some commandline options for specifying which files to flash.

I also wonder if the default flash scripts will allow you to re-flash a "same version" image - the xx30 tools certainly didnt, which is why zmatt worked out the dosflash commandline options.

Either way, to clean this up, it looks like some thought will be needed on how to make the autoexec bat generation better in the future.

This comment has been minimized.

Copy link
@ypid

ypid Jun 29, 2017

Author Contributor

I also wonder if the default flash scripts will allow you to re-flash a "same version" image

This seems not to be an issue here. The EC firmware could just be downgraded with the patched.x200.314.106 image/flasher. I can confirm that this worked. I also tried to increase the version numbers but this was not reflected in the BIOS message. To be continued.

PHLASH16.EXE

This is worth a try, thanks!

@@ -4,7 +4,8 @@ cd c:\flash
cls
echo.
echo.
echo This will flash your firmware to support a classic 7-row keyboard
echo This will flash your EC firmware to support a classic 7-row keyboard (default)
echo or other modifications as configured at modification time.

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

The build system should probably keep track of which patches are enabled and applied and insert that here, to be 100% clear and correct

For older Thinkpad models like the xx00 series the EC can not be configured
to swap Fn and Ctrl. This setting would usually be exposed in the BIOS setup
or in nvram when using coreboot.
Enabled by default for models where this can not be configured.

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

Possibly need to make it clear which patches are available for which types of laptop


if [ "$RM_ON_FAIL" ]; then
rm $FILE
rm "$FILE"
fi

exit 1

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

all these "fixes" patches should go into a separate patch and PR (similarly with some of the copyFL2 stuff below)

This comment has been minimized.

Copy link
@ypid

ypid Jun 26, 2017

Author Contributor

True, I started with this one and moved it out of this PR and into #34. I will address your other comments in a few days :)

exit 1
fi
done
fi

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 26, 2017

Owner

This is all way too complex. I've been thinking about it and now think that the caller should simply provide an arg that is the pattern to match. It could default to "FL2", but for the x200, it could be told to use "01B9x00.FL2" as the pattern, then the same "more than one match" logic could apply.

This comment has been minimized.

Copy link
@ypid

ypid Jun 26, 2017

Author Contributor

It just works already. Your proposal would require more work for people adding such images with more than one FL2 file. Can‘t we just stay with this? I tried to validate all cases so that it should not break something.

This comment has been minimized.

Copy link
@hamishcoleman

hamishcoleman Jun 29, 2017

Owner

It doesnt require any additional work - there is already an assumption that you have the correct linux filename for the FL2 file (though, I see you have just used 'x' in that filename)

Also, I have already found ISO files from Lenovo where they have included multiple, unrelated FL2 files.

Finally, I'm trying to move towards a state where none of the inner names are hidden - and all are visible in the Makefile - which would then allow me to build an auto dependency maker and remove those hardcoded lists from the Makefile. So adding this as a param actually makes work simpler in the future.

I have added the pattern matching feature described here to the master branch as I hope that might make it clearer.

@hamishcoleman

This comment has been minimized.

Copy link
Owner

commented Jun 26, 2017

Ouch! thats good to know about plugging things in during flashing, but sorry that you had to brick something to learn it.

There looked to be a Russian website that had EC flash-programmers, so you might find that there is a way to attach an in system programmer.

Do you have schematics for the x200? I had a look at my x220 schematics and it looks like most of the JTAG pins were easily accessible (all but the CLK and RST lines are wired out to the KBDID$n pins on the x220)

@ypid ypid force-pushed the ypid:add-x200 branch from 0e9a317 to aedd6cb Jun 26, 2017

ypid added some commits Jun 15, 2017

Support swap Fn and CtlL keys (how it should be) for the x200, middleton
For older Thinkpad models like the xx00 series the EC can not be configured
to swap Fn and Ctrl. This setting would usually be exposed in the BIOS setup
or in nvram when using coreboot.
Enabled by default for models where this can not be configured.

Updates: #4
Ensure the outer EC fw checksum is always fixed after patching
The outer checksum has been observed on all Lenovo EC firmware files
analyzed so far. This avoids the special case for the x200 which only
has the outer checksum.

ypid added a commit to ypid/thinkpad-ec that referenced this pull request Jun 26, 2017

@ypid ypid force-pushed the ypid:add-x200 branch from e4995dd to 4e43dd5 Jun 26, 2017

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Jun 29, 2017

Yes, the manual mentions JTAG and also a on-board programming mode so it should be possible. And yes, I got lucky and have all the schematics :-) I already had a detailed look at the board with OpenBoardView. I will get back to this PR when I have tested it again. To speed this up, I ordered a second MB.

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Jul 3, 2017

Nice work on the master branch! I will need to rebase this PR later :)

I tested with a second MB and bricked it again. Seems I am becoming good at this :) One thing I noticed is that the dos flashing tool checks the EC checksum and refuses to do anything when it is not correct.

From BIOS 3.21/EC 1.06 → BIOS 3.14/EC 1.06

  • Did not reflash the EC

From BIOS 3.14/EC 1.06 → BIOS 3.22/EC 1.06

  • Warning mentions to either eject CD before reboot or after reboot finished, but not in between. Earlier versions did not mention this which is why I bricked my first one :)
  • Did not reflash the EC

From BIOS 3.22/EC 1.06 → BIOS 3.14/EC 1.06 (increased EC version to 7XHT24WX)

  • Did not reflash the EC

From BIOS 3.14/EC 1.06 → BIOS 3.14/EC 1.09 7XHT26WW (manually increased EC version)

  • Did reflash the EC
  • Bricked the EC
@@ -32,9 +32,9 @@
 000001f0  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
 00000200  43 4f 52 50 2e 20 49 42  4d 20 32 30 30 31 20 41  |CORP. IBM 2001 A|
 00000210  4c 4c 20 52 49 47 48 54  53 20 52 45 53 45 52 56  |LL RIGHTS RESERV|
-00000220  45 44 00 00 00 00 00 00  10 60 b9 00 13 74 62 b4  |ED.......`...tb.|
+00000220  45 44 00 00 00 00 00 00  10 90 b9 00 13 74 62 b4  |ED...........tb.|
 00000230  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
-00000240  37 58 48 54 32 34 57 57  5f 5f 5f 5f 5f 5f 5f 5f  |7XHT24WW________|
+00000240  37 58 48 54 32 36 57 57  5f 5f 5f 5f 5f 5f 5f 5f  |7XHT26WW________|
 00000250  03 06 03 10 00 00 00 00  00 00 00 00 00 00 00 00  |................|
 00000260  00 00 00 00 28 43 29 20  43 6f 70 79 72 69 67 68  |....(C) Copyrigh|
 00000270  74 20 49 42 4d 20 43 6f  72 70 2e 20 32 30 30 31  |t IBM Corp. 2001|
@hamishcoleman

This comment has been minimized.

Copy link
Owner

commented Jul 4, 2017

Now it sounds like you need to start practising hardware flashing :-(

It is good that the flash tools check the checksum - that at least means that we know we are not accidentally flashing bad data. Did you do any tests with the phlash16.exe tool?

I know I made big changes to the master - effectively forcing a rebase, but what we have now is pretty close to what was in my head. It should allow supporting multiple different major types of hardware in a straight-forward way. There are still a bunch of things I can see to change, but I think it is time for me to go back to waiting until the feature is needed before ripping the infrastructure apart

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Jul 4, 2017

Now it sounds like you need to start practising hardware flashing :-(

Sooner or later that will come in handy. Will probably require a bit of SMD soldering to change the mode of the EC and a second read of the data sheet.

Did you do any tests with the phlash16.exe tool?

I gave it a quick try but got "Cannot flash when Memory Manager (e.g. HIMEM) are present".

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Aug 3, 2017

Just a little update: I still intend to finish this project, rebase the PR and work on getting it merged. But currently I don’t find much time. Maybe in a couple of months. Two more working motherboards are waiting to be bricked (really cheap on ebay) and one day hopefully all of them can be un-bricked and put into service :)

@hamishcoleman

This comment has been minimized.

Copy link
Owner

commented Aug 4, 2017

Thanks for the update - I've been busy and away myself, so have not had much time to spare either.

I might have some time before you do, so - if you dont have any objections - I might be able to rebase and start merging sooner than you (with appropriate warnings about bricking, it seems :-(

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Aug 4, 2017

Thanks! No objections from my side. About the bricking: It seems like the M$ Windows tool might be more resilient here. middleton provided patches for dozens of IBM/Lenovo models and users reported basically no issues. Anyway, it has to work without Windows, especially for the X200 :)

@herbsmn

This comment has been minimized.

Copy link

commented Aug 1, 2018

I have an x200 with libreboot on it and would love to liberate the EC. It sounds like work is still being done to make this process stable though. Is that correct?

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Aug 2, 2018

Not right now unfortunately as far as I know. I linked to a few other places. Also swiftgeek is interested in this and might be able to help you. Feel free to pick up where we left off.

@herbsmn

This comment has been minimized.

Copy link

commented Aug 5, 2018

So does this support any libreboot supported laptops? I also asked this question over here: lynxis/frenc#1

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Aug 6, 2018

This particular PR you asked in does. I successfully tested it on Libreboot until I bricked it. As I see it, the system firmware and the EC firmware are two separate things which don't interact that much, other than system firmware updating the EC firmware (probably not supported by Libreboot yet) and configuration of the EC from the system firmware setup (Supported by Libreboot). About frenc: This is very hardware dependent. Different Thinkpads use different ECs. If you are lucky, similar models might share the same EC. Please check the docs of this project where some details are documented and learn the background. What you want requires work that does not do itself/by other people. You can either commit to it and spend a lot of time or we don't have a free EC firmware for the xx00 until somebody else commits to do it.

@herbsmn

This comment has been minimized.

Copy link

commented Aug 20, 2018

@ypid: What model of libreboot laptop were you using with @lynxis' liberated h8s EC? How well did it work? Did the liberated EC cause the laptop to get bricked? Also, how did you flash it on the laptop? The instructions aren't very well developed.

@ypid

This comment has been minimized.

Copy link
Contributor Author

commented Aug 20, 2018

I can not help you much here. I only flashed the stock/factory EC firmware (slightly patched) using the update mechanism which is supposed to be used by end users (done as part of system firmware update). I have not played with the EC firmware rewrite but I am aware of it and would appreciate a free EC firmware.

@herbsmn

This comment has been minimized.

Copy link

commented Aug 20, 2018

@ypid Thanks for the response. I misread your last comment. I too would appreciate a free EC firmware.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.