Using the (current) latest firmware version (https://github.com/raspberrypi/firmware/releases/tag/1.20190709) I observed that in order to boot a 64bit kernel image I need to force the configuration using arm_64bit=1. The kernel image name (kernel8.img) seems to not be enough for the firmware to put the arm in 64bit mode even though this seems to be the expected behavior (raspberrypi/linux#3057 (comment)).