resize_window sometimes doesn't work

[Nudin]

Describe the bug
As suggested in the documentation, I mapped resize_window to four keys to resize windows faster. Sometimes, a resize operation doesn't work anymore – for example, the window can't be made taller with the key mapped to resize_window taller – but if I use ctr+r and then t that works normally. And sometimes that doesn't work either.

To Reproduce
Steps to reproduce the behavior:

1. Map keys map kitty+up resize_window taller 1 and map kitty+down resize_window shorter 1 and use layout Vertical
2. Open Kitty
3. Create 4 windows
4. Resize the first window by once kitty+up
5. Try to resize the last window by multiple kitty+up – it doesn't work. But ctrl+shift+r followed by t works.

Screenshots

Environment details

kitty 0.24.4 created by Kovid Goyal
Linux numberX1 5.16.14-zen1-1-zen #1 ZEN SMP PREEMPT Fri, 11 Mar 2022 17:40:33 +0000 x86_64
Arch Linux 5.16.14-zen1-1-zen (/dev/tty)

DISTRIB_ID="Arch"
DISTRIB_RELEASE="rolling"
DISTRIB_DESCRIPTION="Arch Linux"
Running under: X11
Frozen: False
Paths:
  kitty: /usr/bin/kitty
  base dir: /usr/lib/kitty
  extensions dir: /usr/lib/kitty/kitty
  system shell: /bin/bash
Loaded config files:
  /home/michi/.config/kitty/kitty.conf

Config options different from defaults:
active_tab_font_style (True, False)
bold_font             Fira Code Bold
bold_italic_font      Hasklig Bold Italic
close_on_child_death  True
cursor_blink_interval 0.0
editor                nvim
enable_audio_bell     False
enabled_layouts       ['vertical', 'fat', 'tall', 'splits', 'stack']
font_family           FiraCode-Regular
inactive_text_alpha   0.85
initial_window_height (1005, 'px')
initial_window_width  (1100, 'px')
italic_font           Hasklig Italic
remember_window_size  False
scrollback_lines      100000
tab_bar_edge          1
tab_bar_style         separator
tab_separator          │ 
visual_bell_duration  0.01
Added shortcuts:
	f4 → toggle_marker function /home/michi/test.py
	f9 → launch --location=hsplit
	f10 → launch --location=vsplit
	f11 → layout_action rotate
	shift+left → move_window left
	shift+right → move_window right
	shift+up → move_window up
	shift+down → move_window down
	alt+escape → kitten kitty_grab/grab.py
	alt+left → neighboring_window left
	alt+right → neighboring_window right
	alt+up → neighboring_window up
	alt+down → neighboring_window down
	ctrl++ → change_font_size all +1
	ctrl+- → change_font_size all -1
	ctrl+shift+/ → launch --allow-remote-control kitty +kitten search.py @active-kitty-window-id
	ctrl+shift+p → scroll_to_mark prev
	ctrl+shift+alt+enter → new_window @ bash -c "echo Warning! Kitty Remote Control active!; bash"
Removed shortcuts:
	ctrl+shift+- → change_font_size all -2.0
	ctrl+shift+p > f → kitten hints --type path --program -
	ctrl+shift+p > h → kitten hints --type hash --program -
	ctrl+shift+p > l → kitten hints --type line --program -
	ctrl+shift+p > n → kitten hints --type linenum
	ctrl+shift+p > w → kitten hints --type word --program -
	ctrl+shift+p > y → kitten hints --type hyperlink
	ctrl+shift+p > shift+f → kitten hints --type path
Changed shortcuts:
	ctrl+shift+f → kitten hints --type path --program -
	ctrl+shift+n → scroll_to_mark next
	ctrl+shift+t → new_tab_with_cwd
	ctrl+shift+z → goto_layout stack
	ctrl+shift+enter → new_window_with_cwd
	ctrl+shift+left → resize_window narrower -1
	ctrl+shift+right → resize_window wider -1
	ctrl+shift+up → resize_window taller 1
	ctrl+shift+down → resize_window shorter 1
	ctrl+shift+f11 → layout_action rotate

Important environment variables seen by the kitty process:
	PATH                                /usr/local/sbin:/usr/local/bin:/usr/bin:/usr/lib/jvm/default/bin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl
	LANG                                de_DE.UTF-8
	SHELL                               /bin/bash
	DISPLAY                             :0
	USER                                michi
	XCURSOR_SIZE                        24
	XDG_SESSION_PATH                    /org/freedesktop/DisplayManager/Session1
	XDG_SEAT                            seat0
	XDG_SESSION_DESKTOP                 KDE
	XDG_SESSION_TYPE                    x11
	XDG_CURRENT_DESKTOP                 KDE
	XDG_SEAT_PATH                       /org/freedesktop/DisplayManager/Seat0
	XDG_SESSION_CLASS                   user
	XDG_VTNR                            1
	XDG_SESSION_ID                      2
	XDG_RUNTIME_DIR                     /run/user/1000
	XDG_CONFIG_DIRS                     /home/michi/.config/kdedefaults:/etc/xdg

Additional context
Reproducible with kitty.conf only with:

map kitty+left resize_window narrower 1
map kitty+right resize_window wider 1
map kitty+up resize_window taller 1
map kitty+down resize_window shorter 1