XMonad.Hooks.DynamicLog corrupt non-ASC characters

[PRESFIL]

Problem Description

I switched from xmonad-contrib==0.16-31+xmonad==0.15-51 to xmonad-contrib-git+xmonad-git. Now, in xmobar==0.35.31 characters are corrupted:

NOTE: last commit on git version - 58feba91d96fee8339d7cf56fb33537be819eb4b

Then, i switching back to xmonad-contrib==0.16-31+xmonad==0.15-51 and:

Is there are some default behavior of xmonad/X.H.DynamicLog changed or maintainer has forgotten some compile parameters for support utf-8?

Configuration File

My test configuration:

import XMonad
import XMonad.Hooks.DynamicLog
import XMonad.Hooks.EwmhDesktops
import XMonad.Layout.NoBorders
import XMonad.Util.SpawnOnce

import qualified Data.Map as M

myStartupHook = do
  spawnOnce "systemctl --user start dunst"
  spawnOnce "trayer --edge top --align right --SetDockType true --SetPartialStrut true --expand true --height 20 --transparent true --alpha 0 --tint 0x000000 --widthtype request --monitor 0"
  spawnOnce "xss-lock --transfer-sleep-lock -- sh -c \"xkb-switch -s us ; exec i3lock --nofork -c \\#000000\""

myKeys conf@(XConfig {XMonad.modMask = modm}) = M.fromList
  [ ((modm .|. shiftMask, xK_z), spawn "loginctl lock-session")
  ]

myLayouts = smartBorders $ layoutHook def

main = do
  xmonad =<< xmobar (ewmhFullscreen (ewmh def
    { modMask = mod4Mask
    , keys = myKeys <+> keys def
    , startupHook = myStartupHook
    , layoutHook = myLayouts
    , handleEventHook = ewmhDesktopsEventHook <+> handleEventHook def
    }))

My fallback configuration:

import XMonad
import XMonad.Hooks.DynamicLog
import XMonad.Hooks.EwmhDesktops
import XMonad.Layout.NoBorders
import XMonad.Util.SpawnOnce

import qualified Data.Map as M

myStartupHook = do
  spawnOnce "systemctl --user start dunst"
  spawnOnce "trayer --edge top --align right --SetDockType true --SetPartialStrut true --expand true --height 20 --transparent true --alpha 0 --tint 0x000000 --widthtype request --monitor 0"
  spawnOnce "xss-lock --transfer-sleep-lock -- sh -c \"xkb-switch -s us ; exec i3lock --nofork -c \\#000000\""

myKeys conf@(XConfig {XMonad.modMask = modm}) = M.fromList
  [ ((modm .|. shiftMask, xK_z), spawn "loginctl lock-session")
  ]

myLayouts = smartBorders $ layoutHook def

main = do
  xmonad =<< xmobar (ewmh def
    { modMask = mod4Mask
    , keys = myKeys <+> keys def
    , startupHook = myStartupHook
    , layoutHook = myLayouts
    })

Checklist

• I've read CONTRIBUTING.md
• I tested my configuration with xmonad-testing

Other

My Linux distribution: Manjaro 20.1

I newbie. I wanted to try a new feature to use the normal fullscreen-mode implementation for Firefox (for me that worked, but this thing has appeared ;В). Thanks in advance.

[slotThe]

This is due to the behaviour introduced in xmonad/xmonad-contrib#346. The TL;DR is that this was fixed in jaor/xmobar/pull/482, which is part of xmobar 0.36 and so updating your version of xmobar should fix the issue.

[PRESFIL]

I updated from xmobar==0.35-31 to xmobar-git (0.36-1), but nothing changed.

My xmobar config:

Config { font = "-misc-fixed-*-*-*-*-14-*-*-*-*-*-*-*"
       , additionalFonts = []
       , wmClass = "xmobar"
       , wmName = "xmobar"
       , bgColor = "#000000"
       , fgColor = "#BFBFBF"
       , alpha   = 255
       , position = TopSize R 100 20
       , border = NoBorder
       , borderColor = "#BFBFBF"
       , borderWidth = 1
       , textOffset = -1
       , iconOffset = -1
       , textOffsets = []
       , hideOnStart = False
       , lowerOnStart = True
       , persistent = False
       , allDesktops = True
       , overrideRedirect = True
       , pickBroadest = False
       , iconRoot = "."
       , commands = [ Run Date "%a %b %_d %Y * %H:%M:%S" "theDate" 10
                    , Run StdinReader
                    , Run Battery [] 60
                    , Run Com ".config/xmobar/padding-icon.sh" [] "trayerpad" 30
                    ]
       , sepChar = "%"
       , alignSep = "}{"
       , template = "%StdinReader% }{ %battery% * <fc=#FF0000>%theDate%</fc> * %trayerpad%"
       , verbose = False
       }

As i know, this config does not requires recompilation.

[PRESFIL]

Temporary solved via changing xmobar font:

diff --git a/.config/xmobar/xmobarrc b/.config/xmobar/xmobarrc
index 8bd56a2..cdcbc56 100644
--- a/.config/xmobar/xmobarrc
+++ b/.config/xmobar/xmobarrc
@@ -1,4 +1,4 @@
-Config { font = "-misc-fixed-*-*-*-*-14-*-*-*-*-*-*-*"
+Config { font = "xft:monospace:size=10"
        , additionalFonts = []
        , wmClass = "xmobar"
        , wmName = "xmobar"

[TheMC47]

Also having the issue as of yesterday, using this font="xft:SFN display:size=10,FontAwesome:size=10"

[slotThe]

I guess this connected to #348 and hence the discussion in #349

(just keeping track of things so we can close this when #349 lands)

[liskin]

This actually sounds like #338 (comment)

[liskin]

@PRESFIL Just so that you understand why upgrading xmobar didn't help but switching to xft did: the ugly hack/workaround @psibi submitted to xmobar in https://github.com/jaor/xmobar/pull/482 was only implemented for xft. The xlfd code path still expects a proper unicode String (not double-utf8 encoded garbage).

I'll create a PR to fix this (#338 (comment)).

[PRESFIL]

The screenshots in the header show that only non-latin characters are corrupted. Perhaps they remain correct because in utf-8, ASCII characters are unique and cannot be prefixes of multibyte sequences, so decoding occurs uniquely. And the rest of the characters are encoded twice.

I can still reproduce this behavior, although the xmonad's, xmonad's and xmonad-contrib's versions have go ahead.

Another question is why changing fonts solves the problem. Maybe in the XLFT handler (I don't know if I call this one -misc-fixed-*-*-*-*-14-*-*-*-*-*-*-* format correctly).
I also did not change the spawnPipe associated with it because I use it implicitly (xmonad =<< xmobar). It used to work out of the box, I would like to fix it.

In any case, I will be able to confirm if your solution works, on my host.

[liskin]

Another question is why changing fonts solves the problem.

“the ugly hack/workaround @psibi submitted to xmobar in jaor/xmobar#482 was only implemented for xft”

[PRESFIL]

Ok I have nothing more to say. It seems I told you something you already know...

[liskin]

@PRESFIL Can you try #471?

[PRESFIL]

It seems to work now with #471:

I hope this PR doesn't damage other bars like dzen.

[liskin]

I hope this PR doesn't damage other bars like dzen.

It should actually fix them rather than break them. :-)

[PRESFIL]

Ok... 👀

[PRESFIL]

Thanks! 🚀