Remove debug logging check

[Siecje]

Unless this is hyper optimization this check done inside the log. https://github.com/python/cpython/blob/3.12/Lib/logging/__init__.py#L1517

[dlech]

These were found to have a measurable difference in performance when profiling. (Mentioned in #1376)

So I would need to see hard evidence to the contrary before making these changes.

[Siecje]

Should this be done in other files?

[dlech]

Only if profiling shows a measured improvement.