UnicodeEncodeError when message contains degree symbol

[kylejohnson]

Home Assistant release (hass --version): 0.61.1

Python release (python3 --version): Python 3.5.4

Component/platform: Ecobee and MQTT Sensors

Description of problem:

When receiving data from sensors (some mqtt, some ecobee) with a unit_of_measurement that contains the degree symbol °, I get a UnicodeEncodeError: 'ascii' codec can't encode character '\xb0' in position 438: ordinal not in range(128) error.

The unit of measurement is accurately shown in the hass web frontend, and is accurately forwarded to InfluxDB

I've set unit_of_measurement to F for my mqtt sensors as a temporary workaround, but the ecobee sensors by-default produce this error.

Expected: If things are actually working - which they appear to be - less noise in the logs. If some functionality is not working because of this, to fix that.

Problem-relevant configuration.yaml entries and steps to reproduce:
Either of these:

1. Using the stock ecobee component

ecobee:
  api_key: !secret ecobee_api_key

2. Using a mqtt sensor as configured:

sensor:
  - platform: mqtt
    state_topic: "environment/server_room/temperature"
    unit_of_measurement: '°F'
    name: "Server Room Temperature"

The ° was inserted using INSERT MODE -> CTRL+K -> SHIFT + G D.
I've tried using vim to save, and iconv to convert, the file to the proper encoding, and neither gets rid of the error.

To reiterate, simply using the ecobee produces this error.

Additional info: Probably related to #9528

Traceback (if applicable):

INFO:homeassistant.components.ecobee:Ecobee data updated successfully
INFO:homeassistant.core:Bus:Handling <Event state_changed[L]: entity_id=climate.main_floor, new_state=<state climate.main_floor=heat; operation_mode=heat, operation=heat, current_temperature=70, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=on, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=on, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>, old_state=<state climate.main_floor=heat; operation_mode=heat, operation=idle, current_temperature=71, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=off, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=off, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>>
--- Logging error ---
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/logging/__init__.py", line 988, in emit
    stream.write(msg)
UnicodeEncodeError: 'ascii' codec can't encode character '\xb0' in position 438: ordinal not in range(128)
Call stack:
  File "/usr/home/kjohnson/homeassistant/bin/hass", line 11, in <module>
    sys.exit(main())
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/__main__.py", line 366, in main
    exit_code = setup_and_run_hass(config_dir, args)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/__main__.py", line 293, in setup_and_run_hass
    return hass.start()
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/core.py", line 158, in start
    self.loop.run_forever()
  File "/usr/local/lib/python3.5/asyncio/base_events.py", line 421, in run_forever
    self._run_once()
  File "/usr/local/lib/python3.5/asyncio/base_events.py", line 1425, in _run_once
    handle._run()
  File "/usr/local/lib/python3.5/asyncio/events.py", line 127, in _run
    self._callback(*self._args)
  File "/usr/local/lib/python3.5/asyncio/tasks.py", line 321, in _wakeup
    self._step()
  File "/usr/local/lib/python3.5/asyncio/tasks.py", line 240, in _step
    result = coro.send(None)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/helpers/entity.py", line 266, in async_update_ha_state
    self.entity_id, state, attr, self.force_update)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/core.py", line 750, in async_set
    'new_state': state,
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/core.py", line 406, in async_fire
    _LOGGER.info("Bus:Handling %s", event)
Message: 'Bus:Handling %s'
Arguments: (<Event state_changed[L]: entity_id=climate.main_floor, new_state=<state climate.main_floor=heat; operation_mode=heat, operation=heat, current_temperature=70, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=on, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=on, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>, old_state=<state climate.main_floor=heat; operation_mode=heat, operation=idle, current_temperature=71, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=off, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=off, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>>,)
DEBUG:homeassistant.components.websocket_api:WS 34582435544: Sending {'type': 'event', 'event': {'event_type': 'state_changed', 'data': {'entity_id': 'climate.main_floor', 'old_state': <state climate.main_floor=heat; operation_mode=heat, operation=idle, current_temperature=71, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=off, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=off, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>, 'new_state': <state climate.main_floor=heat; operation_mode=heat, operation=heat, current_temperature=70, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=on, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=on, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>}, 'origin': 'LOCAL', 'time_fired': datetime.datetime(2018, 1, 18, 3, 21, 38, 293682, tzinfo=<UTC>)}, 'id': 2}
--- Logging error ---
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/logging/__init__.py", line 988, in emit
    stream.write(msg)
UnicodeEncodeError: 'ascii' codec can't encode character '\xb0' in position 522: ordinal not in range(128)
Call stack:
  File "/usr/home/kjohnson/homeassistant/bin/hass", line 11, in <module>
    sys.exit(main())
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/__main__.py", line 366, in main
    exit_code = setup_and_run_hass(config_dir, args)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/__main__.py", line 293, in setup_and_run_hass
    return hass.start()
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/core.py", line 158, in start
    self.loop.run_forever()
  File "/usr/local/lib/python3.5/asyncio/base_events.py", line 421, in run_forever
    self._run_once()
  File "/usr/local/lib/python3.5/asyncio/base_events.py", line 1425, in _run_once
    handle._run()
  File "/usr/local/lib/python3.5/asyncio/events.py", line 127, in _run
    self._callback(*self._args)
  File "/usr/local/lib/python3.5/asyncio/tasks.py", line 321, in _wakeup
    self._step()
  File "/usr/local/lib/python3.5/asyncio/tasks.py", line 240, in _step
    result = coro.send(None)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/components/websocket_api.py", line 239, in _writer
    self.debug("Sending", message)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/components/websocket_api.py", line 224, in debug
    _LOGGER.debug("WS %s: %s %s", id(self.wsock), message1, message2)
Message: 'WS %s: %s %s'
Arguments: (34582435544, 'Sending', {'type': 'event', 'event': {'event_type': 'state_changed', 'data': {'entity_id': 'climate.main_floor', 'old_state': <state climate.main_floor=heat; operation_mode=heat, operation=idle, current_temperature=71, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=off, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=off, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>, 'new_state': <state climate.main_floor=heat; operation_mode=heat, operation=heat, current_temperature=70, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=on, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=on, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>}, 'origin': 'LOCAL', 'time_fired': datetime.datetime(2018, 1, 18, 3, 21, 38, 293682, tzinfo=<UTC>)}, 'id': 2})
DEBUG:homeassistant.components.websocket_api:WS 34681096736: Sending {'type': 'event', 'event': {'event_type': 'state_changed', 'data': {'entity_id': 'climate.main_floor', 'old_state': <state climate.main_floor=heat; operation_mode=heat, operation=idle, current_temperature=71, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=off, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=off, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>, 'new_state': <state climate.main_floor=heat; operation_mode=heat, operation=heat, current_temperature=70, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=on, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=on, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>}, 'origin': 'LOCAL', 'time_fired': datetime.datetime(2018, 1, 18, 3, 21, 38, 293682, tzinfo=<UTC>)}, 'id': 2}
--- Logging error ---
Traceback (most recent call last):
  File "/usr/local/lib/python3.5/logging/__init__.py", line 988, in emit
    stream.write(msg)
UnicodeEncodeError: 'ascii' codec can't encode character '\xb0' in position 522: ordinal not in range(128)
Call stack:
  File "/usr/home/kjohnson/homeassistant/bin/hass", line 11, in <module>
    sys.exit(main())
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/__main__.py", line 366, in main
    exit_code = setup_and_run_hass(config_dir, args)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/__main__.py", line 293, in setup_and_run_hass
    return hass.start()
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/core.py", line 158, in start
    self.loop.run_forever()
  File "/usr/local/lib/python3.5/asyncio/base_events.py", line 421, in run_forever
    self._run_once()
  File "/usr/local/lib/python3.5/asyncio/base_events.py", line 1425, in _run_once
    handle._run()
  File "/usr/local/lib/python3.5/asyncio/events.py", line 127, in _run
    self._callback(*self._args)
  File "/usr/local/lib/python3.5/asyncio/tasks.py", line 321, in _wakeup
    self._step()
  File "/usr/local/lib/python3.5/asyncio/tasks.py", line 240, in _step
    result = coro.send(None)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/components/websocket_api.py", line 239, in _writer
    self.debug("Sending", message)
  File "/usr/home/kjohnson/homeassistant/lib/python3.5/site-packages/homeassistant/components/websocket_api.py", line 224, in debug
    _LOGGER.debug("WS %s: %s %s", id(self.wsock), message1, message2)
Message: 'WS %s: %s %s'
Arguments: (34681096736, 'Sending', {'type': 'event', 'event': {'event_type': 'state_changed', 'data': {'entity_id': 'climate.main_floor', 'old_state': <state climate.main_floor=heat; operation_mode=heat, operation=idle, current_temperature=71, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=off, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=off, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>, 'new_state': <state climate.main_floor=heat; operation_mode=heat, operation=heat, current_temperature=70, operation_list=['auto', 'auxHeatOnly', 'cool', 'heat', 'off'], supported_features=1457, actual_humidity=28, fan_min_on_time=0, aux_heat=on, climate_list=['Away', 'Home', 'Sleep', 'Work'], unit_of_measurement=\xb0F, temperature=71, min_temp=45, mode=Home, max_temp=95, fan=on, friendly_name=Main Floor, away_mode=off @ 2018-01-17T20:15:31.952584-07:00>}, 'origin': 'LOCAL', 'time_fired': datetime.datetime(2018, 1, 18, 3, 21, 38, 293682, tzinfo=<UTC>)}, 'id': 2})

[balloobbot]

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates.

Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍

[kylejohnson]

Hey there. I upgraded to 0.65.6 yesterday, and the problem is still present:

Message: 'Bus:Handling %s'
Arguments: (<Event state_changed[L]: entity_id=sensor.guest_room_temperature, old_state=<state sensor.guest_room_temperature=70.3; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:30:55.408550-06:00>, new_state=<state sensor.guest_room_temperature=70.7; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:34:00.453356-06:00>>,)
DEBUG:homeassistant.components.websocket_api:WS 34571799464: Sending {'id': 2, 'type': 'event', 'event': {'event_type': 'state_changed', 'data': {'entity_id': 'sensor.guest_room_temperature', 'old_state': <state sensor.guest_room_temperature=70.3; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:30:55.408550-06:00>, 'new_state': <state sensor.guest_room_temperature=70.7; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:34:00.453356-06:00>}, 'origin': 'LOCAL', 'time_fired': datetime.datetime(2018, 3, 30, 20, 34, 0, 453387, tzinfo=<UTC>)}}
--- Logging error ---
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/logging/__init__.py", line 994, in emit
    stream.write(msg)
UnicodeEncodeError: 'ascii' codec can't encode character '\xb0' in position 303: ordinal not in range(128)
Call stack:
  File "/usr/home/kjohnson/hass/bin/hass", line 11, in <module>
    sys.exit(main())
  File "/usr/home/kjohnson/hass/lib/python3.6/site-packages/homeassistant/__main__.py", line 362, in main
    exit_code = setup_and_run_hass(config_dir, args)
  File "/usr/home/kjohnson/hass/lib/python3.6/site-packages/homeassistant/__main__.py", line 289, in setup_and_run_hass
    return hass.start()
  File "/usr/home/kjohnson/hass/lib/python3.6/site-packages/homeassistant/core.py", line 158, in start
    self.loop.run_forever()
  File "/usr/local/lib/python3.6/asyncio/base_events.py", line 421, in run_forever
    self._run_once()
  File "/usr/local/lib/python3.6/asyncio/base_events.py", line 1431, in _run_once
    handle._run()
  File "/usr/local/lib/python3.6/asyncio/events.py", line 145, in _run
    self._callback(*self._args)
  File "/usr/local/lib/python3.6/asyncio/tasks.py", line 261, in _wakeup
    self._step()
  File "/usr/local/lib/python3.6/asyncio/tasks.py", line 180, in _step
    result = coro.send(None)
  File "/usr/home/kjohnson/hass/lib/python3.6/site-packages/homeassistant/components/websocket_api.py", line 242, in _writer
    self.debug("Sending", message)
  File "/usr/home/kjohnson/hass/lib/python3.6/site-packages/homeassistant/components/websocket_api.py", line 228, in debug
    _LOGGER.debug("WS %s: %s %s", id(self.wsock), message1, message2)
Message: 'WS %s: %s %s'
Arguments: (34571799464, 'Sending', {'id': 2, 'type': 'event', 'event': {'event_type': 'state_changed', 'data': {'entity_id': 'sensor.guest_room_temperature', 'old_state': <state sensor.guest_room_temperature=70.3; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:30:55.408550-06:00>, 'new_state': <state sensor.guest_room_temperature=70.7; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:34:00.453356-06:00>}, 'origin': 'LOCAL', 'time_fired': datetime.datetime(2018, 3, 30, 20, 34, 0, 453387, tzinfo=<UTC>)}})
DEBUG:homeassistant.components.websocket_api:WS 34668668184: Sending {'id': 2, 'type': 'event', 'event': {'event_type': 'state_changed', 'data': {'entity_id': 'sensor.guest_room_temperature', 'old_state': <state sensor.guest_room_temperature=70.3; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:30:55.408550-06:00>, 'new_state': <state sensor.guest_room_temperature=70.7; unit_of_measurement=\xb0F, friendly_name=Guest Room Temperature @ 2018-03-30T14:34:00.453356-06:00>}, 'origin': 'LOCAL', 'time_fired': datetime.datetime(2018, 3, 30, 20, 34, 0, 453387, tzinfo=<UTC>)}}

[zxdavb]

Me too, python -V: Python 3.6.5, hass --version: 0.66.1

--- Logging error ---
Traceback (most recent call last):
  File "/usr/lib/python3.6/logging/__init__.py", line 994, in emit
    stream.write(msg)
UnicodeEncodeError: 'ascii' codec can't encode character '\xb0' in position 379: ordinal not in range(128)
Call stack:
  File "/srv/hass/bin/hass", line 11, in <module>
    sys.exit(main())
  File "/srv/hass/lib/python3.6/site-packages/homeassistant/__main__.py", line 363, in main
    exit_code = setup_and_run_hass(config_dir, args)
  File "/srv/hass/lib/python3.6/site-packages/homeassistant/__main__.py", line 268, in setup_and_run_hass
    log_rotate_days=args.log_rotate_days, log_file=args.log_file)
  File "/srv/hass/lib/python3.6/site-packages/homeassistant/bootstrap.py", line 179, in from_config_file
    config_path, hass, verbose, skip_pip, log_rotate_days, log_file)
  File "/usr/lib/python3.6/asyncio/base_events.py", line 455, in run_until_complete
    self.run_forever()
  File "/usr/lib/python3.6/asyncio/base_events.py", line 422, in run_forever
    self._run_once()
  File "/usr/lib/python3.6/asyncio/base_events.py", line 1432, in _run_once
    handle._run()
  File "/usr/lib/python3.6/asyncio/events.py", line 145, in _run
    self._callback(*self._args)
  File "/srv/hass/lib/python3.6/site-packages/homeassistant/helpers/entity_platform.py", line 260, in _async_add_entity
    await entity.async_update_ha_state()
  File "/srv/hass/lib/python3.6/site-packages/homeassistant/helpers/entity.py", line 287, in async_update_ha_state
    self.entity_id, state, attr, self.force_update)
  File "/srv/hass/lib/python3.6/site-packages/homeassistant/core.py", line 743, in async_set
    'new_state': state,
  File "/srv/hass/lib/python3.6/site-packages/homeassistant/core.py", line 399, in async_fire
    _LOGGER.info("Bus:Handling %s", event)
Message: 'Bus:Handling %s'
Arguments: (<Event state_changed[L]: entity_id=climate.beans_room, old_state=None, new_state=<state climate.beans_room=unknown; current_temperature=None, min_temp=5.0, max_temp=35.0, temperature=None, operation_mode=None, operation_list=['PermanentOverride', 'FollowSchedule', 'TemporaryOverride'], unit_of_measurement=\xb0C, friendly_name=Beans Room, supported_features=129 @ 2018-04-05T21:52:56.401173+01:00>>,)
INFO:homeassistant.core:Bus:Handling <Event state_changed[L]: entity_id=climate.bathroom, old_state=None, new_state=<state climate.bathroom=unknown; current_temperature=None, min_temp=5.0, max_temp=24.0, temperature=None, operation_mode=None, operation_list=['PermanentOverride', 'FollowSchedule', 'TemporaryOverride'], unit_of_measurement=\xb0C, friendly_name=Bathroom, supported_features=129 @ 2018-04-05T21:52:56.405408+01:00>>

[zxdavb]

As a (temporary) workaround, I changed this file: ${HASS_DIR}/lib/python3.6/site-packages/homeassistant/const.py, so that the line: TEMP_CELSIUS = '°C' becomes: TEMP_CELSIUS = 'C'

[zxdavb]

Still present hass --version = 0.69.0

[zxdavb]

Solution for me was here: https://askubuntu.com/questions/162391/how-do-i-fix-my-locale-issue

[balloobbot]

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates.

Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍

[balloobbot]

This issue will be auto-closed because there hasn't been any activity for a few months. Feel free to open a new one if you still experience this problem 👍