According to the docs (http://babel.pocoo.org/en/latest/api/core.html#utility-functions), I should do this to get the Windows timezone mapping:
babel.core.get_global('win_mapping')
but this collection is empty, and the actual mapping (using Babel 2.3.4 pip-installed on Ubuntu 14.04) is located at:
babel.core.get_global('windows_zone_mapping')
So, it seems either the source code or the documentation should be updated. See also #464