configparser does not convert defaults to strings

[aragilar]

BPO	23835
Nosy	@warsaw, @vstinner, @bitdancer, @ambv, @aragilar, @asottile, @miss-islington, @JunyiXie
PRs	bpo-23835: Enforce that configparser defaults are strings #2558 bpo-23835: [docs] configparser converts defaults to strings #3176 bpo-23835: Restore legacy defaults= behavior for RawConfigParser #3191 bpo-33802: Do not interpolate in ConfigParser while reading defaults #7524 [3.7] bpo-33802: Do not interpolate in ConfigParser while reading defaults (GH-7524) #7529
Files	py27-config-fix.patch

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2018-06-08.17:10:28.583>
created_at = <Date 2015-04-01.04:23:08.378>
labels = ['3.7', 'deferred-blocker', 'type-bug', 'library']
title = 'configparser does not convert defaults to strings'
updated_at = <Date 2021-03-13.13:23:31.799>
user = 'https://github.com/aragilar'

bugs.python.org fields:

activity = <Date 2021-03-13.13:23:31.799>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2018-06-08.17:10:28.583>
closer = 'barry'
components = ['Library (Lib)']
creation = <Date 2015-04-01.04:23:08.378>
creator = 'aragilar'
dependencies = []
files = ['38861']
hgrepos = []
issue_num = 23835
keywords = ['patch', '3.7regression']
message_count = 16.0
messages = ['239768', '240249', '297793', '298205', '298234', '298279', '300660', '300661', '300717', '300791', '318983', '318999', '319047', '319066', '320899', '323285']
nosy_count = 8.0
nosy_names = ['barry', 'vstinner', 'r.david.murray', 'lukasz.langa', 'aragilar', 'Anthony Sottile', 'miss-islington', 'JunyiXie']
pr_nums = ['2558', '3176', '3191', '7524', '7529']
priority = 'deferred blocker'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue23835'
versions = ['Python 3.7']

[aragilar]

ConfigParser(defaults={1:2.4}) and ConfigParser(defaults={"a":5.2}) cause an exception when configparser tries to perform string operations on 1 and 5.2. I didn't see it documented that defaults must only contain strings, and using ConfigParser['DEFAULT'] = {1:2.4} does the necessary string conversion, so it looks like there should be some conversion done to the defaults.

[aragilar]

Here's a patch for 2.7 (based of the head of the 2.7 branch), something similar could be done for 3.4 (I wasn't sure what branch I was supposed to base the patch off, since 3.4 is inactive). The string requirement was already noted in the docstring of the configparser module, but that's not mentioned in the main docs. Also, I wasn't sure where to put a test in because there was not test_configparser.py located in Lib/test.

[bitdancer]

I'm guessing we can only do something here in 3.7, for backward compatibility reasons, but maybe I'm wrong. Hopefully Lukasz will notice the activity on the issue and have time to take a look.

[ambv]

Responded on the PR.

[bitdancer]

Thanks. OK, so you agree a fix is appropriate. What about the question of backport/backward compatibility?

[ambv]

Backwards compatibility will be considered when the patch is ready. I'm not overly worried about fixing a case that currently raises exceptions all over the place. There's few compatibility concerns that we need to consider in this case.

[ambv]

New changeset 44e6ad8 by Łukasz Langa (James Tocknell) in branch 'master':
bpo-23835: Enforce that configparser defaults are strings (bpo-2558)
44e6ad8

[ambv]

New changeset ea57923 by Łukasz Langa in branch 'master':
bpo-23835: [docs] configparser converts defaults to strings (bpo-3176)
ea57923

[ambv]

I merged the original fix and documented it. I thought about it some more and remembered that RawConfigParser objects do in fact support non-string values by historical coincidence. It's unfortunately a popular idiom with old programs to load some configuration defaults using the defaults= keyword and later use the legacy get() and set() API which doesn't check types inside. A config file like this cannot be safely written back to a file, etc.

I would very much like to get rid of RawConfigParser entirely but we're stuck with it due to backwards compatibility. So, to fix the regression, I created PR 3191.

[ambv]

New changeset a5fab17 by Łukasz Langa in branch 'master':
bpo-23835: Restore legacy defaults= behavior for RawConfigParser (bpo-3191)
a5fab17