PEG Generator: Fix scripts to always use the correct parser

[lysnikolaou]

BPO	40688
Nosy	@gvanrossum, @lysnikolaou, @pablogsal, @miss-islington
PRs	bpo-40688: Use the correct parser in the peg_generator scripts #20235 [3.9] bpo-40688: Use the correct parser in the peg_generator scripts (GH-20235) #20396

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = 'https://github.com/lysnikolaou'
closed_at = <Date 2020-05-25.20:00:16.953>
created_at = <Date 2020-05-19.19:05:34.997>
labels = ['type-bug', '3.9', '3.10']
title = 'PEG Generator: Fix scripts to always use the correct parser'
updated_at = <Date 2020-05-25.20:11:43.701>
user = 'https://github.com/lysnikolaou'

bugs.python.org fields:

activity = <Date 2020-05-25.20:11:43.701>
actor = 'miss-islington'
assignee = 'lys.nikolaou'
closed = True
closed_date = <Date 2020-05-25.20:00:16.953>
closer = 'lys.nikolaou'
components = ['Demos and Tools']
creation = <Date 2020-05-19.19:05:34.997>
creator = 'lys.nikolaou'
dependencies = []
files = []
hgrepos = []
issue_num = 40688
keywords = ['patch']
message_count = 3.0
messages = ['369381', '369917', '369920']
nosy_count = 4.0
nosy_names = ['gvanrossum', 'lys.nikolaou', 'pablogsal', 'miss-islington']
pr_nums = ['20235', '20396']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue40688'
versions = ['Python 3.9', 'Python 3.10']

[lysnikolaou]

All the scripts in Tools/peg_generator/scripts need to be updated, since they mostly assume that ast.parse and compile use the old parser. We can use the _peg_parser extension module instead, but it well need some enhancements so that it also supports compilation to bytecode.

[pablogsal]

New changeset 9645930 by Lysandros Nikolaou in branch 'master':
bpo-40688: Use the correct parser in the peg_generator scripts (GH-20235)
9645930

[miss-islington]

New changeset 3c6c86a by Miss Islington (bot) in branch '3.9':
bpo-40688: Use the correct parser in the peg_generator scripts (GH-20235)
3c6c86a