Group by fields "lost" on filtered aggregated question

[flamber]

Describe the bug
After creating a question with a filter on aggregated data, and saving the question, the group-by are "lost"/empty (just displays an arrow →), but the question still works. Though it's not possible to change/remove the group-by.

Logs
When trying to remove the group-by (via the X under Editor), it gives this error:

Firefox: TypeError: e.field(...).name is undefined
Chromium: Uncaught (in promise) TypeError: Cannot read property 'toLowerCase' of undefined

To Reproduce

1. Custom question > Sample Dataset > Orders
2. Summarize Count by User->ID
3. Filter Count > 5
4. Visualize and Save and refresh browser
5. Check Editor where group-by shows a → and cannot click any of Xs to remove it or the entire Summarize section.
6. Notice the empty Group By in Simple > Summarize.

Screenshots

Information about your Metabase Installation:
Metabase 0.33.6/0.33.7.3 (didn't test on master because of #11560) on various backends/browsers.

Additional context
https://discourse.metabase.com/t/cannot-remove-a-seemingly-corrupted-group-by-field/8387
Related to #11495 - perhaps a duplicate, but I was getting different errors.
And perhaps a side-issue of #11235, which confused me in thinking it was not fixed