Section 3 of the specs suggests that the following signs are allowed in names: ! ' * + - . < = > ? _ ` \ ~ (computed by taking the complement of what is stated there to be forbidden). An exhaustive test revealed that \ (backslash) is also forbidden, and that ' < > cannot begin a name.
Thanks for taking the time to test that.
Specification fixed by commit: 05eb981