[issue30355] Unicode symbols crash lib2to3.parse

Terry J. Reedy added the comment: I agree. Δ is not a 2.x identifier (variable name) or anything else (like 'binary operator') and it would be wrong for lib2to3.pgen2.parse.classify to classify it is such, or as anything else. So I am closing this. Benjamin can reopen if we are mistaken. -

[issue30355] Unicode symbols crash lib2to3.parse

Xiang Zhang added the comment: Why? Unicode identifiers are not allowed in 2.x. I don't think lib2to3 is able or responsible to parse invalid syntax source codes. -- nosy: +xiang.zhang ___ Python tracker _

[issue30355] Unicode symbols crash lib2to3.parse

New submission from Yann Grisel: The code formatter YAPF relies on lib2to3 to parse the code before formatting it. The function "classify" from "lib2to3/pgen2/parse.py" returns a ParseError when encountering unicode variable names (like Δ), which it should not. -- components: 2to3 (2.x