[issue21977] In the re's token example OP and SKIP regexes can be improved

Changes by Berker Peksag : -- stage: commit review -> resolved ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue21977] In the re's token example OP and SKIP regexes can be improved

Changes by Raymond Hettinger : -- resolution: -> fixed status: open -> closed versions: -Python 2.7 ___ Python tracker ___ ___ Pytho

[issue21977] In the re's token example OP and SKIP regexes can be improved

Roundup Robot added the comment: New changeset bb28542af060 by Raymond Hettinger in branch '3.4': Issue 21977: Minor improvements to the regexes in the tokenizer example. http://hg.python.org/cpython/rev/bb28542af060 -- nosy: +python-dev ___ Python t

[issue21977] In the re's token example OP and SKIP regexes can be improved

Raymond Hettinger added the comment: I will keep the \- because the - at the front of the character range is a non-obvious special case. The other changes look reasonable. -- priority: normal -> low stage: -> commit review type: enhancement -> performance versions: +Python 2.7, Python

[issue21977] In the re's token example OP and SKIP regexes can be improved

Changes by Raymond Hettinger : -- assignee: docs@python -> rhettinger nosy: +rhettinger ___ Python tracker ___ ___ Python-bugs-list ma

[issue21977] In the re's token example OP and SKIP regexes can be improved

New submission from py.user: https://docs.python.org/3/library/re.html#writing-a-tokenizer There are redundant escapes in the regex: ('OP', r'[+*\/\-]'),# Arithmetic operators Sequence -+*/ is sufficient. It makes the loop to do all steps on every 4 spaces: ('SKIP',r'[ \t]'),