[issue45562] python -d creates lots of tokenizer messages

miss-islington added the comment: New changeset d8ca47c943c4ad396a9c70aff35bbbf4b1868876 by Miss Islington (bot) in branch '3.10': bpo-45562: Ensure all tokenizer debug messages are printed to stderr (GH-29270) https://github.com/python/cpython/commit/d8ca47c943c4ad396a9c70aff35bbbf4b1868876

[issue45562] python -d creates lots of tokenizer messages

Marc-Andre Lemburg added the comment: Thanks, Pablo :-) -- ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: h

[issue45562] python -d creates lots of tokenizer messages

Change by miss-islington : -- pull_requests: +27538 pull_request: https://github.com/python/cpython/pull/29275 ___ Python tracker ___ __

[issue45562] python -d creates lots of tokenizer messages

Pablo Galindo Salgado added the comment: New changeset cdc7a5827754bec83970bb052d410d55f85b3fff by Pablo Galindo Salgado in branch 'main': bpo-45562: Ensure all tokenizer debug messages are printed to stderr (GH-29270) https://github.com/python/cpython/commit/cdc7a5827754bec83970bb052d410d55f

[issue45562] python -d creates lots of tokenizer messages

Change by Pablo Galindo Salgado : -- pull_requests: +27534 pull_request: https://github.com/python/cpython/pull/29270 ___ Python tracker ___ ___

[issue45562] python -d creates lots of tokenizer messages

Marc-Andre Lemburg added the comment: Hi Pablo, I think you missed one instance: print_escape(stdout, tok->cur, tok->inp - tok->cur); Cheers -- ___ Python tracker ___ __

[issue45562] python -d creates lots of tokenizer messages

Pablo Galindo Salgado added the comment: New changeset 038f45230892235e806ef227dfd9484b95687823 by Miss Islington (bot) in branch '3.10': bpo-45562: Print tokenizer debug messages to stderr (GH-29250) (GH-29252) https://github.com/python/cpython/commit/038f45230892235e806ef227dfd9484b95687823

[issue45562] python -d creates lots of tokenizer messages

miss-islington added the comment: New changeset 10bbd41ba8c88bc102df108a4e0444abc7c5ea43 by Pablo Galindo Salgado in branch 'main': bpo-45562: Print tokenizer debug messages to stderr (GH-29250) https://github.com/python/cpython/commit/10bbd41ba8c88bc102df108a4e0444abc7c5ea43 -- __

[issue45562] python -d creates lots of tokenizer messages

Change by Pablo Galindo Salgado : -- resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python tracker ___ ___

[issue45562] python -d creates lots of tokenizer messages

Change by miss-islington : -- pull_requests: +27516 pull_request: https://github.com/python/cpython/pull/29252 ___ Python tracker ___ __

[issue45562] python -d creates lots of tokenizer messages

Change by Pablo Galindo Salgado : -- pull_requests: +27514 stage: -> patch review pull_request: https://github.com/python/cpython/pull/29250 ___ Python tracker ___ ___

[issue45562] python -d creates lots of tokenizer messages

Pablo Galindo Salgado added the comment: Yeah, let me fix that in another PR -- ___ Python tracker ___ ___ Python-bugs-list mailing

[issue45562] python -d creates lots of tokenizer messages

Marc-Andre Lemburg added the comment: I had left a comment on Github about using stderr instead of stdout, to make the output more consistent (other parser error messages go to stderr). Note sure whether that's something you still want to change before closing the issue. -- stage: p

[issue45562] python -d creates lots of tokenizer messages

Pablo Galindo Salgado added the comment: Thanks you for the catch! -- ___ Python tracker ___ ___ Python-bugs-list mailing list Unsu

[issue45562] python -d creates lots of tokenizer messages

Pablo Galindo Salgado added the comment: New changeset ae78ffdc9399802621eabcd1668e44a91ec5f45e by Miss Islington (bot) in branch '3.10': bpo-45562: Only show debug output from the parser in debug builds (GH-29140) (#29149) https://github.com/python/cpython/commit/ae78ffdc9399802621eabcd1668

[issue45562] python -d creates lots of tokenizer messages

Marc-Andre Lemburg added the comment: Yes, I know that (at the moment) it's only documented to work in the parser, but since Py_DebugFlag is a general purpose flag, this use could easily be extended to other parts of the interpreter as well, e.g. for parsing the command line or instrumenting

[issue45562] python -d creates lots of tokenizer messages

miss-islington added the comment: New changeset 86dfb55d2e091cf633dbd7aabcd49d96fb1f9d81 by Pablo Galindo Salgado in branch 'main': bpo-45562: Only show debug output from the parser in debug builds (GH-29140) https://github.com/python/cpython/commit/86dfb55d2e091cf633dbd7aabcd49d96fb1f9d81

[issue45562] python -d creates lots of tokenizer messages

Change by miss-islington : -- pull_requests: +27426 pull_request: https://github.com/python/cpython/pull/29149 ___ Python tracker ___ __

[issue45562] python -d creates lots of tokenizer messages

Change by Pablo Galindo Salgado : -- keywords: +patch pull_requests: +27416 stage: -> patch review pull_request: https://github.com/python/cpython/pull/29140 ___ Python tracker __

[issue45562] python -d creates lots of tokenizer messages

Pablo Galindo Salgado added the comment: Yeah, those are expected in 3.10, but this should not appear in release versions (only on debug ones). Python -d is normally used to debug the parser: -d : turn on parser debugging output (for experts only, only works on debug builds); al

[issue45562] python -d creates lots of tokenizer messages

Change by Marc-Andre Lemburg : -- components: +Parser nosy: +lys.nikolaou, pablogsal ___ Python tracker ___ ___ Python-bugs-list mai

[issue45562] python -d creates lots of tokenizer messages

Marc-Andre Lemburg added the comment: What's even worse is that those debug lines get written to stdout, not stderr. -- ___ Python tracker ___

[issue45562] python -d creates lots of tokenizer messages

New submission from Marc-Andre Lemburg : python3.9 -d: Python 3.9.7 (default, Oct 21 2021, 20:51:19) [GCC 7.5.0] on linux Type "help", "copyright", "credits" or "license" for more information. Loaded pyinteractive.py. >>> python3.10 -d: Python 3.10.0 (default, Oct 21 2021, 23:13:32) [GCC 7.5