[issue39609] Set the thread_name_prefix for asyncio's default executor ThreadPoolExecutor

2020-02-11 Thread Markus Mohrhard
New submission from Markus Mohrhard : The ThreadPoolExecutor in BaseEventLoop.run_in_executor should set a thread_name_prefix to simplify debugging. Might also be worth to limit the number of max threads. On our 256 core machines we sometimes get 1000+ threads due to the cpu_count() * 5

[issue39609] Set the thread_name_prefix for asyncio's default executor ThreadPoolExecutor

2020-02-11 Thread Markus Mohrhard
Change by Markus Mohrhard : -- keywords: +patch pull_requests: +17832 stage: -> patch review pull_request: https://github.com/python/cpython/pull/18458 ___ Python tracker <https://bugs.python.org/issu

[issue39609] Set the thread_name_prefix for asyncio's default executor ThreadPoolExecutor

2020-02-17 Thread Markus Mohrhard
Markus Mohrhard added the comment: We have by now changed to a custom executor. Asyncio is used in some of our dependencies and therefore it took some work to figure out what is creating the thousands of threads that we were seeing. This patch was part of the debuggin and we thought it

[issue40327] list(sys.modules.items()) can throw RuntimeError: dictionary changed size during iteration

2020-04-19 Thread Markus Mohrhard
New submission from Markus Mohrhard : We have hit an issue in the pickle module where the code throws an exception in a threaded environment: The interesting piece of the backtrace is: File "/xxx/1004060/lib/python3.7/site-packages/numpy/core/__init__.py", line 130, in _uf

[issue37502] Pure Python pickle module should not depend on _pickle.PickleBuffer

2019-07-04 Thread Markus Mohrhard
New submission from Markus Mohrhard : The following piece of code import pickle pickle.loads(pickle.dumps(1, protocol=pickle.HIGHEST_PROTOCOL), buffers=None) fails with "TypeError: 'NoneType' object is not iterable" The corresponding PEP (https://www.python.org/dev/peps/

[issue37502] Pure Python pickle module should not depend on _pickle.PickleBuffer

2019-07-04 Thread Markus Mohrhard
Change by Markus Mohrhard : -- keywords: +patch pull_requests: +14409 stage: -> patch review pull_request: https://github.com/python/cpython/pull/14593 ___ Python tracker <https://bugs.python.org/issu

[issue37502] Fix default argument handling for buffers argument in pickle.loads

2019-07-04 Thread Markus Mohrhard
Change by Markus Mohrhard : -- title: Pure Python pickle module should not depend on _pickle.PickleBuffer -> Fix default argument handling for buffers argument in pickle.loads ___ Python tracker <https://bugs.python.org/issu

[issue37502] Fix default argument handling for buffers argument in pickle.loads

2019-07-04 Thread Markus Mohrhard
Markus Mohrhard added the comment: Sorr, I somehow managed to overwrite my title before submitting with the one from one if the results of my searches. -- ___ Python tracker <https://bugs.python.org/issue37