[issue42242] Backport SQLite trace API v2

[Erlend Egeberg Aasland]

Change by Erlend Egeberg Aasland :


--
keywords: +patch
nosy: +erlendaasland
nosy_count: 1.0 -> 2.0
pull_requests: +22017
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/19581

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42241] Backport SQLite trace API v2

[Erlend Egeberg Aasland]

Change by Erlend Egeberg Aasland :


--
keywords: +patch
nosy: +erlendaasland
nosy_count: 1.0 -> 2.0
pull_requests: +22016
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/19581

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41229] Asynchronous generator memory leak

[miss-islington]

miss-islington  added the comment:


New changeset 6e8dcdaaa49d4313bf9fab9f9923ca5828fbb10e by Joongi Kim in branch 
'master':
bpo-41229: Update docs for explicit aclose()-required cases and add 
contextlib.aclosing() method (GH-21545)
https://github.com/python/cpython/commit/6e8dcdaaa49d4313bf9fab9f9923ca5828fbb10e


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42242] Backport SQLite trace API v2

[Erlend Egeberg Aasland]

Erlend Egeberg Aasland  added the comment:

> [not sure if this is how you do backporting, a new issue and GH PR for each 
> supported release tag?]

Backports are almost always created as backports of a specific GitHub pull 
request. The pull request is labelled as, for example, "needs backport to 3.9", 
and a bot will automatically try to cherry-pick the squashed commit to the 
target branch. So, if we wanted to backport GH-19581, we would do that directly 
from the original pull request over at GitHub. That will also preserve commit 
meta-data.

See also:
https://devguide.python.org/committing/?highlight=backport#backporting-changes-to-an-older-version

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42241] Backport SQLite trace API v2

[Dong-hee Na]

Dong-hee Na  added the comment:

We often submit the backported patch by using the backport label from the 
origin PR.
(https://github.com/python/cpython/pull/19581)

So please discuss about the bacporting on bpo-40318

--
nosy: +corona10
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42242] Backport SQLite trace API v2

[Dong-hee Na]

Dong-hee Na  added the comment:

We often submit the backported patch by using the backport label from the 
origin PR.
(https://github.com/python/cpython/pull/19581)

So please discuss the backporting on bpo-40318

--
nosy: +corona10
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[Jakub Kulik]

Change by Jakub Kulik :


Added file: https://bugs.python.org/file49559/Oracle_Solaris_detailed_test.txt

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[Jakub Kulik]

Jakub Kulik  added the comment:

I ran the test and the results are attached (the first one is a complete test 
and the other one failed tests in verbose mode).

I checked the failing tests and divided them into several groups:

issues already reported:
  test_asyncio - reported and being solved here: 
https://bugs.python.org/issue38323
  test_posix - problem with return values, reported here: 
https://bugs.python.org/issue41839
  test_shutil - sendfile for Solaris was disabled in the library, but not in 
the test suite, which leads to the issues (I asked about reenabling here: 
https://bugs.python.org/issue41843; that would solve the issue)

these failures are probably related to our internal network settings (false 
positives):
  test_ssl, test_urllib, test_urllib2, test_urllib2_localnet

other:
  test_float - locale related *
  test_locale - locale related *
  test_re - most likely locale related *
  test_socket - known issues not yet reported upstream (not ready for 
acceptable PR)
  test_time - one locale related * and other not yet known
  test_tcl - yet to investigate

*) Locale related failures are due to wchar_t differences between the Linux 
world and ours. It's something we resolved very recently and have yet to rework 
it into an upstreamable form and report it.

It would be interesting to see Illumos results as well, because while also 
Solaris, there might be differences due to almost ten years of spit development.

--
Added file: https://bugs.python.org/file49558/Oracle_Solaris_full_test.txt

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42243] Don't access the module dictionary directly

[Erlend Egeberg Aasland]

New submission from Erlend Egeberg Aasland :

Quoting from https://docs.python.org/3.10/c-api/module.html:
"It is recommended extensions use other PyModule_* and PyObject_* functions 
rather than directly manipulate a module’s __dict__."

A number of modules still access the module dictionary directly:
zsh % grep -r PyModule_GetDict Modules
Modules/errnomodule.c:PyObject *module_dict = PyModule_GetDict(module);
Modules/_sre.c:d = PyModule_GetDict(m);
Modules/_cursesmodule.c:d = PyModule_GetDict(m);
Modules/_threadmodule.c:d = PyModule_GetDict(m);
Modules/signalmodule.c:PyObject *d = PyModule_GetDict(m);
Modules/_xxsubinterpretersmodule.c:PyObject *ns = 
PyModule_GetDict(main_mod);  // borrowed
Modules/_xxsubinterpretersmodule.c:PyObject *ns = PyModule_GetDict(module); 
 // borrowed
Modules/socketmodule.c:dict = PyModule_GetDict(m);
Modules/_ssl.c:d = PyModule_GetDict(m);
Modules/_curses_panel.c:PyObject *d = PyModule_GetDict(mod);
Modules/_sqlite/connection.c:module_dict = PyModule_GetDict(module);
Modules/_winapi.c:PyObject *d = PyModule_GetDict(m);
Modules/pyexpat.c:d = PyModule_GetDict(m);

--
components: Library (Lib)
messages: 380197
nosy: erlendaasland
priority: normal
severity: normal
status: open
title: Don't access the module dictionary directly
type: enhancement
versions: Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42243] Don't access the module dictionary directly

[Erlend Egeberg Aasland]

Change by Erlend Egeberg Aasland :


--
keywords: +patch
pull_requests: +22018
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23101

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42243] Don't access the module dictionary directly

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

Are all these occurrences in the module initialization code?

I think there is nothing wrong with this. Yes, the code can be a little clearer 
if use PyObject_GetArrt or PyModule_Add*, but rewriting can introduce new bugs.

The remark in the documentation is rather about reading the module attributes 
and writing a new code. It does not require rewriting existing code.

You can do this, but it will be treated as pure cosmetic change. It can be 
accepted if the new code is much clearer.

--
nosy: +serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40452] Tkinter/IDLE: preserve clipboard on closure

[Tal Einat]

Tal Einat  added the comment:

Perhaps we could get a Tcl/Tk dev to help with this?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42243] Don't access the module dictionary directly

[Erlend Egeberg Aasland]

Erlend Egeberg Aasland  added the comment:

> Are all these occurrences in the module initialization code?

Most of them, but not all.

> but rewriting can introduce new bugs.

Of course.


> You can do this, but it will be treated as pure cosmetic change. It can be 
> accepted if the new code is much clearer.

It mostly results in more compact code, which, in my opinion, would improve 
both readability and maintainability.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42244] TimedRotatingFileHandler doesn’t handle the switch to/from DST when using daily/midnight rotation

[Cristian Martinez de Morentin]

New submission from Cristian Martinez de Morentin :

TimedRotatingFileHandler doesn’t handle the switch to/from DST when using 
daily/midnight rotation. When DST switch occurs, the previous day logging file 
is overwritten. The issue is present regardless of the value of the UTC flag 
(True/False).

For instance, we had a DST switch on october 24th in Spain and no logging file 
was created for that day. Instead, the data was written to october 23rd file.

--
components: Library (Lib)
messages: 380201
nosy: Cristian Martinez de Morentin
priority: normal
severity: normal
status: open
title: TimedRotatingFileHandler doesn’t handle the switch to/from DST when 
using daily/midnight rotation
type: behavior
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42240] Add Maxheap version of a heappush into heapq module

[Karthikeyan Singaravelan]

Change by Karthikeyan Singaravelan :


--
nosy: +rhettinger

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42244] TimedRotatingFileHandler doesn’t handle the switch to/from DST when using daily/midnight rotation

[Karthikeyan Singaravelan]

Change by Karthikeyan Singaravelan :


--
nosy: +vinay.sajip

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40318] Migrate to SQLite3 trace v2 API

[Samuel Marks]

Change by Samuel Marks :


--
nosy: +samuelmarks
nosy_count: 4.0 -> 5.0
pull_requests: +22019
pull_request: https://github.com/python/cpython/pull/23102

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40318] Migrate to SQLite3 trace v2 API

[Samuel Marks]

Change by Samuel Marks :


--
pull_requests: +22020
pull_request: https://github.com/python/cpython/pull/23103

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42242] Backport SQLite trace API v2

[Samuel Marks]

Samuel Marks  added the comment:

Done, thanks for the how-to:
- https://github.com/python/cpython/pull/23103 [3.8]
- https://github.com/python/cpython/pull/23102 [3.9]

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[John Gardner]

John Gardner  added the comment:

Don't remove, it is still actively used by so many people. If the maintance 
overhead of 700 lines is a large burdern, then I'm happy to take on whatever 
work is required for it.

--
nosy: +jgardner100

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42037] Documentation confusion in CookieJar functions

[Markus Israelsson]

Markus Israelsson  added the comment:

I am currently updating the documentation source code.
On the cookiejar page it describes 'unverifiable' as a method.
I can however not find that method on the request page because it seems to be 
just a normal attribute.

I will make updates for that as well if that is ok with you?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[Andy Fiddaman]

Andy Fiddaman  added the comment:

Jakub's results looks very familiar to me, having been working on python 3.9 on 
illumos.

For OmniOS, we currently skip these tests via --ignorefile:

# wchar_t related failures
*.test_re.ReTests.test_locale_compiled
*.test_re.ReTests.test_locale_caching
# illumos does not support multiple SCM_RIGHTS messages in a packet
*FDPassSeparate*
# These tests fail on illumos and the first consumes a significant
# amount of memory. Investigation required.
test.test_socket.SendfileUsingSendfileTest.testCount
test.test_socket.SendfileUsingSendfileTest.testWithTimeout
test.test_socket.SendfileUsingSendfileTest.testOffset
#
test.test_asyncio.test_sendfile.*
test.test_asyncio.test_subprocess.SubprocessMultiLoopWatcherTests.*


We are also carrying some local patches for the following. Several come from 
Solaris.

- Stop python detecting and using epoll() on illumos

- scheduling priorities can be < 0
https://github.com/citrus-it/omnios-build/blob/python39/build/python39/patches/mod-posix-sched_priority.patch

- differences in sendfile behaviour (improves the situation but is not complete)
https://github.com/citrus-it/omnios-build/blob/python39/build/python39/patches/mod-posix-sendfile.patch

- Enable sendfile for shutil.copy (mismatch between library and testsuite in 
terms of whether sendfile() is enabled on illumos)
https://github.com/citrus-it/omnios-build/blob/python39/build/python39/patches/mod-shutil-sendfile.patch

- Fixes for building the socket module (_XOPEN_SOURCE=600)
https://github.com/citrus-it/omnios-build/blob/python39/build/python39/patches/mod-socket-xpg6.patch

- Emulate clock_gettime(CLOCK_THREAD_CPUTIME_ID)
https://github.com/citrus-it/omnios-build/blob/python39/build/python39/patches/mod-time-threadtime.patch

- PTY patch
https://github.com/citrus-it/omnios-build/blob/python39/build/python39/patches/pty.patch

and a few others, not all of which are suitable for upstream.
https://github.com/citrus-it/omnios-build/tree/python39/build/python39/patches


With all of this in place, the headline test stats for OmniOS Python 3.9 are:

401 tests OK.

24 tests skipped:
test_dbm_gnu test_epoll test_gdb test_idle test_kqueue test_msilib
test_ossaudiodev test_smtpnet test_socketserver test_startfile
test_tcl test_timeout test_tix test_tk test_ttk_guionly
test_ttk_textonly test_turtle test_urllib2net test_urllibnet
test_winconsoleio test_winreg test_winsound test_xmlrpc_net
test_zipfile64

Tests result: SUCCESS

and, additionally, the dtrace tests succeed (we test them separately as they 
require elevated privileges).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42230] Document that asyncio's wait() and as_completed() accept arbitrary iterables

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +22021
pull_request: https://github.com/python/cpython/pull/23104

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42230] Document that asyncio's wait() and as_completed() accept arbitrary iterables

[Andrew Svetlov]

Andrew Svetlov  added the comment:


New changeset 3d86d090dcbbdfdd3e5a5951cab30612d6131222 by Jakub Stasiak in 
branch 'master':
bpo-42230: Improve asyncio documentation regarding accepting sets vs iterables 
(GH-23073)
https://github.com/python/cpython/commit/3d86d090dcbbdfdd3e5a5951cab30612d6131222


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42230] Document that asyncio's wait() and as_completed() accept arbitrary iterables

[Jakub Stasiak]

Change by Jakub Stasiak :


--
pull_requests: +22022
pull_request: https://github.com/python/cpython/pull/23105

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42230] Document that asyncio's wait() and as_completed() accept arbitrary iterables

[miss-islington]

miss-islington  added the comment:


New changeset ff852aabf22908e7ef0325af65bab5d02c421fd8 by Miss Skeleton (bot) 
in branch '3.9':
bpo-42230: Improve asyncio documentation regarding accepting sets vs iterables 
(GH-23073)
https://github.com/python/cpython/commit/ff852aabf22908e7ef0325af65bab5d02c421fd8


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42230] Document that asyncio's wait() and as_completed() accept arbitrary iterables

[Andrew Svetlov]

Change by Andrew Svetlov :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.6, Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42230] Document that asyncio's wait() and as_completed() accept arbitrary iterables

[Andrew Svetlov]

Andrew Svetlov  added the comment:


New changeset ad37c66adcd474e3d42a51c63ecb6a54ca2d23f2 by Jakub Stasiak in 
branch '3.8':
[3.8] bpo-42230: Improve asyncio documentation regarding accepting sets vs 
iterables (GH-23073) (GH-23105)
https://github.com/python/cpython/commit/ad37c66adcd474e3d42a51c63ecb6a54ca2d23f2


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37193] Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn

[STINNER Victor]

STINNER Victor  added the comment:

The change fixing a leak in socketserver introduces a leak in socketserver :-)

$ ./python -m test test_socketserver -u all -m 
test.test_socketserver.SocketServerTest.test_ThreadingTCPServer -R 3:3
0:00:00 load avg: 0.95 Run tests sequentially
0:00:00 load avg: 0.95 [1/1] test_socketserver
beginning 6 repetitions
123456
..
test_socketserver leaked [3, 3, 3] references, sum=9
test_socketserver leaked [3, 3, 3] memory blocks, sum=9
test_socketserver failed

== Tests result: FAILURE ==

1 test failed:
test_socketserver

Total duration: 497 ms
Tests result: FAILURE

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[Jakub Kulik]

Jakub Kulik  added the comment:

Thanks Andy, good to know we are seeing the same issue!

We tried to fix sendfile differences in Python code before as well, but as you 
said, it was never 100% solved. Recently we finally fixed it in C and it was 
accepted (https://bugs.python.org/issue41687) and backported to 3.9 so you 
might/should be ok without the patch as well.

CLOCK_THREAD_CPUTIME_ID was issue for us as well but before the patch was 
accepted upstream, Oracle Solaris implemented it so it was no longer necessary. 
But the issue is still open https://bugs.python.org/issue35455 and knowing that 
others will use it, I will dust it off and finish it.

Knowing that Oracle and Illumos are facing the same issues, I am much more 
confident that our patches won't break Illumos. I will start upstream more of 
them right away.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42225] Tkinter hangs or crashes when displaying astral chars

[STINNER Victor]

STINNER Victor  added the comment:

> Fixing OS graphics or tk is out of scope for us.  Preventing hangs or crashes 
> when using tkinter is.  On Mac, refusing to insert any astral char into a tk 
> widget might be the best solution.  Serhiy, could that be done in 
> tkinter/_tkinter?

I dislike attempting to workaround Tk issues in Python. As you can see, the 
behavior really depends on the platform. As I wrote, on Fedora 32 it works (the 
character is rendered properly). I would prefer to not block such character on 
Fedora 32 because it does crash on some other platforms.

Or you should detect the very precise conditions explaining why it works on 
some platforms and crash on some other platforms...

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37193] Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn

[STINNER Victor]

STINNER Victor  added the comment:

I rejected the backport to 3.8 and 3.9 since the change causes a regression on 
master.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41835] Speed up dict vectorcall creation using keywords

[Inada Naoki]

Change by Inada Naoki :


--
pull_requests: +22023
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23106

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35455] Solaris thread_time doesn't work with current implementation

[Jakub Kulik]

Jakub Kulik  added the comment:

Comment from https://bugs.python.org/issue42173#msg380205 confirmed that this 
issue is still relevant to Illumos based systems. Because of that, I am happy 
to resolve it.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35455] Solaris: thread_time doesn't work with current implementation

[Jakub Kulik]

Change by Jakub Kulik :


--
title: Solaris thread_time doesn't work with current implementation -> Solaris: 
thread_time doesn't work with current implementation

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41835] Speed up dict vectorcall creation using keywords

[Inada Naoki]

Inada Naoki  added the comment:

> I did PGO+LTO... --enable-optimizations --with-lto

I'm sorry about that. PGO+LTO *reduce* noises, but there are still noises. And 
unpack_sequence is very fragile.
I tried your branch again, and unpack_sequence is 10% *slower* than master 
branch.

I am running pyperformance with PR-23106, which simplifies your function and 
use it from _PyStack_AsDict() and _PyEval_EvalCode().

--
stage: patch review -> 

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42126] Optimize BUILD_CONST_KEY_MAP for distinct keys

[Inada Naoki]

Inada Naoki  added the comment:

OK. Microbenchmark don't justify adding complexity to the eval loop and the 
compiler.

--
resolution:  -> rejected
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35455] Solaris: thread_time doesn't work with current implementation

[Jakub Kulik]

Change by Jakub Kulik :


--
versions: +Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue1635741] Py_Finalize() doesn't clear all Python objects at exit

[STINNER Victor]

STINNER Victor  added the comment:

I converted the unicodedata extension to the multi-phase initialization API in 
bpo-42157 with Mohamed Koubaa.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37193] Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn

[Jason R. Coombs]

Jason R. Coombs  added the comment:

I recommend a rollback. I’ll try to get to it later today.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41835] Speed up dict vectorcall creation using keywords

[Inada Naoki]

Inada Naoki  added the comment:

Short result (minspeed=2):

Slower (4):
- unpack_sequence: 65.2 ns +- 1.3 ns -> 69.2 ns +- 0.4 ns: 1.06x slower (+6%)
- unpickle_list: 5.21 us +- 0.04 us -> 5.44 us +- 0.02 us: 1.04x slower (+4%)
- chameleon: 9.80 ms +- 0.08 ms -> 10.0 ms +- 0.1 ms: 1.02x slower (+2%)
- logging_silent: 202 ns +- 5 ns -> 206 ns +- 5 ns: 1.02x slower (+2%)

Faster (9):
- pickle_dict: 30.7 us +- 0.1 us -> 29.0 us +- 0.1 us: 1.06x faster (-5%)
- scimark_lu: 169 ms +- 3 ms -> 163 ms +- 3 ms: 1.04x faster (-4%)
- sympy_str: 396 ms +- 8 ms -> 383 ms +- 5 ms: 1.04x faster (-3%)
- sqlite_synth: 3.46 us +- 0.08 us -> 3.34 us +- 0.04 us: 1.03x faster (-3%)
- scimark_fft: 415 ms +- 3 ms -> 405 ms +- 3 ms: 1.03x faster (-3%)
- pickle_list: 4.91 us +- 0.07 us -> 4.79 us +- 0.04 us: 1.03x faster (-3%)
- dulwich_log: 82.4 ms +- 0.8 ms -> 80.4 ms +- 0.8 ms: 1.02x faster (-2%)
- scimark_sparse_mat_mult: 5.49 ms +- 0.03 ms -> 5.37 ms +- 0.02 ms: 1.02x 
faster (-2%)
- spectral_norm: 157 ms +- 1 ms -> 153 ms +- 4 ms: 1.02x faster (-2%)

Benchmark hidden because not significant (47): ...

Geometric mean: 1.00 (faster)

Long result is attached.

--
Added file: https://bugs.python.org/file49560/pr23106.txt

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41835] Speed up dict vectorcall creation using keywords

[Inada Naoki]

Inada Naoki  added the comment:

And bench_kwcall.py is a microbenchmark for _PyEval_EvalCode.

$ cpython/release/python -m pyperf compare_to master.json kwcall-nodup.json

kwcall-3: Mean +- std dev: [master] 192 us +- 2 us -> [kwcall-nodup] 175 us +- 
1 us: 1.09x faster (-9%)
kwcall-6: Mean +- std dev: [master] 327 us +- 6 us -> [kwcall-nodup] 291 us +- 
4 us: 1.12x faster (-11%)
kwcall-9: Mean +- std dev: [master] 436 us +- 10 us -> [kwcall-nodup] 373 us +- 
5 us: 1.17x faster (-14%)

Geometric mean: 0.89 (faster)

--
Added file: https://bugs.python.org/file49561/bench_kwcall.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

[DanilZ]

New submission from DanilZ :

Note: problem occurs only after performing the RandomizedSearchCV...

When applying a function in a multiprocess using concurrent.futures if the 
function includes anything else other than print(), it is not executed and the 
process freezes.

Here is the code to reproduce.

from xgboost import XGBRegressor
from sklearn.model_selection import KFold
import concurrent.futures
from sklearn.datasets import make_regression
import pandas as pd
import numpy as np
from sklearn.model_selection import RandomizedSearchCV

# STEP 1
# 
# simulate RandomizedSearchCV

data = make_regression(n_samples=500, n_features=100, n_informative=10, 
n_targets=1, random_state=5)
X = pd.DataFrame(data[0])
y = pd.Series(data[1])
kf = KFold(n_splits = 3, shuffle = True, random_state = 5)
model = XGBRegressor(n_jobs = -1)
params = {
'min_child_weight': [0.1, 1, 5],
'subsample':[0.5, 0.7, 1.0],
'colsample_bytree': [0.5, 0.7, 1.0],
'eta':  [0.005, 0.01, 0.1],
'n_jobs':   [-1]
}
random_search = RandomizedSearchCV(
model,
param_distributions =   params,
n_iter =50,
n_jobs =-1,
refit = True, # necessary for 
random_search.best_estimator_
cv =kf.split(X,y),
verbose =   1,
random_state =  5
)
random_search.fit(X, np.array(y))

# STEP 2.0
# 
# test if multiprocessing is working in the first place

def just_print():
print('Just printing')

with concurrent.futures.ProcessPoolExecutor() as executor:
results_temp = [executor.submit(just_print) for i in range(0,12)]
# 


# STEP 2.1
# 
# test on a slightly more complex function

def fit_model():
# JUST CREATING A DATASET, NOT EVEN FITTING ANY MODEL!!! AND IT FREEZES
data = make_regression(n_samples=500, n_features=100, n_informative=10, 
n_targets=1, random_state=5)
# model = XGBRegressor(n_jobs = -1)
# model.fit(data[0],data[1])
print('Fit complete')

with concurrent.futures.ProcessPoolExecutor() as executor:
results_temp = [executor.submit(fit_model) for i in range(0,12)]
# 


Attached this code in a .py file.

--
components: macOS
files: concur_fut_freeze.py
messages: 380220
nosy: DanilZ, bquinlan, ned.deily, pitrou, ronaldoussoren
priority: normal
severity: normal
status: open
title: concurrent.futures.ProcessPoolExecutor freezes depending on complexity
versions: Python 3.7
Added file: https://bugs.python.org/file49562/concur_fut_freeze.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37193] Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn

[Jason R. Coombs]

Change by Jason R. Coombs :


--
pull_requests: +22024
pull_request: https://github.com/python/cpython/pull/23107

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue39679] functools: singledispatchmethod doesn't work with classmethod

[Eugene-Yuan Kou]

Eugene-Yuan Kou  added the comment:

Hi, I also encounter to the problem, and I have give my attempt to make the 
singledispatchmethod support the classmethod, and staticmethod with type 
annotation. I also adding two tests. Please refer to my fork.  I will trying to 
make a pull request

https://github.com/EugenePY/cpython/compare/3.8...fix-issue-39679

--
nosy: +EugenePY

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40077] Convert static types to heap types: use PyType_FromSpec()

[Erlend Egeberg Aasland]

Change by Erlend Egeberg Aasland :


--
pull_requests: +22025
pull_request: https://github.com/python/cpython/pull/23108

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41835] Speed up dict vectorcall creation using keywords

[Inada Naoki]

Inada Naoki  added the comment:

While this is an interesting optimization, the gain is not enough.
I close this issue for now.

@Marco Sulla
Optimizing dict is a bit hard job. If you want to continue, I have an idea:
`dict(zip(keys, row))` is common use case. It is used by asdict() in datacalss, 
_asdict() in namedtuple, and csv DictReader.
Sniffing zip object and presizing dict may be interesting optimization.

But note that this idea has low chance of accepted too. We tries many ideas 
like this and reject them by ourselves even without creating a pull request.

--
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34067] Problem with contextlib.nullcontext

[Irit Katriel]

Change by Irit Katriel :


--
pull_requests:  -21767

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34067] Problem with contextlib.nullcontext

[Irit Katriel]

Change by Irit Katriel :


--
stage: patch review -> needs patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41435] Allow to retrieve ongoing exception handled by every threads

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:


New changeset 64366fa9b3ba71b8a503a8719eff433f4ea49eb9 by Julien Danjou in 
branch 'master':
bpo-41435: Add sys._current_exceptions() function (GH-21689)
https://github.com/python/cpython/commit/64366fa9b3ba71b8a503a8719eff433f4ea49eb9


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42174] shutil.get_terminal_size() returns 0 when run in a pty

[Florian Bruhin]

Florian Bruhin  added the comment:

Just found another workaround for this in the wild, as part of the "rich" 
library:

https://github.com/willmcgugan/rich/blob/v9.1.0/rich/console.py#L669-L672

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

[Ken Jin]

Ken Jin  added the comment:

Hello, it would be great if you can you provide more details. Like your 
Operating System and version, how many logical CPU cores there are on your 
machine, and lastly the exact Python version with major and minor versions 
included (eg. Python 3.8.2). Multiprocessing behaves differently depending on 
those factors.

FWIW I reduced your code down to make it easier to read, and removed all the 
unused variables:

import concurrent.futures
from sklearn.datasets import make_regression

def just_print():
print('Just printing')

def fit_model():
data = make_regression(n_samples=500, n_features=100, n_informative=10, 
n_targets=1, random_state=5)
print('Fit complete')

if __name__ == '__main__':
with concurrent.futures.ProcessPoolExecutor() as executor:
results_temp = [executor.submit(just_print) for i in range(0,12)]

with concurrent.futures.ProcessPoolExecutor() as executor:
results_temp = [executor.submit(fit_model) for i in range(0,12)]

The problem is that I am *unable* to reproduce the bug you are reporting on 
Windows 10 64-bit, Python 3.7.6. The code runs till completion for both 
examples. I have a hunch that your problem lies elsewhere in one of the many 
libraries you imported.

>>> Note: problem occurs only after performing the RandomizedSearchCV...

Like you have noted, I went to skim through RandomizedSearchCV's source code 
and docs. RandomizedSearchCV is purportedly able to use multiprocessing backend 
for parallel tasks. By setting `n_jobs=-1` in your params, you're telling it to 
use all logical CPU cores. I'm unsure of how many additional processes and 
pools RandomizedSearchCV's spawns after calling it, but this sounds suspicious. 
concurrent.futures specifically warns that this may exhaust available workers 
and cause tasks to never complete. See 
https://docs.python.org/3/library/concurrent.futures.html#threadpoolexecutor 
(the docs here are for ThreadPoolExecutor, but they still apply).

A temporary workaround might be to reduce n_jobs OR even better: use 
scikit-learn's multiprocessing parallel backend that's dedicated for that, and 
should have the necessary protections in place against such behavior. 
https://joblib.readthedocs.io/en/latest/parallel.html#joblib.parallel_backend 


TLDR: I don't think this is a Python bug and I'm in favor of this bug being 
closed as `not a bug`.

--
nosy: +kj

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42240] Add Maxheap version of a heappush into heapq module

[Raymond Hettinger]

Raymond Hettinger  added the comment:

Only the minheap is in the public API.  The maxheap functions are only supposed 
to be used internally.

Thank you for the suggestion, but I think we should decline.

--
resolution:  -> rejected
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42225] Tkinter hangs or crashes when displaying astral chars

[E. Paine]

E. Paine  added the comment:

For me, this is not limited to special characters. Trying to load anything in 
Tk using the 'JoyPixels' font crashes (sometimes it does load but all 
characters are very random - most are whitespace - and it crashes again after a 
call to `fc-cache`). IDLE crashes when trying to preview the font.

I believe this is what is being experienced on 
https://askubuntu.com/questions/1236488/x-error-of-failed-request-badlength-poly-request-too-large-or-internal-xlib-le
 because they are not using any special characters yet are reporting the same 
problem.

--
components:  -macOS
nosy: +epaine

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

[DanilZ]

DanilZ  added the comment:

Hi Ken, thanks for a quick reply.

Here are the requested specs.
System:
Python 3.7.6
OS X 10.15.7

Packages:
XGBoost 1.2.0
sklearn 0.22.2
pandas 1.0.5
numpy 1.18.1

I can see that you have reduced the code, which now excludes the 
RandomizedSearchCV part. This (reduced) code runs without any problems on my 
side as well, but if running it after the RandomizedSearchCV, the last function 
fit_model() freezes in a multiprocess.

I will read through the docs, but at first it looks as the actual problem is in 
the concurrent.futures module, because the easy function just_print() runs 
without issues. So the freeze is triggered by adding minor complexity into the 
fit_model() function running in a multiprocess.

> On 2 Nov 2020, at 17:34, Ken Jin  wrote:
> 
> 
> Ken Jin  added the comment:
> 
> Hello, it would be great if you can you provide more details. Like your 
> Operating System and version, how many logical CPU cores there are on your 
> machine, and lastly the exact Python version with major and minor versions 
> included (eg. Python 3.8.2). Multiprocessing behaves differently depending on 
> those factors.
> 
> FWIW I reduced your code down to make it easier to read, and removed all the 
> unused variables:
> 
> import concurrent.futures
> from sklearn.datasets import make_regression
> 
> def just_print():
>print('Just printing')
> 
> def fit_model():
>data = make_regression(n_samples=500, n_features=100, n_informative=10, 
> n_targets=1, random_state=5)
>print('Fit complete')
> 
> if __name__ == '__main__':
>with concurrent.futures.ProcessPoolExecutor() as executor:
>results_temp = [executor.submit(just_print) for i in range(0,12)]
> 
>with concurrent.futures.ProcessPoolExecutor() as executor:
>results_temp = [executor.submit(fit_model) for i in range(0,12)]
> 
> The problem is that I am *unable* to reproduce the bug you are reporting on 
> Windows 10 64-bit, Python 3.7.6. The code runs till completion for both 
> examples. I have a hunch that your problem lies elsewhere in one of the many 
> libraries you imported.
> 
 Note: problem occurs only after performing the RandomizedSearchCV...
> 
> Like you have noted, I went to skim through RandomizedSearchCV's source code 
> and docs. RandomizedSearchCV is purportedly able to use multiprocessing 
> backend for parallel tasks. By setting `n_jobs=-1` in your params, you're 
> telling it to use all logical CPU cores. I'm unsure of how many additional 
> processes and pools RandomizedSearchCV's spawns after calling it, but this 
> sounds suspicious. concurrent.futures specifically warns that this may 
> exhaust available workers and cause tasks to never complete. See 
> https://docs.python.org/3/library/concurrent.futures.html#threadpoolexecutor 
> (the docs here are for ThreadPoolExecutor, but they still apply).
> 
> A temporary workaround might be to reduce n_jobs OR even better: use 
> scikit-learn's multiprocessing parallel backend that's dedicated for that, 
> and should have the necessary protections in place against such behavior. 
> https://joblib.readthedocs.io/en/latest/parallel.html#joblib.parallel_backend 
> 
> 
> TLDR: I don't think this is a Python bug and I'm in favor of this bug being 
> closed as `not a bug`.
> 
> --
> nosy: +kj
> 
> ___
> Python tracker 
> 
> ___

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42236] os.device_encoding() doesn't respect the UTF-8 Mode

[STINNER Victor]

Change by STINNER Victor :


--
pull_requests: +22026
pull_request: https://github.com/python/cpython/pull/23109

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

[DanilZ]

DanilZ  added the comment:

Here is a gif of what’s going on in my ActivityMonitor on a Mac while this code 
is executed:
https://gfycat.com/unselfishthatgraysquirrel 


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42224] test_format:test_locale fails when locale does not set grouping in thousands

[Lysandros Nikolaou]

Lysandros Nikolaou  added the comment:


New changeset 301822859b3fc34801a06f1090d62f9f2ee5b092 by Lysandros Nikolaou in 
branch 'master':
bpo-42224: Fix test_format when locale does not expect number grouping 
(GH-23067)
https://github.com/python/cpython/commit/301822859b3fc34801a06f1090d62f9f2ee5b092


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42224] test_format:test_locale fails when locale does not set grouping in thousands

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 1.0 -> 2.0
pull_requests: +22027
pull_request: https://github.com/python/cpython/pull/23110

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42224] test_format:test_locale fails when locale does not set grouping in thousands

[Lysandros Nikolaou]

Change by Lysandros Nikolaou :


--
pull_requests: +22028
pull_request: https://github.com/python/cpython/pull/23111

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42246] Implement PEP 626

[Mark Shannon]

New submission from Mark Shannon :

Implementation of PEP 626 requires:

1. Implementation of the new line number table and associated APIs.
2. Removal of BEGIN_DO_NOT_EMIT_BYTECODE and END_DO_NOT_EMIT_BYTECODE from the 
compiler as they do not understand line numbers and may remove lines from the 
bytecode that they shouldn't.
3. Enhance compiler front-end and CFG optimizer to avoid the negative 
performance impact of PEP.
 a) Duplicate the tests in while blocks to avoid the extra jump instruction at 
the end of the loop.
 b) Duplicate and renumber terminator blocks that have no line numbers.

Guaranteeing that f_lineno is correct without hurting performance
-

PEP 626 mandates that the f_lineno attribute of a frame is always correct, even 
after a return or raise, but we don't want to hurt performance.
Since the interpreter ensures that the f_lasti attribute of a frame is always 
correct, we can ensure correctness of f_lineno at zero cost, by ensuring that 
all RETURN_VALUE, RAISE_VARARGS and RERAISE instruction have a non-negative 
line number. Then f_lineno can always be lazily computed from f_lasti.

The front-end generates artificial RERAISEs and RETURN_VALUE that have no line 
number. To give these instructions a valid line number we can take advantage of 
the fact that such terminator blocks (blocks with no successors) can be freely 
duplicated. Once duplicated, each terminator block will have only one 
predecessor and can acquire the line number of the preceding block, without 
causing false line events.

--
assignee: Mark.Shannon
messages: 380231
nosy: Mark.Shannon, pablogsal
priority: normal
severity: normal
status: open
title: Implement PEP 626
type: enhancement
versions: Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42037] Documentation confusion in CookieJar functions

[Roundup Robot]

Change by Roundup Robot :


--
keywords: +patch
nosy: +python-dev
nosy_count: 3.0 -> 4.0
pull_requests: +22029
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23112

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42246] Implement PEP 626

[Mark Shannon]

Change by Mark Shannon :


--
keywords: +patch
pull_requests: +22030
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/23113

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42224] test_format:test_locale fails when locale does not set grouping in thousands

[miss-islington]

miss-islington  added the comment:


New changeset 1e96de9ed4b1ca96d345b7e309a8fe3802638f4a by Miss Skeleton (bot) 
in branch '3.8':
bpo-42224: Fix test_format when locale does not expect number grouping 
(GH-23067)
https://github.com/python/cpython/commit/1e96de9ed4b1ca96d345b7e309a8fe3802638f4a


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

[DanilZ]

DanilZ  added the comment:

FYI: I’ve tried all the three of the possible backends: ‘loky’ (default) / 
’threading’ / ‘multiprocessing’. None of them solved the problem.

> On 2 Nov 2020, at 17:34, Ken Jin  wrote:
> 
> A temporary workaround might be to reduce n_jobs OR even better: use 
> scikit-learn's multiprocessing parallel backend that's dedicated for that, 
> and should have the necessary protections in place against such behavior. 
> https://joblib.readthedocs.io/en/latest/parallel.html#joblib.parallel_backend 
> 

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42236] os.device_encoding() doesn't respect the UTF-8 Mode

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 4b9aad49992a825d8c76e428ed1aca81dd3878b2 by Victor Stinner in 
branch 'master':
bpo-42236: Enhance init and encoding documentation (GH-23109)
https://github.com/python/cpython/commit/4b9aad49992a825d8c76e428ed1aca81dd3878b2


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42224] test_format:test_locale fails when locale does not set grouping in thousands

[Lysandros Nikolaou]

Lysandros Nikolaou  added the comment:


New changeset 723e21a8e79815ae77474d1f21b9847b9c9bdbeb by Lysandros Nikolaou in 
branch '3.9':
bpo-42224: Fix test_format when locale does not expect number grouping 
(GH-23067)
https://github.com/python/cpython/commit/723e21a8e79815ae77474d1f21b9847b9c9bdbeb


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

[Ken Jin]

Ken Jin  added the comment:

Hmm apologies I'm stumped then. The only things I managed to surmise from 
xgboost's and scikit-learn's GitHub issues is that this is a recurring issue 
specifically when using GridSearchCV :

Threads with discussions on workarounds:
https://github.com/scikit-learn/scikit-learn/issues/6627
https://github.com/scikit-learn/scikit-learn/issues/5115

Issues reported:
https://github.com/dmlc/xgboost/issues/2163
https://github.com/scikit-learn/scikit-learn/issues/10533
https://github.com/scikit-learn/scikit-learn/issues/10538 (this looks quite 
similar to your issue)

Some quick workarounds I saw were:
1. Remove n_jobs argument from GridSearchCV
2. Use parallel_backend from sklearn.externals.joblib rather than 
concurrent.futures so that the pools from both libraries don't have weird 
interactions.

I recommend opening an issue on scikit-learn/XGBoost's GitHub. This seems like 
a common problem that they face.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37193] Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn

[Pablo Galindo Salgado]

Pablo Galindo Salgado  added the comment:


New changeset aca67da4fe68d5420401ac1782203d302875eb27 by Jason R. Coombs in 
branch 'master':
Revert "bpo-37193: remove thread objects which finished process its request 
(GH-13893)" (GH-23107)
https://github.com/python/cpython/commit/aca67da4fe68d5420401ac1782203d302875eb27


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42180] Missing a plural in library/functions

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +22031
pull_request: https://github.com/python/cpython/pull/23114

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41832] PyType_FromSpec() should accept tp_doc=NULL

[hai shi]

hai shi  added the comment:

I will take a look in this weekend :)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42210] float.hex discards sign from -nan

[Sree]

Sree  added the comment:

Thanks, all. I just wanted to know if this was a deliberate decision or an 
oversight. It also took me a while to realize it washex, and not fromhex.

That allows the current behaviour to be easily worked around in Python code, 
and a backwards compatible optional parameter to hex() might allow -nan in the 
future without breaking existing software.

Surprisingly, the standard does allow this [but this may not have been the 
intent] -- (Section 6.2) "Recognize that format conversions,
including conversions between supported formats and external representations as 
character sequences,
might be unable to deliver the same NaN." The conversion to character sequences 
text is key since I'm using a test harness written in Python that writes out 
and reads back text files containing float data.

Section 6.3 in the standard also adds more details on when the sign bit in NaNs 
is relevant.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42245] concurrent.futures.ProcessPoolExecutor freezes depending on complexity

[DanilZ]

DanilZ  added the comment:

Thank you so much for the input! I will study all the links you have sent:

Here is a screen recording of some additional experiments:
https://vimeo.com/user50681456/review/474733642/b712c12c2c 


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[Gordon Ross]

Gordon Ross  added the comment:

I can understand the frustrations around dealing with minority platforms, but 
please remember that the illumos project (www.illumos.org) is basically the 
inheritor of problems around "Build on Solaris" for 3rd party software like 
Python.  There are several OS distributions based on illumos that would be 
impacted by removing the ability to (easily) build Python. I'm confident we can 
find some people to help maintain build-bots etc. if that's what it takes.  If 
you're still looking for such help, let me know and I'll ask on 
develop...@list.illumos.org for volunteers.

Thanks!  -GWR

--
nosy: +gwr

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42228] Activate.ps1 clears PYTHONHOME

[Steve Dower]

Steve Dower  added the comment:

If `\Lib\os.py` exists, then you shouldn't need either 
a registry entry or environment variable.

This sounds the same as the approach used on GitHub Actions and Azure 
Pipelines, and also through the packages at 
https://www.nuget.org/packages/python. These work fine, as far as I'm aware.

If there is some other reason you need PYTHONHOME to be set inside an activated 
virtual environment, you could set it _after_ activating the environment, or 
just modify the Activate.ps1 that is included in your tarball.

However, I seem to recall there were some fairly obscure bugs if a venv didn't 
resolve itself normally. So your best bet is to make sure that it can be 
resolved without needing the setting.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42228] Activate.ps1 clears PYTHONHOME

[Ben Boeckel]

Ben Boeckel  added the comment:

We build our own applications which run Python interpreters internally, so the 
auto-discovery won't work. It also doesn't seem to work for venvs either since 
the venv's `python.exe` is under `Scripts` which makes it not able to find 
things either on its own.

I've worked around it so far by just ignoring `Activate.ps1` completely and 
setting up PATH, PYTHONHOME, and PYTHONPATH instead, but this tells me that 
`Activate.ps1` probably needs some consideration for other use cases. The 
layout certainly seems wrong for auto-discovery at least.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42247] unittest hides traceback frames in chained exceptions

[David Mandelberg]

New submission from David Mandelberg :

The traceback in the output of the attached test (see below) doesn't include 
line 5, which is where the original exception is raised. I think this is 
because 
https://github.com/python/cpython/blob/b9ee4af4c643a323779fd7076e80b29d611f2709/Lib/unittest/result.py#L180-L186
 uses the `limit` parameter to try to hide the implementation of `self.fail()` 
from the traceback, but `traceback.TracebackException.format()` applies the 
limit to the chained exception. I'm not sure if that's a bug in unittest or 
traceback, but from the comment in the above part of unittest, I don't think 
it's intentional.


F
==
FAIL: test_foo (__main__.FooTest)
--
Traceback (most recent call last):
  File "foo.py", line 12, in test_foo
foo()
ValueError: foo

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "foo.py", line 14, in test_foo
self.fail('foo() raised ValueError')
AssertionError: foo() raised ValueError

--
Ran 1 test in 0.000s

FAILED (failures=1)

--
components: Library (Lib)
files: foo.py
messages: 380244
nosy: dseomn
priority: normal
severity: normal
status: open
title: unittest hides traceback frames in chained exceptions
type: behavior
versions: Python 3.8
Added file: https://bugs.python.org/file49563/foo.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42246] Implement PEP 626

[Pablo Galindo Salgado]

Pablo Galindo Salgado  added the comment:

I'm happy that we are removing BEGIN_DO_NOT_EMIT_BYTECODE and 
END_DO_NOT_EMIT_BYTECODE but could you elaborate how this is related? These 
macros protect the compiler from emitting bytecode that corresponds to deaf 
code and by definition, unreachable. Could you give an example of a situation 
in which they create something that messes up the line numbers? Is this 
something to be with cleanup blocks in dead code or something similar?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41943] unittest.assertLogs passes unexpectedly

[miss-islington]

miss-islington  added the comment:


New changeset 6fdfcec5b11f44f27aae3d53ddeb004150ae1f61 by Irit Katriel in 
branch 'master':
bpo-41943: Fix bug where assertLogs doesn't correctly filter messages… 
(GH-22565)
https://github.com/python/cpython/commit/6fdfcec5b11f44f27aae3d53ddeb004150ae1f61


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42243] Don't access the module dictionary directly

[Raymond Hettinger]

Raymond Hettinger  added the comment:

I would leave it as-is.

--
nosy: +rhettinger

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42228] Activate.ps1 clears PYTHONHOME

[Steve Dower]

Steve Dower  added the comment:

> I've worked around it so far by just ignoring `Activate.ps1` completely and 
> setting up PATH, PYTHONHOME, and PYTHONPATH instead

This sounds like the right approach. Though if you're genuinely embedding 
Python in your application you should consider just including a copy of the 
runtime that you can fully control.

> this tells me that `Activate.ps1` probably needs some consideration for other 
> use cases. The layout certainly seems wrong for auto-discovery at least.

Activate.ps1 only has one use case: to activate a virtual environment created 
with -m venv against a regular installation. Once you're customising the base 
install, you can use a python._pth file [1], a regular .pth file [2], or 
environment variables, but the venv tool isn't really for that case.

1: https://docs.python.org/3/using/windows.html#finding-modules
2: https://docs.python.org/3/library/site.html

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42248] Raised exception in Enum keeping user objects alive unnecessarily

[Eric Froemling]

New submission from Eric Froemling :

I've run into an issue where exceptions thrown by Enum constructors are keeping 
my objects alive. The underlying issue seems to be the same as 
https://bugs.python.org/issue36820

The same method used to fix the issue above seems to work here: simply adding a 
try/finally clause around the error handling at the end of enum.Enum.__new__() 
which sets ve_exc and exc to None does the trick.

I've attached a short script which demonstrates the issue. I realize that the 
cyclic garbage collector will eventually handle this case, but its a bummer to 
lose determinism in the destruction of my objects.

I'd be happy to create a PR for this or whatever I can do to help; just let me 
know if I should (I'm new here).

--
components: Library (Lib)
files: enum_ref_loop_example.py
messages: 380249
nosy: efroemling
priority: normal
severity: normal
status: open
title: Raised exception in Enum keeping user objects alive unnecessarily
versions: Python 3.8
Added file: https://bugs.python.org/file49564/enum_ref_loop_example.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41435] Allow to retrieve ongoing exception handled by every threads

[Serhiy Storchaka]

Change by Serhiy Storchaka :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42103] [security] DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:


New changeset 34637a0ce21e7261b952fbd9d006474cc29b681f by Serhiy Storchaka in 
branch 'master':
bpo-42103: Improve validation of Plist files. (GH-22882)
https://github.com/python/cpython/commit/34637a0ce21e7261b952fbd9d006474cc29b681f


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42103] [security] DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 4.0 -> 5.0
pull_requests: +22032
pull_request: https://github.com/python/cpython/pull/23115

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41796] _ast module state should be made per interpreter

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 5cf4782a2630629d0978bf4cf6b6340365f449b2 by Victor Stinner in 
branch 'master':
bpo-41796: Make _ast module state per interpreter (GH-23024)
https://github.com/python/cpython/commit/5cf4782a2630629d0978bf4cf6b6340365f449b2


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42103] [security] DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format

[Serhiy Storchaka]

Change by Serhiy Storchaka :


--
pull_requests: +22033
pull_request: https://github.com/python/cpython/pull/23116

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42103] [security] DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format

[Serhiy Storchaka]

Change by Serhiy Storchaka :


--
pull_requests: +22034
pull_request: https://github.com/python/cpython/pull/23117

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42103] [security] DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format

[miss-islington]

miss-islington  added the comment:


New changeset e277cb76989958fdbc092bf0b2cb55c43e86610a by Miss Skeleton (bot) 
in branch '3.9':
bpo-42103: Improve validation of Plist files. (GH-22882)
https://github.com/python/cpython/commit/e277cb76989958fdbc092bf0b2cb55c43e86610a


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42224] test_format:test_locale fails when locale does not set grouping in thousands

[Lysandros Nikolaou]

Change by Lysandros Nikolaou :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42103] [security] DoS (MemError via CPU and RAM exhaustion) when processing malformed Apple Property List files in binary format

[Serhiy Storchaka]

Change by Serhiy Storchaka :


--
pull_requests: +22035
pull_request: https://github.com/python/cpython/pull/23118

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42236] os.device_encoding() doesn't respect the UTF-8 Mode

[STINNER Victor]

Change by STINNER Victor :


--
pull_requests: +22036
pull_request: https://github.com/python/cpython/pull/23119

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41796] _ast module state should be made per interpreter

[STINNER Victor]

Change by STINNER Victor :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26789] logging: Trying to log during Python finalization with NameError: name 'open' is not defined

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 45df61fd2d58e8db33179f3b5d00e53fe6a7e592 by Victor Stinner in 
branch 'master':
bpo-26789: Fix logging.FileHandler._open() at exit (GH-23053)
https://github.com/python/cpython/commit/45df61fd2d58e8db33179f3b5d00e53fe6a7e592


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26789] logging: Trying to log during Python finalization with NameError: name 'open' is not defined

[STINNER Victor]

STINNER Victor  added the comment:

I fixed the issue in the master and I will not backport the change to stable 
branches on purpose. Thanks for the review Vinay!

--

I pushed a change in Python 3.10 which reduces the risk of "NameError: name 
'open' is not defined" when logging really late during the Python finalization.

It's a workaround on fragile finalization code. Please don't rely on it! You 
should release resources explicitly at exit. Don't rely on implicit __del__() 
finalizers.

I chose to enhance the logging module anyway since the initial issue was that 
asyncio failed to log a message at exit, a message which is supposed to help 
developer to fix their code. It's a convenient tool to ease debugging. But, 
again, it would be really bad idea to rely on it to ensure that logging still 
works after logging.shutdown() has been called!

About asyncio, for development, you can try to frequently call gc.collect() 
using call_later() or something, to get issues like "never-retrieved 
exceptions":
https://docs.python.org/dev/library/asyncio-dev.html

I chose to restrict this issue to the very specific case of NameError when 
calling logging.FileHandler.emit() late during the Python finalization.

If someone wants to enhance another function, please open a new issue.

I will not backport my change since the Python finalization is really fragile 
and my logging fix rely on many enhancements made in the master that will not 
be backported to Python 3.9 and older on purpose. Changes on the finalization 
are also fragile and can introduce new subtile bugs. It happened multiple 
times. But overall, step by step, the Python finalization becomes more and more 
reliable ;-)

For curious people, here are my notes on the Python finalization:
https://pythondev.readthedocs.io/finalization.html

--

About the logging, honestly, I'm not sure that it's a good idea that 
FileHandler.emit() reopens the file after logging.shutdown() has been called 
(this function calls FileHandler.close() which closes the file).

But if someone disagrees, please open a separated issue ;-) This one is now 
closed.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35455] Solaris: thread_time doesn't work with current implementation

[Pablo Galindo Salgado]

Pablo Galindo Salgado  added the comment:


New changeset 9568622c9983b682b2a2a7bacfd3c341028ea099 by Jakub Kulík in branch 
'master':
bpo-35455: Fix thread_time for Solaris OS (GH-8)
https://github.com/python/cpython/commit/9568622c9983b682b2a2a7bacfd3c341028ea099


--
nosy: +pablogsal

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35455] Solaris: thread_time doesn't work with current implementation

[Pablo Galindo Salgado]

Change by Pablo Galindo Salgado :


--
resolution:  -> fixed
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[Terry J. Reedy]

Terry J. Reedy  added the comment:

People interested in helping Solaris issues should see my post above, msg380006.

Issue #35455, about thread time on Solaris, with a simple but non-trivial 
patch, was just closed as fixed after reviews from 2 coredevs and a 3rd person.

I presume Victor will close his proposed PR when there is a buildbot and 
additional action on issues.  We have gotten new information that supports 
doing so.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42173] Drop Solaris support

[Raymond Hettinger]

Raymond Hettinger  added the comment:

Victor, are you going to close the PR?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42180] Missing a plural in library/functions

[Pablo Galindo Salgado]

Pablo Galindo Salgado  added the comment:


New changeset 6b7a90db362253d67201c2a438a3f38f1ec6180c by Miss Skeleton (bot) 
in branch '3.9':
bpo-42180: fix plural in arguments and control (GH-23015) (GH-23114)
https://github.com/python/cpython/commit/6b7a90db362253d67201c2a438a3f38f1ec6180c


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com