[issue14107] Debian bigmem buildbot hanging in test_bigmem

Changes by Charles-François Natali : -- resolution: -> fixed stage: needs patch -> committed/rejected status: open -> closed ___ Python tracker ___ _

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Charles-François Natali added the comment: test_bigmem now passes on the buildbot: http://python.org/dev/buildbot/all/builders/AMD64%20debian%20bigmem%203.x/builds/149/steps/test/logs/stdio -- ___ Python tracker _

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Roundup Robot added the comment: New changeset 52dc4fcd0d6f by Charles-François Natali in branch 'default': Issue #14107: test: Fix a deadlock involving the memory watchdog thread. http://hg.python.org/cpython/rev/52dc4fcd0d6f -- ___ Python tracker

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Charles-François Natali added the comment: > I think my original plan was to put it in non-blocking mode, but I > must have forgotten in the end. Here's a patch. > I can't think of any drawback off the top of my head, so that sounds > reasonable. I'll try to write up a patch (I have only 1.2G

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Antoine Pitrou added the comment: > """ > /* We can't do anything if the consumer is too slow, just bail > out */ > if (write(watchdog.wfd, (void *) &x, sizeof(x)) < sizeof(x)) >break; > if (write(watchdog.wfd, data, data_len) < data_len) >

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Charles-François Natali added the comment: > 1. IIUC, the goal of the watchdog thread is to collect memory > consumption in a timely manner: that's now the case, but since the > information is printed in a standard thread, it doesn't bring any improvement > (because it can be delayed for arbitr

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Charles-François Natali added the comment: """ Thread 0x2ba588709700: File "/var/tmpfs/martin.vonloewis/3.x.loewis-parallel2/build/Lib/test/support.py", line 1168 in consumer File "/var/tmpfs/martin.vonloewis/3.x.loewis-parallel2/build/Lib/threading.py", line 682 in run File "/var

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Nadeem Vawda added the comment: The buildbot still isn't happy: http://www.python.org/dev/buildbot/all/builders/AMD64%20debian%20bigmem%203.x/builds/144/steps/test/logs/stdio Also, I ran the test on my own machine and noticed two tests that are still exceeding their nominal peak memory us

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Nadeem Vawda added the comment: > My PC has 12 GB of RAM and no swap. I ran the test after my commit. That explains. I ran it earlier (obviously), so it included a bunch of those more-demanding tests, which must be where the OOM killer hit it. -- __

[issue14107] Debian bigmem buildbot hanging in test_bigmem

STINNER Victor added the comment: >> I ran test_bigmem on my computer. The test pass but it is really slow. > > Is this with or without the fix you just pushed? How much RAM does your > system have? I tried running with "-M 4.5G" on my 8GB machine earlier > today, and it ate through all of my RA

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Nadeem Vawda added the comment: > I ran test_bigmem on my computer. The test pass but it is really slow. Is this with or without the fix you just pushed? How much RAM does your system have? I tried running with "-M 4.5G" on my 8GB machine earlier today, and it ate through all of my RAM plus 4GB

[issue14107] Debian bigmem buildbot hanging in test_bigmem

STINNER Victor added the comment: I ran test_bigmem on my computer. The test pass but it is really slow. $ ./python -m test -v -M 8G test_bigmem (... Ran 164 tests in 3228.227s OK (skipped=44) 1 test OK. One hour, whereas 44 tests are skipped. Skipped tests are the tests using the m

[issue14107] Debian bigmem buildbot hanging in test_bigmem

Roundup Robot added the comment: New changeset 4afcb25988c4 by Victor Stinner in branch 'default': Issue #14107: fix bigmem tests on str.capitalize(), str.swapcase() and http://hg.python.org/cpython/rev/4afcb25988c4 -- nosy: +python-dev ___ Python tr

[issue14107] Debian bigmem buildbot hanging in test_bigmem

New submission from Nadeem Vawda : On the debian bigmem buildbot, test_bigmem hangs until it gets killed by a timeout: http://www.python.org/dev/buildbot/all/builders/AMD64%20debian%20bigmem%203.x/builds/134/steps/test/logs/stdio http://www.python.org/dev/buildbot/all/builders/AMD64%2