[Python-Dev] Sporadic failures of test_subprocess and test_multiprocessing_spawn

[Victor Stinner]

Hi,

Can you please take a look at the following issue and try to reproduce it?
http://bugs.python.org/issue23771

The following tests sometimes hang on "x86 Ubuntu Shared 3.x" and
"AMD64 Debian root 3.x" buildbots:

- test_notify_all() of test_multiprocessing_spawn
- test_double_close_on_error() of test_subprocess
- other sporadic failures of test_subprocess

I'm quite sure that they are regressions, maybe related to the
implementation of the PEP 475. In the middle of all PEP 475 changes, I
changed some functions to release the GIL on I/O, it wasn't the case
before. I may be related.

Are you able to reproduce these issues? I'm unable to reproduce them
on Fedora 21. Maybe they are more likely on Debian-like operating
systems?

Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

[Python-Dev] MemoryError and other bugs on AMD64 OpenIndiana 3.x

[Victor Stinner]

Hi,

The buildbot AMD64 OpenIndiana 3.x is always red since at least 6
months. Almost always, tests fail because the buildbot has not enough
memory. Well, it's fun to see how Python handles MemoryError (it's
pretty good, there is no hard crash! my work on failmalloc was maybe
useful ;-)), but it doesn't help to detect regressions.

Would it be possible to enhance this buildbot?

I copy this email to the owner of buildbot. But I also sent it to
python-dev because MemoryError is not the only error, please take care
of our buildbots!

Thanks,
Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

[Python-Dev] Buildbot x86 XP-4 3.x doesn't compile anymore: drop it?

[Victor Stinner]

Hi,

The buildbot x86 XP-4 3.x doesn't compile anymore since 3 months or
more (maybe when Steve upgraded the Visual Studio project to VS 2015?
I don't know).

Would it be possible to fix this buildbot, or to turn it off?

By the way, do we seriously want to support Windows XP? I mean, *who*
will maintain it (no me sorry!). I saw recent changes to explicitly
*drop* support for Windows older than Visa (stop using GetTickCount,
always call GetTickCount64, for time.monotonic).

Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

[Python-Dev] OpenBSD buildbot has many failures

[Victor Stinner]

Hi,

The OpenBSD buildbot always fail with the same failures since many
months (ex: test_socket). Is someone interested to fix them? If no,
would it be possible to turn it off to get a better view of
regressions? Currently, they are too many red buildbots to quickly see
regressions introduced by recent commits.

http://buildbot.python.org/all/builders/x86%20OpenBSD%205.5%203.x

Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

[Python-Dev] Buildbot PPC64 AIX 3.x failures

[Victor Stinner]

Hi,

There are many failures on the AIX buildbot. Can someone try to fix
them? Or would it be possible to turn off the buildbot to quickly see
regressions?

http://buildbot.python.org/all/builders/PPC64%20AIX%203.x/builds/3426/steps/test/logs/stdio

The buildbot has not enough memory, and some tests are failing since
more than 3 months.

Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Buildbot x86 XP-4 3.x doesn't compile anymore: drop it?

[Tim Golden]

On 28/03/2015 09:51, Victor Stinner wrote:

Hi,

The buildbot x86 XP-4 3.x doesn't compile anymore since 3 months or
more (maybe when Steve upgraded the Visual Studio project to VS 2015?
I don't know).

Would it be possible to fix this buildbot, or to turn it off?

By the way, do we seriously want to support Windows XP? I mean, *who*
will maintain it (no me sorry!). I saw recent changes to explicitly
*drop* support for Windows older than Visa (stop using GetTickCount,
always call GetTickCount64, for time.monotonic).


Per PEP 11, we track Microsoft lifecycle support, so we no longer 
support WinXP on 3.5 and newer. We do support XP on 3.4 and older, 
including 2.7. At least, that's my understanding. Given that, the only 
XP buildbot which makes sense is one running VS 2008 (2.7, 3.1, 3.2) or 
VS 2010 (3.3, 3.4).


I think -- and I'm responding here to the wider set of emails Victor has 
just posted re failing buildbots -- that the difficulty with red 
buildbots is finding someone at the intersection of understanding the 
buildbot platform and understanding the code which has just broken it. 
(Or at least, having the wherewithal to come to understand both).


And that someone might well not be the person who's hosting the 
buildbot: at its minimum they run up a VM and install the OS and the 
required tools. It's can be a way of offering help to the Python 
community without even being involved in core development at all.


I concur with what Victor's touched on: that buildbots are not useful if 
they're always red. But finding the right person to turn them green is 
not necessarily easy.


For myself I'm quite willing for someone to ping me with: "there's a 
Windows buildbot gone red; can you have a look?" But I have precious 
little time, and if the failure requires me to garner an understanding 
of a deep-level code change, a version-specific issue with the VS 
compiler, and some odd interaction with VM on which the buildbot is 
running, I'm unlikely to have enough time or energy to invest in it.


Willing-but-not-always-able-ly-yours,

TJG
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Sporadic failures of test_subprocess and test_multiprocessing_spawn

[Chris Angelico]

On Sat, Mar 28, 2015 at 8:39 PM, Victor Stinner
 wrote:
> Are you able to reproduce these issues? I'm unable to reproduce them
> on Fedora 21. Maybe they are more likely on Debian-like operating
> systems?

I just tried it on my Debian Wheezy AMD64, not running as root. (The
same computer the buildbot runs on, but the host OS rather than the
virtual machine.) Unable to reproduce. Ran a full 'make test' and
still no problems.

Am now trying it on the buildbot itself, to see if I can recreate it.

ChrisA
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Buildbot x86 XP-4 3.x doesn't compile anymore: drop it?

[Victor Stinner]

Le samedi 28 mars 2015, Tim Golden  a écrit :
>
> For myself I'm quite willing for someone to ping me with: "there's a
> Windows buildbot gone red; can you have a look?" But I have precious little
> time, and if the failure requires me to garner an understanding of a
> deep-level code change, a version-specific issue with the VS compiler, and
> some odd interaction with VM on which the buildbot is running, I'm unlikely
> to have enough time or energy to invest in it.
>

You don't need to monitor buildobts everydays. Last days I checked
buildbots because I made chnages which behave differently on each platform.

Usually, I try to check buildbots each month and I only try to fix obvious
bugs and a few of the most annoying issues.

The problem is more on platforms which less interesged developers like AIX,
OpenBSD, old FreeBSD, etc.

Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Sporadic failures of test_subprocess and test_multiprocessing_spawn

[Chris Angelico]

On Sat, Mar 28, 2015 at 9:10 PM, Chris Angelico  wrote:
> On Sat, Mar 28, 2015 at 8:39 PM, Victor Stinner
>  wrote:
>> Are you able to reproduce these issues? I'm unable to reproduce them
>> on Fedora 21. Maybe they are more likely on Debian-like operating
>> systems?
>
> I just tried it on my Debian Wheezy AMD64, not running as root. (The
> same computer the buildbot runs on, but the host OS rather than the
> virtual machine.) Unable to reproduce. Ran a full 'make test' and
> still no problems.
>
> Am now trying it on the buildbot itself, to see if I can recreate it.

It seems to be stalling out. I'm not sure exactly what's happening
here. Running just that one file doesn't do it, but running the full
test suite results in a stall.

ChrisA
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Sporadic failures of test_subprocess and test_multiprocessing_spawn

[Victor Stinner]

Good, you are able to reproduce it. The next step is to identify the
sequence of test to reproduce it. How do you run the test suite? Are you
using -j1?

Victor

Le samedi 28 mars 2015, Chris Angelico  a écrit :

> On Sat, Mar 28, 2015 at 9:10 PM, Chris Angelico  > wrote:
> > On Sat, Mar 28, 2015 at 8:39 PM, Victor Stinner
> > > wrote:
> >> Are you able to reproduce these issues? I'm unable to reproduce them
> >> on Fedora 21. Maybe they are more likely on Debian-like operating
> >> systems?
> >
> > I just tried it on my Debian Wheezy AMD64, not running as root. (The
> > same computer the buildbot runs on, but the host OS rather than the
> > virtual machine.) Unable to reproduce. Ran a full 'make test' and
> > still no problems.
> >
> > Am now trying it on the buildbot itself, to see if I can recreate it.
>
> It seems to be stalling out. I'm not sure exactly what's happening
> here. Running just that one file doesn't do it, but running the full
> test suite results in a stall.
>
> ChrisA
> ___
> Python-Dev mailing list
> Python-Dev@python.org 
> https://mail.python.org/mailman/listinfo/python-dev
> Unsubscribe:
> https://mail.python.org/mailman/options/python-dev/victor.stinner%40gmail.com
>
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Sporadic failures of test_subprocess and test_multiprocessing_spawn

[Chris Angelico]

On Sat, Mar 28, 2015 at 11:50 PM, Victor Stinner
 wrote:
> Good, you are able to reproduce it. The next step is to identify the
> sequence of test to reproduce it. How do you run the test suite? Are you
> using -j1?

I just ran 'make test'. Early in the output are these lines:

./python  ./Tools/scripts/run_tests.py
/root/build/python -W default -bb -E -R -W error::BytesWarning -m test
-r -w -j 0 -u all,-largefile,-audio,-gui

(The build was done in /root/build, fwiw)

So it seems to be -j0.

ChrisA
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Buildbot PPC64 AIX 3.x failures

[David Edelsohn]

On Sat, Mar 28, 2015 at 5:57 AM, Victor Stinner
 wrote:
> Hi,
>
> There are many failures on the AIX buildbot. Can someone try to fix
> them? Or would it be possible to turn off the buildbot to quickly see
> regressions?
>
> http://buildbot.python.org/all/builders/PPC64%20AIX%203.x/builds/3426/steps/test/logs/stdio
>
> The buildbot has not enough memory, and some tests are failing since
> more than 3 months.

I have cleaned out the build directories and restarted the buildslave.

There is more than enough memory and most memory process limits are
unlimited.  One of the tests presumably crashed in a bad way that
prevented normal cleanup by the buildslave.

- David
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Sporadic failures of test_subprocess and test_multiprocessing_spawn

[Serhiy Storchaka]

On 28.03.15 11:39, Victor Stinner wrote:

Can you please take a look at the following issue and try to reproduce it?
http://bugs.python.org/issue23771

The following tests sometimes hang on "x86 Ubuntu Shared 3.x" and
"AMD64 Debian root 3.x" buildbots:

- test_notify_all() of test_multiprocessing_spawn
- test_double_close_on_error() of test_subprocess
- other sporadic failures of test_subprocess

I'm quite sure that they are regressions, maybe related to the
implementation of the PEP 475. In the middle of all PEP 475 changes, I
changed some functions to release the GIL on I/O, it wasn't the case
before. I may be related.

Are you able to reproduce these issues? I'm unable to reproduce them
on Fedora 21. Maybe they are more likely on Debian-like operating
systems?


Just run tests with low memory limit.

(ulimit -v 6; ./python -m test.regrtest -uall -v 
test_multiprocessing_spawn;)


test_io also hangs.


___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Buildbot x86 XP-4 3.x doesn't compile anymore: drop it?

[David Bolen]

Victor Stinner  writes:

> Would it be possible to fix this buildbot, or to turn it off?
(...)
> By the way, do we seriously want to support Windows XP? I mean, *who*
> will maintain it (no me sorry!).  I saw recent changes to explicitly
> *drop* support for Windows older than Visa (stop using GetTickCount,
> always call GetTickCount64, for time.monotonic).

Disabling the 3.x branch (or 3.5+ going forward) on the XP buildbot
seems plausible to me, assuming the issue is unlikely to be fixed (or
someone found with time to look into it).

If, as Tim suggests in his response, 3.5+ need not be officially
supported on XP anyway, it may not be worth much effort to address.
At some point (such as switching to VS 2015), we aren't going to be
able to compile newer releases under XP anyway.

I'm assuming you aren't suggesting turning off the XP buildbot
entirely, correct?  As long as any fixes are still getting applied to
2.x or earlier 3.x releases, I do think having a buildbot covering
those branches for XP would be useful, if only to catch possible
issues in back-ported fixes.  There's still an amazing number of XP
systems in service.  While I doubt very many of those running XP also
need the latest 3.x release of Python, I expect there are quite a few
active 2.x users.

-- David

___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Buildbot x86 XP-4 3.x doesn't compile anymore: drop it?

[Victor Stinner]

Le 28 mars 2015 21:15, "David Bolen"  a écrit :

> I'm assuming you aren't suggesting turning off the XP buildbot
> entirely, correct?

I'm talking about the 3.x slave, so only python 3.5.

Would it be possible to specify in What's New In Python 3.5 which Windows
versions are no more supported?

Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com

Re: [Python-Dev] Buildbot x86 XP-4 3.x doesn't compile anymore: drop it?

[Steve Dower]

We discussed that a while back and decided the PEP was sufficient, but I'm not 
entirely opposed to a reminder.

Probably best to repurpose this buildbot for 2.7. David has a Windows 8.1 one 
that should be marked as stable for 3.x (though it's not quite stable yet... 
AFAIK it's the only machine with VS 2015 other than mine).

Cheers,
Steve

Top-posted from my Windows Phone

From: Victor Stinner
Sent: ‎3/‎28/‎2015 16:14
To: David Bolen
Cc: python-dev@python.org
Subject: Re: [Python-Dev] Buildbot x86 XP-4 3.x doesn't compile anymore: drop 
it?


Le 28 mars 2015 21:15, "David Bolen" 
mailto:db3l@gmail.com>> a écrit :

> I'm assuming you aren't suggesting turning off the XP buildbot
> entirely, correct?

I'm talking about the 3.x slave, so only python 3.5.

Would it be possible to specify in What's New In Python 3.5 which Windows 
versions are no more supported?

Victor
___
Python-Dev mailing list
Python-Dev@python.org
https://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: 
https://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com