Re: comparing parallel test runs

2017-05-18 Thread Marek Polacek
On Thu, May 18, 2017 at 05:22:50PM -0600, Martin Sebor wrote: > On 05/17/2017 11:19 PM, Andi Kleen wrote: > > Marek Polacek writes: > > > > > On Wed, May 17, 2017 at 09:13:40AM -0600, Jeff Law wrote: > > > > On 05/17/2017 04:23 AM, Aldy Hernandez wrote: > > > > > Hi folks. > > > > > > > > > > I'

Re: comparing parallel test runs

2017-05-18 Thread Martin Sebor
On 05/17/2017 11:19 PM, Andi Kleen wrote: Marek Polacek writes: On Wed, May 17, 2017 at 09:13:40AM -0600, Jeff Law wrote: On 05/17/2017 04:23 AM, Aldy Hernandez wrote: Hi folks. I've been having troubles comparing the results of different test runs for quite some time, and have finally deci

Re: comparing parallel test runs

2017-05-17 Thread Andi Kleen
Marek Polacek writes: > On Wed, May 17, 2017 at 09:13:40AM -0600, Jeff Law wrote: >> On 05/17/2017 04:23 AM, Aldy Hernandez wrote: >> > Hi folks. >> > >> > I've been having troubles comparing the results of different test runs >> > for quite some time, and have finally decided to whine about it.

Re: comparing parallel test runs

2017-05-17 Thread Marek Polacek
On Wed, May 17, 2017 at 09:13:40AM -0600, Jeff Law wrote: > On 05/17/2017 04:23 AM, Aldy Hernandez wrote: > > Hi folks. > > > > I've been having troubles comparing the results of different test runs > > for quite some time, and have finally decided to whine about it. Perhaps > > someone can point

Re: comparing parallel test runs

2017-05-17 Thread Jeff Law
On 05/17/2017 04:23 AM, Aldy Hernandez wrote: > Hi folks. > > I've been having troubles comparing the results of different test runs > for quite some time, and have finally decided to whine about it. Perhaps > someone can point out to whatever I may be doing wrong. > > I generally do "make check

Re: comparing parallel test runs

2017-05-17 Thread Jeff Law
On 05/17/2017 07:28 AM, Jonathan Wakely wrote: > On 17 May 2017 at 11:23, Aldy Hernandez wrote: >> Has anyone seen this behavior? Is it my test box? Are there known problems >> with parallel checks? > > Smells like https://gcc.gnu.org/bugzilla/show_bug.cgi?id=77684 > Yup. Note that I ack'd a p

Re: comparing parallel test runs

2017-05-17 Thread Jonathan Wakely
On 17 May 2017 at 11:23, Aldy Hernandez wrote: > Has anyone seen this behavior? Is it my test box? Are there known problems > with parallel checks? Smells like https://gcc.gnu.org/bugzilla/show_bug.cgi?id=77684

Re: comparing parallel test runs

2017-05-17 Thread Richard Biener
On Wed, May 17, 2017 at 12:23 PM, Aldy Hernandez wrote: > Hi folks. > > I've been having troubles comparing the results of different test runs for > quite some time, and have finally decided to whine about it. Perhaps someone > can point out to whatever I may be doing wrong. > > I generally do "ma

comparing parallel test runs

2017-05-17 Thread Aldy Hernandez
Hi folks. I've been having troubles comparing the results of different test runs for quite some time, and have finally decided to whine about it. Perhaps someone can point out to whatever I may be doing wrong. I generally do "make check -k -j60" on two different trees and compare the results