Re: comparing DejaGNU results

2006-06-03 Thread James Lemke
On Fri, 2006-06-02 at 16:26 -0700, Mike Stump wrote: > On Jun 2, 2006, at 11:08 AM, James Lemke wrote: > > I took a quick pass at implementing the comparisons in a more suitable > > lanugage. Run time is now a few seconds on both platforms. About the > > same as compare_tests on my old ibook/OSX

Re: comparing DejaGNU results

2006-06-02 Thread Mike Stump
On Jun 2, 2006, at 11:08 AM, James Lemke wrote: I took a quick pass at implementing the comparisons in a more suitable lanugage. Run time is now a few seconds on both platforms. About the same as compare_tests on my old ibook/OSX and much faster on FC3. Since Ben and I seem interested in this

Re: comparing DejaGNU results

2006-06-02 Thread James Lemke
I took a quick pass at implementing the comparisons in a more suitable lanugage. Run time is now a few seconds on both platforms. About the same as compare_tests on my old ibook/OSX and much faster on FC3. Trials show the same results as before. For anyone interested, the new version is attached

Re: comparing DejaGNU results

2006-06-01 Thread James Lemke
> > Both the results files I used contained the following ssequence of > > results: > > PASS: gcc.c-torture/compile/930210-1.c (test for excess errors) > > PASS: gcc.c-torture/compile/930210-1.c (test for excess errors) > > FAIL: gcc.c-torture/compile/930210-1.c (test for excess errors) > > FAIL: g

Re: comparing DejaGNU results

2006-06-01 Thread Joseph S. Myers
On Thu, 1 Jun 2006, James Lemke wrote: > Both the results files I used contained the following ssequence of > results: > PASS: gcc.c-torture/compile/930210-1.c (test for excess errors) > PASS: gcc.c-torture/compile/930210-1.c (test for excess errors) > FAIL: gcc.c-torture/compile/930210-1.c (test

Re: comparing DejaGNU results

2006-06-01 Thread James Lemke
> Your approach is faster, esp. on Darwin / NetBSD. > The only advantages I see to mine is handling variants (Richard's patch > fixes that), verbosity control, and detail -- compare_tests only looks > at X?(PASS|FAIL). Hmm.. another small point, FWIW. Both the results files I used contained the f

Re: comparing DejaGNU results

2006-06-01 Thread James Lemke
Whoops... I forgot to attach my fixes, for anyone that's interested. -- Jim Lemke [EMAIL PROTECTED] Orillia, Ontario --- dg-cmp-results.sh 2006/05/31 19:22:14 1.18 +++ dg-cmp-results.sh 2006/06/01 17:53:21 @@ -31,6 +31,16 @@ if test $# -ne 3 -o ! -f "$2" -o ! -f "$ exit 1 fi +# Comman

Re: comparing DejaGNU results

2006-06-01 Thread James Lemke
> Please do. I'd welcome it (and scripts to generate html, to track > known issues, to trim log files, to drive things and do on)... I > think having a few different styles would be good, then people can > try them all out and see which ones they like and why. Anyway, for > me, it isn't

Re: comparing DejaGNU results

2006-06-01 Thread Mike Stump
On Jun 1, 2006, at 1:45 AM, Richard Earnshaw wrote: The only problem I have with Mike's script is that it doesn't handle runs with multiple multi-lib variants nicely. Yeah, in the past, we drove the multilib pass from above as in general we had to select different hardware for testing. I lik

Re: comparing DejaGNU results

2006-06-01 Thread Richard Earnshaw
On Thu, 2006-06-01 at 03:43, Mike Stump wrote: > Mine was designed to do two things, figure out if the results are > interesting and not send email, if they are not, and to show > engineers the `interesting' detailed results in priority order. It's > meant to be run daily, and on good days,

Re: comparing DejaGNU results

2006-05-31 Thread Mike Stump
On May 31, 2006, at 11:13 AM, James Lemke wrote: My current version is attached. If others find it useful I can contribute it. Comments and suggestions are welcome. Please do. I'd welcome it (and scripts to generate html, to track known issues, to trim log files, to drive things and do on)

Re: comparing DejaGNU results

2006-05-31 Thread Mike Stump
On May 31, 2006, at 5:57 PM, Ben Elliston wrote: Don't we have a comparison script in the "contrib" subdirectory? If that script does indeed work, then I'd like to distribute it with DejaGnu. Please. Yes, it does work and has been working just fine for the past decade to decade and a half.

Re: comparing DejaGNU results

2006-05-31 Thread Jim Wilson
James Lemke wrote: I wanted some mechanical way to compare the output of dejagnu runs between releases, etc. Did you look at contrib/compare_tests? It does something very similar to what your script is doing. -- Jim Wilson, GNU Tools Support, http://www.specifix.com

Re: comparing DejaGNU results

2006-05-31 Thread Andrew Pinski
> > > > I thought that Jeff Law had something that compared .sum files back when > > > he was RM. The description of what you wrote sounds similar. > > > Don't we have a comparison script in the "contrib" subdirectory? > > If that script does indeed work, then I'd like to distribute it with > D

Re: comparing DejaGNU results

2006-05-31 Thread Ben Elliston
> > I thought that Jeff Law had something that compared .sum files back when > > he was RM. The description of what you wrote sounds similar. > Don't we have a comparison script in the "contrib" subdirectory? If that script does indeed work, then I'd like to distribute it with DejaGnu. There us

Re: comparing DejaGNU results

2006-05-31 Thread Joe Buck
On Wed, May 31, 2006 at 02:33:29PM -0400, James Lemke wrote: > On Wed, 2006-05-31 at 12:27 -0600, Jeffrey Law wrote: > > On Wed, 2006-05-31 at 11:25 -0700, Joe Buck wrote: > > > On Wed, May 31, 2006 at 02:13:44PM -0400, James Lemke wrote: > > > > I wanted some mechanical way to compare the output o

Re: comparing DejaGNU results

2006-05-31 Thread James Lemke
On Wed, 2006-05-31 at 12:27 -0600, Jeffrey Law wrote: > On Wed, 2006-05-31 at 11:25 -0700, Joe Buck wrote: > > On Wed, May 31, 2006 at 02:13:44PM -0400, James Lemke wrote: > > > I wanted some mechanical way to compare the output of dejagnu runs > > > between releases, etc. I asked a few people at

Re: comparing DejaGNU results

2006-05-31 Thread Jeffrey Law
On Wed, 2006-05-31 at 11:25 -0700, Joe Buck wrote: > On Wed, May 31, 2006 at 02:13:44PM -0400, James Lemke wrote: > > I wanted some mechanical way to compare the output of dejagnu runs > > between releases, etc. I asked a few people at the GCC Summit last year > > what they used or knew about. No

Re: comparing DejaGNU results

2006-05-31 Thread Joe Buck
On Wed, May 31, 2006 at 02:13:44PM -0400, James Lemke wrote: > I wanted some mechanical way to compare the output of dejagnu runs > between releases, etc. I asked a few people at the GCC Summit last year > what they used or knew about. Not much came to light, so I ended up > writing something of

comparing DejaGNU results

2006-05-31 Thread James Lemke
I wanted some mechanical way to compare the output of dejagnu runs between releases, etc. I asked a few people at the GCC Summit last year what they used or knew about. Not much came to light, so I ended up writing something of my own. It's a shell script I've been using on Linux with only trivi