On Fri, Dec 9, 2011 at 11:43 AM, Joe & Anne Tennies <tenn...@gmail.com>wrote:

> The thing is, we aren't trying to "scientifically correct" statistics.
> What we're aiming to say is, "This is not so wildly different as to be of
> any concern." We aren't looking for minor difference, but orders of
> magnitude difference.
>
>
Agreed.

But in the name of science (science!) I've run the a/b test that Tom
suggested (with the abababaaabbb pattern, even), and these were the results:

          Trunk     Patches
Run #1   443.093    448.851
Run #2   440.845    445.338
Run #3   439.795    445.746
Run #4   437.751    462.278
Run #5   439.482    460.737
Run #6   436.606    461.509

Mean     439.595    454.077
Std Dev    2.288      8.245


(I won't speak as to whether all of these decimal places are warranted, but
unittest reports milliseconds, so I'm sticking with three places all around)

All times are in seconds. This was tested on Python 2.6.7, and SQLite,
against Django trunk from this morning (a), and Vinay's 3k-compatible
branch from yesterday (b).


-- 
Regards,
Ian Clelland
<clell...@gmail.com>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To post to this group, send email to django-developers@googlegroups.com.
To unsubscribe from this group, send email to 
django-developers+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/django-developers?hl=en.

Reply via email to