On Fri, Dec 9, 2011 at 8:36 AM, Tom Evans <tevans...@googlemail.com> wrote:
> On Fri, Dec 9, 2011 at 4:17 PM, Ian Clelland <clell...@gmail.com> wrote: > > Unscientifically, trunk without the Python 3 patches runs 1.5% faster w/ > > SQLite, 0.6% faster w/ MySQL. (based on a sample size of 1 :) ) > > > > I know you put the word 'unscientifically' in there, but you can draw > no conclusions from doing one run of each like that. See my reply > earlier in the week on how to simply and easily do valid statistical > testing. > > http://osdir.com/ml/django-developers/2011-12/msg00162.html > > I posted the results to have at least a single data point, as a "things don't appear to be wildly different" reassurance. Agreed, that the confidence interval is probably big enough to drive a bus through, and that any claims of "faster" or "slower" are completely unjustified statistically*. I'm just scripting my test runner to switch directories to do the a/b testing that you were suggesting earlier; perhaps I'll have some numbers to post in a couple of hours. * Except of course, if I had phrased it as the true fact that my two test runs with Python 2.6 completed more quickly than my test runs with Python 3.2, which, perhaps, is what I should have done. -- Regards, Ian Clelland <clell...@gmail.com> -- You received this message because you are subscribed to the Google Groups "Django developers" group. To post to this group, send email to django-developers@googlegroups.com. To unsubscribe from this group, send email to django-developers+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/django-developers?hl=en.
