Re: [Numpy-discussion] Performance testing in unit tests

2009-08-27 Thread Robert Kern
On Fri, Aug 28, 2009 at 00:44, Gael Varoquaux wrote: > On Thu, Aug 27, 2009 at 03:33:30PM -0700, Robert Kern wrote: >> From my experience, doing performance tests inside of your normal test >> suite is entirely unreliable. Performance testing requires rigorous >> control over external factors that

Re: [Numpy-discussion] Performance testing in unit tests

2009-08-27 Thread Gael Varoquaux
On Thu, Aug 27, 2009 at 03:33:30PM -0700, Robert Kern wrote: > From my experience, doing performance tests inside of your normal test > suite is entirely unreliable. Performance testing requires rigorous > control over external factors that you cannot do inside of your test > suite. Your tests will

Re: [Numpy-discussion] Performance testing in unit tests

2009-08-27 Thread Robert Kern
On Thu, Aug 27, 2009 at 15:03, Gael Varoquaux wrote: > Hi list, > > This is slightly off topic, so please pardon me. > > I want to do performance testing. To be precise, I have a simple case: I > want to check that 2 operations perform with a similar speed (so I am > abstracted from the machines pe

[Numpy-discussion] Performance testing in unit tests

2009-08-27 Thread Gael Varoquaux
Hi list, This is slightly off topic, so please pardon me. I want to do performance testing. To be precise, I have a simple case: I want to check that 2 operations perform with a similar speed (so I am abstracted from the machines performance). What would be the recommended way of timing the oper