Re: Splitting of tests in the mochitest suite

2014-01-27 Thread Andrew Halberstadt
On 01/27/2014 03:36 PM, Ehsan Akhgari wrote: On 1/27/2014, 7:44 AM, Andrew Halberstadt wrote: A downside to chunking such that skipped tests are taken into account is that it will make some chunks take longer to run than others. This negatively impacts the scheduling algorithms and ultimately in

Re: Splitting of tests in the mochitest suite

2014-01-27 Thread Ehsan Akhgari
On 1/27/2014, 7:44 AM, Andrew Halberstadt wrote: A downside to chunking such that skipped tests are taken into account is that it will make some chunks take longer to run than others. This negatively impacts the scheduling algorithms and ultimately increases infrastructure load. I assume you ar

Re: Splitting of tests in the mochitest suite

2014-01-27 Thread Andrew Halberstadt
A downside to chunking such that skipped tests are taken into account is that it will make some chunks take longer to run than others. This negatively impacts the scheduling algorithms and ultimately increases infrastructure load. The effects are especially noticeable on new platforms/applicat

Re: Splitting of tests in the mochitest suite

2014-01-21 Thread Ehsan Akhgari
On 1/21/2014, 2:19 PM, Gregory Szorc wrote: On 1/21/14, 10:25 AM, Ehsan Akhgari wrote: On 1/21/2014, 12:54 PM, Gregory Szorc wrote: On 1/21/14, 9:05 AM, Ehsan Akhgari wrote: It seems to me like the splitting algorithm for mochitests gives us different chunking results on different platforms, s

Re: Splitting of tests in the mochitest suite

2014-01-21 Thread Gregory Szorc
On 1/21/14, 10:25 AM, Ehsan Akhgari wrote: On 1/21/2014, 12:54 PM, Gregory Szorc wrote: On 1/21/14, 9:05 AM, Ehsan Akhgari wrote: It seems to me like the splitting algorithm for mochitests gives us different chunking results on different platforms, see this test failure for example: < https://t

Re: Splitting of tests in the mochitest suite

2014-01-21 Thread Ehsan Akhgari
On 1/21/2014, 12:54 PM, Gregory Szorc wrote: On 1/21/14, 9:05 AM, Ehsan Akhgari wrote: It seems to me like the splitting algorithm for mochitests gives us different chunking results on different platforms, see this test failure for example: < https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=74

Re: Splitting of tests in the mochitest suite

2014-01-21 Thread Ryan VanderMeulen
On 1/21/2014 12:05 PM, Ehsan Akhgari wrote: It seems to me like the splitting algorithm for mochitests gives us different chunking results on different platforms, see this test failure for example: < https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=746018b05d67>. Is this expected? If not, is

Re: Splitting of tests in the mochitest suite

2014-01-21 Thread Gregory Szorc
On 1/21/14, 9:05 AM, Ehsan Akhgari wrote: It seems to me like the splitting algorithm for mochitests gives us different chunking results on different platforms, see this test failure for example: < https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=746018b05d67>. Is this expected? If not, is th

Splitting of tests in the mochitest suite

2014-01-21 Thread Ehsan Akhgari
It seems to me like the splitting algorithm for mochitests gives us different chunking results on different platforms, see this test failure for example: < https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=746018b05d67>. Is this expected? If not, is this easy to fix so that a given test always f