Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-07 Thread Adrian Prantl via lldb-dev
> On Feb 6, 2018, at 9:29 AM, Davide Italiano via lldb-dev > wrote: > > On Tue, Feb 6, 2018 at 8:18 AM, Pavel Labath wrote: >> On 6 February 2018 at 15:41, Davide Italiano wrote: >>> On Tue, Feb 6, 2018 at 7:09 AM, Pavel Labath wrote: On 6 February 2018 at 04:11, Davide Italiano via ll

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-07 Thread Davide Italiano via lldb-dev
On Wed, Feb 7, 2018 at 9:32 AM, Pavel Labath wrote: > On 6 February 2018 at 15:51, Davide Italiano wrote: >> >> FWIW, I strongly believe we should all agree on a configuration to run >> tests and standardize on that. >> It's unfortunate that we have two build systems, but there are plans >> to mo

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-07 Thread Pavel Labath via lldb-dev
On 6 February 2018 at 15:51, Davide Italiano wrote: > > FWIW, I strongly believe we should all agree on a configuration to run > tests and standardize on that. > It's unfortunate that we have two build systems, but there are plans > to move away from manually generating xcodebuild, as many agree i

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-07 Thread Davide Italiano via lldb-dev
On Wed, Feb 7, 2018 at 7:57 AM, Pavel Labath wrote: > On 7 February 2018 at 14:20, Zachary Turner wrote: >> >> As someone who gave up on trying to set up a bot due to flakiness, I have a >> different experience. > > I did not say it was easy to get to the present point, and I am > certain that th

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-07 Thread Pavel Labath via lldb-dev
On 7 February 2018 at 14:20, Zachary Turner wrote: > > As someone who gave up on trying to set up a bot due to flakiness, I have a > different experience. I did not say it was easy to get to the present point, and I am certain that the situation is much harder on windows. But I believe this is du

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-07 Thread Zachary Turner via lldb-dev
On Wed, Feb 7, 2018 at 2:38 AM Pavel Labath wrote: > On 6 February 2018 at 18:53, Zachary Turner wrote: > > I'm not claiming that it's definitely caused by dotest and that moving > away > > from dotest is going to fix all the problems. Rather, I'm claiming that > > dotest has an unknown amount

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-07 Thread Pavel Labath via lldb-dev
On 6 February 2018 at 18:53, Zachary Turner wrote: > I'm not claiming that it's definitely caused by dotest and that moving away > from dotest is going to fix all the problems. Rather, I'm claiming that > dotest has an unknown amount of flakiness (which may be 0, but may be > large), and the alte

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-06 Thread Zachary Turner via lldb-dev
On Mon, Feb 5, 2018 at 8:12 PM Davide Italiano via lldb-dev < lldb-dev@lists.llvm.org> wrote: > > > Conclusions: > The reliability of the suite (and the health of the codebase) is very > important to us. If you have issues, let us know. > In general, I'm looking for any kind of feedback, feel free

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-06 Thread Zachary Turner via lldb-dev
On Tue, Feb 6, 2018 at 8:19 AM Pavel Labath via lldb-dev < lldb-dev@lists.llvm.org> wrote: > On 6 February 2018 at 15:41, Davide Italiano > wrote: > > On Tue, Feb 6, 2018 at 7:09 AM, Pavel Labath wrote: > >> On 6 February 2018 at 04:11, Davide Italiano via lldb-dev > >> > >> So, I guess my quest

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-06 Thread Davide Italiano via lldb-dev
On Tue, Feb 6, 2018 at 8:18 AM, Pavel Labath wrote: > On 6 February 2018 at 15:41, Davide Italiano wrote: >> On Tue, Feb 6, 2018 at 7:09 AM, Pavel Labath wrote: >>> On 6 February 2018 at 04:11, Davide Italiano via lldb-dev >>> >>> So, I guess my question is: are you guys looking into making sure

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-06 Thread Pavel Labath via lldb-dev
On 6 February 2018 at 15:41, Davide Italiano wrote: > On Tue, Feb 6, 2018 at 7:09 AM, Pavel Labath wrote: >> On 6 February 2018 at 04:11, Davide Italiano via lldb-dev >> >> So, I guess my question is: are you guys looking into making sure that >> others are also able to reproduce the 0-fail+0-xpa

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-06 Thread Davide Italiano via lldb-dev
On Tue, Feb 6, 2018 at 7:09 AM, Pavel Labath wrote: > On 6 February 2018 at 04:11, Davide Italiano via lldb-dev > wrote: >> Hi, >> in the last couple of months a lot of people put a lot of attentions >> and energy into lldb and we're starting to see the first results. I >> decided to sit down and

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-06 Thread Davide Italiano via lldb-dev
On Tue, Feb 6, 2018 at 7:09 AM, Pavel Labath wrote: > On 6 February 2018 at 04:11, Davide Italiano via lldb-dev > wrote: >> Hi, >> in the last couple of months a lot of people put a lot of attentions >> and energy into lldb and we're starting to see the first results. I >> decided to sit down and

Re: [lldb-dev] [RFC] Testsuite in lldb & possible future directions

2018-02-06 Thread Pavel Labath via lldb-dev
On 6 February 2018 at 04:11, Davide Italiano via lldb-dev wrote: > Hi, > in the last couple of months a lot of people put a lot of attentions > and energy into lldb and we're starting to see the first results. I > decided to sit down and write this e-mail to state where we are and > what are some