[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere added a comment. Please see https://reviews.llvm.org/D45332 for the lldb test format and https://reviews.llvm.org/D45333 for how to use that to run the tests. https://reviews.llvm.org/D45215 ___ lldb-commits mailing list lldb-commits@l

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

zturner added a comment. In https://reviews.llvm.org/D45215#1057311, @labath wrote: > > Preferably lit would take care of as much as possible. I think Zachary’s > > idea makes sense as an incremental step. If we think of one python file as > > a google test executable, it makes sense to return

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

labath added a comment. > Preferably lit would take care of as much as possible. I think Zachary’s > idea makes sense as an incremental step. If we think of one python file as > a google test executable, it makes sense to return a list of test for every > python file for “v2”. I think running t

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

I have some ideas for how to run the different variants as separate tests, but I'll save it for the next RFC :) On Wed, Apr 4, 2018 at 10:24 AM Jonas Devlieghere wrote: > > > On Apr 4, 2018, at 5:12 PM, Adrian Prantl wrote: > > > > > > > >> On Apr 4, 2018, at 9:07 AM, Zachary Turner wrote: > >

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

> On Apr 4, 2018, at 5:12 PM, Adrian Prantl wrote: > > > >> On Apr 4, 2018, at 9:07 AM, Zachary Turner wrote: >> >> Sure, but getting lit to run one file at a time is a nice incremental step >> towards that and can make both patches easier to review. > > Agreed, I just want to make sure th

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

> On Apr 4, 2018, at 9:07 AM, Zachary Turner wrote: > > Sure, but getting lit to run one file at a time is a nice incremental step > towards that and can make both patches easier to review. Agreed, I just want to make sure that we are all on the same page as to which direction we want to evo

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

Sure, but getting lit to run one file at a time is a nice incremental step towards that and can make both patches easier to review. On Wed, Apr 4, 2018 at 9:02 AM Adrian Prantl wrote: > > On Apr 4, 2018, at 8:53 AM, Pavel Labath wrote: > > > > On Wed, 4 Apr 2018 at 16:47, Zachary Turner wrote:

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

> On Apr 4, 2018, at 8:53 AM, Pavel Labath wrote: > > > > On Wed, 4 Apr 2018 at 16:47, Zachary Turner > wrote: > > On Wed, Apr 4, 2018 at 8:11 AM Jonas Devlieghere via Phabricator > mailto:revi...@reviews.llvm.org>> wrote: > JDevlieghere added a comment. > > In

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

On Wed, 4 Apr 2018 at 16:47, Zachary Turner wrote: > > On Wed, Apr 4, 2018 at 8:11 AM Jonas Devlieghere via Phabricator < > revi...@reviews.llvm.org> wrote: > >> JDevlieghere added a comment. >> >> In https://reviews.llvm.org/D45215#1056917, @zturner wrote: >> >> > I haven’t had time to look at t

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

On Wed, Apr 4, 2018 at 8:11 AM Jonas Devlieghere via Phabricator < revi...@reviews.llvm.org> wrote: > JDevlieghere added a comment. > > In https://reviews.llvm.org/D45215#1056917, @zturner wrote: > > > I haven’t had time to look at this in detail yet, but when I originally > had > > this idea I t

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere added a comment. In https://reviews.llvm.org/D45215#1056917, @zturner wrote: > I haven’t had time to look at this in detail yet, but when I originally had > this idea I thought we would use lit’s discovery mechanism to find all .py > files, and then invoke them using dotest.py in s

Re: [Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

I haven’t had time to look at this in detail yet, but when I originally had this idea I thought we would use lit’s discovery mechanism to find all .py files, and then invoke them using dotest.py in single process mode with a path to a specific file. Why do we need run lines? On Wed, Apr 4, 2018 at

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

zturner added a subscriber: JDevlieghere. zturner added a comment. I haven’t had time to look at this in detail yet, but when I originally had this idea I thought we would use lit’s discovery mechanism to find all .py files, and then invoke them using dotest.py in single process mode with a path t

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

labath added a comment. In https://reviews.llvm.org/D45215#1056731, @JDevlieghere wrote: > Alright, I'm convinced this is the way to go. > > - For (1) I'll see if I can get some inspiration from the visit logic in > dotest.py. I guess the functionality is similar. I agree on doing this in a > s

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere added a comment. Alright, I'm convinced this is the way to go. - For (1) I'll see if I can get some inspiration from the visit logic in dotest.py. I guess the functionality is similar. I agree on doing this in a separate tool, especially if we want to remove functionality from dote

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

labath added a reviewer: zturner. labath added a comment. Adding Zachary as he's familiar with lit internals. I'll try to elaborate more on the approach I had in mind. I would split my approach into a couple of tests. 1. Write a tool which will dump out the list of all tests in the test suite.

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

labath added a comment. In https://reviews.llvm.org/D45215#1056607, @JDevlieghere wrote: > In https://reviews.llvm.org/D45215#1056043, @labath wrote: > > > I don't think this is going in a good direction TBH. > > > > You are building another layer on top of everything, whereas I think we > > sho

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere added a comment. In https://reviews.llvm.org/D45215#1056043, @labath wrote: > I don't think this is going in a good direction TBH. > > You are building another layer on top of everything, whereas I think we > should be cutting layers out. Besides the issues already pointed out (not

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

labath added a comment. I don't think this is going in a good direction TBH. You are building another layer on top of everything, whereas I think we should be cutting layers out. Besides the issues already pointed out (not being able to differentiate PASS/XFAIL/SKIP, not all .py files being tes

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere updated this revision to Diff 140826. JDevlieghere added a comment. - Add few more examples as per Davide's request. - Add run line to the python file. Because the `.py` suffix is currently specified in the root of the `TestSuite` directory, we end up with a bunch of unresolved test

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere added a comment. In https://reviews.llvm.org/D45215#1055832, @aprantl wrote: > So this is basically replacing the parallel test-driver functionality of > dotest with lit and dotest is only used to invoke one test at a time. This > way we (as the LLVM project) can avoid maintaining

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

aprantl added a comment. So this is basically replacing the parallel test-driver functionality of dotest with lit and dotest is only used to invoke one test at a time. This way we (as the LLVM project) can avoid maintaining to test drivers implemented in python. That clearly sounds like the rig

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere added a comment. In https://reviews.llvm.org/D45215#1055820, @davide wrote: > Can you add another test or two? It's a little complicated to see what's > going on here, but from your description, it makes sense. > I'm not particularly worried right now to distinguish between `UNSUPP

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

davide added a comment. Can you add another test or two? It's a little complicated to see what's going on here, but from your description, it makes sense. I'm not particularly worried right now to distinguish between `UNSUPPORTED` and `PASS`. In practice, it doesn't matter (at least for the tran

[Lldb-commits] [PATCH] D45215: RFC/WIP: Have lit run the lldb test suite

JDevlieghere created this revision. JDevlieghere added reviewers: davide, labath, aprantl, vsk, jasonmolenda, jingham, friss. Herald added a subscriber: llvm-commits. With `lldb-dotest` checked in, this is the next step in allowing us to run the LLDB test suite with lit. I've converted a single