Re: Sane plugin testing

2008-08-08 Thread Arnaud HERITIER
> > > > > ITs are needed for example in plugins when we wrap another tool, but > > otherwise, and particularly in the core we should have a good unit tests > > suite. > > In plugins world, we have a lot of UTs with our test harness and ITs. > I think ITs is sometimes misunderstanding by dev or user

Re: Sane plugin testing

2008-08-08 Thread Benjamin Bentmann
Vincent Siveton wrote: So, what to do if a user propose a test case? Add it as an IT or transform it to the plugin harness? IMHO, ITs give us the most value in terms of coverage so these are my favorite. Admittedly, that might be influenced by the fact that plugin ITs are usually easier to

Re: Sane plugin testing

2008-08-08 Thread Vincent Siveton
Hi Arnaud, 2008/8/7 Arnaud HERITIER <[EMAIL PROTECTED]>: > As I said in another thread, we just ended 3. > We named the profile integration-tests but to have the same name as in the > core we'll rename it run-its > > It seems that there is 2 point of view about ITs activation : > -1) ITs are part

Re: Sane plugin testing

2008-08-08 Thread Benjamin Bentmann
Olivier Lamy wrote: My question is : why do prefer shitty (the name ? :- ) . Good question ;-), but I believe this is irrelevant for the things Jason had in mind. As I understand, the intention was to try out how the plugins work with Maven 2.1. But that merely requires to build them with t

Re: Sane plugin testing

2008-08-07 Thread Arnaud HERITIER
don't > > want to be required to write everything in groovy...sure groovy might be > > java but if I have some existing classes that do what I need, then I > > want to use them directly. (I think this is already fixed but haven't > > tried it) > > > > >

Re: Sane plugin testing

2008-08-07 Thread Olivier Lamy
> -Original Message- > From: Jason van Zyl [mailto:[EMAIL PROTECTED] > Sent: Wednesday, August 06, 2008 12:15 PM > To: Maven Developers List > Subject: Re: Sane plugin testing > > My pick for the tool is STY. I think Brian has used it, and Jason > Dillon definite

Re: Sane plugin testing

2008-08-07 Thread Arnaud HERITIER
As I said in another thread, we just ended 3. We named the profile integration-tests but to have the same name as in the core we'll rename it run-its It seems that there is 2 point of view about ITs activation : -1) ITs are part of the build and always launched -2) ITs are launched on demand (beca

RE: Sane plugin testing

2008-08-06 Thread Brian E. Fox
lto:[EMAIL PROTECTED] Sent: Wednesday, August 06, 2008 12:15 PM To: Maven Developers List Subject: Re: Sane plugin testing My pick for the tool is STY. I think Brian has used it, and Jason Dillon definitely has his opinion. The unit testing is different and the plugin-testing-harness is for

Re: Sane plugin testing

2008-08-06 Thread Jason van Zyl
My pick for the tool is STY. I think Brian has used it, and Jason Dillon definitely has his opinion. The unit testing is different and the plugin-testing-harness is for unit testing and I'm not concerned about that in this context. If you look at the way Jason Dillon tests his plugins I thi

Re: Sane plugin testing

2008-08-06 Thread Brett Porter
+1 to all below. All the information I could find in January is here: http://docs.codehaus.org/display/MAVENUSER/Review+of+Plugin+Testing+Strategies Please use that as a starting point. There has probably been stuff added to STY since. It generally seemed the best, but I would like to see it

Sane plugin testing

2008-08-06 Thread Jason van Zyl
Hi, I think we've gotten to the point where we need to decide how we are going to test plugins. We need to pick one of the frameworks, settle on a pattern, and use that in the plugins otherwise there will be no sane way to validate a set of plugins works against a given version of Maven.