On Wednesday, August 29, 2012 6:04:09 PM UTC+10, Alex Ogier wrote: > > On Wed, Aug 29, 2012 at 3:44 AM, Russell Keith-Magee > <rus...@keith-magee.com <javascript:>> wrote: > > > > I suppose you could see it as a semantic nuance. However, to my mind, > > there is a different. A skipped test is something that could -- or > > even *should* be run -- but can't due to missing some optional > > prerequisite. In this case, we're talking about tests that can't ever > > be run. To my mind, it doesn't make sense to have those tests present > > but "skipped". > > I'm not sure I see the difference between a configuration that makes a > test unnecessary and a missing optional dependency that makes a test > unnecessary. >
I recently had a similar need to flag/mark/annotate tests for the purpose of separation of unit, smoke, functional etc. My solution involved a kind of hacked up test runner (and django-jenkins) and an annotation for flagging tests. In this case, the distinction between skipped and not run is an important one, IMHO. If I have a test marked "unit" and "flaky" and another test marked "functional", I want my "unit, not-flaky" run to _skip_ the first (matches "unit", but also matches a "not" condition), but _ignore_ the second (no match). That way my unit test counts don't show a whole load of irrelevant skipped tests. In other words, they're simply not candidates. Some more details of my (work in progress) approach to test separation are midway through the following presentation (slides 24-27)... http://www.slideshare.net/mindsocket/towards-continuous-deployment-with-django Since that talk a whole 2 weeks ago, I've become aware of django-nose and I'm looking at the possibilities there now. I hope this provides some useful context to the discussion, it may only be of relevance to determining how many yaks to shave. - Roger Barnes -- You received this message because you are subscribed to the Google Groups "Django developers" group. To view this discussion on the web visit https://groups.google.com/d/msg/django-developers/-/-Z5tKkOTGPYJ. To post to this group, send email to django-developers@googlegroups.com. To unsubscribe from this group, send email to django-developers+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/django-developers?hl=en.
