>>>>> Lenth, Russell V >>>>> on Wed, 27 Mar 2019 00:06:08 +0000 writes:
> Dear R-Devel, As I am sure many of you know, a special > issue of The American Statistician just came out, and its > theme is the [mis]use of P values and the many common ways > in which they are abused. The lead editorial in that issue > mentions the 2014 ASA guidelines on P values, and goes one > step further, by now recommending that the words > "statistically significant" and related simplistic > interpretations no longer be used. There is much > discussion of the problems with drawing "bright lines" > concerning P values. > This is the position of a US society, but my sense is that > the statistical community worldwide is pretty much on the > same page. > Meanwhile, functions such as 'print.summary.lm' and > 'print.anova' have an argument 'signif.stars' that really > does involve drawing bright lines when it is set to > TRUE. And the default setting for the "show.signif.stars" > option is TRUE. Isn't it time to at least make > "show.signif.stars" default to FALSE? And, indeed, to > consider deprecating those 'signif.stars' options > altogether? Dear Russ, Abs has already given good reasons why this article may well be considered problematic. However, I think you and (many but not all) others who've raised this issue before you, slightly miss the following point. If p-values are misleading they should not be shown (and hence the signif.stars neither. That has been the approach adopted e.g., in the lme4 package *AND* has been an approach originally used in S and I think parts of R as well, in more places than now, notably, e.g., for print( summary(<glm>) ). Fact is that users will write wrappers and their own packages just to get to p values, even in very doubtful cases... But anyway that (p values or not) is a different discussion which has some value. You however focus on the "significance stars". I've argued for years why they are useful, as they are just a simple visualization of p values, and saving a lot of human time when there are many (fixed) effects looked at simultaneously. Why should users have to visually scan 20 or 50 numbers? In modern Data analysis they should never have to but rather look at a visualization of those numbers. ... and that's what significance stars are, not more, nor less. Martin ______________________________________________ R-devel@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-devel