Re: [R] caret pls model statistics

2013-03-05 Thread Charles Determan Jr
Does anyone know of any literature on the kappa statistic with plsda? I have been trying to find papers that used plsda for classification and have yet to come across this kappa value. All the papers I come across typically have R2 as an indicator of model fit. I want to make sure I conduct such

Re: [R] caret pls model statistics

2013-03-03 Thread Max Kuhn
That the most common formula, but not the only one. See Kvålseth, T. (1985). Cautionary note about $R^2$. *American Statistician*, *39*(4), 279–285. Traditionally, the symbol 'R' is used for the Pearson correlation coefficient and one way to calculate R^2 is... R^2. Max On Sun, Mar 3, 2013 a

Re: [R] caret pls model statistics

2013-03-03 Thread Charles Determan Jr
I was under the impression that in PLS analysis, R2 was calculated by 1- (Residual sum of squares) / (Sum of squares). Is this still what you are referring to? I am aware of the linear R2 which is how well two variables are correlated but the prior equation seems different to me. Could you expla

Re: [R] caret pls model statistics

2013-03-03 Thread Charles Determan Jr
Thank you for your response Max. Is there some literature that you make that statement? I am confused as I have seen many publications that contain R^2 and Q^2 following PLSDA analysis. The analysis usually is to discriminate groups (ie. classification). Are these papers incorrect in using thes

Re: [R] caret pls model statistics

2013-03-02 Thread Max Kuhn
Charles, You should not be treating the classes as numeric (is virginica really three times setosa?). Q^2 and/or R^2 are not appropriate for classification. Max On Sat, Mar 2, 2013 at 5:21 PM, Charles Determan Jr wrote: > I have discovered on of my errors. The timematrix was unnecessary and a

Re: [R] caret pls model statistics

2013-03-02 Thread Charles Determan Jr
I have discovered on of my errors. The timematrix was unnecessary and an unfortunate habit I brought from another package. The following provides the same R2 values as it should, however, I still don't know how to retrieve Q2 values. Any insight would again be appreciated: library(caret) librar

[R] caret pls model statistics

2013-03-02 Thread Charles Determan Jr
Greetings, I have been exploring the use of the caret package to conduct some plsda modeling. Previously, I have come across methods that result in a R2 and Q2 for the model. Using the 'iris' data set, I wanted to see if I could accomplish this with the caret package. I use the following code: