Re: [R] accuracy of a neural net

2009-05-25 Thread onyourmark
It looks promising. I saw the pdf at:http://cran.r-project.org/web/packages/caret/vignettes/caretMisc.pdf. I will give it a try. Thank you. onyourmark wrote: > > Hi. I started with a file which was a sparse 982x923 matrix and where the > last column was a variable to be predicted. I did principl

Re: [R] accuracy of a neural net

2009-05-24 Thread Max Kuhn
You might want to use cross-validation or the bootstrap to get error estimates. Also, you should include the PCA step in the resampling since it does add noise to the model. Look at the pcaNNet and train functions in the caret package. Also your code for the nnet would imply that you are predicti

[R] accuracy of a neural net

2009-05-24 Thread onyourmark
Hi. I started with a file which was a sparse 982x923 matrix and where the last column was a variable to be predicted. I did principle component analysis on it and arrived at a new 982x923 matrix. Then I ran the code below to get a neural network using nnet and then wanted to get a confusion matrix