To look up "observer agreement", you might consider the "RSiteSearch" package. The "RSiteSearch.function" looks only for matches in help pages of contributed packages.

library(RSiteSearch)
oa <- RSiteSearch.function("observer agreement")
attr(oa, "hits") # 4 functions matching this term
HTML(oa) # to open the results as a table in a web browser.

An alternative search term for this is "interrater reliability".

ir.r <- RSiteSearch.function("inter-rater reliability")
attr(ir.r, "hits") # 1
irr <- RSiteSearch.function("interrater reliability")
attr(irr, "hits") # 19
ir..r <- RSiteSearch.function("inter rater reliability")
attr(ir..r, "hits") # 1


In particular, this identified a package "irr" for interrater reliability.

The development version of the "RSiteSearch" package on R-Forge includes a "unionRSiteSearch" function that allows one to combine all these searches. You can get this version using 'install.packages("RSiteSearch", repos="http://R-Forge.R-project.org";)'; if this gives you version 1.0-0, please wait 24 hours and try again, because this version contains a bug that I just fixed. The new version 1.0-1 should be available in 24 hours. With it, the following just worked for me:

IRR <- unionRSiteSearch(oa, unionRSiteSearch(ir.r,
        unionRSiteSearch(irr, ir..r) ) )
attr(IRR, "hits")
HTML(IRR)


Hope this helps. Spencer Graves

Murray Cooper wrote:
Paul,

I suggest looking up "observer agreement". The description of your study sounds like a classical
categorical observer agreement problem. I can't give
a reference off the top of my head, but if you get
stuck, e-mail me and I'll try and find a ref to get you started.

Murray M Cooper, Ph.D.
Richland Statistics
9800 N 24th St
Richland, MI, USA 49083
Mail: richs...@earthlink.net

----- Original Message ----- From: "Paul Heinrich Dietrich" <paul.heinrich.dietr...@gmail.com>
To: <r-help@r-project.org>
Sent: Sunday, May 10, 2009 8:25 AM
Subject: [R] Function recommendation for this study...



Hi,
I'm not used to thinking along these lines, and wanted to ask your advice:

Suppose you have a sample of around 100, consisting of patients according to
doctors, in which patients and doctors are given a questionnaire with
categorical responses.  Each patient somehow has roughly 3 doctors, or 3
rows of data. The goal is to assess by category of each question or DV the agreement between the patient and 3 doctors. For example, a question may be
asked about how well the treatment is understood by the patient, and the
patient answers with their perception, while the 3 doctors each answer with
their perception.

The person currently working on this has used a Wilcoxon Sign Rank test, and asked what I thought. Personally, I shy away from nonparametrics and prefer
parametric Bayesian methods, but of course am up for whatever is most
appropriate. I was concerned about using multiple Wilcoxon tests, one for
each question, and wondering if there is a parametric method in R for
something like this, and a method which is multivariate?  Thanks for any
suggestions.
--
View this message in context: http://www.nabble.com/Function-recommendation-for-this-study...-tp23469646p23469646.html
Sent from the R help mailing list archive at Nabble.com.

______________________________________________
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.


______________________________________________
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.


______________________________________________
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.

Reply via email to