=========================================================================
Date: Wed, 12 Jul 2006 08:16:10 -0400
Reply-To: Vassilis Hartzoulakis <hartzoulakis@ATH.FORTHNET.GR>
Sender: "SPSSX(r) Discussion" <SPSSX-L@LISTSERV.UGA.EDU>
From: Vassilis Hartzoulakis <hartzoulakis@ATH.FORTHNET.GR>
Subject: interrater agreement, intrarater agreement
Hi everyone
I have a dataset of 10000 subjects and their scores on a composition they
wrote. Each composition was scored by 2 different raters (randomly selected
from a pool of 70). The scores could range from 0 to 15.
So far I have set up a table with 10000 rows/cases and 5 columns (IDsubject,
IDraterA, rateA, IDraterB, rateB)
e.g.
00001, 1200, 12, 1300, 14 (the 1st rater gave a 12/15 and the 2nd a 14/15)
00002, 1200, 09, 1300, 12
00003, 1400, 15, 1200, 13
00004, 1400, 02, 1200, 08 etc.
Can someone suggest the best possible layout and analysis to investigate
inter and intra rater agreement?
Thank you
|