[Bestplus] a training video

[Schwerdtfeger, Jane]

Hi, all--it would be the best of all possible worlds, but once we have a
video to check our inter-rater reliability, testers (and we as trainers)
will only have to score the video once a year.  Testers will also use the
video and not have to do the 10 additional practice administrations after a
lapse of 2 months.  But until we have the video, we will have to do it this
way.
 
The video is going to be quite costly (and lengthy) to develop--beyond the
choosing of the videotaped student interviews, scores will have to be
created by expert scorers for those student interviews, and it will also
have to go through a number of analyses to ensure that the video is valid
and reliable.  CAL is thinking it will take probably a year to complete.
And you're right, we'll need more than one set of student interviews to
score, so we won't be able to memorize the test year after year, either, as
students have done with the current BEST test.
 
Jane

-----Original Message-----
From: Ellenredmax at aol.com [mailto:Ellenredmax at aol.com]
Sent: Friday, April 30, 2004 10:26 AM
To: Bestplus at lists.literacytent.org
Subject: [Bestplus] a training video


Since it sounds like some testers will have to do 10 practice tests several
times a year because of a time gap between testing sessions, wouldn't it be
great if we had several videos !  Then each program could use a different
one each quarter for their testers and the testers would have some scores to
compare their results with.  
Ellen