Skip to main content
edited tags
Link
edited tags
Link
philshem
  • 17.7k
  • 7
  • 69
  • 171
Source Link

Dataset of multiple judges or examiners giving scores

I am looking for a publicly available data set of (ideally) the following kind.

  1. Multiple (must be 3 or more) examiners each grade the academic work (e.g., essay, dissertation, term-assignment) of multiple (ideally 20 or more) students.
  2. Every examiner grades every student.
  3. In addition to the grade given by each examiner to each student, there is a single "comprehensive" grade for each student given by faculty, based (in some manner that is transparent) on the other grades.

An example might be where all Honors-level dissertations are marked by the four members of a faculty examining committee. The description is of an ideal example, but I'd be very pleased to learn of other similar open-data examples where the grade involves some degree of "judgement" on the part of the examiner. I'm not looking, for example, for a dataset where multiple people ("examiners") record their reading from a measuring instrument (i.e., give a grade) under multiple conditions (equivalent to "multiple students")