A global resource for markers of written questions

9 votes

We use a marking rubric that defines the characteristics of good, borderline and poor responses to written questions. We'd like this to be available as a global resource to markers of MWQ and SAQ. We understand that this type of global resource is already available for OSCEs.

Gathering Interest risr/assess Suggested by: Leah Bloomfield (11 Apr, '23) • Upvoted: 12 Oct, '23 • Comments: 5

Comments: 5

04 Aug, '21
Daisy Garling Merged
The ability to add a Global Rating when marking each Multi-Part Written question. This will allow us to trial a borderline-regression standard setting methodology.

What is needed is a categorical rating scale at the end of each of the MWQ item.

For RANZCR, the markers will mark each question out of 10 (based on the marking template). Then as an addition, there needs to be another marking question that says “Global Rating” with a drop-down to the following 6 options:

Outstanding
Clear Pass
Borderline Pass
Borderline Fail
Clear Fail
Significant Concerns

This means the candidate can be awarded a mark, and a rating.
25 Oct, '22
Reshma Pais Merged
In addition to the above mentioned the standard setting for Multi-Part Written question to allow Adjustable Borderline Method would be ideal to allow a regression test
22 Feb, '23
Leah Bloomfield Merged
Two requests here
(a) Markers of written exams use a rubric that defines the generic criteria for a pass/borderline/fail. The rubric is used in combination with the model answer that is specific to the question. The same rubric is used for all items, so it does not need to be attached to each item. How can we upload the rubric so that it is available to markers when they are notified that they have items to mark.

(b) Markers of written exams need access to resources (eg images, pdfs) that can not be included in the model answer. How can these be uploaded for a written question? I note that they can be uploaded for an OSCE.
07 Jun, '23
David Admin
"Upload resources for markers of written questions" (suggested by Leah Bloomfield on 2023-02-22), including upvotes (1) and comments (0), was merged into this suggestion.
07 Jun, '23
David Admin
"Global Rating/ Criteria for MWQ items" (suggested by Daisy Garling on 2021-08-04), including upvotes (4) and comments (1), was merged into this suggestion.