OSCER reporting: exporting the section titles with the marksheet
We need to be able to export the marks from our OSCER examinations to send off to ACER for analysis. To allow ACER to complete their analysis, they require the section titles of the marksheet to be included in the data that is exported.
Reasoning:
For example, if a particular case is marked out of 10, we need to know the score for question 1 (marked, say out of 3), the score for question 2 (marked out of 4) and the score for question 3 (marked out of 3). The reason is that each question is mapped to different domains. We need to be able to see how a candidate goes across all cases and all stations for every question mapped to ‘observation’ or mapped to ‘pathology’ for instance.
Please refer to RANZCR ticket: PSD-6151
Comments: 1
-
01 Feb, '23
Paul RossWe think we've worked around this in our post-processing, but it would certainly be easier if things like Sections or Count-As dimension tags could be included with the exported marks, so I'll add my upvote here.
The trick to the workaround is to use the Item Export spreadsheet as well as the Candidate Responses exports. You can use the Item number and Criteria Stem fields to grab the column headers for each question and merge in the tags/sections. It takes a bit of post-processing to match everything up but a statistician or analyst should be able to get them talking.
We use Sections to duplicate the information in our Admissions criteria "count as" dimensions *because* sections are included in the "item set export" where the count as domains are not. This doesn't work for us for our OSCEs because we don't want the ordering of our marksheet criteria to be determined by the domains. So we've asked for the "Count As" dimension to be included in the item export for a similar reason.