Online Assessment / Effective Marking and Feedback


Adding a rubric or marking sheet to an assessment helps to provide criteria to mark against to ensure a consistent standard for staff and students to measure against. Rubrics, when used effectively, can help reduce the amount of time that is spent grading and enhance the quality of feedback that students receive. There are several elements to consider when building and designing rubrics. Below we will look at:

  • Analytic vs Holistic Rubrics
  • How to choose key criteria and the weighting that accompanies them
  • How to design this within Turnitin
  • Quick tips for marking

The office of Quality Standards and Partnerships at the University of Lincoln has a marking policy (Marking and Grading – External Link). When designing your rubric please make sure to adhere to the University guidelines and policies.

Image text: Analytic Vs Holistic Rubrics

There are two main types of rubrics which can be designed and there are advantages and disadvantages for both. Please see the key terminology below:

Analytic rubrics

Analytic rubrics take an individual criteria and put the performance mark against this (I.e. 1st, 2:1, 2:2). An analytical rubric can have several criterions but all of these will have a separate performance marking grid (see image below). This can be useful when you need to be more specific of how that criteria is marked or there are differing quality measures for each criteria.

Advantages

  • Provides useful feedback on Strengths, weaknesses and areas for improvement.
  • Criterion can be weighted to reflect importance of each dimension​
  • Easy to identify key specific areas for development
  • Allows the marker to mark in more depth

Considerations

  • Can takes time to create​ as they are more in-depth
  • Each point for each scores needs to be concise and well-defined otherwise it can lead to inconsistency in scores

Holistic rubrics

Holistic rubrics uses the same quality or performance scale for each of the criteria and gives a wider overview of how the student are doing as a whole. This is the most common form of rubric.

Image text: Success Criteria, Scoring, Quality

Advantages

  • Can be marked more consistently
  • Quick to mark as marking detail is minimal
  • Emphasis on what the learner can demonstrate rather than areas of development

Considerations

  • Doesn’t provide specific feedback for improvements
  • Criteria cannot be weighted
Image text: Criteria and Weighting

Selecting key evaluation criteria, weighting, and quality scale

When designing your rubric, you need to consider what criteria you will be evaluating the students against. This can also include the amount each criteria is worth in terms of the overall mark. There are no set rules for how many criteria need to be selected but should always link back to your assignment brief and intended learning outcomes.

Each column should measure the quality or mark outcome of that particular criteria, ranging from low to hight (or Fail to distinction). The standard rubric usually encompasses the following marks (for Undergraduate)

  • Significantly below standard (fail)
  • Approaching pass (fail)
  • Pass (3rd)
  • Satisfactory to good (2:2)
  • Good to V.Good (2:1)
  • Excellent (1st)
  • Outstanding (high 1st)

However, these can be expanded upon to include a split for each grade i.e. a lower 2:2 and a higher 2:2. This can be useful to help with discrepancies between marking. Below we have placed two resources. One rubric using the standard marking grid and one which has expanded on the marking categories.

OQSP standard rubric example | Link to External Site

Image text: Designing Rubrics with Turnitin Banne

If you would like support with building rubrics, we would recommend following the advice given on our resource hub. Please find below a link to appropriate resources.

Using the Rubrics Templates on Turnitin | Internal Link

Turnitin: Creating Rubrics within Turnitin | Internal Link

Image Text : Quick Tips for Marking

Quick tips for marking

We have provided some advice below which can be used to help develop quick marking habits, the suggestions below are examples which can be tailored to reflect your individual subject needs.

QuickMarks

Built inside of Turnitin is a feature called QuickMarks. This feature allows you to create a library of commonly used phrases (see image below) to help make feedback more efficient by simply by dragging and dropping each phrase to the correct location in the document.

Quick marks can be edited in two different ways. The first is that by clicking on each click mark you can add a comment to make the feedback more personalised. Secondly, whilst there are pre-set examples built into the quick marks library, you can add your own phrases to tailor it to your course.

Audio

Turnitin also allows you to leave an audio recording alongside quickmarks and written feedback to support your feedback summary. These short recordings (maximum time of 3 mins) can help you to explain your feedback in a more personalised way.  In the interest of accessibility, audio feedback should be used as a supplementary tool to enhance written feedback unless a transcript of the audio can be provided.

General feedback (for formative)

Whilst individualised feedback is always useful, one way to support big groups with marking is to highlight elements that you see appearing multiple times when marking. By highlighting these common mistakes to your entire group in a session you can reduce the amount of marking that needs to be done for a formative assessment and focus your attention on individuals who need further support.