Skip to content

Grading Workflow

Ioannis Michaloliakos edited this page Sep 9, 2023 · 6 revisions

Overview

Grading on-paper assignments is one of the main use-cases of this app. The app contains scripts that automate the handling of scanned PDF files with the students' work, other scripts that automatically identify the student corresponding to each submission based on their university id and it has a grading interface that allows one to grade the submissions digitally, and provide comments to the students. If you are using this app for a Canvas course, the app allows graders to upload all (or partial) grades and comments to a Canvas assignment.

Scanning the students paper submissions

The app expects the student submissions as a collection of PDF files. Each PDF file can contain dozens of submissions. A common choice is to scan each student section separately, i.e. create one PDF file of scanned submissions per section.

The scanning configuration options can be the default options on most modern scanners. The image resolution should be set to approximately 300 dpi. Less than that would lead to loss of clarity in the generated PDF. More than that would lead to unnecessarily large PDF files.

In order to use the scripts that automatically identify the students' university ID, the assignment should contain in (at least) one page a row of cells as the input field for the ID. Here is an example for the 8-digit university ID at the University of Florida:

ID_input_template

You do not need to have exactly this layout. The cells for each digit of the ID simply need to be somewhere on the top left of the page. All cells should be of equal width and there should be no horizontal gap between the cells. Note that the algorithm that locates the handwritten digits tries to find the rectangle with the largest area near the top left of the page, so make sure your assignment does not contain a larger rectangle near the ID input field.

Adding the scans to the app

After you have scanned the students' work, launch the app, and navigate to the assignment that you want to grade. You will encounter a page that looks similar to this:

update grading scheme, upload scans
  • First, set the grading scheme for the assignment. For example, in you have a quiz with 10 points total score, four questions, with maximum grades 4,1,4,1 (in that order), then set the following options and click Update.

    Screenshot 2023-09-08 at 2 20 47 PM
  • Next, upload the submissions to the app. On the left form, click on (or drag-and-drop the PDFs to) the Choose Files button. You can add multiple PDFs at once. If the PDFs contain the submissions of more than one student, choose Multiple students in the student selector. Finally, choose the number of pages of each submission, so that the PDFs are divided appropriately. E.g. if each scanned submission has two 2-sided sheets of paper, set the number of pages to 4. Click upload and wait about 1 minute for the submissions to be processed.

Identify the students

After the PDFs have been processed you will be redirected to the assignment overview page that will look similar to this:

assignment overview start

Next to the Identify button there is a counter of the number of submissions that are not associated to a student. No submissions are associated to students initially. Clicking the Identify button triggers a script that searches for IDs on page 1 of each submission. To change the target page(s), first click on the edit icon above the Identify button, select the pages to search and finally press the Identify button. Here is an example of how the page selection should look like if you want the app to search for university IDs on page 3:

identify before

After the image recognition script completes in about a minute, most submissions will be associated with a student:

identify after

It is common for some students to forget to fill in their ID, but the vast majority (>95%) of students who write their IDs will be identified automatically. You can identify the remaining submissions manually while grading (see the next section).

Grade the submissions

Sync from Canvas

Upload grades and comments to Canvas

Clone this wiki locally