Documentation Index
Fetch the complete documentation index at: https://docs.pawtograder.com/llms.txt
Use this file to discover all available pages before exploring further.
Assigning Grading Tasks
Pawtograder has a robust feature to allow instructors to assign grading tasks to staff. When a grading task is assigned, the instructor can set a due date for that task, and re-assign the task to a different grader if needed. When reassigning a rubric part to a TA who already completed grading a different rubric part for the same submission, the new work will appear in their pending work list. Pawtograder will also automatically allow any other grader to complete the task if the original grader is unable to complete it (without needing to re-assign the task).Automatic Completion of Related Reviews
When a grader completes their assigned review, Pawtograder automatically:- Marks other review assignments as complete if they cover the same or a subset of rubric parts
- Completes the overall submission review when all required rubric checks are satisfied
- Validates that uncovered rubric parts have no blocking requirements before marking the submission complete
Conflicts of Interest
Pawtograder will automatically ensure that graders do not grade assignments that they have a conflict of interest in. Graders can self-input their conflicts (under “Course Settings” - “Grading Conflicts”), and instructors can review and enter conflicts for all graders in the class. Graders are encouraged to input a “Reason” for their conflict, so that instructors can understand the nature of the conflict and help avoid declaring spurious conflicts.
Assigning Group Mentors
For group assignments, you can assign mentors to student groups from the assignment’s Groups management page. Each group can have one assigned mentor.- Navigate to the assignment’s Groups page
- Find the Mentor column in the groups table
- Select a grader or instructor from the dropdown for each group
- The mentor assignment is saved automatically
Assigning Grading to Group Mentors
When using the bulk assign grading feature, you can automatically assign each group’s submission to their assigned mentor:- Select Assign to group mentors from the assignment mode dropdown
- The system will automatically assign each group’s submission to the group’s mentor
- Submissions without groups or without assigned mentors will be skipped
- Grading conflicts are automatically checked and respected
Assigning Grading Tasks
Pawtograder’s “Bulk Assign Grading” feature (from an Assignment’s “Grading Assignments” page) allows instructors to assign grading tasks to staff in bulk. When reassigning a rubric part to a TA who already completed grading a different rubric part for the same submission, the system automatically clears the completion timestamp so the new work appears in their pending work list.
- By submission: Split submissions between graders (each grader gets complete rubrics for their assigned submissions)
- By rubric part: Split rubric parts between graders (each submission is graded by multiple graders, each handling different rubric parts)
- Assign to lab leaders: Automatically assign each submission to all lab leaders of the student’s lab section
- Assign to group mentors: Automatically assign each group’s submission to that group’s assigned mentor
Assignment Modes
Pawtograder offers several modes for distributing grading tasks:By Submission
Submissions are split between graders first. Each grader receives complete submissions with all selected rubric parts.By Rubric Part
Rubric parts are split between graders first. Each submission is assigned to different graders for different rubric parts, allowing specialization.Assign to Lab Leaders
Each submission is automatically assigned to all lab leaders of the student’s lab section. No manual grader selection needed.Assign to Group Mentors
Each group’s submission is automatically assigned to the group’s assigned mentor. This mode:- Requires groups to have mentors assigned (see Group Management)
- Skips submissions without groups or without assigned mentors
- Respects grading conflicts between mentors and group members
- Ideal for group projects with dedicated mentors
Configuring Assignments
The algorithm offers several assignment modes:- By submission: Split submissions between graders (assigning all selected rubric parts to each grader)
- By rubric part: Split rubric parts between graders first (assigning each submission to different graders for each rubric part)
- Assign to lab leaders: Automatically assign each submission to all lab leaders of the student’s lab section
- Assign to group mentors: Automatically assign each group’s submission to the group’s assigned mentor
Instructor Groups
Instructor groups allow you to organize course staff into teams for grading assignments. This is useful when you have multiple sections, campuses, or specialized grading teams. You can create instructor groups and assign staff members to them, then use these groups to filter grading assignments. To manage instructor groups, navigate to Course Settings and select “Instructor Groups”. You can create new groups, add or remove staff members, and view all existing groups. When assigning grading tasks, you can filter by instructor group to ensure that only staff from specific teams are assigned to grade particular submissions. To select assignees (for “By submission” and “By rubric part” modes), you can filter by role (e.g. graders, instructors, or both), and optionally filter by tag. The form will show which graders will be assigned, and you can manually override the selection of graders.Group Mentor Assignment
When using the “Assign to group mentors” mode:- Each group’s submission is automatically assigned to the group’s mentor
- Submissions without groups or without assigned mentors are skipped
- No manual grader selection is needed
- The system validates for grading conflicts with group members
Managing Review Due Dates
Instructors can set and update review due dates for grading tasks and self-reviews in bulk or on a per-student basis. This feature is available for both grading rubrics and self-review rubrics.Bulk Review Due Date Updates
From the assignment’s grading page, you can set review due dates for multiple students at once:- Select the students whose review due dates you want to update
- Choose the rubric type (grading rubric or self-review)
- Set the new due date
- Apply the changes to all selected students
Per-Student Review Due Date Adjustments
You can also adjust review due dates for individual students directly from the gradebook view. This allows for fine-grained control when handling individual extension requests or special circumstances. Both grading staff review due dates and student self-review due dates can be managed through these interfaces, providing flexibility in managing assignment timelines.Grading Comments and Review Release
Once a review has been released to students, grading comments are locked to maintain grading integrity. Instructors and graders cannot edit or delete comments after the review is released. This ensures that students receive consistent feedback and prevents post-release modifications that could cause confusion. If you need to make changes to feedback after release, you will need to unrelease the review first, make your edits, and then re-release it.Group Grading with Split Rubrics
When grading group assignments, Pawtograder supports per-student adjustments even when using split rubrics. This allows you to:- Apply different scores to individual group members for specific rubric items
- Add student-specific notes and feedback within a group submission
- Maintain fair grading when group members contribute differently
Instructor Groups
For large courses with multiple instructors or teaching teams, you can organize graders into instructor groups. This feature allows you to:- Partition grading responsibilities across different teaching teams
- Ensure graders only see and grade submissions assigned to their group
- Manage grading workflows independently for different course sections or campuses
Individual Grading for Group Assignments
For group assignments, Pawtograder supports individual grading where each group member receives a separate grade. This is useful when:- Group members contributed unequally to the project
- You want to assess individual understanding within a group context
- Different group members demonstrated different levels of mastery
Enabling Individual Grading
When creating grading assignments for a group assignment:- Select the option to Grade group members individually
- The system will create separate grading tasks for each student in the group
- Each student’s grade will be recorded independently in the gradebook
- Graders can assign different scores to different group members
How Individual Grading Works
- Separate rubric instances: Each group member gets their own rubric evaluation
- Independent scores: Students in the same group can receive different grades
- Shared submission: All group members’ grades are based on the same submitted work
- Gradebook integration: Individual grades appear in the gradebook under each student’s name
Best Practices
- Communicate expectations: Let students know in advance if group assignments will be graded individually
- Document differences: When assigning different grades to group members, provide clear feedback explaining the differences
- Consider peer feedback: Use peer feedback surveys to inform individual grading decisions
- Be consistent: Apply the same grading criteria to all group members, adjusting scores based on individual contribution or understanding
- Group members contributed unequally to the assignment
- You want to account for peer feedback or individual performance
- Different aspects of the assignment should be graded individually vs. collectively
- Assign different scores to each group member for specific rubric items
- Maintain shared scores for collaborative work while differentiating individual contributions
- Track individual performance within group contexts for gradebook calculations
Reassigning Grading Tasks
After grading tasks have been assigned, instructors can reassign them to different graders if needed. This is useful when:- A grader is unable to complete their assigned tasks
- Workload needs to be rebalanced among graders
- A grader has a conflict of interest that was discovered after assignment
- A grader is unavailable or overloaded
- Workload needs to be rebalanced
- A conflict of interest is discovered after initial assignment
Bulk Completing Grading Reviews
The Mark All Grading Complete button allows you to efficiently complete multiple grading reviews at once. When you click this button:- The system checks which incomplete submission reviews can be marked complete
- A review is eligible if all required rubric checks have been applied
- You’ll see a summary showing:
- How many reviews can be marked complete
- How many have missing required checks (and will be skipped)
- Confirming will mark all eligible reviews as complete
- Completing reviews after a grading session
- Finalizing grades before releasing them to students
- Ensuring all required feedback has been provided
Only reviews with all required rubric checks applied will be marked complete. Reviews with missing required checks are automatically skipped to prevent incomplete grading.
Managing Repository Permissions
For assignments with GitHub repositories, you can audit and fix repository permissions to ensure all group members have the correct access.Fix Repository Permissions
The Fix Permissions button on the Repositories page allows you to comprehensively audit and correct all assignment repository permissions:- Navigate to the assignment’s Repositories page
- Click the Fix Permissions button
- The system will:
- Audit all repositories for the assignment
- Compute the correct collaborator list from current group membership
- Enqueue permission sync jobs for each repository
- Skip repositories that haven’t been created on GitHub yet
- Skip repositories where no students have confirmed GitHub usernames
- Number of syncs enqueued
- Repositories skipped (no usernames)
- Repositories skipped (not ready)
- Any errors encountered
- Students join or leave groups after repository creation
- GitHub permissions become out of sync with group membership
- You need to verify all students have correct repository access
Reassigning Grading Tasks
After grading tasks have been assigned, you may need to reassign them to different graders due to workload changes, conflicts of interest, or grader availability.Reassigning Individual Submissions
To reassign a single submission to a different grader:- Navigate to the assignment’s Grading Assignments page
- Find the submission you want to reassign
- Click the Reassign button next to the grader’s name
- Select a new grader from the dropdown
- Optionally update the due date for the new grader
- Click Confirm to complete the reassignment
- Transfer the grading task to the new grader
- Preserve any existing grading work (comments, rubric checks)
- Notify the new grader of their assignment
- Update the grading dashboard to reflect the change
Bulk Reassignment
For reassigning multiple submissions at once:- Navigate to the assignment’s Grading Assignments page
- Select the submissions you want to reassign using checkboxes
- Click Bulk Reassign at the top of the list
- Choose the new grader(s) for the selected submissions
- Optionally update due dates
- Preview the changes before confirming
- Click Confirm Bulk Reassignment
Reassignment preserves all existing grading work. If a grader has already started grading a submission, their work will remain visible to the new grader and can be continued or modified.
Automatic Completion by Other Graders
Even without explicit reassignment, any grader with appropriate permissions can complete a grading task assigned to another grader. This allows for flexible workflows where:- Graders can help each other meet deadlines
- Backup graders can step in when needed
- Instructors can review and complete any grading task
Assigning Group Mentors
For group assignments, you can assign mentors to student groups. Mentors are typically graders or instructors who provide guidance and feedback to specific groups throughout the assignment.Setting Group Mentors
- Navigate to the assignment’s Groups page
- In the groups table, find the Mentor column
- Use the dropdown to select a mentor for each group
- The mentor assignment is saved automatically
Using Group Mentors for Grading
When using the Assign to group mentors mode in bulk grading:- Each group’s submission is automatically assigned to that group’s mentor
- Groups without assigned mentors are skipped with a warning
- Submissions not associated with a group are also skipped
- Grading conflicts are still respected
- Navigate to the assignment’s Groups page
- Locate the Mentor column in the groups table
- Select a grader or instructor from the dropdown for each group
- The mentor assignment is saved automatically
- Mentors can be automatically assigned to grade their groups’ submissions using the “Assign to group mentors” bulk grading mode
- Students see their group’s mentor on the submission page
- Mentors can view analytics for only their assigned groups in survey responses
Reassigning Grading Tasks
After grading tasks have been assigned, instructors can reassign individual submissions or rubric parts to different graders:- Navigate to the assignment’s grading page
- Find the submission you want to reassign
- Click Reassign next to the grader’s name
- Select a new grader from the dropdown
- Optionally add a note explaining the reassignment
- Click Confirm Reassignment
- When a submission is reassigned to a new grader, it appears in their pending work list immediately
- If the new grader had already completed grading a different rubric part for the same submission, the system clears the
completed_attimestamp to ensure the new work appears as pending - The original grader’s work is preserved and can be reviewed if needed
- Reassignments respect conflict of interest rules
- Balancing workload when a grader falls behind
- Handling grader absences or availability changes
- Correcting assignment errors
- Ensuring quality by moving submissions to more experienced graders
- Navigate to the assignment’s “Grading Assignments” page
- Find the submission or rubric part that needs reassignment
- Select the new grader from the reassignment interface
- Confirm the reassignment
- When reassigning a rubric part to a grader who already completed a different part for the same submission, the system resets the completion status for the new assignment
- The new grading task appears in the grader’s pending work list
- Previously completed work by the original grader is preserved
- The new grader can view all previous feedback while completing their assigned part
Repository Permissions Audit
Pawtograder provides a “Fix Repository Permissions” button on the Repositories page that allows instructors to audit and correct GitHub repository permissions for all assignment repositories in a single operation. This feature is useful when:- Students join or leave groups after repositories have been created
- Repository permissions become out of sync with group membership
- You need to ensure all students have proper access to their assignment repositories
- Check all repositories for the assignment
- Verify that each repository has the correct collaborators based on current group membership
- Enqueue permission sync jobs for repositories that need updates
- Provide a summary of synced repositories, skipped repositories, and any errors
Grading Reassignment
When a student submits a new version of their work after grading has begun, Pawtograder automatically handles the reassignment of grading tasks. The system will:- Move incomplete grading assignments to the new active submission
- Preserve existing grading comments on the original submission
- Reopen grading assignments so graders can review the new submission
- Prevent data loss by detecting conflicts with existing grading work
Grading Status Dashboard
The grading status dashboard provides a comprehensive overview of grading progress across all assignments. Access it from the course navigation to see:- Assignment-level progress: View completion status for each assignment
- Grader workload: See how many tasks are assigned to each grader
- Due dates: Track upcoming grading deadlines
- Completion rates: Monitor overall grading progress
- Monitor completion rates for assigned grading tasks
- Track which graders are on schedule or falling behind
- Identify bottlenecks in the grading workflow
- View grading statistics across multiple assignments
- Monitor which assignments have pending grading tasks
- Track completion rates for each grader
- Identify bottlenecks in the grading workflow
- View grading assignments by staff member or by assignment
- Completion rates: Track how many submissions have been graded versus pending
- Grader workload: See the distribution of grading tasks across staff members
- Due dates: Monitor upcoming grading deadlines
- Assignment progress: View grading status for each assignment at a glance
- Overall completion: Track how many submissions have been graded
- Per-grader progress: See individual grader workload and completion rates
- Rubric part breakdown: Monitor progress on specific rubric components
- Due date tracking: Identify overdue grading tasks
- Bottleneck identification: Quickly spot where grading is falling behind
- Overall Progress: Visual progress bars showing completion rates for each rubric part
- Grader Performance: Individual grader statistics including assigned tasks, completed tasks, and completion rates
- Submission Status: Track which submissions have been graded and which are still pending
- Due Date Tracking: Monitor grading task deadlines and identify overdue assignments
- Identify bottlenecks in the grading process
- Balance workload across graders
- Follow up with graders who may need support
- Ensure timely feedback delivery to students
Managing Review Assignments
Viewing Review Assignments
The “All Assignments” tab provides a comprehensive view of all review assignments, organized into two sub-tabs:- Grading reviews: Shows all non-self-review rubric assignments (grading review, meta-grading, code walk, etc.)
- Self reviews: Shows only self-review rubric assignments
- Submitter information
- Assignee details
- Due dates (in the course’s configured timezone)
- Review status (Not Started, In Progress, Completed)
- Rubric and review round (grading reviews only)
Editing Individual Review Assignments
Click the edit icon on any review assignment row to modify:- Due date: Set or update the deadline for completing the review
- Assignee: Reassign the review to a different grader (grading reviews only)
Bulk Editing Review Due Dates
Use the “Bulk edit grading due dates” or “Bulk edit self-review due dates” buttons to update multiple review assignments at once:- Select a rubric from the dropdown (required)
- Choose a new due date and time
- Optionally check “Only rows not yet completed” to skip finished reviews
- Click “Apply to matching rows”
Bulk Editing Review Due Dates
Use the “Bulk edit grading due dates” or “Bulk edit self-review due dates” buttons to update multiple review assignments at once:- Select a rubric from the dropdown (required)
- Choose a new due date and time
- Optionally check “Only rows not yet completed” to skip finished reviews
- Click “Apply to matching rows”
Student Overview Page
The student overview page (accessible from “Manage” → “Students” → select a student) provides instructors with a comprehensive view of an individual student’s course participation and performance:Student Information
- Email address: The student’s account email
- Lecture section: If enrolled in a Canvas/SIS section, displays the section name, meeting times, and location
- Lab section: Shows the lab section name, meeting times, location, and assigned section leaders
Assignments Table
The assignments table shows all course assignments with the following information for the selected student:- Title: Assignment name (linked to submission if available)
- Group: For group assignments, displays:
- Group name
- Other group members (excluding the viewed student)
- Group mentor (if assigned)
- Submission #: Ordinal number of the submission (linked to submission page)
- Submission Time: When the student submitted
- Autograder Score: Automated test results
- Total Score: Final grade out of maximum points
- Due Date: Assignment deadline (with any student-specific adjustments)
- Adjust Due Date: Quick access to modify the due date for this student