Peer review for instructors (using Canvas Groups)

BASIC REQUIREMENTS:
  • Users must be part of an institutional license that includes peer review and a Canvas Learning Management System (LMS) integration
  • Course copy is not supported in the PlayPosit peer review.
  • Instructors must link and launch a regular Bulb in their Canvas courses before assigning a peer review Bulb, and all the students are recommended to take a regular Bulb before taking a peer review Bulb. Please see the best practices section for more information. 
  • This article covers how to use Canvas groups with a PlayPosit peer review assignment. 
    • Information on PlayPosit peer review in a non-Canvas LMS can be found in this help article
    • Information on PlayPosit peer review without an LMS can be found in this help article.
    • Information on the learner experience of peer review:

In this article

Create, assign, and grade peer review assignments in PlayPosit 3.0

  1. What is a peer review bulb?
  2. Terminology
  3. Best practices when using PlayPosit's peer review application
  4. Importing groups from Canvas
  5. How to update groups for peer review
  6. The instructor's experience

What is a peer review bulb?

The peer review application provides instructors the opportunity to collect learner-submitted videos. These videos are then distributed among learner groups for review by peers. Based on how instructors have configured the assignment, learners in the group will provide criterion-based feedback referencing a rubric formatted by the instructor and/or open ended, time-stamped feedback through a discussion interaction. Peer review assignments may be used in a traditional classroom environment or for professional development.

Terminology

This section outlines important terminology and definitions of the items that will be referenced throughout the help article. Peer review assignments are customizable and allow for several optional features.

1

Rubric - A customizable scoring tool that lists the criteria by which a peer review submission may be graded, primarily used to structure the way learners give each other feedback. If a peer review assignment has a rubric, then learners will fill out the required criterion to submit feedback on their peers' submissions  and participate in a discussion forum. Instructors will also fill out rubrics to assign final grades to learner submissions.

Note: Rubrics are optional. In the case that an instructor has opted to implement a rubric, it will be automatically attached to the videos that learners upload to PlayPosit.

Note: If a peer review assignment does not have a rubric, learners will only be required to upload a submission and participate in the discussion forum. The instructor will manually assign a point value to learner submissions.

2

Criterion - A rubric element representing a principle or standard by which to evaluate a learner's peer review submission. Instructors will assign a point value to each criterion ranging from 1-5 points. Each criterion will include a section for learners to provide peers with additional feedback to explain why they received the point value.

Note: Only available when assigning a peer review assignment with a Rubric. 

3

Group - A collection or subset of learners within a class who may give each other feedback on a peer review assignment. Members of a group can see each other's submissions and are only able to receive and provide feedback to members of their own group. Click here to learn more about Canvas groups.

Note: Groups are optional. Peer review assignments that do not contain groups will require that learners view and provide feedback to all peers within the class.

4

Group Sets - Group sets house the different groups within a Canvas course and can be imported into PlayPosit. Click here to learn more about Canvas group sets.

Best practices when using PlayPosit's peer review application

This section highlights best practices and recommendations to ensure the easiest and most seamless workflow when using the PlayPosit peer review application.

  • Assign a regular PlayPosit bulb to learners before assigning a peer review bulb - this serves three purposes:
    1. Ensures that all learners enrolled in the course are properly set up with PlayPosit accounts.
    2. Ensures that all learners will be available for sorting when building groups for a peer review assignment.
    3. Familiarizes learners with the process of taking a PlayPosit bulb. 
  • Prepare groups in Canvas before creating the peer review assignment -  For a more seamless Canvas workflow,  create a group set and populate it with groups before designing a peer review assignment and rubric. See this section for more information.
  • Determine whether or not the peer review assignment will include rubrics in advance - This impacts the format of the assignment and the instructions that are provided to learners. Below are the standard instructions that PlayPosit provides learners engaging in a peer review assignment. Instructors are able to edit the instructions to fit the unique needs of their assignment:
    • (If rubrics are enabled) The peer review assignment has three parts. First, upload a video and submit it to your instructor. Second, watch your peer review group's videos and leave time stamped comments. Third, fill out the grading rubrics, and submit your final feedback.
    • (If rubrics are disabled) The peer review assignment has two parts. First, upload a video and submit it to your instructor. Second, watch your peer review group's videos and leave time-stamped comments.

Importing groups from Canvas

Importing groups will enable instructors to require that learners only submit feedback for members of their own groups for their overall peer review assignments to be marked complete. Ordinarily, for a peer review assignment to be marked complete, a learner must both submit a video and submit feedback for every member of their class.

Before importing groups into PlayPosit from Canvas, please ensure that:

  • You have existing group sets and groups in Canvas
  • Each student in your Canvas course belongs to a group within each group set
  • You have created and launched at least one PlayPosit assignment within your Canvas course
  • Your admin has provided PlayPosit with an admin developer key.

This is the current recommendation for importing groups:

If you have not created a peer review assignment yet, click here (with rubric) or here (without rubric).

  1. After creating a peer review assignment and clicking Save in the PlayPosit tool, or after clicking the Canvas icon next to a peer review bulb to set a bulb link, click on the Manage Group Sets button
  2. Click on Fetch Group Sets. PlayPosit will now fetch the groups sets, groups, and the associated learner information from Canvas. PlayPosit will also create accounts for any learners who have not yet accessed a PlayPosit bulb from Canvas. These operations may take some time, so do not close this tab.
    1. If this is the first time you’ve ever imported group sets from Canvas into PlayPosit, a new tab will open and ask you to authorize PlayPosit to fetch data from your Canvas account. Click Authorize and then close the tab. You may need to click Fetch Group Sets one more time.
  3. You should now see all of your group sets and groups within each group set

If you need to make changes to a group set or group after the initial import, then follow the instructions here.

Note: This warning toast occurs when the Canvas session has expired. Click on Fetch Group Sets to refresh the Canvas session. The second time that you click on Fetch Group Sets, a green toast will appear that says “Fetching Imported Groups”. This will load newly created Canvas Group Sets.

How to update groups for peer review

Instructors may need to update their groups for a variety of reasons, either before a peer review bulb has been assigned to learners, or while they are completing it. Regardless of the type of change that needs to be made, PlayPosit's peer review application allows for group membership to be changed at any time:

  1. In Canvas, make the desired changes to group membership. Examples include moving a learner to a new group, adding new and previously ungrouped students to existing groups, and either creating or deleting groups.
  2. Access the Group Set Manager in PlayPosit in one of two ways:
    • If the peer review assignment has not yet been linked, when attempting to set the link, click Manage Group Sets.
    • If the peer review assignment has been linked, launch the assignment in Canvas and click Manage Groups.

  3. In the manage groups popover click the refresh button next to the group set that was updated.
  4. Check that the learner has been moved to the appropriate group by clicking the drop down arrows. Click Save and Close when don

Note: If a learner has changed groups they should not have to re-submit a peer review bulb attempt. However, the members in the learner's group will change accordingly. If the learner has changed groups after receiving feedback from members of their original group, they should still be able to view the feedback from the original group in addition to the new group feedback.

The instructor's experience

BASIC REQUIREMENTS:
  • Instructors can also reuse the existing Peer Review assignment by clicking on the thumbnail of the Bulb and selecting Copy to create a copied version of the Peer Review Bulb.

PlayPosit strongly encourages reviewing the terminology and reading the section on best practices when using PlayPosit’s peer review application before creating a peer review assignment with the following steps.

Creating a peer review assignment with a rubric

  1. Create an assignment in Canvas and launch PlayPosit. Click Set Link on the gray screen.
  2. Click the dropdown arrow next to Add New Bulb and select Add Peer Review Assignment.
  3. Be sure to name the peer review assignment.
    1. Optional instructors can include custom Learning Objectives/Instructions. Otherwise, if left blank, PlayPosit will display generic instructions to learners that will inform them how to complete the peer review assignment.
  4. Click Advanced settings and toggle Enable peer review on.
    1. Optional Toggle Allow learners to upload video files on to allow learners to upload their peer review submissions directly to PlayPosit. (Only possible if your institutional license includes HLS minutes)
    2. Optional Toggle Anonymize student rubric submissions to prevent learners from knowing the identities of their reviewers.
    3. Optional Toggle Allow learners to use private video hosts off to restrict learners so they can only use YouTube and Vimeo as video sources. By default, this option is enabled and learners can use the institution’s video host’s integrations if they have an account. To learn more about the different video hosts available on PlayPosit, click here.
  5. Toggle Enable grading rubrics on to allow learners to evaluate each other according to specific criteria that is set by the instructor in the next step. Otherwise, learners will only watch the videos of their peers and leave time-stamped comments. See the section on terminology for more information on rubrics. Otherwise, refer to this section on how to create a peer review assignment without a rubric.
  6. Design the rubric by clicking Create Rubric and adding numeric criteria and sections. 
    1. Define each rubric criterion (e.g. Clarity of concept).
    2. Numeric values for each criterion can be set to be worth between 1 and 5 points.
    3. Reorganize the sections and criterion by dragging and dropping from the left side of each row.
    4. To delete criteria, click the trash icon on the right side. 
    5. Click Save and Close when done to save the rubric and move on to setting a bulb link.
  7. On the next menu:
    1. If a group set has already been imported for the class, select it from the drop down menu labeled "Select Group Set" and then click Link.
    2. If a group set has not yet been imported, click Manage Group Sets and refer to the section on groups.

Creating a peer review assignment without a rubric

  1. Create an assignment in Canvas and launch PlayPosit. Click Set Link on the gray screen.
  2. Click the dropdown arrow next to Add New Bulb and select Add Peer Review Assignment.
  3. Be sure to name the peer review assignment.
    1. Optional Instructors can include custom Learning Objectives/Instructions. Otherwise, if left blank, PlayPosit will display generic instructions to learners that will inform them how to complete the peer review assignment.
  4. Adjust the number of points an assignment is worth.
    1. Optional Toggle the Enable complete/incomplete grading to allow learners to receive full points as soon as they have both submitted their own video and completed giving feedback to all other learners in their group or class.
    2. Optional Toggle Allow learners to upload video files to allow learners to upload their own video files to their peer review submissions directly to PlayPosit. (Only possible if your institutional license includes HLS minutes)
    3. Optional Toggle Anonymize student rubric submissions to prevent learners from knowing the identities of their reviewers. 
    4. Optional Toggle Allow learners to use private video hosts off to restrict learners so they can only use YouTube and Vimeo as video sources. By default, this option is enabled and learners can access any video host that the institutional license includes. To learn more about the different video hosts available on PlayPosit, click here.
  5. Click Next to move on to setting the bulb link when finished configuring the peer review assignment.
  6. On the next menu:
    1. If a group set has already been imported for the class, select it from the drop down menu labeled "Select Group Set" and then click Link.
    2. If a group set has not yet been imported, click Manage Group Sets and refer to the section on groups

Grading a peer review bulb with a rubric

Once learners have completed all of the necessary tasks associated with the peer review assignment, the instructor is able to monitor the peer review assignment to:

  • View individual submissions
  • Assess the feedback provided and received
  • Assign final grades to each learner

See the additional steps below if grading peer review assignments that have rubrics.

Grading peer review assignments with rubrics

If rubrics are enabled for a peer review assignment, instructors can use the gradebook to:

  1. Copy a learner's submission into the My Bulbs tab as a new bulb.
  2. Assign individual grades to learners and View feedback given by a learner and feedback received by the same learner
  3. Enter Grade Mode to quickly assign grades to multiple learners at a time
  4. Sync grades to the Canvas gradebook.
  5. Export the learners' data for this peer review assignment.

Note: To moderate or participate in the discussion, click the Rubric button. The Rubric button will allow you to view Peer Review bulbs and participate in discussion forums. After clicking the Rubric button click the Evaluate Submission button to view the Peer Review bulb.

Filling out rubrics as an instructor and exporting final grades

The section below outlines how instructors submit final grades for a peer review assignment with rubrics and how to export the final grades. In order for an assignment to be considered complete, instructors will need to submit final grades.

  1. Click the rubric icon for the learner you wish to grade. This will open a panel with three tabs, opening automatically to the Instructor Feedback tab. 
  2. Click Evaluate Submission to launch the player view of this learner's submission.
  3. Click the rubric icon in the sidebar to access the grading rubric for the learner's submission. The instructor can enter numeric values and leave comments or notes for each criterion. 
  4. Click Submit Rubric to proceed to the next step.
  5. If the same rubric is accessed again after submission, the Instructor Feedback tab will display the given score. Click View Submission to launch the player again with a read-only version of the submitted rubric.
  6. Otherwise, click the rubric icon to view the submitted rubric for this learner.
  7. To modify the score previously assigned to a learner, return to the gradebook for the peer review assignment and click Enter Grade Mode.
  8. The score column for learners who have previously been graded will now show a number of radio buttons, each with a point value. Select the point value you want to assign for each available learner, and then click Save Grades.
  9. Remember to Sync Grades to the Canvas gradebook!

Example of what is synced to Canvas: If a Canvas assignment worth 50 points and the rubric is worth 16 points and the learner earns 4/16 for the rubric, it will appear as 25% in Canvas. 4 out of 16 is 25% of the possible points so Canvas translates that as 25% out of 50 which results in 12.5.

View feedback received from the learner's peers

Click on the Feedback Received tab to view the rubrics completed by the learner's peers for the submission. These rubrics do not factor into the learner's score. The final grade is assigned by the instructor filling out the rubric associated with the learner’s submission.

Click the Discussion icon to load a view of the discussion forum for the learner's submission.

View feedback given

Select the Feedback Given tab to view the scores given by the learner to others in the peer group. The instructor can also view group progress status.

Grading without a rubric

If rubrics were not enabled for the assignment, use the gradebook to: 

  1. Preview a learner's submission
  2. Copy a learner's submission into the My Bulbs tab as a new bulb.
  3. Enter Grade Mode to quickly assign grades to multiple learners at a time.
  4. Sync Grades to Canvas's gradebook.
  5. Export the learners' data for this peer review assignment.

Assign and export final grades

  1. Learners who have submitted a video for this peer review assignment will have a "-%" entry in the Score column, denoting that the assignment needs to be graded. If Complete/Incomplete Grading was enabled on the assignment, then this value will read "100%" instead of "-%". Click Enter Grade Mode to assign a final score.

  2. Select a point value for the learner's submission and click Save Grades, then click Sync Grades to export the final score to the Canvas gradebook.

Data export for peer review

To export the learners' data from the peer review assignment, please click on the data export icon on the top right of the monitor page.

On the exported CSV file, instructors can find the following information:

  • Learner ID
  • Learner name
  • Learner Email
  • The number of interactions (learners can't add interaction to the peer review bulb, there are three built-in interactions to host discussion and grading. When learners reply to others' bulbs, the interaction they interact with will also add to this number. For example, if a learner has reviewed two other learners' bulbs, there will be 9 interactions in this field.)
  • Interaction types (it will be discussion interaction and fill in the blank by default)
  • Points earned 
  • Points available
  • Score
  • Status
  • LMS sync status
  • Start time
  • Completion time

Still need help? Contact Us Contact Us