Peer Review for instructors (using PlayPosit Groups)

What is a peer review bulb?

The peer review application provides instructors the opportunity to collect learner-submitted videos. These videos are then distributed among learner groups for review by peers. Based on how instructors have configured the assignment, learners in the group will provide criterion-based feedback referencing a rubric formatted by the instructor and/or open ended, time-stamped feedback through a discussion interaction. Peer review assignments may be used for a traditional classroom environment or for professional development.

Terminology

This section outlines important terminology and definitions of the items that will be referenced throughout the help article. Peer review assignments are customizable and allow for several optional features.

1

Rubric - A customizable scoring tool that lists the criteria by which a peer review submission may be graded, primarily used to structure the way learners give each other feedback. If a peer review assignment has a rubric, then learners will fill out the required criterion to submit feedback on their peers' submissions and participate in a discussion forum. Instructors will also fill out rubrics to assign final grades to learner submissions.

Note: Rubrics are optional. In the case that an instructor has opted to implement a rubric, it will be automatically attached to the videos that learners upload to PlayPosit.

Note: If a peer review assignment does not have a rubric, learners will only be required to upload a submission and participate in the discussion forum. The instructor will manually assign a point value to learner submissions.

2

Criterion - A rubric element representing a principle or standard by which to evaluate a learner's peer review submission. Instructors will assign a point value to each criterion ranging from 1-5 points. Each criterion will include a section for learners to provide peers with additional feedback to explain why they received the point value.

Note: Only available when assigning a peer review assignment with a Rubric. 

3

Group - A collection or subset of learners within a class who may give each other feedback on a peer review assignment. Members of a group can see each other's submissions and are only able to receive and provide feedback to members of their own group

Note: Groups are optional. Peer review assignments that do not contain groups will require that learners view and provide feedback to all peers within the class.

3

Group Sets - A way to organize and save a set of groups for peer review assignments. Group sets makes it easy to reuse groups that have been built by the instructor for future peer review assignments.

Note: Group sets are limited to the specific class in which they were created. An instructor will need to build new group sets for other classes regardless of whether the same set of learners are in more than one class.

Best practices when using PlayPosit's peer review application

This section highlights best practices and recommendations to ensure the easiest and most seamless workflow when using the PlayPosit peer review application.

• Assign a regular PlayPosit bulb to learners before assigning a peer review bulb - this serves three purposes:
  1. Ensures that all learners enrolled in the course are properly set up with PlayPosit accounts.
  2. Ensures that all learners will be available for sorting when building groups for a peer review assignment.
  3. Familiarizes learners with the process of taking a PlayPosit bulb. 
• Prepare groups before creating the peer review assignment - Depending on the number of learners in a class, the process of creating groups within a group set may take a while. For best results, create a group set and populate it with groups before designing a peer review assignment and rubric. See this section for more information.
• Determine whether or not the peer review assignment will include rubrics in advance - This impacts the format of the assignment and the instructions that are provided to learners. Below are the standard instructions that PlayPosit provides learners engaging in a peer review assignment. Instructors are able to edit the instructions to fit the unique needs of their assignment:
  • (If rubrics are enabled) The peer review assignment has three parts. First, upload a video and submit it to your instructor. Second, watch your peer review group's videos and leave time stamped comments. Third, fill out the grading rubrics, and submit your final feedback.
  • (If rubrics are disabled) The peer review assignment has two parts. First, upload a video and submit it to your instructor. Second, watch your peer review group's videos and leave time-stamped comments.

Creating PlayPosit Groups

Access the PlayPosit groups menu in one of two ways:

• Click Manage Group Sets when attempting to link a peer review bulb through the LMS (clicking the new tab icon will open the group set editor in a new tab). 

  

• Navigating to Classes > Learners > Groups.

1. Type in a title for a new PlayPosit group set and press Enter.
2. Click Add Group to create a new group. Click on the newly created group to edit the name.
3. Drag and drop learners from the right side of the menu into a corresponding group on the left side.
   1. Note: Only learners who have previously launched a PlayPosit bulb for the class or who have been otherwise enrolled in the class will show up in this menu. See the section on best practices for more information.
      
4. Click Save and Close when done.

Refer to the section on updating PlayPosit groups if you would like to make changes at a later time.

Updating PlayPosit groups

If the membership of one or more groups needs to be changed, such as when a learner joins the class late, follow the steps below to update the groups after accessing the PlayPosit Groups menu:

Access the PlayPosit groups menu by one of three ways:

• If the peer review assignment has not yet been linked in the LMS, click Manage Group Sets when attempting to link a peer review bulb through the LMS.
• If the peer review assignment has already been linked, launch the assignment from the LMS and click Manage Groups. 
• Navigate to Classes > Learners > Groups.

1. Select the group set in the dropdown.
2. Make the necessary updates to group membership in that group set by dragging new learners into existing groups, swapping existing learners between new groups, or even creating new groups.
   
3. Click the Close button when done.

Note: If a learner has changed groups they should not have to re-submit a peer review bulb attempt. However, the members in the learner's group will change accordingly and the learner may need to provide feedback for the new members of their group. Feedback that they have already received will still be visible.

The instructor's experience

PlayPosit strongly encourages reviewing the terminology and reading the section on best practices when using PlayPosit’s peer review application before creating a peer review assignment with the following steps.

Creating a peer review assignment with a rubric

1. Create an assignment in the Learning Management System (LMS) and launch PlayPosit. Click Set Link on the gray screen.
2. Click the dropdown arrow next to Add New Bulb and select Add Peer Review Assignment.
   
3. Be sure to name the peer review assignment.
   1. Optional - instructors can include custom Learning Objectives/Instructions. Otherwise, if left blank, PlayPosit will display generic instructions to learners that will inform them how to complete the peer review assignment.
4. Click Advanced settings and toggle Enable peer review on.
1. Optional Toggle Allow learners to upload video files on to allow learners to upload their peer review submissions directly to PlayPosit. (Only possible if your institutional license includes HLS minutes)
2. Optional Toggle Allow learners to use private video hosts off to restrict learners so they can only use YouTube and Vimeo asvideo sources. By default, this option is enabled and learners can use the institution’s video host’s integrations if they have an account. To learn more about the different video hosts available on PlayPosit, click here.
3. Optional Toggle Anonymize student rubric submissions to prevent learners from knowing the identities of their reviewers.Toggle Enable grading rubrics on to allow learners to evaluate each other according to specific criteria that is set by the instructor in the next step. Otherwise, learners will only watch the videos of their peers and leave time-stamped comments. See the section on terminology for more information on rubrics. Otherwise, refer to this section on how to create a peer review assignment without a rubric.
5. Design the rubric by clicking Create Rubric and adding numeric criteria and sections. 
   1. Define each rubric criterion (e.g. Clarity of concept).
   2. Numeric values for each criterion can be set to be worth between 1 and 5 points.
   3. Reorganize the sections and criterion by dragging and dropping from the left side of each row.
   4. To delete criteria, click the settings gear on the right side. 
      
   5. Click Save and Close when done to save the rubric and move on to setting a bulb link.
   6. Optional Toggle Anonymize student rubric submissions to prevent learners from knowing the identities of their reviewers. 
      
6. On the next menu:
   1. If a group set has already been created for the class, select it from the drop down menu labeled "Select Group Set."
   2. If a group set has not yet been created, click Manage Groups and refer to the section on groups. 

Creating a peer review assignment without a rubric

1. Create an assignment in your LMS and launch PlayPosit. Click Set Link on the gray screen.
2. Click the dropdown arrow next to Add New Bulb and select Add Peer Review Assignment.
   
3. Be sure to name the peer review assignment.
   1. Optional Instructors can include custom Learning Objectives/Instructions. Otherwise, if left blank, PlayPosit will display generic instructions to learners that will inform them how to complete the peer review assignment. 
4. Adjust the number of points an assignment is worth.
   1. The Enable complete/incomplete grading option may also be toggled on to allow learners to receive full points as soon as they have both submitted their own video and completed giving feedback to all other learners in their group or class.
      
   2. Optional Toggle Allow learners to use private video hosts off to restrict learners so they can  only use YouTube and Vimeo as video sources. By default, this option is enabled and learners can access any video host that the institutional license includes. To learn more about the different video hosts available on PlayPosit, click here.
   3. Optional Toggle Allow learners to upload video files to allow learners to upload their own video files to their peer review submissions directly to PlayPosit. (Only possible if your institutional license includes HLS minutes)
   4. Optional Toggle Anonymize student rubric submissions to prevent learners from knowing the identities of their reviewers. 
5. Click Next to move on to setting the bulb link when finished configuring the peer review assignment.
6. On the next menu:
   1. If a group set has already been created for the class, select it from the drop down menu labeled "Select Group Set."
   2. If a group set has not yet been created, click Manage Group Sets and refer to the section on groups. 
      

Grading a peer review bulb with a rubric

Once learners have completed all of the necessary tasks associated with the peer review assignment, the instructor is able to monitor the peer review assignment to:

• View individual submissions
• Assess the feedback provided and received
• Assign final grades to each learner

See the additional steps below if grading peer review assignments that have rubrics.

Grading peer review assignments with rubrics

If rubrics are enabled for a peer review assignment, instructors can use the gradebook to:

1. Preview a learner's submission
2. Assign individual grades to learners and View feedback given by a learner and feedback received by the same learner
3. Enter Grade Mode to quickly assign grades to multiple learners at a time
4. Sync grades to the LMS gradebook.
5. Export the learners' data for this peer review assignment.

Filling out rubrics as an instructor and exporting final grades

The section below outlines how instructors submit final grades for a peer review assignment with rubrics and how to export the final grades. In order for an assignment to be considered complete, instructors will need to submit final grades.

1. Click the rubric icon for the learner you wish to grade. This will open a panel with three tabs, opening automatically to the Instructor Feedback tab. 
2. Click Evaluate Submission to launch the player view of this learner's submission.
3. Click the rubric icon in the sidebar to access the grading rubric for the learner's submission. The instructor can enter numeric values and leave comments or notes for each criterion. 
4. Click Submit Rubric to proceed to the next step.
5. If the same rubric is accessed again after submission, the Instructor Feedback tab will display the given score. Click View Submission to launch the player again with a read-only version of the submitted rubric.
6. Otherwise, click the rubric icon to view the submitted rubric for this learner.
7. To modify the score previously assigned to a learner, return to the gradebook for the peer review assignment and click Enter Grade Mode.
8. The score column for learners who have previously been graded will now show a number of radio buttons, each with a point value. Select the point value you want to assign for each available learner, and then click Save Grades.
9. Remember to Sync Grades to the LMS gradebook!

View feedback received from the learner's peers

Click on the Feedback Received tab to view the rubrics completed by the learner's peers for the submission. These rubrics do not factor into the learner's score. The final grade is assigned by the instructor filling out the rubric associated with the learner’s submission.

Click the Discussion icon to load a view of the discussion forum for the learner's submission.

View feedback given

Select the Feedback Given tab to view the scores given by the learner to others in the peer group. The instructor can also view group progress status.

Grading without a rubric

If rubrics were not enabled for the assignment, use the gradebook to: 

1. Preview a learner's submission
2. Copy a learner's submission into the My Bulbs tab as a new bulb.
3. Enter Grade Mode to quickly assign grades to multiple learners at a time.
4. Sync Grades to the LMS gradebook.
5. Export the learners' data for this peer review assignment.

Assign and export final grades

1. Learners who have submitted a video for this peer review assignment will have a "-%" entry in the Score column, denoting that the assignment needs to be graded. If Complete/Incomplete Grading was enabled on the assignment, then this value will read "100%" instead of "-%". Click Enter Grade Mode to assign a final score.
   
   
2. Select a point value for the learner's submission and click Save Grades, then click Sync Grades to export the final score to the LMS gradebook.

Data export for peer review

To export the learners' data from the peer review assignment, please click on the data export icon on the top right of the monitor page.

On the exported CSV file, instructors can find the following information:

• Learner ID
• Learner name
• Learner Email
• The number of interactions (learners can't add interaction to the peer review bulb, there are three built-in interactions to host discussion and grading. When learners reply to others' bulbs, the interaction they interact with will also add to this number. For example, if a learner has reviewed two other learners' bulbs, there will be 9 interactions in this field.)
• Interaction types (it will be discussion interaction and fill in the blank by default)
• Points earned 
• Points available
• Score
• Status
• LMS sync status
• Start time
• Completion time