Participant Rating Guide

Created by the Twilio Research team, this guide explains how to rate participant quality after sessions and serves as a shared reference your team can use to stay consistent.

⭐️ 5 Star Rating = Exceptional participant, very engaged, shared detailed and insightful feedback. Communicated clearly, stayed on topic, and was easily guided through the questions. This is someone you would want to interview again. Required: arrived on time, experience aligned with screener responses and profile)

⭐ 3 Star Rating = Adequate participant, showed up on time, experience is accurate and aligned with their screener responses and profile. Gave good insights but may have required more guidance to stay on topic/provide deeper responses.

⭐ 1 Star Rating = Very poor quality participant, gave no valuable feedback. Screener and profile did not reflect accurate experience. Showed suspicious and/or fraudulent behavior, cancelled and rescheduled multiple times. This is someone who should not be interviewed again.

For all 1 and 2 ratings: Please add a note for why you are down-rating this participant.

Participant rating can be used to inform future recruiting, and exclude low-rating participants from future studies.