There are 6 key steps to complete when setting up an Unmoderated Test Study, detailed below.
Create new Studies much faster and more reliably by setting up custom Email Templates and Question Templates (used in screeners and surveys) that can be leveraged by your team. Ensure the right questions are being asked, pre-define mapping between questions and custom Properties to automatically enrich Participant Profiles, and use professional, consistent, approved communication in all email outreach.
After completing all Study setup steps, you can either (1) publish it to an Active status to proceed with the next steps to add and invite Participants and begin research or (2) save and exit to keep it in a Draft state to return later. Learn more about Study Statuses.
Visit our Creating Studies in Rally guide to learn more about how to prepare key components in advance before creating Studies, and learn the next steps for conducting each Study type after creation.
Create an Unmoderated Test Study
Navigate to the Studies page and select '+ New Study'.
Enter a Study Name.
Recruitment defaults to In-house (recruit Participants from your own database in Rally).
If you would like to recruit Participants from an external panel (incentives + recruitment fees per Participant required), learn how to Create an Unmoderated Test Study + Recruit from External Panel.
Select the Study Type 'Unmoderated Test'.
Select 'Continue' to open the Study Builder.
Plan
Start by setting up the key details of your Study.
Study Name: Give your Study a clear and descriptive name to easily identify it in your workspace.
Study external name: Add an external name for your Study. This can be used with Personalization Tokens to easily add the participant-facing name into emails, etc.
Research Goal (optional): Define the specific goal or objective of your research Study to guide your team.
Research Plan (optional): Provide additional details about your research plan, such as methodology or target audience.
Study Type: Confirm the Study type is an 'Unmoderated Test' before proceeding.
Participant Limit: Set a maximum number of Participants for your Study or choose to allow unlimited Participants for continuous research.
Consent (optional): Add a consent form to ensure Participants understand and agree to participate in your Study. Choose the type of consent form and its placement within the signup process. Learn more about consent placement.
Select consent form: Select the consent form to include from the dropdown.
Upload Documents, such as NDAs, and create custom Consent Forms to select from in Studies.
When to capture consent: Decide when to request consent from participants to determine consent placement within the Study by selecting an option:
Before participants start the screener
After participants submit the screener
Before the test starts
After the test is completed
Manual - you'll email the consent form
To capture consent before or after the screener, you'll need to add a screener first before returning to the Plan step to enable these options.
When capturing consent before or after the screener, links sent for unmoderated tests will request consent before the activity if the Participant has not yet provided consent in this Study (ex: invited to test without first being invited to complete the screener+consent).
Learn how to manually email consent forms directly to Participants.
Incentive (optional): Specify the amount or reward you will provide to Participants for their participation.
Users can 'Add Funds' to the selected Incentive Budget here, or wait to add funds before sending incentives later. This may require manager approval.
Learn how to set up, send, and manage Incentives.
Branding (optional): Personalize your Study with your company's logo and brand colors to create a cohesive experience.Set up and manage Brands for your workspace.
Set up and manage Brands for your workspace.
Language (optional): Select from the options to translate your Study into another language. Currently, each Study can only have 1 language set; for example, choosing Spanish will not show an English option for users.
Note: Web pages, screener endings, and uneditable elements of emails will be translated by Rally to your chosen language, but customizable elements that your team creates or includes (such as screener and survey questions or question templates, email content or email templates, and consent forms) will not be automatically translated and can be prepared in advance by your team.
Screener
Ask the right questions to keep your Participants engaged and gather the best feedback.
Screener tool: Select your preferred screener tool. While Rally's native screener tool is recommended for seamless integration with properties and automated follow-ups, you can also choose from one of our Survey integrations with Qualtrics, SurveyMonkey, Typeform, or UserTesting. You can also 'Link to a custom survey' to use an alternative non-integrated survey tool; if you choose this option, follow the link to ensure proper setup to see survey completion updates in Rally Studies.
Qualification: Choose your preferred qualification method to streamline the workflow for qualified Participants from the 2 options below:
Complete screener without being disqualified: With this option, Participants who complete the screener without encountering any auto-disqualifying answers will automatically qualify for the study.
You will need to set up conditional logic to disqualify participants based on specific question responses, or participants who complete screeners will auto-qualify unexpectedly.
Have a qualifying answer to specific questions: With this option, you can set specific questions in the screener that will automatically qualify Participants based on their answers.
You will need to set up conditional logic to qualify participants based on specific question responses, or participants who complete screeners will not auto-qualify as expected.
Immediate Testing (optional): Allow qualified Participants to start the unmoderated test immediately after completing the screener, without waiting for you to follow up.
Build Screener: If you use Rally's screener tool, create your screener by adding questions and implementing conditional logic to tailor the screening process. Select '+ Add Question' and either:
'Create New Question'
Learn how to create new questions, map questions/responses to Properties, and optionally save them as new Question Templates as you go.
'Add From Question Templates'
We recommend creating custom Question Templates in advance to allow your team to quickly and easily build quality screeners.
Screener endings: Customize messages for Participants based on their qualification status.
Standard: A general message that Participants see after they submit the screener.
Example: "Thank you for taking the time to fill out the screener survey. If you match our criteria, you will receive an email from us."
Qualified: A message that Participants see after they submit the screener with auto-qualifying answers.
Example: "Thank you for choosing to participate. We think you'd be an awesome fit for our Study, and we will reach out to you when there are opportunities for you to participate in."
Disqualified: A message that Participants see after they submit the screener with auto-disqualifying answers.
Example: "Thank you for taking the time to fill out the survey."
💡 Screeners cannot be submitted twice by a Participant for the same Study. This avoids overwriting original responses or any Participants attempting to bypass a disqualification with an additional submission attempt.
Test
Set up the testing tool.
Select the tool: Choose from our unmoderated testing integration partners: UserTesting, UserZoom, Maze, or Ballpark. Alternatively, insert a custom link to your testing tool.
Enter Test URL: Once the test is set up in the external platform, copy the link to the test and paste it into Rally. Depending on the testing integration you use, there may be additional steps to complete the test setup.
Messages: Modify the message that Participants see once they have completed the test.
Rally allows the flexibility to use custom test tools in Rally Studies, but our dedicated testing integration partners are recommended for the most seamless experience. When using an alternate test tool, please reference your test tool's support documentation for specific instructions on how to successfully set up the redirect link that Participants must click after completing the test in order for Rally to know to mark them as 'Test Completed.' Full compatibility may vary depending on the tool used.
Maze: If you’re using Maze, you’ll need to add a redirect link to your Maze test.
In Maze: Open the Thank You screen of your draft Maze. This is the final screen that testers will see upon completion.
Click the toggle Post-maze redirection to redirect your testers to a different page once they have completed the maze.
Enter the call-to-action (CTA) text in the Button text field — e.g. “Get your reward”.
Enter the redirect URL in the URL link field.
Emails
Preparing your emails upfront saves you time and keeps your messaging consistent. You can always return to edit them later or edit them when sending. We highly recommend setting up custom Email Templates for your team in advance to save significant time and ensure professional, consistent, approved communication is used in all email outreach. Email Templates can be selected when reviewing and editing messages during the Email setup step.
Unmoderated Test Screener: Send an invitation to potential Participants to participate in your Study by taking the screener. Not included for Studies without screeners.
Unmoderated Test: Send the test link to qualified Participants. This email bypasses the screener (if one is included) and allows the Participant to begin the test.
Incentive: Thank Participants for taking part in the unmoderated test and send them an incentive via Tremendous. Confirm the incentive amount before saving. Not included for Studies without incentives enabled.
Edit and Preview Outreach Emails
Select the pencil icon next to each email to customize and carefully preview each one.
💡 Visit Email Templates for complete steps and additional important information.
Select Template: Select from pre-made Email Templates for consistency.
Layout: Select Plain Text or choose Branded for more professional outreach.
Subject: Edit the email subject as needed. Optionally, include Personalization Tokens to auto-populate such as Participant's First Names.
Body: Edit the email body as needed (less relevant for Email Templates). Optionally, further customize formatting and add Personalization Tokens to auto-include relevant information, such as Study Name or Incentive Amount.
Include Unsubscribe Link: Include a link at the bottom of your emails allowing recipients to stay unsubscribed. It will help you stay compliant with local spam laws and improve deliverability. Unsubscribe links are required for branded emails.
Send Test: Optionally, send yourself a test email.
+ Save As New Template: Save any new email you create as an Email Template for later reuse.
Done: Select Done to close the editor.
💡 Learn how to decrease spam rate and improve email deliverability before emailing customers.
Share
Choose how you'll recruit Participants and share your Study.
Select Recruitment Channels:
Send Emails: Emails are always enabled.
Share a Public Link: Toggle on 'Share a Public Link’ if you’d like to invite Participants via a share link.
Recruitment Preferences:
Welcome Page: Create a custom Welcome Page for Participants by selecting 'Edit Page'. Check the corresponding boxes to decide whether the welcome page will be shown to Participants invited via Email or Share Link, or neither.
Contact Information: Confirm which information will be required from Participants when they sign up.
First Name & Last Name: This setting is enabled by default and requires a person to enter their first name & last name to join this Study. Optionally, disable this setting for Participants invited via Email.
Email Address: This setting is enabled by default as an email address is required to join a Study. Decide whether to allow 'Personal or work emails' or 'Work emails only'. This defaults to 'Personal or work emails'.
Review
Confirm everything is correct or add any missing info to ensure your Study is complete.
Review the components of your Study: Rally will check for any known errors or missing details in your Study setup for you to make necessary edits. Preview your entire Study from the Participant's perspective to ensure a seamless experience.
Select 'Create Study' in the top right to launch the Study and get started!
If you're not ready to Publish it, select 'Save & Exit' to save it in a Draft state to return later.
Next, add Participants to your Study before sending email invitations or sharing links.
Visit our guide to learn more about how to prepare key components in advance before creating Studies, and learn the next steps for conducting each Study type after creation.