There are 6 key steps to complete when setting up an Unmoderated Test Study, detailed below.
Create new Studies much faster and more reliably by setting up custom Email Templates and Question Templates (used in screeners and surveys) that can be leveraged by your team. This saves you significant time and allows you to ensure the right questions are being asked, pre-define mapping between questions and custom Properties to automatically enrich Participant Profiles, and use professional, consistent, approved communication in all email outreach.
After completing all Study setup steps, you can either:
Publish it to an Active status to proceed with the next steps to add and invite Participants and begin research.
Save and exit to keep it in a Draft state to return later.
Learn more about Study Statuses.
Create an Unmoderated Test Study
Navigate to the Studies page and select '+ New Study'.
Enter a Study Name.
Select the Study Type 'Unmoderated Test'.
Select 'Continue' to open the Study Builder.
Plan
Start by setting up the key details of your Study.
Study Name: Give your Study a clear and descriptive name to easily identify it in your workspace.
Study External Name (optional): If you have an external name for your Study, you can add it here. The external Study name is what Participants will see.
Research Goal (optional): Define the specific goal or objective of your research Study to guide your team.
Research Plan (optional): Provide additional details about your research plan, such as methodology or target audience.
Study Type: Confirm the Study type is an 'Unmoderated Test' before proceeding.
Participant Limit: Set a maximum number of Participants for your Study or choose to allow unlimited Participants for continuous research.
Consent (optional): You can add a consent form to ensure Participants understand and agree to participate in your Ptudy. You can also choose the type of consent form and its placement within the signup process.
Upload Documents, such as NDAs, and create custom Consent Forms to select from in Studies.
Incentive (optional): Specify the amount or reward you will provide to Participants for their participation.
Users can 'Add Funds' to the selected Incentive Budget here, or wait to add funds before sending incentives later. This may require manager approval.
Learn how to set up, send, and manage Incentives.
Branding (optional): Personalize your Study with your company's logo and brand colors to create a cohesive experience.Set up and manage Brands for your workspace.
Set up and manage Brands for your workspace.
Language (optional): Select from the options to translate your Study into another language. Currently, each Study can only have 1 language set; for example, choosing Spanish will not show an English option for users.
Note: Web pages and automated emails will be translated by Rally to your selected language, but any customizable elements that your team creates or includes (such as custom screener and survey questions or question templates, custom emails or email templates, and consent forms) will not be automatically translated by Rally and should be prepared in advance by your team.
Screener
Ask the right questions to keep your Participants engaged and gather the best feedback.
Screener tool: Select your preferred screener tool. While Rally's native screener tool is recommended for seamless integration with properties and automated follow-ups, you can also choose from one of our Survey integrations with Qualtrics, SurveyMonkey, Typeform, or UserTesting.
Immediate Testing: Toggle on immediate testing to allow qualified Participants to start the unmoderated test immediately after the screener.
Build Screener: If you use Rally's screener tool, create your screener by adding questions and implementing conditional logic to tailor the screening process. Select '+ Add Question' and either:
'Create New Question'
Learn how to create new questions, map questions/responses to Properties, and optionally save them as new Question Templates as you go.
'Add From Question Templates'
We recommend creating custom Question Templates in advance to allow your team to quickly and easily build quality screeners.
Screener endings: Customize messages for Participants based on their qualification status.
Standard: A general message that Participants see after they submit the screener.
Example: "Thank you for taking the time to fill out the screener survey. If you match our criteria, you will receive an email from us."
Qualified: A message that Participants see after they submit the screener with auto-qualifying answers.
Example: "Thank you for choosing to participate. We think you'd be an awesome fit for our Study, and we will reach out to you when there are opportunities for you to participate in."
Disqualified: A message that Participants see after they submit the screener with auto-disqualifying answers.
Example: "Thank you for taking the time to fill out the survey."
đĄ Screeners cannot be submitted twice by a Participant for the same Study. This avoids overwriting original responses or any Participants attempting to bypass a disqualification with an additional submission attempt.
Test
Set up the testing tool.
Select the tool: Choose from our unmoderated testing integration partners: UserTesting, UserZoom, or Maze. Alternatively, insert a custom link to your testing tool.
Enter Test URL: Once the test is set up in the external platform, copy the link to the test and paste it into Rally. Depending on the testing integration you use, there may be additional steps to complete the test setup.
Messages: Modify the message that Participants see once they have completed the test.
Note: If youâre using Maze, youâll need to add a redirect link to your Maze test.
In Maze: Open the Thank You screen of your draft Maze. This is the final screen that testers will see upon completion.
Click the toggle Post-maze redirection to redirect your testers to a different page once they have completed the maze.
Enter the call-to-action (CTA) text in the Button text field â e.g. âGet your rewardâ.
Enter the redirect URL in the URL link field.
Emails
Preparing your emails upfront saves you time and keeps your messaging consistent. You can always return to edit them later or edit them when sending. We highly recommend setting up custom Email Templates for your team in advance to save significant time and ensure professional, consistent, approved communication is used in all email outreach. Email Templates can be selected when reviewing and editing messages during the Email setup step.
Unmoderated Test Screener: Send an invitation to potential Participants to participate in your Study by taking the screener. Not included for Studies without screeners.
Unmoderated Test: Send the test link to qualified Participants.
Incentive: Thank Participants for taking part in the unmoderated test and send them an incentive via Tremendous. Confirm the incentive amount before saving. Not included for Studies without incentives enabled.
Edit and Preview Outreach Emails
Select the pencil icon next to each email to customize and carefully preview each one.
đĄ Visit Email Templates for complete steps and additional important information.
Select Template: Select from pre-made Email Templates for consistency.
Layout: Select Plain Text or choose Branded for more professional outreach.
Subject: Edit the email subject as needed. Optionally, include Personalization Tokens to auto-populate such as Participant's First Names.
Body: Edit the email body as needed (less relevant for Email Templates). Optionally, further customize formatting and add Personalization Tokens to auto-include relevant information, such as Study Name or Incentive Amount.
Include Unsubscribe Link: Include a link at the bottom of your emails allowing recipients to stay unsubscribed. It will help you stay compliant with local spam laws and improve deliverability. Unsubscribe links are required for branded emails.
Send Test: Optionally, send yourself a test email.
+ Save As New Template: Save any new email you create as an Email Template for later reuse.
Done: Select Done to close the editor.
đĄ Learn how to decrease spam rate and improve email deliverability before emailing customers.
Share
Choose how you'll recruit Participants and share your Study.
Select Recruitment Channels:
Send Emails: Emails are always enabled.
Share a Public Link: Toggle on 'Share a Public Linkâ if youâd like to invite Participants via a share link.
Recruitment Preferences:
Welcome Page: Create a custom Welcome Page for Participants by selecting 'Edit Page'. Check the corresponding boxes to decide whether the welcome page will be shown to Participants invited via Email or Share Link, or neither.
Contact Information: Confirm which information will be required from Participants when they sign up.
First Name & Last Name: This setting is enabled by default and requires a person to enter their first name & last name to join this Study. Optionally, disable this setting for Participants invited via Email.
Email Address: This setting is enabled by default as an email address is required to join a Study. Decide whether to allow 'Personal or work emails' or 'Work emails only'. This defaults to 'Personal or work emails'.
Review
Confirm everything is correct or add any missing info to ensure your Study is complete.
Review the components of your Study: Rally will check for any known errors or missing details in your Study setup for you to make necessary edits. Preview your entire Study from the Participant's perspective to ensure a seamless experience.
Select 'Create Study' in the top right to launch the Study and get started!
If you're not ready to Publish it, select 'Save & Exit' to save it in a Draft state to return later.
Next, add Participants to your Study before sending email invitations or sharing links.