Rally has partnered with Dialogue AI so you can run AI-moderated interviews in Dialogue while Rally handles recruitment, tracking, and incentives.

• Recruit from an external panel or from your own user database for Dialogue studies.

• Track who started, completed, or was excluded, right in your Rally study.

• Send incentives through Rally to thank participants who complete the interview.

There are two ways to use Dialogue in Rally:

• Connect your Dialogue account (recommended). Link your Rally study to a Dialogue study, either by picking it from a list or by pasting its link. Rally tracks completions and exclusions automatically through a completion webhook.

• Paste a participant link without connecting. Participants come back to Rally when they finish and are marked as completed. Rally can't track exclusions this way.

Required user permissions

Company keys and team keys

Dialogue offers two kinds of API key, and Rally works with both:

• Company key (recommended). A Dialogue company admin creates it under Company settings > API keys. Rally can follow studies and completions in every team of your Dialogue company.

• Team key. A team admin creates it under the team's Settings > API keys. Rally only sees that one team's studies and completions.

If you connect a team key, the Dialogue connection in Rally shows Connected to a single Dialogue team. Everything works for that team, but studies in your other Dialogue teams won't be tracked. To cover every team, ask a Dialogue company admin for a company key and select Replace under API access.

Connect your Dialogue account

You'll need a Dialogue API key. We recommend a company key, which a Dialogue company admin creates under Company settings > API keys.

1. In Rally, navigate to Settings > Integrations.

2. Under Testing tools, find Dialogue and select Connect.

3. Under API access, paste your key into the API key field.

4. Select Connect.

Once connected, Rally shows Dialogue company: followed by your company's name, or Dialogue team: followed by the team's name if you connected a team key.

Next, set up the completion webhook. Until it's verified, the card shows Webhook not verified and Rally does not track completions automatically.

Set up the completion webhook

The webhook is how Dialogue tells Rally when a participant finishes or is excluded.

1. In Rally, open the Dialogue connection from Settings > Integrations and find the Completion webhook section.

2. Copy the Endpoint URL.

3. In Dialogue, open Company settings > Webhooks and select Add Endpoint. If you connected a team key, use the team's Settings > Webhooks instead. Paste the endpoint URL, select both response.completed and response.rejected under Subscribe to events, then select Create.

4. On the new endpoint's page, copy the Signing Secret and paste it into Signing secret in Rally. Select Save.

5. In Dialogue, open the endpoint's Testing tab, choose response.completed under Send event, and select Send Example.

The status changes from Awaiting test event to Verified, and Rally shows when the Last event received arrived.

Use Dialogue in Rally studies

1. Create a new unmoderated test study in Rally. New unmoderated studies default to your connected testing platform.

2. In What app are you using for this test?, choose Dialogue. You can type in Search platforms to find it.

3. Link your Dialogue study:

   • If Rally shows a Dialogue study list, choose your study from Dialogue study. You can search by study or folder name.

   • If Rally shows a Dialogue study link field, your Dialogue company doesn't let Rally list its studies. Copy the study's link from Dialogue, either the participant link or any page of the study in Dialogue, paste it into Dialogue study link, and select Link study. Rally shows the study by its ID, since Dialogue doesn't share study names in this case.

4. Rally fills in the Participant link for you. There's nothing to add to it.

5. Complete study setup and begin research.

Once the webhook is verified, completions come from Dialogue. Participants finish on Dialogue's own end screen and Rally doesn't send them back, so there's no redirect URL to configure and no completion message to write.

If the webhook isn't set up yet, the builder shows Completions won't be tracked automatically until the completion webhook is set up, with a link back to the Dialogue settings.

What happens to participants

• Test Started: the participant opened the Dialogue link.

• Test Completed: Dialogue reported that the participant finished.

• Test Excluded: Dialogue screened out, auto-rejected, or a reviewer rejected the response. Rally records the reason as Screened out or Failed quality check.

If a participant was already marked Test Completed, a later exclusion is kept as a note and they stay completed.

You can also set Test Excluded yourself from the participant's status menu. Rally asks for a short Reason for excluding, which is saved with the participant's test result.

Excluded participants:

• Stop counting toward the study's target.

• Can't take the test again. They see a message that they've already taken part.

• Count under Canceled.

See each participant's response

• The Test response column in the participants table links to the participant's response in Dialogue, when Dialogue has a finished response to show.

• A person's profile has an Unmoderated tests section that lists each result: completed or excluded, by whom, why, and a View response link.

Use a participant link without connecting

1. Create a new unmoderated test study in Rally and choose Dialogue.

2. In Dialogue, copy your study's participant link. It looks like https://app.dialogueai.com/study/…. A research.dialogueai.com dashboard link won't work here.

3. Paste the link into Enter test URL in your Rally study. If your account is connected and Rally shows a study list, select Paste a link instead first.

4. Under Messages, write the completion message participants see when they return to Rally.

5. Complete study setup and begin research.

Rally passes the return link to Dialogue automatically, so participants come back to Rally when they finish and are marked Test Completed. There's no redirect URL to copy into Dialogue.

FAQs

Rally says "Connected to a single Dialogue team".

You connected a team key, so Rally only sees that team's studies and completions. Ask a Dialogue company admin to create a company key under Company settings > API keys, then select Replace under API access in Rally. See Company keys and team keys above.

I don't see a Dialogue study list, only a "Dialogue study link" field.

Your Dialogue company doesn't let Rally list its studies. Paste a link to the study from Dialogue and select Link study. Completions are still tracked automatically.

My Dialogue study isn't in the list.

With a company key, Rally lists studies from every team in your Dialogue company. With a team key, Rally only lists that team's studies; connect a company key to see the rest.

Rally says the study isn't in my Dialogue account.

The link you pasted names a study outside the Dialogue company or team you connected. Check that you copied the link from the right study, or connect a key that covers that study's team.

The card says "Webhook not verified". What do I do?

Rally doesn't track completions automatically until the completion webhook is verified. Open Manage on the Dialogue card and finish the steps in Set up the completion webhook, including sending an example event from the endpoint's Testing tab in Dialogue.

The card says "API key rejected".

Dialogue no longer accepts the saved key, so Rally can't read your studies or completed responses. Create a new key in Dialogue and select Replace under API access.

I replaced the API key and completions stopped.

Replacing the key clears the saved signing secret and its verification. Set up the completion webhook again for the company or team the new key belongs to.

Rally says my link isn't valid.

When pasting a participant link without connecting, use the link that looks like https://app.dialogueai.com/study/…, not a research.dialogueai.com dashboard link.

What happens if I disconnect Dialogue?

Rally deletes the API key and signing secret and stops receiving completions from Dialogue. Existing studies keep working through the redirect.

I can't see the Endpoint URL.

Only teammates with the "Modify survey integration settings" permission can see it. Ask a workspace admin.