Listen Labs

Last updated: November 12, 2026

Rally has partnered with Listen Labs so you can run AI-moderated research in Listen Labs while Rally handles recruitment, tracking, and incentives.

  • Recruit from an external panel or from your own user database for Listen Labs studies.

  • Track who started, completed, or was excluded, right in your Rally study.

  • Send incentives through Rally to thank participants who complete the test.

There are two ways to use Listen Labs in Rally:

  • Connect your Listen Labs account (recommended). Pick your Listen Labs study from a list. Rally tracks completions and exclusions automatically through a completion webhook.

  • Paste a share link without connecting. Participants come back to Rally when they finish and are marked as completed. Rally can't track exclusions this way.


Required user permissions

Connecting Listen Labs requires the "Modify survey integration settings" permission. Only teammates with this permission can see the webhook endpoint URL.


Connect your Listen Labs account

You'll need a Listen Labs API key. A Listen admin creates it under Account > Developer in Listen Labs.

  1. In Rally, navigate to Settings > Integrations.

  2. Under Testing tools, find Listen Labs and select Connect.

  3. Under API access, paste your key into the API key field.

  4. Select Connect.

Next, set up the completion webhook. Until it's verified, the card shows Webhook not verified and Rally does not track completions automatically.


Set up the completion webhook

The webhook is how Listen Labs tells Rally when a participant finishes or is excluded.

Only Listen Labs workspace Admins can see and change webhooks, and Listen Labs turns webhooks on per workspace. If you don't see a Webhooks section under Account > Developer, contact support@listenlabs.ai.

  1. In Rally, open the Listen Labs connection from Settings > Integrations and find the Completion webhook section.

  2. Copy the Endpoint URL.

  3. In Listen Labs, click Account at the bottom of the left sidebar. On the Developer card, open Webhooks and select Add endpoint.

  4. Paste the Rally endpoint URL and subscribe the endpoint to both events:

    • response.completed reports participants who finish.

    • response.ignored reports participants Listen Labs excludes. Rally never hears about these otherwise.

  5. Save the endpoint, then copy its signing secret. It starts with whsec_, and Listen Labs shows it only once.

  6. In Rally, paste the secret into Signing secret and select Save.

  7. In Listen Labs, select Send test event. Under Manage > Recent deliveries, the test shows Delivered.

The status in Rally changes from Awaiting test event to Verified, and Rally shows when the Last event received arrived.

Rally also checks Listen Labs every hour for completed responses, in case a webhook event was missed.


Use Listen Labs in Rally studies

  1. Create a new unmoderated test study in Rally. New unmoderated studies default to your connected testing platform.

  2. In What app are you using for this test?, choose Listen Labs. You can type in Search platforms to find it.

  3. From Listen Labs study, choose your study. You can search by study or folder name.

  4. Rally fills in the Participant link for you. There's nothing to add to it.

  5. Complete study setup and begin research.

Once the webhook is verified, completions come from Listen Labs. Participants finish on Listen Labs' own end screen and Rally doesn't send them back, so there's no redirect URL to configure and no completion message to write.

If the webhook isn't set up yet, the builder shows Completions won't be tracked automatically until the completion webhook is set up, with a link back to the Listen Labs settings.


What happens to participants

  • Test Started: the participant opened the Listen Labs link.

  • Test Completed: Listen Labs reported that the participant finished.

  • Test Excluded: Listen Labs excluded the response (response.ignored). Rally records a reason, such as Didn't finish for partial responses.

If a participant was already marked Test Completed, a later exclusion is kept as a note and they stay completed.

You can also set Test Excluded yourself from the participant's status menu. Rally asks for a short Reason for excluding, which is saved with the participant's test result.

Excluded participants:

  • Stop counting toward the study's target.

  • Can't take the test again. They see a message that they've already taken part.

  • Count under Canceled.

See each participant's response

  • The Test response column in the participants table links to the participant's response in Listen Labs.

  • A person's profile has an Unmoderated tests section that lists each result: completed or excluded, by whom, why, and a View response link.


Use a share link without connecting

  1. Create a new unmoderated test study in Rally and choose Listen Labs.

  2. In Listen Labs, go to your project, click Recruit, and copy the Shareable link.

  3. Paste the link into Enter test URL in your Rally study. If your account is connected, select Paste a link instead first.

  4. Under Messages, write the completion message participants see when they return to Rally.

  5. Complete study setup and begin research.

Rally adds a return link to the Listen Labs link for you, so participants come back to Rally when they finish and are marked Test Completed. There's no redirect URL to copy into Listen Labs.


Rally details displayed

Rally details can be displayed in Listen Labs responses, including:

  • Participant ID

  • Study ID

  • Source of response

Each attribute will be displayed within the URL Parameters section for each response.


FAQs

The card says "Webhook not verified". What do I do?

Rally doesn't track completions automatically until the completion webhook is verified. Open Manage on the Listen Labs card and finish the steps in Set up the completion webhook, including sending a test event.

I lost the signing secret, or I rotated it in Listen Labs.

Listen Labs shows a secret only once. Select Rotate secret under Manage on the endpoint in Listen Labs, paste the new secret into Signing secret in Rally right away, and send a test event. Listen Labs stops signing with the old secret as soon as you rotate it.

Completions stopped arriving.

Check the endpoint under Account > Developer > Webhooks in Listen Labs. If every delivery to an endpoint fails for 5 days, Listen Labs switches the endpoint off. Switch it back on, then send a test event.

The card says "API key rejected".

Listen Labs no longer accepts the saved key, so Rally can't list your studies or read completed responses. Create a new key in Listen Labs and select Replace under API access.

I replaced the API key and completions stopped.

Replacing the key clears the saved signing secret and its verification. Set up the completion webhook again for the account the new key belongs to.

Why don't I see Listen Labs excluded participants in Rally?

Check that the webhook is subscribed to response.ignored as well as response.completed.

What happens if I disconnect Listen Labs?

Rally deletes the API key and signing secret and stops receiving completions from Listen Labs. Existing studies keep working through the redirect.

I can't see the Endpoint URL.

Only teammates with the "Modify survey integration settings" permission can see it. Ask a workspace admin.