Supersona
한국어Sign in

User guide

How to build a survey and read its results, one task at a time.

Contents · 13 sections

Get started

New here? Start with one of these.

How a survey runs

  1. Goals and metrics

    What you want to learn and how you’ll judge the results

  2. Virtual customers

    How many virtual customers take part, and who they are

  3. Screens and tasks

    The screens, actions and task to compare

  4. Interview setup

    Confirm the briefing, write the questions, then start

  5. Run the survey

    Progress and answers as they arrive

  6. Report

    Results, analysis and suggested fixes

Build a survey

Create a survey

Select ‘New survey’ in My surveys or the top bar. A new survey is created and you choose its type.

Choosing a survey type. The App or web screens card, the Ads and content card and the Get started button are numbered.

How to use

  1. App or web screens

    For flows that span several screens, like sign-up, booking or checkout.

  2. Ads and content

    For comparing ad copy and images.

  3. Get started

    Takes you to step 1, Goals and metrics, with the type you chose.

Checkpoints

  • What you add in step 3 depends on the type: screen images for app or web screens, copy and images for ads and content.
  • An ‘Untitled survey’ appears under Drafts in the left menu. Once you describe what you want to learn in step 1, that sentence becomes its name.

Build a survey

Set goals and metrics

In step 1, Goals and metrics, set what you want to learn and how you’ll judge the results.

Survey goal

The Survey goal card. The fields for what you want to learn, the key message and the hypothesis are numbered.

How to use

  1. What you want to learn

    One sentence on what this survey should find out. For example: “We want to know whether first-time users can finish booking a space.”

  2. Key message or action you want to drive

    What your screens or ad are meant to get across. Optional.

  3. Hypothesis to test

    What you expect the results to show. Optional.

Checkpoints

  • Fill in what you want to learn and the message field and Goal metrics card appear. Fill in the message and the hypothesis field appears.
  • What you want to learn is the survey’s name. It updates the page title and the left menu as you type.
  • With a hypothesis, the report’s overall take says whether the results support it, contradict it, or can’t tell.

These fields are used to analyze results. Virtual customers never see them.

Goal metrics

The Goal metrics card. The metric cards, the custom metric field and the help icon are numbered.

How to use

  1. Success metrics

    Choose at least one: completion rate, selection rate, drop-off point, message clarity, or preference and why.

  2. Custom metric

    For a metric that isn’t listed, type it in and select ‘Add metric’.

  3. About goal metrics

    Select ? to see what each metric measures.

Checkpoints

  • You can select ‘Next’ and move on to step 2, Virtual customers, once at least one metric is chosen.
  • Each metric’s result by design appears in the report’s summary and under ‘Metric impact’.
  • Custom metrics aren’t calculated. AI uses them when it writes interview questions in step 4.

Build a survey

Choose virtual customers

In step 2, Virtual customers, set how many virtual customers take part and who they are.

Size and mix

The Sample mix card and the list of virtual customers taking part. Number of people, countries, gender mix, set shares and the list are numbered.

How to use

  1. Number of people

    Anywhere from 10 to 200. The default is 100, and the Free plan allows up to 100.

  2. Countries

    Where virtual customers come from. The number next to each country is how many candidates it has.

  3. Gender mix

    Drag the slider to set the share of women and men.

  4. Automatic · Set shares

    Set shares shows the sliders. Automatic follows each country’s real population. Age mix works the same way.

  5. Virtual customers taking part

    The people picked, each with a short profile.

Checkpoints

  • Change the size, countries or mix and the list updates right away.
  • Raise one slider and the others come down with it, so the total stays at 100%.
  • If there aren’t enough candidates, the mix gets as close as it can and the list shows how many were actually picked.
  • Each 100 virtual customers use 1 report, so 200 people use 2. Twice as many people takes about twice as long to run.

Areas and screening criteria

The bottom of the Sample mix card. Areas, the screening criteria field and Reset mix are numbered.

How to use

  1. Areas

    Open it to pick people only from certain areas.

  2. Screening criteria

    Describe the customers you’re looking for, one trait per line, up to 5 lines. Then select ‘Find matching people’.

  3. Reset mix

    Sets countries, shares and areas back to their defaults. Your criteria stay.

Checkpoints

  • Select ‘Find matching people’ and AI reads each candidate’s profile, then moves people who match to the top of the list.
  • You can keep working on other fields while AI checks. Progress shows under the field.
  • When it’s done, people who match are marked ‘Matches criteria’, and a line like “42 of 100 people match” shows the result.
  • If too few people match, the remaining places go to other candidates.
  • After you edit the criteria, select ‘Find matching people’ again.

Build a survey

Add screens and a task

In step 3, Screens and tasks, write the task virtual customers will do and add the screens you want to compare.

Situation, task and number of designs

The Situation and task card and the Number of designs card. The product description, situation and task fields, One design and Compare two designs (A/B) are numbered.

How to use

  1. About the product or service

    One line on what the screens are for. Optional. For example: “SPACE, an app for booking meeting rooms and study rooms by the hour”.

  2. Situation

    The situation virtual customers are in. Optional. For example: “You need a room for next week’s team meeting, and quickly.”

  3. Task for virtual customers

    What virtual customers should try to do on your screens. For example: “Choose a space and a time, and finish booking.”

  4. One design

    To see how people react to a single flow.

  5. Compare two designs (A/B)

    To compare two designs. Each virtual customer tries both.

Checkpoints

  • Choose two designs and every step gets a design A and a design B slot side by side.
  • If design B has any screens, copy or images, switching back to one design asks whether to delete design B.

The product description and situation are used when you create the briefing; the task reaches virtual customers exactly as written.

Screens

Step 1 of the Screens and tasks card. The help on setting up screens and actions, step 1 with its design A and design B screen images, and the screen name field are numbered.

How to use

  1. How to set up screens and actions

    Select ? for examples.

  2. Step

    Add screen images with ‘Upload next screen image’ below the card. Each image is one step.

  3. Screen name

    The name the report uses for this screen.

Checkpoints

  • Each image you upload adds a step. Use the arrows at the top right of a step to reorder.
  • With two designs, deleting one design’s screen empties only that slot. To delete a whole step, use the trash icon at the top right of the step.
  • Replace an image and you’re asked to check that the existing actions still fit. Select ‘Keep as is’ once they do.
  • Images must be PNG, JPEG or WebP, up to 5 MB and 4,096 px wide or tall. A survey holds up to 24 files.

Actions and where they lead

The action list. Actions, Find actions with AI, Add action and the destination field are numbered.

How to use

  1. Actions

    What people can do on this screen, in one sentence. For example: “Tap ‘Book this space’ to choose a time”.

  2. Find actions with AI

    AI reads the screen and finds what people can tap or check, written as action sentences.

  3. Add action

    Adds an action line you fill in yourself.

  4. Goes to

    For each action, choose another step, ‘Stays here’, ‘Task completed’ or ‘Didn’t find it’.

Checkpoints

  • Finding actions with AI usually takes 10–30 seconds. Each action it finds shows its role, such as ‘To the next screen’, ‘Stays on this screen’ or ‘Finishes the task’. Keep the ones you want checked and select the add button.
  • ‘Connect it yourself’ means AI didn’t decide where the action leads. After adding it, choose where it goes. Until you do, ‘Next up’ at the bottom reminds you.
  • Designs A and B share one action list. Only the screen images differ.
  • Only virtual customers who tap an action leading to ‘Task completed’ count as finishing the task.

Ads and content surveys

Design A’s card in an ads and content survey. Design A copy, Design A image, Where people see it, Buttons or copy people can choose, and Add from copy are numbered.

How to use

  1. Design A copy

    Paste your ad copy, landing page headline or message as is. Up to 10,000 characters.

  2. Design A image

    Add the ad image if there is one. It’s optional.

  3. Where people see it

    The situation people see the ad in. For example: “On the subway on the way home from work.”

  4. Buttons or copy people can choose

    If the ad has a button, choose ‘They can tap one’ or ‘They can tap several’.

  5. Add from copy

    Turns a phrase in your copy into an option people can choose.

Checkpoints

  • In an ads and content survey, step 3 is called ‘Content and tasks’.
  • With two designs, design B’s card follows below and works the same way.
  • Once you set options, the report shows how many people chose each one.
  • ‘Where people see it’ is used when you create the briefing, and reaches virtual customers through it.
  • An ads and content survey’s task card has no ‘Situation’ field. Enter ‘Where people see it’ for each design instead.

Build a survey

Prepare the briefing and questions

In step 4, Interview setup, confirm the briefing virtual customers read before they start, and write the questions they answer afterward.

Write and confirm the briefing

The Interview briefing card. Regenerate, the briefing, the request to AI and the Confirmed badge are numbered.

How to use

  1. Write briefing with AI

    AI drafts the briefing. Once it has, this button reads ‘Regenerate’.

  2. Briefing

    Edit the draft yourself.

  3. Changes for AI to make

    Describe the change and select ‘Ask AI to revise’. AI rewrites the briefing, so other sentences may change too.

  4. Confirm

    Review it and select ‘Confirm’. It then shows ‘Confirmed’.

Checkpoints

  • AI writes the briefing from what you entered in step 3, smoothing the wording. It doesn’t add times, places or circumstances you didn’t write.
  • If you change what the briefing is based on after confirming, such as the screens, actions, ‘Where people see it’, task or number of designs, confirm the briefing again. The warning lists what changed.
  • If the briefing gives away the survey’s intent, like its goal or hypothesis, you’ll see a warning.

If left blank, only the task is sent. Your goal, key message, hypothesis and metrics are never included in the briefing.

Interview questions

The Interview questions card and the Interview mode card. Write questions with AI, question type, Improve with AI, Add question, interview mode and Before you start are numbered.

How to use

  1. Write questions with AI

    AI fills in questions that match your goal metrics.

  2. Question type

    What each question is for: message clarity, likes and why, pain points and so on.

  3. Improve with AI

    AI rewrites one question more clearly. If you don’t like it, select ‘Undo’.

  4. Add question

    Adds a question. Use the trash icon to delete one.

  5. Interview mode

    Virtual customers see all of a design’s screens and answer in one go (single interview).

  6. Before you start

    A last check of everything from step 1 to step 4.

Checkpoints

  • If a question gives away the answer you want, you’ll see a warning.
  • Anything missing shows in ‘Before you start’ and in ‘Next up’ at the bottom. Select it to jump there.

Virtual customers receive the confirmed briefing and your questions exactly as written.

Interview questions in an ads and content survey

The Interview questions card in an ads and content survey. The text shown before the five-point questions, a fixed question, Follow-up, the answer type and Improve with AI are numbered.

How to use

  1. Shown before the five-point questions

    What virtual customers see before the five-point questions.

  2. Fixed questions

    Message clarity, likeability and ease of viewing are in every ads and content survey; the rest are statements that come with the goals you chose in step 1. People answer on five points, from ‘Strongly disagree’ to ‘Strongly agree’. You can’t edit them, but you can delete them.

  3. Follow-up

    The message clarity and first impression questions also ask this, answered in their own words alongside the five points.

  4. Open-ended · Five points

    Questions you add are answered in people’s own words. Choose ‘Five points’ to have one answered on five points instead.

  5. Improve with AI

    AI rewrites one question: an open-ended one as an open question, a five-point one as a statement.

Checkpoints

  • ‘Write questions with AI’ writes open-ended questions for what the fixed questions don’t ask. If you typed in goals yourself, it writes one for each.
  • A five-point question gets clearer answers when you write it as a statement.
  • You can put a deleted fixed question back from ‘Removed fixed questions’.
  • The report’s ‘Results by question’ shows how many people chose Agree or higher on each five-point question, and the answers that came up most on each open-ended question.

Build a survey

Start and run the survey

Start the survey with ‘Start survey’ at the bottom of step 4, then follow its progress in step 5, Run the survey.

Start the survey

The start dialog. The reports left this month and the Start survey button are numbered.

On this screen

  1. Reports left

    How many reports you can use this month. Starting uses 1 per 100 people.

  2. Start survey

    Starts the virtual customer interviews right away.

How to use

  1. Select ‘Start survey’ at the bottom of step 4.
  2. Check how many reports you have left this month, then start.
  3. Starting uses 1 report per 100 virtual customers and takes you to step 5, Run the survey.

Checkpoints

  • If anything is missing, the dialog lists it. ‘Go to the first item’ takes you there.
  • If you don’t have enough reports, you can’t start. The dialog shows when they refill and what you can do next.
  • Edit steps 1–4 after starting and the button becomes ‘Start again’. Each restart uses 1 report per 100 virtual customers, and you can open the earlier report from Earlier reports in step 6.
  • If the earlier survey stopped before it finished, starting again ends it first. If it got any answers, they become a report that counts toward your limit; if not, it won’t count.

Follow progress

The progress card. Progress, the progress stages, results by design and the answers panel are numbered.
From the sample survey in the walkthrough.

On this screen

  1. Progress

    Interviews done out of the total. The total is people × designs.

  2. Stages

    Assign virtual customers, interviews, building the report, then AI analysis.

  3. Results by design

    How many finished the task, didn’t find it, or stopped partway, by design.

  4. See virtual customers’ answers

    Open it to read answers as they arrive.

Checkpoints

  • The survey keeps running if you close the page. Come back any time to pick up where you left off.
  • Use ‘Pause’ to stop and ‘Continue’ to pick up where it stopped.
  • ‘End here’ cancels the remaining interviews and can’t be undone. Answers already in are kept in the report. To run it again, edit steps 1–4 and select ‘Start again’.
  • When it’s done, select ‘Next’ at the bottom to go to step 6, Report.

Read the results

Read the report

Read step 6, Report, in this order to go from the conclusion to the evidence behind it.

Summary and designs

The top of the report. Export, the summary and the designs compared are numbered.
From the sample survey in the walkthrough.

On this screen

  1. Export

    Saves the report as a file. In your own surveys it sits at the right of the survey title.

  2. Summary

    Goal metrics, number of virtual customers and interviews done.

  3. Designs compared

    The screens used when the survey started and what virtual customers were given.

Checkpoints

  • Once the report is ready, AI analysis (overall take, reaction themes, suggestions) follows. It keeps going if you close the page.
  • Editing steps 1–4 after starting doesn’t change ‘Designs compared’ (‘Design shown’ with one design). It still shows the designs used when the survey started.
  • An ads and content survey’s report also has ‘Results by question’. Select a five-point question to see how the answers spread across the five levels, and why.

1. Overall take: the conclusion

The Overall take card. The AI analysis label is numbered.

On this screen

  1. AI analysis

    The top line is the conclusion. Below it: the biggest obstacle, the verdict on your hypothesis, and what to fix.

2. Comparison: the difference

The Comparison card. People who finished the task, people who finished in only one design, the difference, the 95% range, actions to finish the task and people who finished both designs are numbered.

On this screen

  1. People who finished the task

    Out of everyone, how many finished the task in each design.

  2. Finished the task in only one design

    Everyone tried both designs, so the difference between them comes from these people.

  3. Difference

    The gap between the two designs’ rates, in percentage points.

  4. 95% range

    Where the difference likely falls. If the range includes 0, there may be no real difference.

  5. Actions to finish the task

    For each design, the average number of actions people chose before finishing, counting only people who finished. If the number who finished differs by design, it says how many each average covers.

  6. People who finished both designs

    Among the same people who finished both designs, how many took fewer actions on each design.

3. Reaction themes: the reasons

The Reaction themes card. Both designs, Only in design A, the severity help and the quotes button are numbered.

On this screen

  1. Both designs

    Reactions that came up in both designs.

  2. Only in design A

    Reactions that came up in one design only. Start here to see why the results differ.

  3. About severity

    How problems are rated severe, moderate or minor.

  4. View quotes

    The answers behind the theme, word for word.

4. Customer journey: where people drop off

The Customer journey overview card. Most stops, why they stopped and the help on reading the bars are numbered.

On this screen

  1. Most stops

    The screen where the most people stopped partway.

  2. Why they stopped or gave up

    The reasons people gave when they stopped or gave up on that screen, sorted into reaction themes.

  3. How to read the bars

    Each bar is a screen. The colors show what people did there.

5. Suggestions: what to do next

The Suggestions card. A suggestion line and the supporting quotes button are numbered.

On this screen

  1. Suggestion

    What to change. The observation, cause and result above it are the evidence.

  2. View supporting quotes

    The answers the suggestion is based on.

6. Virtual customer answers: the source

The Virtual customer answers card. The filters, Show all answers, one virtual customer’s answers and Customer journey are numbered.

On this screen

  1. Filters

    Filter answers by sex, age group and design.

  2. Show all answers

    Opens every answer that’s collapsed under each question.

  3. One virtual customer

    Who they are and their answer for each design. ‘Didn’t reach this question’ means their interview was still in progress, ended with an error or was cancelled before the questions, and that status shows below it. People who stopped during the task still answer the questions.

  4. Customer journey

    Open it to see the screens this virtual customer saw and the actions they chose before answering, in order. ‘6 actions’ next to it is how many actions they chose during the task.

Checkpoints

  • Choose a filter and only that group’s answers remain. The count at the top changes too, for example “50 of 100 people”.
  • Compare designs by metric under ‘Metric impact’, and by country, sex and age under ‘Reactions by demographic’.

Earlier reports

The Earlier reports list in step 6, open. Earlier reports and the latest item are numbered.

How to use

  1. Earlier reports

    Open the list above the report in step 6.

  2. Latest

    Choose a report. Each report shows when it was made and its number of virtual customers.

Checkpoints

  • ‘Earlier reports’ appears only after you start the survey again and an earlier report exists.
  • The most recent one is marked ‘Latest’.

Read the results

Export the report

Save the report as a file to share with your team.

The Export menu, open. Save as PDF, Responses CSV, Metrics CSV and Raw records (JSON).

How to use

  1. Select ‘Export’ on the report.
  2. Choose a format. For a PDF, choose ‘Save as PDF’ in the print dialog.

Checkpoints

  • Responses CSV has one row per virtual customer per design. Metrics CSV has each metric’s denominator and ratio, and the comparison between designs.
  • In a screen-flow survey where someone finished the task, Metrics CSV also has each design’s average ‘Actions to finish the task’.
  • Raw records (JSON) holds the virtual customers’ recorded actions and the raw tallies. It doesn’t include the designs or the question text.
  • The PDF shows when the report was generated, and who exported it and when.

Usage and your team

Check usage and team details under ‘Reports this month’ or ‘Settings’ at the bottom of the left menu.

Plan and usage

Plan and usage in Settings. Plan and usage and Ask for more reports are numbered.

On this screen

  1. Plan and usage

    Your plan, reports and add-on reports left this month, and your next payment date.

  2. Ask for more reports

    Get in touch if you need more reports.

Checkpoints

  • Every time you start or restart a survey, 1 report is used per 100 virtual customers, however many designs it has.
  • Teams that sign up get 3 free reports every month. Need more? Use See plans to move to Pro or Team.

Team settings

Team settings. Team name, members and Invite members are numbered.

On this screen

  1. Team name

    The name everyone on your team sees. Only admins can change it.

  2. Members

    Who’s on the team and their role (admin or member).

  3. Invite members

    A team admin enters an email and the invitation goes out right away. Once they open the link and sign in with that address, they’re a member.

Cancel invitations and remove members

The Members card in team settings. The Cancel invitation and Remove buttons are numbered.

On this screen

  1. Cancel invitation

    Cancels an invitation under Invited that hasn’t been accepted yet.

  2. Remove

    Removes a member from this team. It doesn’t appear on an admin’s row.

How to use

  1. Select ‘Cancel invitation’ next to an invitation under Invited, or ‘Remove’ next to a member.
  2. Select ‘Cancel invitation’ or ‘Remove member’ in the dialog. It takes effect right away.

Checkpoints

  • A cancelled invitation’s link no longer works. Inviting them again sends a new link.
  • A removed member loses access to this team’s surveys and reports right away. To bring them back, invite them again.
  • Only team admins can invite members, cancel invitations or remove members. Admins can’t be removed.

Switch teams

The account menu with its team list. Switch team and the team to switch to are numbered.

How to use

  1. Switch team

    Open the account menu in the top bar and select ‘Switch team’.

  2. Team to switch to

    Choose a team. Your role in each team shows next to its name.

Checkpoints

  • ‘Switch team’ appears only when you belong to two or more teams.
  • Switching takes you to My surveys and shows the surveys of the team you chose.

Account settings

Change your name, theme and password under Settings at the bottom of the left menu, or Account settings in the account menu.

Change your password

The Password card in account settings. New password, Confirm new password and Change password are numbered.

How to use

  1. New password

    Enter a new password.

  2. Confirm new password

    Enter the same password again.

  3. Change password

    Your password changes right away.

Checkpoints

  • If you signed up with Google or a sign-in link, you can create a password here too.
  • If you see “For security, you can change your password only after a recent sign-in.”, sign out, sign in again, then change it.

Name and theme

Checkpoints

  • Your name shows in the team member list and the account menu.
  • The theme is the same setting as Theme in the account menu, and it’s saved only in the browser you’re using.

Glossary

The terms you’ll see on screen, in the order you build a survey.

Virtual customer
An AI persona picked to match the mix you set.
Design
One version of the screen flow or content you show virtual customers.
Step
One screen a virtual customer sees.
Action
Something people can do on a screen, such as tapping, choosing or checking.
Task
What virtual customers try to do on your screens.
Briefing
What virtual customers read before they start.
Interview
One virtual customer trying one design and answering. A survey runs people × designs interviews.
Screening criteria
Traits of the customers you’re looking for. People who match go to the top of the list.
Confirm
Deciding to send the briefing to virtual customers exactly as written. Change what it’s based on, such as the screens, actions, ‘Where people see it’, task or number of designs, and you’ll need to confirm it again.
Task completed
When someone taps an action that leads to ‘Task completed’.
Didn’t find it
When someone ends without finding a way to finish the task.
Stopped partway
When a virtual customer stops the task on their own.
Action limit reached
When someone uses up the set number of actions without finishing. They count as not finishing the task.
Reaction theme
A reaction that came up across several virtual customers.
95% range
Where the result likely falls. The fewer people, the wider it is.
Points
The difference between two rates. 40% and 70% are 30 points apart.

FAQ

Didn’t find your answer?

Send us a message and we’ll reply by email.

Contact us