What are the voting exercises and how does the voting process work?

Jeffrey Stulmaker Updated by Jeffrey Stulmaker

After participants submit their responses to an open-ended Ask Opinion question, the Remesh platform will prompt a sequence of exercises in which participants express their agreement toward other participants' answers.

There are currently two types of voting exercises:

Agree/Disagree

Agree/Disagree presents the participant with a single response from the in-process Ask Opinion and prompts them to select if they agree or disagree with the response. This exercise is used to get an absolute baseline of what a participant does and doesn't agree with.

Binary Choice

Binary Choice presents the participant with two responses from the in-process Ask Opinion and prompts them to select the response they prefer more. This exercise provides a relative signal of agreement for responses which is used for "ranking" them as a list.

These exercises are shown to participants in sets of five, and the first exercise a participant completes (e.g., agree/disagree or binary choice) will be random. So, a participant may see five agree/disagree exercises, then five binary choices, then five agree/disagree, etc. and they will continue in this manner until the time for the question runs out.

The voting process is used to understand a group efficiently and at scale. Because it isn't efficient for every participant to vote on every response submitted, the voting process enables us to infer and calculate a score representing the group's opinion of every response. This is done using the two voting activities outline above. The more a participant votes, the more the Remesh platform learns about them and can more accurately make predictions about their behaviors and opinions.

How did we do?

How many votes were cast on an each response?

How is "Total Time Estimated" calculated on the Discussion Guide Excel template?

Contact