Asking the Questions

Michael Wagstaff • 15 September 2023

Top tips for insightful questionnaires

Putting together an insightful survey requires a thoughtful approach to question design. Properly framed questions elicit more accurate responses, ensuring the collected data truly represents the sentiments of your audience. 

This article provides a clear guide on best practices to consider when creating survey questions.

1. Keep it Clear and Concise:
Survey respondents should be able to understand a question instantly. Avoid using jargon, acronyms or technical language. If your survey targets a specific audience familiar with certain terms, ensure clarity isn’t sacrificed for brevity.

2. Use Specific Language:
Broad or vague questions leave room for varied interpretations. Instead of asking, "Are you satisfied with our services?", be specific, such as "How satisfied are you with our customer support responsiveness?"

3. Avoid Leading Questions:
Your questions should be neutral and shouldn’t hint at a preferred answer. For instance, "Don’t you think our new product is groundbreaking?" is leading. Instead, use "How would you describe our new product?"

4. Stick to One Topic per Question:
Double-barreled questions address two topics but only allow for one answer, which can be confusing. Split them. Instead of "How satisfied are you with our product quality and delivery time?", separate it into two distinct questions.

5. Provide a Neutral Option:
For scaled questions, always include a midpoint or neutral option, such as "neither agree nor disagree," to capture respondents who genuinely sit in the middle.

6. Avoid Absolute Terms:
Questions with words like "always" or "never" may be too extreme for many respondents. Instead, use scales like "often," "sometimes," and "rarely."

7. Ensure All Possible Responses are Covered:
Multiple choice questions should encompass all likely answers. It’s always wise to include an "Other" option with a fill-in box for unexpected answers.

8. Use Open-ended Sparingly:
While open-ended questions can provide rich qualitative data, they might also deter participants because they require more effort to answer. Use them strategically.

9. Be Mindful of Bias:
Review your questions to ensure they’re free from personal bias, cultural assumptions or gender biases. Such biases could skew results and alienate respondents.

10. Randomise Answer Choices:
For multiple choice questions, it's good practice to randomise the answer choices (except where a logical order is needed). This minimises the chance of response bias.

11. Test Your Survey:
Before rolling out your survey, test it with a pilot group. This will highlight confusing questions, technical hiccups or issues you might have overlooked.

12. Respect Respondent’s Time:
Long surveys can lead to respondent fatigue, which can impact data accuracy. Make sure your survey is as concise as possible and respect the respondent’s time by indicating how long the survey might take at the beginning.

Conclusion:
An effectively designed survey is a powerful tool in the business decision-making process. By adhering to these best practices, you’ll maximise response rates, enhance data accuracy and ultimately gain more valuable insights. 

Remember, the goal isn’t just to collect data, but to collect meaningful data. Effective question design is pivotal to achieving this outcome.


by Michael Wagstaff 2 June 2025
With the insights industry creaking under poor quality data, generative AI adds to the mix by creating convincing synthetic respondents. How should we treat these fascinating fakers?
by Michael Wagstaff 26 May 2025
Do tech people know more about market research than social scientists? In this article we discuss whether big tech is taking over the insights industry and what role is there for human researchers.
by Michael Wagstaff 12 May 2025
Does curating a personal brand make a difference? In this article, I consider my own lack of brand image and reflect on what might have been.
by Michael Wagstaff 9 May 2025
If surveys are ill-suited for addressing the questions that remain genuinely unanswered and unnecessary for those that are readily answered, then what exactly is their future?
by Michael Wagstaff 8 May 2025
In an effort to improve quality, the market research industry's current focus is on survey length and question engagement. This overlooks a more fundamental issue: respondent authenticity.
by Michael Wagstaff 7 May 2025
The true value of review sites lies in going beyond the stars and analysing what reviewers are actually saying.
by Michael Wagstaff 28 April 2025
Predictive analytics is reshaping brand insights by moving beyond descriptive dashboards to proactive decision-making
by Michael Wagstaff 28 April 2025
The uncovering of large scale survey fraud has shaken the market research industry. In this article, we discuss how a much more rigorous panel sign up procedure is needed to reduce the impact of fraudulent respondents.
by Michael Wagstaff 8 April 2025
The huge volume of data available through consumer comments, reviews and surveys can make cutting through the noise difficult. In this article we discuss how text analytics combined with human expertise can uncover the insight.
by Michael Wagstaff 10 March 2025
Market research agencies are going all in on AI based models to generate next level consumer insight. But are these just more illusion than substance?
Show More