Is Big Tech Eating Our Lunch?

Michael Wagstaff • 26 May 2025

Do tech people know more about market research than social scientists?

Recently, I came across a sentiment that resonated deeply: "We live in an age where tech people think they know more about market research than a sociologist."


Undeniably, technology has revolutionised market research methodologies, providing tools of unprecedented power and precision. Data science, artificial intelligence and machine learning promise almost instant insights, distilling vast data sets into concise, actionable strategies. As technology companies move into areas traditionally the province of market research, it might appear at face value that the researcher's traditional expertise - the subtle, nuanced understanding of human behaviour - is becoming sidelined.


First principles

I'm not so sure. The foundational principle of market research has not fundamentally changed. At its heart, effective research is not solely about data; it is about insight and understanding the nuances, contradictions and subtleties of human behaviour. Here, human understanding remains irreplaceable. While algorithms can identify patterns within data, researchers interprets the significance of those patterns within a cultural and emotional context.


This brings me to a vital realisation that while technology undeniably enriches our toolkit, sociological understanding ensures we remain connected to the complex, emotional and often unpredictable human factors that drive true consumer insight.


The human factor

Algorithms, as advanced as they have become, do not yet comprehend irony, hidden social pressures or cultural subtleties. Human life rarely fits neatly into binary code or statistical categories.


But ignoring technological advances would be equally misguided. The data-driven precision that technology offers is transformative. It complements rather than replaces human insight, allowing us to test hypotheses, validate intuitions and deliver sharper, more meaningful analysis.


I believe that the integration of human insight with technological capabilities is a powerful combination and one that underpins our business philosophy.  Technology enriches our methodological toolkit but sociological understanding provides essential context and meaning

by Michael Wagstaff 23 June 2025
After yet another market research conference calls for great emphasis on storytelling, we discuss why researchers find it so difficult and what can be done to get better at it.
by Michael Wagstaff 21 June 2025
A university degree doesn't necessarily make you a better researcher but it does help. We have a look at whether a degree should be a requirement for market research roles.
by Michael Wagstaff 19 June 2025
Given the huge amount of brand insight that can be derived by applying techniques such as text analytics to existing data, we ask whether the end of the survey for brand metrics is in sight?
by Michael Wagstaff 2 June 2025
With the insights industry creaking under poor quality data, generative AI adds to the mix by creating convincing synthetic respondents. How should we treat these fascinating fakers?
by Michael Wagstaff 12 May 2025
Does curating a personal brand make a difference? In this article, I consider my own lack of brand image and reflect on what might have been.
by Michael Wagstaff 8 May 2025
In an effort to improve quality, the market research industry's current focus is on survey length and question engagement. This overlooks a more fundamental issue: respondent authenticity.
by Michael Wagstaff 7 May 2025
The true value of review sites lies in going beyond the stars and analysing what reviewers are actually saying.
by Michael Wagstaff 28 April 2025
Predictive analytics is reshaping brand insights by moving beyond descriptive dashboards to proactive decision-making
by Michael Wagstaff 28 April 2025
The uncovering of large scale survey fraud has shaken the market research industry. In this article, we discuss how a much more rigorous panel sign up procedure is needed to reduce the impact of fraudulent respondents.
by Michael Wagstaff 8 April 2025
The huge volume of data available through consumer comments, reviews and surveys can make cutting through the noise difficult. In this article we discuss how text analytics combined with human expertise can uncover the insight.
Show More