Generating Insight From Text Analytics

Michael Wagstaff • 13 November 2023

The authentic voice of the customer

Introduction

Text analytics is increasingly becoming an important tool for brands seeking to understand the vast landscape of unstructured data. This technology enables brands to sift through large volumes of text to extract actionable insights, a task that was once insurmountable due to the sheer scale of the data involved. By utilising advanced techniques such as topic modelling and sentiment analysis, brands can gain a competitive edge through a deeper understanding of customer sentiment, market trends, and brand perception.


What is Text Analytics?


Text analytics is the process of converting unstructured text data into meaningful data for analysis, using statistical pattern learning and natural language processing (NLP). NLP techniques are applied to the text data to understand and interpret the human language within it. This includes tasks like tokenisation (breaking text into words or phrases), part-of-speech tagging, and entity recognition. The goal is to convert unstructured text into a structured format that can be analysed algorithmically.This technique allows for the extraction of valuable information from text sources, which can include customer feedback, online reviews, survey responses and website content. The insights uncovered from text analytics can inform decision-making processes, strategic planning and customer experience improvement efforts.


Applications of Text Analytics:


  • Sentiment analysis evaluates the emotional tone of text data, identifying whether the sentiment is positive, negative, or neutral, thereby providing a direct measure of customer sentiment towards a brand or product. This is crucial for understanding overall customer satisfaction and shaping communication strategies.


  • Topic Modelling applied to platforms like Trustpilot are rich sources of customer feedback. Topic modelling algorithmically uncovers recurring themes or subjects in large text datasets, enabling brands to identify dominant conversation topics among their customers. This insight is invaluable for tailoring content strategies and understanding market needs.


  • Aspect analysis or aspect-based sentiment analysis, takes sentiment analysis further by dissecting customer opinions about specific aspects of a product or service, such as quality, delivery or price. This granular view is essential for targeted product improvements and marketing messages.


  • Text classification categorises text into predefined groups, streamlining the analysis of customer feedback and identifying common issues or queries, thereby enhancing customer service efficiency and responsiveness. For example, text classification can automatically sort customer feedback into categories like 'billing', 'product issues' or 'technical support', allowing for quicker and more focused responses from customer service teams.


  • Trend analysis in text analytics identifies patterns and changes in customer sentiments or topics over time, offering brands foresight into evolving market trends and customer preferences. This information is key to staying ahead in a dynamic market. For example, trend analysis might reveal a growing interest in eco-friendly products among consumers, enabling a brand to adjust its product development and marketing strategies accordingly.


  • Customer journey analytics uses text analytics to map out the customer experience at various touchpoints, providing insights into customer satisfaction drivers and pain points. This understanding is crucial for optimising the customer journey and enhancing brand loyalty.For example, analysing customer feedback might show that users often experience difficulties during the online checkout process, indicating a critical area for improvement to enhance overall customer satisfaction.


  • Predictive analytics uses text data to forecast future trends and customer behaviours. This foresight enables brands to anticipate market needs, identify potential risks, and plan strategically, ensuring they remain competitive and responsive to their customer base. It involves extracting features or attributes from the text that are relevant to the predictive model. This could include the frequency of certain words or phrases, sentiment scores, topic classifications or trends over time. The model is trained using a portion of the collected data, where the outcomes are already known. For example, in predicting customer churn based on historical data where the topics customers discussed and their sentiment towards them, led to churn or retention.


  • Analysing open-ended survey responses: Surveys often contain open-ended questions that can yield insightful qualitative data. Text analytics can process these responses at scale, providing a quantitative lens to qualitative feedback. This approach can help brands understand the nuances of customer needs and preferences, informing product development and targeted marketing campaigns.


  • Website content analysis: A company's website is an important touchpoint for customers. Text analytics can evaluate the content's effectiveness by identifying the most engaging topics, the clarity of the communication and the alignment of the content with customer interests and search behaviours.


Below are some examples of the insight that can be generated through text analytics. Hover over each image for details.


Disadvantages and compromises

Despite its advantages, text analytics is not without its drawbacks. One significant challenge is the ambiguity of language—sarcasm, idioms and varying expressions can lead to misinterpretation. Additionally, the quality of insights is only as good as the data input. This means that biases in data collection can skew results. There's also the issue of privacy and ethical considerations surrounding the use of customer data. Ensuring compliance with data protection laws is paramount.


Furthermore, text analytics does not always capture the full context behind the text, potentially missing out on crucial subtleties. This is where human judgment remains indispensable, to interpret and validate the findings of text analytics.


Conclusion

For brands, text analytics offers a powerful lens through which to view the customer's feedback.  It can uncover trends and sentiments that might otherwise remain hidden in the vast expanse of data. However, it should not be seen as a panacea; it is a tool that, while powerful, has limitations and requires a discerning eye to interpret its output effectively.


By understanding both its strengths and weaknesses, brands can make informed decisions that are both data-driven and intuitively guided.



by Michael Wagstaff 18 July 2025
Housing affordability is getting worse and there is a need to balance policies relating to demand with those addressing supply.
by Michael Wagstaff 23 June 2025
After yet another market research conference calls for great emphasis on storytelling, we discuss why researchers find it so difficult and what can be done to get better at it.
by Michael Wagstaff 21 June 2025
A university degree doesn't necessarily make you a better researcher but it does help. We have a look at whether a degree should be a requirement for market research roles.
by Michael Wagstaff 19 June 2025
Given the huge amount of brand insight that can be derived by applying techniques such as text analytics to existing data, we ask whether the end of the survey for brand metrics is in sight?
by Michael Wagstaff 2 June 2025
With the insights industry creaking under poor quality data, generative AI adds to the mix by creating convincing synthetic respondents. How should we treat these fascinating fakers?
by Michael Wagstaff 26 May 2025
Do tech people know more about market research than social scientists? In this article we discuss whether big tech is taking over the insights industry and what role is there for human researchers.
by Michael Wagstaff 12 May 2025
Does curating a personal brand make a difference? In this article, I consider my own lack of brand image and reflect on what might have been.
by Michael Wagstaff 8 May 2025
In an effort to improve quality, the market research industry's current focus is on survey length and question engagement. This overlooks a more fundamental issue: respondent authenticity.
by Michael Wagstaff 7 May 2025
The true value of review sites lies in going beyond the stars and analysing what reviewers are actually saying.
by Michael Wagstaff 28 April 2025
Predictive analytics is reshaping brand insights by moving beyond descriptive dashboards to proactive decision-making
Show More