Coding qualitative data: How to understand what users really want?

Qualitative data gives us tremendous insights into what do customers want. But making sense of it can be tricky. One way to do it is by coding the data.
Want articles like this straight to your inbox?
Subscribe here

When you have a pile of qualitative data, how do you sift through it to understand what users really value? 

In this post, we're looking at how you can make dealing with data a little less intimidating. 

Why do you need qualitative data?

Many brands assume that competitors in their vertical are their biggest threat. In reality, your biggest threat is a poor customer experience. 

Ben explained that everything today is all about the customer. Google isn’t collecting feedback within one product area — they are collecting everything.

Your biggest competition has become well-funded companies that create easy, enjoyable user experiences — setting the bar high for everyone else.

And the way to create pleasant user experiences, is through qualitative research.

They're listening to their customers and solving their customers’ problems by collecting, voice of customer data, collecting qualitative feedback.

The way that they're more directly your competitors is that they're creating these friction frictionless experiences. They're raising the stakes for all of us. 

User experience trumps everything

Today, user experience is more important than price, quality, and even your product itself. 

Modern users who are accustomed to a great brand experience elsewhere (even in an entirely different vertical) simply won’t be happy with a poorly designed experience. 

Companies used to compete on features maybe 50 years ago, when with more competition, they competed on price.

We're now selling experiences. And the only way to measure and account for this is to get feedback and to get voice of customer data.  

In the age of data, measuring and benchmarking users’ experiences becomes a vital task. 

Knowing the name of something is not the same as knowing something. - Richard Feynman

This quote inspires the importance of creating hypotheses and conducting research.

When you apply this mindset to the popular jobs-to-be-done framework for customer research, it’s the same concept.

You need to go beyond identifying the product that a customer is using - you need to identify the “job” they are hiring the product for.

This mental model is behind all of these kind of core concepts. It’s also what explains why we suck at communicating and marketing and gathering voice of customer data. So we think the product is what we sell, but it's not the same.  

How do you code qualitative data?

There's a specific qualitative research coding exercise that my team conducted for an online jewelry store. 

The jewelry client wanted to understand what motivated first-time buyers. They chose to ask the question, “What matters to you most when buying jewelry?”

Taking the open-ended responses, we created a list of different codes that seemed to describe the responses well. 

The codes are 1-4 word summaries that capture the essence of the responses. In this case, the codes identified included things like quality, style, and price among others.

With these codes, we have the signal strength of the names that people give to what matters to them.

We need to now try to make that leap over to what they mean and try to get from the name of something, to something.

Coding data = finding patterns 

After creating the initial list of codes, it was time to take the analysis one step further. 

Looking closely at the codes showed that some were connected. Things like quality and durability could be placed in the same thematic category. 

Grouping similar comments together allowed me to look at the broader patterns in the data. 

In this case, meaning a material value are big core motivating themes. They want the jewelry to connect to something in their lives, right? That's a big thing to pivot on, to hang our hat onto in terms of a strategy and where we're going.

A framework for moving from data to knowledge

The process that we described above is the process of moving from raw data to knowledge that you can act upon.

It doesn’t happen all at once, and it can be a messy process. But the end goal is to go from qualitative data analysis, to insights, to action.

This model stretches over a lot of cool hypotheses and marketing, and you can use it in your personal life a ton as well.

The core of this, the heart is that data to code to category. This is the pattern finding.

One response can be coded in several ways

With open-ended responses, there is a large degree of interpretation. Often, one customer survey response can lend itself to several different codes.

For example, one of the jewelry survey responses was “I really don't see why this is so expensive. Seems like I can get it elsewhere for less.” 

This response can be viewed through the lens of price, value, or competition.

How you code it may depend on your end goal, and the type of information you are looking for. 

You can sort of have a different goal in mind, as you search for patterns and start to thrash around here. There's no right or wrong answer. 

Look for similarities and dissimilarities

While patterns provided the foundational part of this analysis, you should also look for dissimilarities.

There's gold in the anomalies. You don't want to have too much of a scientific approach.

In other words, you don’t want to become fixated on one correct way of streamlining everything into boxes. Sometimes the similarities will stand out; sometimes the differences will. 

Codification process example

When we logged the codes for the jewelry client, we used a spreadsheet. 

Each of the customer surveys responses was a row, and each new code identified was a column.

As we read through each response one by one, we added more and more columns. Every time a response resonated with an existing or new column, we added an “X.” 

Tips and tactics for qualitative data coding

I recommend the following tips for conducting surveys and interviews in order to ensure you’re starting with the best possible raw data: 

  • Avoid ‘why’ and ‘was’ questions - these words trigger rationalizations
  • Open with ‘how,’ ‘where,’ ‘what,’ ‘when,’ ‘which,’ ‘who’ questions 
  • Use at least one open-ended question
  • Test open-ended questions by trying to answer with yes/no
  • Use closed-ended questions for benchmarking 

Helpful software for coding qualitative data

In terms of helpful tools, try the below services that can be helpful for SaaS businesses:

Real-life coding qualitative data example

One of my clients was Native Deodorant, a pricey natural deodorant owned by Procter & Gamble.

The original e-commerce website for Native had the headline:

Deodorant to stay fresh and clean.

But that was not convincing anyone to buy a $12 stick of deodorant.

Using research, I rewrote the value proposition to better fit the “job” customers were “hiring” for:

Deodorant, without the chemistry experiment.

This is the ‘something’. This is why I would hire deodorant at $12 a stick. To, you know, not pollute my body.  

It’s always worth going in search of the perfect, powerful message. 

Out now: Watch our free B2B messaging course and learn all the techniques (from basic to advanced) to create messaging that resonates with your target customers.


Duplicate this page

Template

This will be our first template report, featuring a clean layout and a sticky sidebar for easy navigation.
Get the full report

01.

Introduction

Today’s marketing leaders face a flood of software choices. Every tool promises to solve their problems, but picking the wrong one can cost their company time and money. Using Wynter, we asked 100 top CMOs from companies with 200+ employees how they make these choices. Their answers revealed something surprising: they’re not starting their search on Google anymore. Instead, they’re turning to dark social and asking trusted peers for advice. Meanwhile, AI tools are quietly reshaping how these leaders research their options, creating new decision paths that didn’t exist a year ago.

This report shows you exactly how these leaders pick their tools, where they look for information, and what makes them say “yes” to a purchase.

This year, we learnt the rules of B2B software buying have changed.
1. What’s the core problem or opportunity?
  • What’s not working in current processes?
  • What opportunities are we missing?
  • What’s the cost of doing nothing?
First, we pinpoint exactly what’s broken in our current processes—otherwise, we risk buying features we don’t actually need.
— Nipul, CMO (501–1000 employees; SaaS/Software,IT Services & IT Consulting).
We typically begin with a long list—about five to seven vendors. Then we narrow it down to three finalists once we see which solutions check the boxes on security, budget, and integrations.
— Andrew, Chief Marketing Officer, (5001–10,000 employees; SaaS/Software)
Bar chart showing where CMOs start their vendor search.
Vendor searching: the three-pronged approach
Private communities lead the way (72% of CMOs start here)Every software purchase starts with a problem.

When looking for new software, the majority (72%) of marketing leaders first turn to private groups like Slack channels and WhatsApp groups to seek out honest conversations with peers who’ve solved similar challenges.

This marks a shift in buying CMO buying behavior. Just one year ago in our first version of this report, most CMOs began their search on Google. Today, they’re heading straight to dark social where candid conversations happen beyond the reach of marketing teams.

Why are CMOs turning to “dark social” as the first touchpoint? The answer is simple: trust. Marketing leaders are craving unfiltered truth from peers, it’s word-of-mouth for the digital age. And while you may be thinking that the buzzword of ‘dark social’ has somewhat faded, the behavior has become more important than ever.
Pie chart illustrating how today’s buyers engage across multiple channels.
Follow companies on social media.
Pie chart illustrating how today’s buyers engage across multiple channels.
Read the supplier’s blog.
Pie chart illustrating how today’s buyers engage across multiple channels.
Follow founders on social media.
Pie chart illustrating how today’s buyers engage across multiple channels.
Meet representatives at events.
The message is clear:

While dark social might spark initial interest, review sites help build the confidence needed to move vendors onto the shortlist. It’s not enough to be recommended in private communities, you need the public validation to back it up.

Get the full report here

Know exactly what your buyers want and improve your messaging

Join 10,000+ other marketers and subscribe and get weekly insights on how to land more customers quicker with a better go-to-market machine.
You subscribed successfully.