Concept testing for B2B: kill bad ideas before you build them

Four concept testing methods, what to test and ask, and why comparative tests beat "would you buy this?"

Concept testing is showing an idea to the people you want to buy it, before you build or launch it, and measuring whether they understand it, care about it and prefer it to what they use today. In B2B that idea is usually a product, a feature, a positioning angle, a messaging direction or a campaign. The goal isn't validation. It's killing bad ideas while they're still cheap.

Most B2B teams skip it. They ship, look at the dashboard six months later, and argue about why it flopped. Here's how to run concept testing in B2B, what the research says about reading the results, and where it goes wrong.

The short version

  • Building the wrong thing is the classic startup killer. In CB Insights' analysis of startup post-mortems, "no market need" was the top reason companies failed, cited by 42% (CB Insights).
  • Purchase intent overstates demand, especially for new products. A meta-analysis by Morwitz, Steckel and Gupta found stated intentions predict purchases much better for existing products than for new ones, and better when collected in a comparative mode (International Journal of Forecasting, 2007).
  • So test comparatively. "Which would you rather have, this or what you use today, and why?" beats "Would you buy this?" every time.
  • Small samples work for finding problems. 15 respondents usually surface most of what's confusing about a concept. Save 100+ for when you need to report percentages.
  • The most useful output is the "why." Scores tell you which concept wins. Open-text reasons tell you how to make it better.

What concept testing is (and isn't) in B2B

Consumer brands have done concept testing for decades: show a shampoo concept to 300 shoppers, measure purchase intent, forecast sales. B2B is different. You've got smaller markets, buying committees, long sales cycles and buyers who are expensive to reach. You're rarely forecasting volume. You're answering simpler questions:

  • Do buyers understand what this is?
  • Is the problem it solves one they actually have, and care about?
  • Is it different from what they already use or could buy?
  • Which of our options is strongest, and why?

Concept testing isn't market sizing, and it's not a replacement for usability testing a working product. It sits before both. If buyers don't get the concept on paper, a better prototype won't save it.

The four concept testing methods

MethodHow it worksBest forTrade-off
MonadicEach respondent sees one concept onlyClean read on each concept, no comparison biasNeeds a separate group per concept, so more respondents
Sequential monadicEach respondent sees all concepts one by one, in rotated orderComparing 2 to 4 concepts with a smaller sampleEarlier concepts color how later ones are judged
Comparative (preference)Respondents see concepts side by side and pick one, then explain whyChoosing between viable directionsTells you which wins, not whether any is good enough
Qualitative concept reviewA small group reacts in open text or interviewsEarly ideas, finding what's confusing or missingNo numbers to report

For most B2B teams, I'd pair two of these. Start with a qualitative review to fix what's confusing, then run a comparative test to pick the winner. Wynter covers both: message tests for open-text reactions on a single concept, and preference tests for comparing up to three concepts side by side, both with verified B2B buyers from your ICP.

What to test, and what to ask

What you're testingWhat to showQuestions that matter
A new product or featureOne-page concept: problem, solution, who it's for, how it's differentHow clear is this? How relevant is the problem? What would you use today instead?
A positioning or messaging directionHeadline, subhead, 3 supporting points, or a mocked-up homepage heroWhat do you think this company does? Who is it for? What's different about it?
A new segment or use caseThe concept framed for that segmentIs this a problem you have? How do you handle it now? What would make you switch?
A pricing or packaging ideaThe package and price as buyers would see themIs it clear what you get? Which plan would you pick? What feels missing?
An ad or campaign ideaThe creative or key visual with copyWhat's the message? Would you click? What would you expect to find?

A few rules for the stimulus:

  • Show it the way buyers would see it. A homepage hero, a one-pager or an ad. Not an internal strategy slide.
  • Keep concepts equal in polish. If one concept is designed and the other is a Google Doc, you're testing design, not ideas.
  • One variable at a time when comparing. If two concepts differ in headline, audience and price, you won't know what made the winner win.

How to run a B2B concept test, step by step

1. Write down the decision

"Depending on the result, we'll build A, build B, or build neither." If the answer can't change the decision, don't run the test. The same rule from our customer research playbook applies here.

2. Define the audience precisely

Role, seniority, company size, industry. A concept for VPs of Finance at mid-market SaaS companies tested on "business professionals" tells you nothing. This is where panel quality matters most (more on that in our guide to B2B research panels).

3. Fix clarity first

Run the concept past around 15 people in your ICP and ask what they think it is, who it's for and what's unclear. Most early concepts fail on clarity, not on appeal. Fix that before you measure preference, or you'll measure confusion.

4. Test comparatively

Put your strongest concept next to the current alternative (what buyers use today, or your current messaging) and a second concept if you have one. Ask which they'd choose and why. For vote shares you can trust, use at least 30 respondents, ideally 50.

5. Code the reasons

Group every "why" into themes. Themes that keep showing up for the winner are what to lead with. Themes behind losses are what to fix or drop. Our post on coding qualitative data walks through how.

6. Decide, then retest the fix

Change the concept based on what you learned and test the new version against the old one. Two quick rounds beat one big study.

How to read concept test results without fooling yourself

  • Discount purchase intent. People say yes to new ideas more easily than they pay for them. Morwitz and colleagues found intentions predict behavior far better for existing products than new ones. Treat "definitely would buy" as interest, not a forecast.
  • Watch the "what would you use instead" answers. If buyers say "a spreadsheet works fine," your real competitor is the status quo, and your concept has to beat it, not a rival vendor.
  • Look for specific language. Real interest sounds concrete: "we'd use this for our quarterly board reporting." Polite interest sounds generic: "seems useful."
  • Don't over-read small differences. At 50 respondents, a 55/45 split is a tie. Lean on the reasons.
  • Separate the idea from the execution. If buyers love the problem but hate the solution, you've validated the problem. That's still worth a lot.

Concept testing mistakes I see constantly

  • Testing with friendly customers only. They'll like anything you show them. Test with ICP buyers who don't know you.
  • Asking "would you buy this?" You'll get a yes. It won't mean much.
  • Testing too late. If the feature's already built and launched, you're not concept testing, you're post-rationalizing.
  • Testing too many concepts at once. Narrow to two or three before you put them in front of buyers.
  • Using the test to settle internal politics. Research should inform the decision, not replace it.

When concept testing isn't enough

  • You need willingness to pay or price elasticity. That's a job for specialist pricing research like conjoint or Van Westendorp studies, which Wynter doesn't run. Our post on price sensitivity covers the basics.
  • You need to know if the product works. That's usability testing with a prototype or beta.
  • You need real demand signals. For that, combine concept tests with behavioral tests like waitlists or fake-door pages. See our guide to market validation.

Frequently asked questions

What is concept testing?

Concept testing is research that shows a product, feature, positioning or campaign idea to target buyers before launch to measure whether they understand it, find it relevant and prefer it to alternatives.

How many people do you need for a B2B concept test?

Around 15 to find clarity problems in a single concept, 30 to 50 to compare two or three concepts in a preference test, and 100 or more if you need to report percentages to leadership.

What's the difference between concept testing and message testing?

Concept testing checks whether an idea is worth pursuing. Message testing checks whether the way you communicate an idea lands with buyers. In B2B they overlap, because buyers judge a new concept almost entirely through how it's described.

Is concept testing the same as an A/B test?

No. An A/B test measures real behavior on live traffic and needs volume. Concept testing gets reactions from targeted buyers before launch, so it works when you don't have traffic yet or can't afford to launch the wrong thing.

Kill it while it's cheap

Every concept that dies in a test saves you a quarter of building, launching and explaining. If you want verified buyers from your ICP reacting to your concept in 12 to 48 hours, run it as a preference test or a message test on Wynter.

Want articles like this straight to your inbox?
Subscribe here
Market research

Concept testing for B2B: kill bad ideas before you build them

Four concept testing methods, what to test and ask, and why comparative tests beat "would you buy this?"

Get the full report here

Know exactly what your buyers want

Join 20,000+ other marketers and subscribe and get weekly insights on how to land more customers quicker with a better go-to-market machine.