Problem Interviews: Test Assumptions, Not Opinions

Problem Interviews: Test Assumptions, Not Opinions

As of 2026, Highline Beta argues that most failed ventures die because the problem was never truly tested through well-designed problem interviews that challenge preexisting assumptions rather than collect compliments.

Key Takeaways

Problem interviews should function as experiments designed to expose behavior and tension, not create agreement or validation theater. Highline Beta's approach focuses on anchoring conversations in real moments and past decisions rather than hypotheticals, using structured guides that move from broad context to specific moments of action. The methodology reveals workarounds, emotional cues, frequency patterns, and decision moments that surface gaps between what people say and what they actually do.

What's the difference between positive feedback and actual validation in problem interviews?

Positive feedback represents what users say, while validation comes from what they actually do. Teams often confuse polite agreement with real learning, but words lie while behavior doesn't. A well-designed problem interview guide forces teams to interrogate actual behavior, decisions, and trade-offs rather than collect hypothetical enthusiasm or compliments.

How should problem interview questions be structured to uncover real behavior?

Strong questions ask for stories rather than opinions, using prompts like "Tell me about the last time..." instead of "Would you use..." to reveal actual behavior rather than imagination. The guide should move from broad context to specific moments of action, staying in the problem space long enough to uncover uncomfortable truths. Neutral follow-ups like "Why that?" and "What happened next?" probe without leading the conversation toward predetermined solutions.

What specific signals indicate a problem interview guide is working effectively?

An effective guide reveals workarounds like hacks and duct-tape solutions, emotional cues including hesitation and frustration, and frequency patterns showing how often problems occur. It also exposes decision moments that pushed people to act or avoid acting, along with the broader context surrounding those moments. These signals help teams understand whether a problem is real, frequent, and painful enough to warrant solving.

When should teams prioritize running problem interviews over other research methods?

Problem interviews are most valuable early in the process before solutions harden and teams become emotionally invested in specific directions. They're particularly crucial when a problem feels promising but unproven, when stakeholders have competing interpretations of user pain, or when teams are getting positive feedback but no actual traction. This timing allows teams to confirm whether a problem is worth solving at all before investing in solution development.

Teams often confuse positive feedback with validation. But what users say is cheap. What they do is the signal.

A well-designed problem interview guide is what separates polite agreement from real learning. It forces teams to interrogate behavior, decisions, and trade-offs—not collect compliments or hypothetical enthusiasm.

At Highline Beta, we treat interviews as experiments, not conversations. The goal isn’t to be liked. It’s to learn something true, even if it’s uncomfortable.

For more in-depth coverage of our thoughts in user research, check out these previous newsletter editions: Interviewing Without Bias; What Users Say vs. What They Do

Why Problem Interviews Matter

Most failed ventures don’t die because the solution was bad. They die because the problem was never truly tested, and interviews weren’t designed to challenge preexisting assumptions.

Problem interviews:

  • Shift teams from confirmation to discovery
  • Replace feature talk with real stories
  • Surface emotional and situational drivers behind behavior
  • Expose gaps between what people say and what they actually do

What Makes a Strong Interview Guide

A good guide is designed to expose behavior and tension—not create agreement.

It anchors the conversation in:

  • Real moments, not hypotheticals
  • Past decisions, not future intent
  • Lived context, not abstract preferences

If the guide is working, it reveals:

  • Workarounds: hacks, shortcuts, duct-tape solutions
  • Emotional cues: hesitation, frustration, guilt, relief
  • Frequency & recency:how often it happens, when it last hurt
  • Decision moments:what pushed them to act (or avoid acting)
  • Context: what else was happening around the moment

Don’t ask, what’s hard? Ask, what did you do about it?

How to Write a Problem Interview Guide

Strong guides are structured to move from broad context → specific moments of action.

1. Ask for stories, not opinions

“Tell me about the last time…” reveals behavior. “Would you use…” reveals imagination.

2. Probe without leading

Neutral follow-ups unlock truth:

  • “Why that?”
  • “What else did you try?”
  • “What happened next?”

Article content

3. Stay out of solution mode

Pitching biases the conversation.Stay in the problem space long enough to learn something uncomfortable.

Using the Highline Beta Problem Interview Generator

When using the Highline Beta Problem Interview Generator, follow these steps:

  1. Start a session and answer the questions based on what you already know (or have hypothesized) about your problem(s)
  2. Generate the interview guide
  3. Take the guide into conversations with your target audience

The output gives you a well-rounded guide grounded in your starbursting questions; ready to test whether the problem is real, frequent, and painful.

When to Run Problem Interviews

Do this work early, before solutions harden and teams become emotionally invested.

Problem interviews are most valuable when:

  • A problem feels promising but unproven
  • Stakeholders have competing interpretations of user pain
  • You’re getting positive feedback, but no traction

This stage is about confirming whether a problem is worth solving at all.

That’s why the guide matters.

Why This Approach Works

Words lie. Behavior doesn’t. People say they’d use things they never search for, sign up for, or prioritize.

Assumptions surface fast. The moment you ask “What did you do last time?” instead of “Would you use this?”, guesswork becomes visible.

Insight lives below the first answer. Without a guide, teams stop at surface explanations (“I’m too busy”). With one, they uncover the real drivers: guilt, fear, avoidance, trade-offs.

Gen Z Example

Problem space:

Socially-conscious Gen Zers feel that traditional saving is “hopeless” given the current climate and economic instability. They need to align their limited spending with their personal values and identity rather than just “stashing” money away for an uncertain future.

Specific problems:

  • Socially conscious Gen Zers struggle to save in traditional ways because saving feels misaligned with their values and an uncertain future.
  • Gen Zers with limited income find it hard to choose between spending and saving, because both feel risky and emotionally loaded.
  • Values-driven Gen Zers lack ways to align everyday spending with their ethics, making money decisions feel disconnected from their identity.
  • Gen Zers disengaged from traditional financial advice need alternatives to “save more” narratives that feel unrealistic and judgmental.
  • Young adults facing economic instability struggle to feel financial progress today when long-term planning feels unreliable.

Learning goals:

  • Are these real and painful problems
  • How painful are they
  • Who experiences them most acutely
  • How are they currently attempting to solve these problems

Target stakeholders:

Socially-conscious Gen Zers

HLB Problem Interview Generator Output

Interview Overview

This interview series aims to understand the emotional and practical tension Gen Z experiences between traditional financial 'wisdom' and their personal ethical values. We are moving beyond simple 'budgeting' talk to uncover why traditional saving feels futile or even morally misaligned for this demographic.

The approach is rooted in narrative discovery—asking participants to recount specific moments of financial friction. We want to understand if the 'hopelessness' regarding the economic future is a passive feeling or an active driver of their spending behavior, and how they bridge the gap between their identity and their bank account.

Sample Questions

  • Walk me through the last time you thought about your long-term financial future. What triggered that thought and what did you end up doing?
  • Tell me about the last time you looked at your bank account and felt like 'it doesn't even matter.' What led to that moment?
  • What feels riskier to you right now: not having enough money saved for 10 years from now, or spending money today on things that don't align with who you are? Why?
  • When you hear the advice 'you need to save for the future,' what specific thoughts or feelings come up for you? Does that advice feel relevant to your life?
  • Describe a time when you chose to spend money on something meaningful today rather than putting it into savings. What made that the right choice at the moment?
  • Tell me about your current work or income situation. How does your specific career path influence how you view 'saving' versus 'investing in your identity'?
  • What 'hacks' or systems have you created for yourself to make sure your money goes toward things you actually believe in?
  • Have you ever tried using a budgeting or savings app? What made you stop using it, or where did it fail to understand what you actually care about?
  • How often do you have to choose between a 'cheaper' unethical option and a 'pricier' ethical one? How does that trade-off affect your mood for the rest of the day?
  • When you’re feeling stressed about money and values, who or what do you turn to for advice? What makes that source more trust-worthy than a bank?

What This Unlocks

By the end of a strong problem interview cycle:

  • The abstract “money problem” becomes tangible and testable
  • Emotional weight replaces vague frustration
  • Research shifts from validation theater to real signal
  • Teams know what not to build just as clearly as what to explore next

Coming up next week: How to synthesize interview learnings into sharper problem statements and concept directions, without jumping to solutions too early.

Thanks for reaching out. Be sure to check us out on LinkedIn for all of our current news and announcements.
Oops! Something went wrong while submitting the form.